Yes you can safely stay with jD 3.2 The only down side is that you will not have access to the new facilities
It is unlikely that upgradinf the Maria dB level will affect existing sites. Its just that jD needed to have use of the new DB levels. This will soon be required by Joomla! 4 but jD 3.2 will remain OK but no updates are expected to it.