Your movemap idea is a good one but will not work in the context of torsion space relax; movemaps control torsion space not 3d space (so being “near the ligand” isn’t the descriptor you need it to be).
I would start out with just the flags
-relax::limit_aroma_chi2 true
-relax::constrain_relax_to_start_coords true
-relax::coord_constrain_sidechains true
for constrained relax to start with and see if you are happy with the results. (the latter two of these flags are for constraints; the first is a scorefunction tweak that improves relax, or used to anyway)