Does the mpi process trying to run Rosetta, and the machine on which Rosetta is running, have read access to the directory where Rosetta lives? I think this may be a permissions issue – the MPI client machines can’t libdevel.so.
You can try the statically linked build (extras=mpi,static), or try fixing the permissions/file visibility?
Did you try MOVING the Rosetta executable from the place it was compiled onto another machine? That’s a big no-no (unless using the static build).
If you use the non-mpi build does it work? You can try a quick job on the head node (and just kill it after 20 seconds), which will give plenty of time for this startup error to occur.