Luki, author of ShapeComplementarityCalculator, suggests a different method for removing it (also removing ScFilter, instead of editing its internals).
I suspect that merely commenting out the GenerateToroidalSurface function will not be sufficient to build rosetta without the ScCalc. The compiler will probably get confused on something else then. To fully remove it:
1) Remove the line for ShapeComplementarityCalculator in src/core.3.src.settings
2) Remove the line for the ScFilter in src/protocols.src.settings
3) Remove the two lines for ScFilter in src/protocols/init.cc
I just tried it (Linux 64bit, gcc 4.1.2) and it builds successfully without it.”