[Chaos in a Can]

You should be able to use the calibration file idea without running into the aforementioned problem.
You could load your main project that uses the calibration file as the startup application, then use a button on the front panel of a vi to save the current settings to the calibration file. Running the debug version should allow you to change the calibration file without rebuilding the startup application.