How did you solve the potential networking issues and latency? Do you have some interpolation for delayed frames? Do you have timestamps on the frames to know how long they took to trasmit... when you computed your position, and transmit this back to the robot does it take into account the latency on this end. How did you work around or simulate the FMS locked stress, and did you test against a typical network traffic of a match.
All of these questions scared me away from this kind of solution. I hope you have some good answers for them.
I guess you can always set still for a few seconds and that should solve that.