[Alan Anderson]

The most effective camera-based tracking systems I've seen don't use the camera image to provide direct feedback. They use the image to decide how far to turn, and then use some other feedback (gyro, turret position sensor, whatever) to close the loop on the aiming. The occasional camera image can be used to update the desired setpoint.