If the point of this feedback loop is to prevent backdriving, have you considered switching the jumper on your speed controllers to active breaking?
The
double jointed arm I had the pleasure of working on, last year, had some trouble with inertia until we turned this option on. It worked like a charm.