Have you looked at our closed-loop examples? Our gains won’t be perfect for your system, but it should get you close. For example, in our Velocity example, our gains are:
kP = 5e-5;
kI = 1e-6;
It looks like some of yours are as high as 2 in some places.
I think Coast mode makes it harder for PID and less precise since the motor will keep spinning without power. Maybe try Brake mode. I don’t know if that is related but it wouldn’t hurt