Using navX MXP to get robot velocity

[Poseidon5817]

From this thread:

Originally Posted by Arhowk

I'd also like to know... In my experience most mouse only maintain about 95% accuracy (meaning that the same motion repeated an infinite number of times will have a 5% deviance in delta distance). At the start of the season I expected to integrate the accelerometer to obtain velocity, but it's noise is horrendous. If the mouse gets good data, than it might be a good option.

I'm assuming that Arhowk tried this with the roboRIO's built-in accelerometer. Has anyone tried something similar with accelerometer data from the navX MXP expansion board? If integrating that data can give a reasonably accurate velocity, I could see this being another solution for simple autonomous motion profiling, rather than using encoders on the drive.

[Skyehawk]

Now that you bring it up I am really excited to give it a go before the season starts. Too bad I am a college student and don't have access to the hardware for this endeavor.

The way I see it though the noise of the accelerator will result in an error of many magnitudes greater than the error in robot velocity from drive train encoders.

While we are on the subject of sensors to obtain robot velocity, has anyone tried multi point sonar (or other range finder) velocity? Not that it would be in any way practical, but just a thought.

I don't mean to hijack this tread in any way, sorry if I do.

[slibert]

Originally Posted by Poseidon1671

From this thread:



I'm assuming that Arhowk tried this with the roboRIO's built-in accelerometer. Has anyone tried something similar with accelerometer data from the navX MXP expansion board? If integrating that data can give a reasonably accurate velocity, I could see this being another solution for simple autonomous motion profiling, rather than using encoders on the drive.

There are a number of reasons why using the onboard RoboRIO accelerometers for this is a non-starter, including that rotation needs to be taken into account, and that accelerometers measure acceleration due to gravity in addition to acceleration due to linear motion, and the gravity component needs to be removed accurately to access the linear acceleration data.

The navX-MXP can track the rotation and remove the gravity component since it fuses the gyroscope data w/the accelerometer data. The navX-MXP v. 2.0 firmware has been modified to calculate velocity and displacement onboard in real-time. However....

After analyzing the resulting displacement data, my determination is that it's accurate to about 1 meter over a 15 second autonomous period, which is not accurate enough for the types of things we are doing. There are a few reasons for this level of accuracy. The primary reason is that the levels of noise present in the current generation of MEMS accelerometers, such as those in the navX-MXP, is high enough that when it is double-integrated (cubed) there's a large error that's introduced. And this is what leads to the inaccuracy. Lots of work went into filtering the data, and also disabling integration when no motion is detection, but the results still aren't near what we need for use in Autonomous.

Based upon this investigation, my current estimation is we need to see noise levels that are about 1/100th (2 orders of magnitude) lower than current technology to get to an error of about a centimeter or so during the autonomous period. When technology reaches that point, we'll build a board that makes this features available for use in FIRST FRC and FTC robots. But until that time, it's a waiting game.

STMicro is making good strides towards lower-noise MEMS accelerometers (25 ug/square-root-hertz is their best noise spec); these accelerometers are more expensive, and they're still not to the level we'll need them to be (~2 ug/square-root-hertz). Looking into my crystal ball, I think we're roughly 5 years away from something that becomes viable.

If you do want to play around with what the navX-MXP calculates, there's a new "Experimental" button in the navXUI that, along w/the new v. 2.0 firmware, will display integrated velocity and displacement in the x and y axes. It's marked "experimental" for a reason...

[Gdeaver]

Initially, I thought the Bosch integrated IMU was better than the Navmxp for this. However there is a difference between on the kitchen table and on a robot. On a really robot the error is about the same as Silbert noted. We also looked at several gaming mice back in 2013. The problem with mice is the carpet. If we played on a smooth flooring they could be a solution. They loose there accuracy at higher velocities. If some one wanted to put the effort into it using a camera several inches off the carpet and proper illumination coupled Advanced optic flow algorithms may work for FRC bots.
For our team, machine vision solutions have been beyond our reach with the resources we have. We are a swerve team. To navigate 3 tote auto this year we used encoders on all 4 wheels, a navxmxp, and a sonar sensor referencing the distance to the player station wall. Fusing these inputs, we are able to perform the several motions needed to accomplish the 3 tote auto reliably. Maybe some day auto navigation will be plug and play but for now it's hard. I commend the teams that did 3 tote auto this year.

[slibert]

Originally Posted by Gdeaver

Advanced optic flow algorithms may work for FRC bots.

Interesting to note - Kauailabs is working on a prototype of this - PX4Flow optical flow sensor plus navX-based sensor plus LEDs plus proximity sensor - and sensor fusion. Illumination and optical focus are tricky issues, esp at higher speeds (higher frame rates), and an autofocus mechanism may be required to make it easy to configure. As you say, it's not trivial, and our goal is to determine its accuracy, repeatability, and if it can be manufactured as a plug n play product at a reasonable cost. If enough progress is made we hope to present some preliminary results next year. Fusing optical flow and imu with wheel encoders as a fallback if optical flow SNR is too low may be the way to go.

[Alan Anderson]

We tested using optical tracking of robot position a decade ago, using an optical mouse with the equivalent of a telephoto lens. When the distance from the sensor to the carpet is perfectly consistent, the results are great. But any variation in height changes the field of view, and that changes the relationship between motion of the image and physical motion of the robot. We couldn't eliminate vibration and bounce from the system, and eventually abandoned the project as unworkable on a real-world FRC robot. (It might have been worth trying for Lunacy, with the super-smooth floor and very low accelerations, but the trailer still caused some variations in tilt that would have to be compensated for somehow.)

If the carpet had a pattern on it that could be detected and measured, keeping the horizontal distances calibrated, I think it would be a good idea to revisit the concept.

[slibert]

Originally Posted by Alan Anderson

We tested using optical tracking of robot position a decade ago, using an optical mouse with the equivalent of a telephoto lens. When the distance from the sensor to the carpet is perfectly consistent, the results are great. But any variation in height changes the field of view, and that changes the relationship between motion of the image and physical motion of the robot. We couldn't eliminate vibration and bounce from the system, and eventually abandoned the project as unworkable on a real-world FRC robot. (It might have been worth trying for Lunacy, with the super-smooth floor and very low accelerations, but the trailer still caused some variations in tilt that would have to be compensated for somehow.)

If the carpet had a pattern on it that could be detected and measured, keeping the horizontal distances calibrated, I think it would be a good idea to revisit the concept.

Great input, our initial tests a few years ago showed an accurate, fast ranging sensor is part of the solution, so the current prototype has a fast IR ranging sensor.

The vibration part would seem to be managed by a very high framerate in the sensor, our previous experiments worked w/the ADNS3080 optical mouse sensor which had a 6400hz framerate if I recall correctly. What framerate were you using, and what was the general frequency of the vibration?

The resolution of the ADNS3080 was very low, which is why our hope is the much higher resolution of the PX4FLOW sensor will allow it to seem more structure in the carpet than the ADNS3080. Getting enough CPU and illumination to use the higher res at a high framerate is the challenging part currently encountered.

[Alan Anderson]

Originally Posted by slibert

The vibration part would seem to be managed by a very high framerate in the sensor, our previous experiments worked w/the ADNS3080 optical mouse sensor which had a 6400hz framerate if I recall correctly. What framerate were you using, and what was the general frequency of the vibration?

Frame rate wouldn't seem to be relevant. Our test system could track the carpet at more than 20 feet per second from about 2.5 cm, and at least 30 feet per second at 4-5 cm. The problem wasn't related to the speed of horizontal tracking, it was because the vertical distance between sensor and carpet was varying. Moving the sensor upward or downward by less than a millimeter, corresponding to about 2-4 percent of the separation, would throw off the distance measurements by about 5-10 percent. We thought about trying to mount the mouse much higher to make the error a lower percentage, but we didn't have the lenses available to get the focus to work.

The vibration on our test rig was induced by a 2004-vintage Thomas air compressor (we used a pneumatic linear actuator to move a strip of carpet a known distance), at I'd guess a few dozen Hertz. When we tried to use the sensors on an actual robot, the roughness of the wheels and the compliance of the carpet induced enough bounce and other vertical "noise" to make the readings nearly useless.

[slibert]

Originally Posted by Alan Anderson

Frame rate wouldn't seem to be relevant. Our test system could track the carpet at more than 20 feet per second from about 2.5 cm, and at least 30 feet per second at 4-5 cm. The problem wasn't related to the speed of horizontal tracking, it was because the vertical distance between sensor and carpet was varying. Moving the sensor upward or downward by less than a millimeter, corresponding to about 2-4 percent of the separation, would throw off the distance measurements by about 5-10 percent. We thought about trying to mount the mouse much higher to make the error a lower percentage, but we didn't have the lenses available to get the focus to work.

The vibration on our test rig was induced by a 2004-vintage Thomas air compressor (we used a pneumatic linear actuator to move a strip of carpet a known distance), at I'd guess a few dozen Hertz. When we tried to use the sensors on an actual robot, the roughness of the wheels and the compliance of the carpet induced enough bounce and other vertical "noise" to make the readings nearly useless.

Got it, thanks, hadn't been taking small-scale vertical variation into account. Moving the lens farther from the floor should help as you say, which also might impact the illumination requirements a bit, but also requires greater depth of field (and wider FOV and higher resolution sensing) to handle faster motion and detect sufficient structure in carpet. It's a fascinating problem...

If we back up to the OP's question about velocity for motion profiling (rather than calculating displacement), do you think your test rig showed promise for velocity vector estimation that would rival or exceed encoders?

[Alan Anderson]

Originally Posted by slibert

If we back up to the OP's question about velocity for motion profiling (rather than calculating displacement), do you think your test rig showed promise for velocity vector estimation that would rival or exceed encoders?

Errors in measuring position translate directly to errors in deriving velocity.

When we gave up on the "telephoto mouse" project, we went to a trio of encoders (something like a US Digital S1, 64 counts per revolution) mounted to custom-fabricated follower wheels that were built something like the old "trick wheel" omnis. On carpet, they worked very well (though we soon discovered a hardware limitation in the IFI controllers' interrupt support, which we overcame with a simple TTL "quadrature hysteresis" circuit between the encoder and the digital input pins).