Dual Cameras - Dual Purposes

[Invictus3593]

What I'd recommend making a simple ask/response protocol over TCP. When asked for it, take the IR or depth image on the robot and writing it. When it is read on the DB, format it as needed and transfer it into an image of some sort. I have some Kinect code in LV that moves the data efficiently into different formats if you find you need it.

...

Using an accelerometer to determine distance is a very hard problem. To do this, you need to know orientation as well as accelerations and you need to have high quality sensors and/or knowledge of how the chassis can be affected.

If I used a gyro and the kinect sensor together and had a small diagram of the field and our robot on it (to scale of the field), couldn't I use the gyro for orientation? On the kinect side, I was thinking that maybe taking the accelerometer data and calculating speed and time to get the distance traveled, then compare that to the gyro data and move the diagramed robot accordingly.

It is very possible to show 3 camera feeds in c++( 2 from the kinect, 1 from a webcam), and c for the matter. I could send you a really good demo program that I wrote for our team meeting last week to teach our new programmers about openCV/computer vision. Pm me and I'll send it to you. It's kind of long (~100ish lines) so it'd really stretch out this post and would be obnoxious.

...

Instead of using the accelerometer , we use a gyro for orientation. What we have been working on is using our vision solution instead of a gyro, or as a check for it at the very least. To do this for all 6 desired values, x y and z displacement, and pitch roll yaw, I'd suggest using pose. I digress, however. I would love to work on a project like this with anyone interested (that is, using the accelerometer readings in the kinect)

I have some experience with opencv, but i used the .net wrapper to use it in c# and i felt like it lacked what i needed. But i'd love to see that code! I'll be pm-ing you soon.

does the gyro provide speed and time? I have never used one so I have no idea. If it does, there may be no reason to call the kinect's accelerometer at all, just use the gyro to help plot the diagram maybe?