2009 base C/C++ code?

[Daniel_LaFleur]

Originally Posted by Greg McKaskle

I can't do much of a comparison -- I'm not familiar with the previous vision code.

The new library will be broken into a camera library with functions for connecting, getting an image, setting parameters of the camera, and an image processing library with functions for analyzing what is in an image. This includes shape based analysis, color based analysis, pattern based analysis, etc. The analysis section is based upon the NI vision library, so more details can be found online.

Greg McKaskle

Greg,

In the 'shape based' analysis, can the vision system interpolate orientation of a known 3-d object within the cameras field of vision? Can the vision system determine trajectory (in 3-d) based on movement and size change of a known shape/size object within the cameras field of vision?

or will we have to do the calculations outside of LV vision?

[Roger]

From the demo video I saw (not a live demo), a table full of typical tools was flashed on the screen (overhead view), then right after a count of the different tools was displayed. From what I understand (and reading Greg's description above) the "shapes" (and colors and patterns) are programmed into the code somehow, then the code and/or hardware (I don't know which) does the dirty work grinding out which is what. Fairly quickly, I might add. Thus "shapes" could be tool profiles or letter outlines or game pieces. Same with colors. Size and rotation didn't matter, but the profile had to be similar to the pre-programmed profile. In a word----

I guess for 2009 the signs "Turn Left!" "Go Fast!" could really be read by the robot.

I'm thinking there must be a catch, or a trade-off, or something. The problems with the CMUcam was not that it couldn't read green vs red vs blue -- it could -- but that it would pick up arena lights from across the field. (I'm looking at you, Boston's BU arena!) The shapes I'm thinking have to be directly in front of the camera and on a plain contrasting background to be picked up clearly. I can't wait to see how well it really works.

Daniel, my guess is that the software/hardware can determine shape (profile), but your software would have to save size/rotation of the shape each "frame" to track differences between frames to determine trajectory. Or, wait and see.

[Greg McKaskle]

Originally Posted by Daniel_LaFleur

In the 'shape based' analysis, can the vision system interpolate orientation of a known 3-d object within the cameras field of vision? Can the vision system determine trajectory (in 3-d) based on movement and size change of a known shape/size object within the cameras field of vision?

or will we have to do the calculations outside of LV vision?

NI vision library is primarily for planar shapes. Typically chips on a board, or other bits of an object being manufactured. Additionally, the camera image is simply a 2D matrix of light intensities. Determining the difference between a scene of 3D objects, and a printed poster of the same scene is difficult even for humans, much more difficult for computers.

So if you are clever about how you use it, yes, you can use vision to measure things about the image and to interpret it in 3D. But no, it doesn't automatically infer 3D information from a camera image.

Greg McKaskle

[ShotgunNinja]

So, in summary, it's very similar to the tracking and profiling systems found in newer security cameras? I've read in a few-years-old PopSci somewhere that some newer camera systems were incorporating a collection of two-color bitmaps to profile shape and direction of people walking by. Is it something similar?

EDIT: Also, any new hustle and bustle from the FIRST officials about my hint (see above) ? Again, I'd LOOOVE to see the OOP approach to something like this. It just makes me feel even smarter

[Greg McKaskle]

If the templates are bitmap based, then this is what IMAQ would refer to as pattern based shape recognition. The patterns are trained in advance, and a scene is examined for instances of the pattern.

Geometric recognition, by contrast finds the high contrast lines in a image and compares their shape against the template shapes.

Greg McKaskle

[kamocat]

And we will be getting all this (or it will become available online) when we get the cRIO in November?
(In this case, I'm just referring to the Labview default code, because NI has no control whatsoever over the WPI C++ code)