2012 Beta Testers

[yarden.saa]

We applied , we were also last year but because we moved to another lab/workshop we didn't have the time for it.

[Jimmy Nichols]

We applied for out first time this year. We are hoping to be selected.

[Mk.32]

We are applying as well.
Just wondering what are the chances of a team to be selected?

[Jon Stratis]

We just finished filling out the Survey... however, when we submit it, it seems to only refresh the page. Anyone else encountering this? We don't get any sort of confirmation that it went through!

Edit: Found our issue... apparently form errors don't really show up well on the site when viewed in Firefox!

[JamesTerm]

Thanks for posting reminder... we may do this again, still thinking about it. I do want to ask a question as there is a goal I'd like to pursue. Is there anyone at all that was able to use vision through the driver-station using c++ wind-river? If so please let me know as we would like to gather information on how to do this (e.g. for Beta Exhibition). Thanks.

[Greg McKaskle]

118 used C++ and a Beagle Bone. I don't really see an issue with doing it on the dashboard. What are your concerns?

Greg McKaskle

[JamesTerm]

Originally Posted by Greg McKaskle

118 used C++ and a Beagle Bone. I don't really see an issue with doing it on the dashboard. What are your concerns?

Greg McKaskle

When I was in beta last year... I was really excited about the idea of doing video processing through the driver station, and I really wanted to do that. Since this was a new presented feature, I couldn't find very much information on step by step what to do. Brad had some instructions but only for the Java platform. Jarod (341) has some good info, and source... but same scenario. I could not find the info I needed and eventually gave up. I still want to figure this out and hopefully can help others at for the task 5 exhibition who were stuck like I am now. So at this point... I just want to gather links docs info... etc on how to do this using c++ wind-river environment. Eventually have a step-by-step document on what to do... as well as example code on how to send commands from the driver station back to the robot... for things like target coordinates etc.

I've never heard of a beagle bone... thanks for info on team 118. I should hook up with them and see if they can help.

Hopefully enough teams have tested this new path... and from what I've heard it's been positive results with minimal latency.


P.S. If I can figure all of this out... it would be cool to overlay cross hairs on the video image that comes to the driver station... I'll save this research for next iteration.

[Greg McKaskle]

You may be able to find step-by-step instructions, but perhaps you don't need them.

To get an image from the dashboard to the camera, you simply do an http get to start the mjpg stream. You can alternately request individual jpegs. You can do this in LV with the default dashboard, in Java with smart dashboard. You can also write a C/C++ dashboard, but there are no tools in the kit for doing this -- you can use Microsoft or gcc for PC development.

Once you have the image, you can use any laptop image processing library you like -- some use OpenCV, some use the NI IMAQ libraries.

To send info back to the robot, you can use UDP, TCP, or the smart dashboard. The smart dashboard is the simplest approach, and with some sample code, the UDP and TCP aren't too bad either.

As for placing marks on top of the image, the NI IMAQ vision control does this pretty easily, and I'm assuming you can modify the image or similarly overlay it in smart dashboard.

Once you start the project, you can ask additional quesitons.

Greg McKaskle

[JamesTerm]

Originally Posted by Greg McKaskle

You may be able to find step-by-step instructions, but perhaps you don't need them.

To get an image from the dashboard to the camera, you simply do an http get to start the mjpg stream. You can alternately request individual jpegs. You can do this in LV with the default dashboard, in Java with smart dashboard. You can also write a C/C++ dashboard, but there are no tools in the kit for doing this -- you can use Microsoft or gcc for PC development.

Greg McKaskle

Thanks for this preliminary information... I think for CD I'll just ask some high top level questions for the good of the group... and figure out the best direction to go.

What I'd like to do is have a solution that many c++ teams can use without needing to write any JAVA code. So I remember the default dashboard having callback tags or something like this, but it sounds like there is no easy way to somehow bridge the callbacks into a c++ environment. Let me know if this is not true... I know for c# it's possible to write bridge code as we do this for our products at work. If it is possible then perhaps we could offer the bridge code for others to use (since everyone gets the default dash board).

Ok so let's look at the C++ dashboard option... I presume this would be something to the effect where it becomes the replacement exe (to replace the default one), and at that point we could easily interface with it. If we went down this route, would it be something we could offer to other teams? I'd be happy to port over the default dashboard from JAVA to c++ for this exe if that sounds like the best direction.

If I can get past this first hurdle... it will help clarify the next step for us. Thanks in advance for helping us out.

[JamesTerm]

Originally Posted by JamesTerm

Thanks for this preliminary information... I think for CD I'll just ask some high top level questions for the good of the group... and figure out the best direction to go.

I've spoke with 118 and they went the "http get" path...using UDP packets. (Thanks 118 for this info). We'll pursue this direction as well but instead we'll use Windows and Visual Studio. I figure it will be a more feasible alternative for teams to consider using vision processing on the driver station, but it will be interesting to see how wireless latency compares against high cpu usage video processing on the cRIO. There's probably some info on this comparison else where in CD (I'm going to re-read 341's posts on their latency).

[Greg McKaskle]

Reading between the lines, I suspect that 118 is doing an HTTP GET to init the mjpeg stream. This is inherently done over TCP. I suspect they sent data back to the cRIO using UDP. Of course the computer doing this work was mounted on their robot, not on the DS.

If you want to do this with the smart dashboard, it would involve writing some windows specific code using gcc or Visual Studio that would read the UDP packet from the DS, parse the info and display it. It would do the TCP GET to get the mjpeg stream opened, and some code to decode or display it. It could also recompile or implement the network table protocol for C++ and use that to do read/writes to the cRIO for sharing data. No need to interoperate with JAVA unless you decide to.

Similarly, the LV dashboard does the UDP and TCP work. No network table implementation was made publicly available last year.

Greg McKaskle

[JamesTerm]

Originally Posted by Greg McKaskle

If you want to do this with the smart dashboard, it would involve writing some windows specific code using gcc or Visual Studio that would read the UDP packet from the DS, parse the info and display it.

Thanks for sharing this work-flow we may try to pursue that... one thing I'd like to know is if the smart dashboard can be developed on off-line. I know I've seen a testing harness available in the past, but that one is out dated. It would be great to be able to interface with the smart dashboard without needing a cRIO present.

Also while I'm here... I'm looking forward to seeing if the Joystick protocol is going to change to use the full HID info. I was thinking of creating an article/feature request about this in terms of being able to use the POV controls on a logitech game pad. I wanted to use that control for this year's game but could not.

[Tom Line]

Originally Posted by Greg McKaskle

Reading between the lines, I suspect that 118 is doing an HTTP GET to init the mjpeg stream. This is inherently done over TCP. I suspect they sent data back to the cRIO using UDP. Of course the computer doing this work was mounted on their robot, not on the DS.

If you want to do this with the smart dashboard, it would involve writing some windows specific code using gcc or Visual Studio that would read the UDP packet from the DS, parse the info and display it. It would do the TCP GET to get the mjpeg stream opened, and some code to decode or display it. It could also recompile or implement the network table protocol for C++ and use that to do read/writes to the cRIO for sharing data. No need to interoperate with JAVA unless you decide to.

Similarly, the LV dashboard does the UDP and TCP work. No network table implementation was made publicly available last year.

Greg McKaskle

Greg, when I thought about this I assumed that the Labview dashboard live-stream is already an mpeg stream and that Labview users can pull frames from that and use the Labview example vision code to process it. Is that the case? Is there a reason not to do it that way?