Who’s planning on applying for one of this 2013 season’s Beta Test teams?
http://www.usfirst.org/roboticsprograms/frcblog/beta-testing-process
September 7 deadline to apply.
**FRC 2013 Beta Test Forums: **http://forums.usfirst.org/forumdisplay.php?f=1547
I did beta testing last year, and it was great. It was a great way to learn more about FRC libraries and a great way to give back to the community. However, it takes the full support of your FRC team to execute. I highly recommend teams if any calibre to sign up and participate, provided they have the resources and 6 Weeks worth of time.
Beta Testing was awesome last year (http://team1912.com/beta_testing.html) and we hope to do it again this year!
I had a lot of fun doing it last year and we’re hoping to get accepted for Java again.
We applied , we were also last year but because we moved to another lab/workshop we didn’t have the time for it.
We applied for out first time this year. We are hoping to be selected.
We are applying as well.
Just wondering what are the chances of a team to be selected?
We just finished filling out the Survey… however, when we submit it, it seems to only refresh the page. Anyone else encountering this? We don’t get any sort of confirmation that it went through!
Edit: Found our issue… apparently form errors don’t really show up well on the site when viewed in Firefox!
Thanks for posting reminder… we may do this again, still thinking about it. I do want to ask a question as there is a goal I’d like to pursue. Is there anyone at all that was able to use vision through the driver-station using c++ wind-river? If so please let me know as we would like to gather information on how to do this (e.g. for Beta Exhibition). Thanks.
118 used C++ and a Beagle Bone. I don’t really see an issue with doing it on the dashboard. What are your concerns?
Greg McKaskle
When I was in beta last year… I was really excited about the idea of doing video processing through the driver station, and I really wanted to do that. Since this was a new presented feature, I couldn’t find very much information on step by step what to do. Brad had some instructions but only for the Java platform. Jarod (341) has some good info, and source… but same scenario. I could not find the info I needed and eventually gave up. I still want to figure this out and hopefully can help others at for the task 5 exhibition who were stuck like I am now. So at this point… I just want to gather links docs info… etc on how to do this using c++ wind-river environment. Eventually have a step-by-step document on what to do… as well as example code on how to send commands from the driver station back to the robot… for things like target coordinates etc.
I’ve never heard of a beagle bone… thanks for info on team 118. I should hook up with them and see if they can help.
Hopefully enough teams have tested this new path… and from what I’ve heard it’s been positive results with minimal latency.
P.S. If I can figure all of this out… it would be cool to overlay cross hairs on the video image that comes to the driver station… I’ll save this research for next iteration.
You may be able to find step-by-step instructions, but perhaps you don’t need them.
To get an image from the dashboard to the camera, you simply do an http get to start the mjpg stream. You can alternately request individual jpegs. You can do this in LV with the default dashboard, in Java with smart dashboard. You can also write a C/C++ dashboard, but there are no tools in the kit for doing this – you can use Microsoft or gcc for PC development.
Once you have the image, you can use any laptop image processing library you like – some use OpenCV, some use the NI IMAQ libraries.
To send info back to the robot, you can use UDP, TCP, or the smart dashboard. The smart dashboard is the simplest approach, and with some sample code, the UDP and TCP aren’t too bad either.
As for placing marks on top of the image, the NI IMAQ vision control does this pretty easily, and I’m assuming you can modify the image or similarly overlay it in smart dashboard.
Once you start the project, you can ask additional quesitons.
Greg McKaskle
Thanks for this preliminary information… I think for CD I’ll just ask some high top level questions for the good of the group… and figure out the best direction to go.
What I’d like to do is have a solution that many c++ teams can use without needing to write any JAVA code. So I remember the default dashboard having callback tags or something like this, but it sounds like there is no easy way to somehow bridge the callbacks into a c++ environment. Let me know if this is not true… I know for c# it’s possible to write bridge code as we do this for our products at work. If it is possible then perhaps we could offer the bridge code for others to use (since everyone gets the default dash board).
Ok so let’s look at the C++ dashboard option… I presume this would be something to the effect where it becomes the replacement exe (to replace the default one), and at that point we could easily interface with it. If we went down this route, would it be something we could offer to other teams? I’d be happy to port over the default dashboard from JAVA to c++ for this exe if that sounds like the best direction.
If I can get past this first hurdle… it will help clarify the next step for us. Thanks in advance for helping us out.
I’ve spoke with 118 and they went the “http get” path…using UDP packets. (Thanks 118 for this info). We’ll pursue this direction as well but instead we’ll use Windows and Visual Studio. I figure it will be a more feasible alternative for teams to consider using vision processing on the driver station, but it will be interesting to see how wireless latency compares against high cpu usage video processing on the cRIO. There’s probably some info on this comparison else where in CD (I’m going to re-read 341’s posts on their latency).
Reading between the lines, I suspect that 118 is doing an HTTP GET to init the mjpeg stream. This is inherently done over TCP. I suspect they sent data back to the cRIO using UDP. Of course the computer doing this work was mounted on their robot, not on the DS.
If you want to do this with the smart dashboard, it would involve writing some windows specific code using gcc or Visual Studio that would read the UDP packet from the DS, parse the info and display it. It would do the TCP GET to get the mjpeg stream opened, and some code to decode or display it. It could also recompile or implement the network table protocol for C++ and use that to do read/writes to the cRIO for sharing data. No need to interoperate with JAVA unless you decide to.
Similarly, the LV dashboard does the UDP and TCP work. No network table implementation was made publicly available last year.
Greg McKaskle
Thanks for sharing this work-flow we may try to pursue that… one thing I’d like to know is if the smart dashboard can be developed on off-line. I know I’ve seen a testing harness available in the past, but that one is out dated. It would be great to be able to interface with the smart dashboard without needing a cRIO present.
Also while I’m here… I’m looking forward to seeing if the Joystick protocol is going to change to use the full HID info. I was thinking of creating an article/feature request about this in terms of being able to use the POV controls on a logitech game pad. I wanted to use that control for this year’s game but could not.
Greg, when I thought about this I assumed that the Labview dashboard live-stream is already an mpeg stream and that Labview users can pull frames from that and use the Labview example vision code to process it. Is that the case? Is there a reason not to do it that way?
Greg, when I thought about this I assumed that the Labview dashboard live-stream is already an mpeg stream and that Labview users can pull frames from that and use the Labview example vision code to process it. Is that the case? Is there a reason not to do it that way?
Last year, the default dashboard changed from reading individual JPEGs to doing an mjpeg stream. As you mention, it has always been possible to branch the image wire and connect it to the vision VIs for processing. Getting the processing back to the robot would involved UDP or TCP done on the open ports, or possibly using the beta-quality Network-Tables.
The example code ofr vision and tutorial that went with it supported both laptop and cRIO. It didn’t integrate it into the dashboard, but you pretty much just needed to copy and paste the loop and connect it to the mjpeg wire.
So yeah, no reason not to. If the processing is done when needed or on low resolution images, the cRIO should have plenty juice to process the images. But the added power of the laptop makes it far easier to get a working solution with less optimization. For reference, the cRIO is about 800 MIPs. Image processing is almost entirely integer, so that is a pretty good metric to use. The Atom in the classmates is around 3000 MIPs.
Greg McKaskle
Thanks for the benchmarks… I presume the 800 MIPs is referring to the cRIO II right? I tested the example rebound rumble vision processing code on the regular cRIO and found it took 80-110ms per frame to process. I did not test this on the cRIO II though. If I understand correctly image processing on the cRIO is almost entirely integer, while processing using openCV on a classmate would not need this kind of optimization.
That’s basically what we did this year. I posted a simplified example here: http://forums.usfirst.org/showthread.php?p=59750#post59750