![]() |
Reliability of Pixy Camera?
Our team is considering purchasing a Pixy camera (link below) to hopefully use in next year's game. For the teams that have used a Pixy in the past, how reliable has it been? As it uses hue-based filtering, have any teams had problems tracking greyscale objects (such as the 2016 boulders)?
Also, after reading through the docs it looks like the get x, y locations are pixel-based. This seems like it may be an issue as the camera appears to have a fairly fish-eye lens (see photo linked below). Has this been an issue for any teams that do vision tracking by using vector-based calculations and moving by gryo angle rather than direct camera feedback? Pixy: http://charmedlabs.com/default/pixy-cmucam5/ Fish-eye example: http://i74.photobucket.com/albums/i2...ps1e87977b.jpg Thanks! |
Re: Reliability of Pixy Camera?
You're not going to be able to track the greyscale boulders, but the Pixy should be fine for stuff like the retroreflective tape on the goal. At least from our observations, the Pixy has a huge lack of contrast or color --- everything's pretty washed-out, so you'll only be able to do bright colors.
Fisheye shouldn't be that much of a problem. Worst case, you can use OpenCV to determine the distortion factors, then write a correction software-side. |
Re: Reliability of Pixy Camera?
My opinion is that the Pixycam would probably be better on a FTC - VEX scale field. Lighting variations and FRC field scale gave it problems when we tested it. In my opinion it might be better to bite the bullet and invest resources in learning grip - Opencv with some camera choices. Our student are working on a PI3 and opencv for next year. We used grip and a Pi2b this year. I would say that grip was a good learning tool.
|
Re: Reliability of Pixy Camera?
Hey, so my team bought the Pixycam during the off season. It is one of the easiest visioning cameras to use. From what I have seen on my team's Pixycam is that it doesn't have to much of a fisheye effect to it, also if does are team didn't do anything to fix it and it works great at our shop. Sadly we didn't get to try it out at an off season. The only problem with the Pixycam is you can't really get both x and y, at least yet. What is very helpful is for it to work you just have tell you Pixy what it is looking for once, on the computer interface, and then it sends you a voltage depending where it is and then you code for it.
|
Re: Reliability of Pixy Camera?
I have been using the pixymon camera for some fun off season project. Here is are auto aiming ping pong robot https://www.youtube.com/watch?v=2pQD2WqQjCM
It is very impressive however there are some big downsides to it. 1) if you ever brown the camera out it will loose its configuration 2) Camera does not have great resolution so distance is a problem 3) Can not do any advanced shape detection. This is almost a must in FRC over all i would not recommend it for FRC. It is a lot of fun to play with and to learn but just not great for FRC |
Re: Reliability of Pixy Camera?
Quote:
2) resolution and distance aren't really required for FRC, shooting from the defenses was very doable for us last year at reasonably low resolutions. I've also had good luck with the CMUcam3 in the past which was probably comparable resolution. Typically the first step I do in any image processing is to lower the resolution of the image so I can process it faster. 3) Last year we did 0 shape recognition, we relied almost exclusively on lowering the exposure on the camera. I like to think our camera tracking was pretty reliable last year. I guess I'm just disagreeing that you really need high resolution and shape recognition. |
Re: Reliability of Pixy Camera?
On 1296 this year we used the Pixy for our vision both in auton and teliop, it worked great! We did try and use it for some boulder tracking and this did not work very well outside of ~6in, due to the grey boulder and carpet along with the lack of reflectiveness of the boulder. For a year that does not need shape recognition like this year with the tower the Pixy seems to be a relativity easy solution. My favorite part is Pixymon which allows for super easy tuning.
*Disclaimer I am not a programmer/software guy and most of this info was relayed to me from the programmer. |
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
We used the Pixy camera from week 5 on in Stronghold. It was the key to our autonomous high shot and a major contributor to our 9-11 high goal matches. The interface we chose to use was the simplest one (digital/analog X). I found it to be a bit touchy to set up, but once calibrated to the lighting in each venue it worked well.
We did change the lens from the stock one (75 degree horizontal field of view) to I think 51 degrees field of view. |
Re: Reliability of Pixy Camera?
I could be wrong about using it on the FRC robot. Sounds like lots of people have had good luck with it
Has anyone seen the problem where if the board browns out you loss your config . Maybe there is just something wrong with my board |
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
So the PixyCam has a pretty good resolution, though depending on the year may not work well enough, we actually got ours to work to about the mid-line. Also the boulders do seem to be a problem. Also to get a live feed from the pixycam it isn't very possible, yet. (I'm hoping pixy releases an FRC version becuase they have an FLL version.) Though, my team didn't need to use anything other then what is provided by Pixy, the Pixycam and the Pixymon, to interface. We also didn't have any brown out problems. I do believe the PixyCam is very worth the cost, because on-board processing is better than off-board processing, and to set-up something like you would: need a camera, a kangaroo computer, and led lights. All this can come to a much more hefty price than the PixyCam. (which my team paid $100 for are setup and the other setup I'm talking about is nearly $200 or more.)
|
Re: Reliability of Pixy Camera?
Quote:
-not a programmer. :P |
Re: Reliability of Pixy Camera?
After seeing how much great results people have had i started looking into the i2c communication. Any chance anyone has written the i2c communication for Labview?
|
Re: Reliability of Pixy Camera?
To teams that got the Pixy to work. Where did you shoot from? Did you shoot from the defenses? Did you have to be centered and perpendicular to the target? What did you do about getting 2 targets when positioned to the side and 2 targets were in view?
|
Re: Reliability of Pixy Camera?
Quote:
The 2 target problem turned out to be no problem at all. Using the digital/analog X interface the Pixy gave the X position for only the largest target it saw. In every case that target was the goal most perpendicular to our catapult, and therefore the goal we wanted to be aiming at. For clarification, we used the two signals from the Pixy as follows: The digital output told the robot when the Pixy saw what we taught it to look for anywhere within its visual field. At that point the robot removed the yaw authority from our driver and aimed itself. A large indicator on the driver station told our operator when the robot was aligned and ready to shoot. At that same time full drive authority was returned to our driver, just in case we needed to relocate due to being defended. |
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
Quote:
1. What settings would you alter in order to get the best performance? Actual numbers on specific settings would be very helpful, I'm curious to know what you did to have the best performance possible. 2. What benefits did you find in changing the lens? What issues did you experience that made you look into changing the lens? To anyone else who ran the Pixy this past year or have other experience, please feel free to chime in on your answers too. |
Re: Reliability of Pixy Camera?
Thanks everyone for all of the great responses!
I just have one other question. Is there a way to pull the raw footage from the camera in the case that more advanced vision processing is needed? It looks like it may be possible via a USB connection but I don't see anything specifically referring to it in the USB api docs. |
Re: Reliability of Pixy Camera?
Quote:
The lens choice was also made to reduce the potential sources for false targeting. Using the Pixymon program to see what the camera saw, the 51 degree lens gave us the best view of the field with the least view beyond it. The system was not perfect and needed tweaking along the way. The scrolling LED display along the arena perimeter at champs was occasionally orange and had to be considered. We also found that the end wall diamond plate at champs was highly polished, far more so than at our district events. That caused or robot to shoot at its own reflection once in autonomous (funny in hindsight). After teaching it to turn 30 degrees to starboard before looking for a target that was no longer an issue. The Pixy can actually be set to look for 7 simultaneous colors. Who knows, that may be useful this year. |
Re: Reliability of Pixy Camera?
I haven't used the pixy cam on an FRC robot, but I purchased one and I'll be using it for another robot competition. It has worked well in my initial testing with controlled lighting.
As stated. It is really more of a color-proximity sensor, a highly optimized and specialized sensor that does one thing well. If that is useful in the game, make use of it. If not, it is actually a pretty good exercise to make your own pixy cam using a USB camera and a little bit of processing code and extend it to do some additional measurements on the particles. But at that point, there isn't much need to incorporate the pixy cam. Just build your own. It is a great learning opportunity. The optimization is the hard part. But I'm pretty sure most can make it fast enough for what they need on the robot. We aren't needing to measure the wing-beat speed of an unladen European swallow, are we? Greg McKaskle |
Re: Reliability of Pixy Camera?
Ok, I think we may have to revisit the pixy cam. Our judgement may have been premature. We went with grip on a Pi2b and an IP camera. The programmers are working on Opencv on a PI3 with IP camera and a native Pi camera. The difference is color blob detection vs object detection. The Pixy cam is a much simpler solution. One can not have enough tools in the tool box for next season. It seams that machine vision is a requirement for FRC teams that aspire to play at a high level. Our best trained operator could aim and shoot at best in 7 to 8 seconds. Our auto aim and shoot was average of 3 to 4 seconds and more consistent.
|
Re: Reliability of Pixy Camera?
It's nice to see how far the CMUcam platform has come. I remember trying to fuss with the old rs232 ones years ago.
Has anyone looked into the OpenMV camera? I don't hear as much about it, but I've been using one for a while and it's pretty nice, I wonder how they compare with one another. (buying more than one $60+ dev board at a time is somewhat difficult to justify to oneself and ones wallet.) |
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
Quote:
<complaining>Tangentially, I myself purchased my own unit through the Kickstarter campaign, so it was at a discounted price of ~$60. They then tell us that they encountered production issues and had to spend the shipping fees they had charged on the problem, so we all needed to spend an extra $12 to get our already-bought boards actually sent to us, ultimately eliminating the discount we received for backing the campaign.</complaining> |
Re: Reliability of Pixy Camera?
Quote:
In robotMap: Code:
public static I2C pixyi2c;Code:
public static void printPixyStuff(){ |
Re: Reliability of Pixy Camera?
Quote:
pixyValues[0] = (byte) 0b01010101; pixyValues[1] = (byte) 0b10101010; and is there some reason why if you counter goes above 50 you change what you do? |
Re: Reliability of Pixy Camera?
Quote:
|
Re: Reliability of Pixy Camera?
So, this is what I was told about the two loops.
"check if the index is getting so high that you can’t align and see an entire frame." I think this is that it takes too long to parse all the data so we split it up? Looking back at documentation, this is how the code should look. Now with comments! Code:
// set the number of bytes to get from the pixycam each read cycle. The pixycam outputs 14 byte blocks |
Re: Reliability of Pixy Camera?
Quote:
Did you have the pixy in Lego mode or just I2C mode? |
Re: Reliability of Pixy Camera?
Quote:
|
| All times are GMT -5. The time now is 05:57 PM. |
Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi