Go to Post Robots that don't obey the laws of physics will be checked for alien technology and magic. - Greg McKaskle [more]
Home
Go Back   Chief Delphi > CD-Media > White Papers
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

photos

papers

everything



Zebravision 4.0 Goal Detection - Team 900

By: ForeverAlon
New: 19-05-2016 20:21
Updated: 17-09-2016 13:05
Total downloads: 219 times


Zebravision 4.0 is Team 900s vision system for the 2016 season; FIRST Stronghold. Our work was focused around recognizing the vision goals using shape and color based matching, recognizing the boulders using a neural network, and integrating the detection systems into a tracking system using the StereoLabs ZED stereo camera. One of the main features of Team 900’s Zebravision code this year was goal detection. This paper gives an overview of the hardware and code used.

Zebravision 4.0 is Team 900s vision system for the 2016 season; FIRST Stronghold. Our work was focused around recognizing the vision goals using shape and color based matching, recognizing the boulders using a neural network, and integrating the detection systems into a tracking system using the StereoLabs ZED stereo camera. One of the main features of Team 900’s Zebravision code this year was goal detection. This paper gives an overview of the hardware and code used.

The system used a Stereolabs ZED RGB-depth camera and green LED rings to highlight the retroreflective tape around the goal. The image was filtered to look for the reflected LED color and thresholded to turn it into binary “green / not green” image. The code then extracted contours from the image and applied a number of simple filters to rule out blobs which were obviously not goals. The remaining contours were scored in a number of criteria and the best scoring few objects were assumed to be goals. If more than one valid goal is found, several tiebreakers were used to pick one goal to shoot at. If a valid goal was found, the angle and distance to the target was reported; if none were found, a packet with -1.0 distance and angle was returned to the roboRIO.

Attached Files

  • pdf Rev 1.0

    Zebravision4.0GoalDetection.pdf

    downloaddownload file

    uploaded: 23-05-2016 18:06
    filetype: pdf
    filesize: 683.9kb
    downloads: 217



Recent Downloaders

  • Guest

Discussion

view entire thread

Reply

19-05-2016 20:23

ForeverAlon


Unread Re: paper: Zebravision 4.0 Goal Detection - Team 900

Zebravision 4.0 is Team 900s vision system for the 2016 season; FIRST Stronghold. Our work was focused around recognizing the vision goals using shape and color based matching, recognizing the boulders using a neural network, and integrating the detection systems into a tracking system using the StereoLabs ZED stereo camera. One of the main features of Team 900s Zebravision code this year was goal detection. This paper gives an overview of the hardware and code used.

The system used a Stereolabs ZED RGB-depth camera and green LED rings to highlight the retroreflective tape around the goal. The image was filtered to look for the reflected LED color and thresholded to turn it into binary green / not green image. The code then extracted contours from the image and applied a number of simple filters to rule out blobs which were obviously not goals. The remaining contours were scored in a number of criteria and the best scoring few objects were assumed to be goals. If more than one valid goal is found, several tiebreakers were used to pick one goal to shoot at. If a valid goal was found, the angle and distance to the target was reported; if none were found, a packet with -1.0 distance and angle was returned to the roboRIO.



20-05-2016 15:15

OccamzRazor


Unread Re: paper: Zebravision 4.0 Goal Detection - Team 900

So I watched you guys practice and play at competition and I saw that you rarely missed if you decided to fire a boulder - your robot had lethal accuracy when there was no defender. I even saw small robots hit you and your turret would turn and you would score anyway.

My question is that with a defender in your way blocking your camera occasionally would you still be able to track the known location of the goal and fire? It seemed as though you could fire over most defenders even if they were 4ft 6in if you could track the location while they were blocking you and fire anyway. How did you combat camera obstruction?



20-05-2016 15:20

marshall


Unread Re: paper: Zebravision 4.0 Goal Detection - Team 900

Quote:
Originally Posted by OccamzRazor View Post
So I watched you guys practice and play at competition and I saw that you rarely missed if you decided to fire a boulder - your robot had lethal accuracy when there was no defender. I even saw small robots hit you and your turret would turn and you would score anyway.

My question is that with a defender in your way blocking your camera occasionally would you still be able to track the known location of the goal and fire? It seemed as though you could fire over most defenders even if they were 4ft 6in if you could track the location while they were blocking you and fire anyway. How did you combat camera obstruction?
We didn't.

But we have plans for it now. We're going to be adding latency and IMU compensation to the code to better track the targets. We will be working closely with Kauai Labs to make it happen before too long.



view entire thread

Reply

Tags

loading ...



All times are GMT -5. The time now is 08:46.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi