|
|
|
![]() |
|
|||||||
|
||||||||
![]() |
| Thread Tools |
Rating:
|
Display Modes |
|
#1
|
||||
|
||||
|
Detecting gears with deep learning
Using deep learning to find gears! This model was trained for around 3 hours with a dataset of only ~420 images:
![]() Short video: https://www.youtube.com/watch?v=ia-qFr3SDM8 I'll continue adding more images to the dataset (and possibly images of fuel). |
|
#2
|
|||
|
|||
|
Re: Detecting gears with deep learning
Nice, similar to something we're looking at. What localization method did you use? I'm guessing either R-CNN or YOLO v2?
|
|
#3
|
||||
|
||||
|
Re: Detecting gears with deep learning
Neural networks are so last year.
![]() I kid! Great job with this. I hope you guys share your code and take some time to share your process after the season is over. |
|
#4
|
||||
|
||||
|
Re: Detecting gears with deep learning
Quote:
While cool, it looks like gear detection won't be that useful for our robot. I'm planning on uploading the data, pre-trained model, and instructions on how to run it sometime this week. |
|
#5
|
|||
|
|||
|
Re: Detecting gears with deep learning
That's awesome, I've been trying to do this year, but still have not gotten enough data.
|
|
#6
|
||||
|
||||
|
Re: Detecting gears with deep learning
What I did was take a couple of videos (13 so far) of the gears while varying the angle, lighting, etc. Then I converted the videos into individual frames and annotated them in MATLAB. Took me two afternoons to get a bit over 400 annotated images.
|
|
#7
|
|||
|
|||
|
Re: Detecting gears with deep learning
I feel like an idiot for not thinking of the hat. That should have been my first instinct. In all seriousness though that's amazing. Did you use any backend for the training like theano or tensorflow. And what did you computer didn't you use for training.
|
|
#8
|
||||
|
||||
|
Re: Detecting gears with deep learning
I used caffe and trained on a GTX 1080. Seeing how it only took 3 hours to get pretty decent results, I bet the same training could be accomplished by a laptop in a day.
|
|
#9
|
|||
|
|||
|
Re: Detecting gears with deep learning
I have a GTX 1080 on my laptop, so Ill try a Single shot model with Caffe later today. Ill update you if I get any results.
|
|
#10
|
|||
|
|||
|
Re: Detecting gears with deep learning
Just curious, why would you need to detect gears autonomously?
|
|
#11
|
|||
|
|||
|
Re: Detecting gears with deep learning
Well, why not? First its a really fun challenge for programmers. Its also a great learning experience for anyone interested in neural nets and machine learning. But specific for the game, it depend on your team. One use would be to automatically intake a gear. If you are on the other side of the field, visibility becomes a major issue. Especially if you are directly behind the airship. If you can track a gear, then you can press a button and have the robot intake the gear.
|
|
#12
|
||||
|
||||
|
Re: Detecting gears with deep learning
Our robot doesn't really have any use for this, but I thought it would be fun to do nonetheless.
|
![]() |
| Thread Tools | |
| Display Modes | Rate This Thread |
|
|