Integrating a CNN into WPILIB

Technical
,
1

Hi!

My name is Jacob Mitchell, and I am the lead programmer for Team 7064 in Lansing, Kansas. Our team uses WPILIBJ. For an engineering project this year, I am working on integrating a Neural Network designed to identify game pieces by using standard webcam footage. I have an in-depth understanding of creating these models on their own. I could easily make a Python Neural Network in VSCode, but I am not sure how to integrate this into WPILIB and First.

A few years ago, a team alumni used a second PC to run a neural network for the same purposes, but this was during the at-home challenge year. What are some methods that you recommend? Do you have any tips for implementation?

Thank you so much for your help! Have a great rest of your day!

2

Assuming you host this on a coprocessor (basically required as the RoboRIO won’t have enough processing power to do it), the easiest way to integrate will be to use pyntcore to send the data through NetworkTables to the robot code on the Rio.