Log in

View Full Version : KINECT WORKING IN LABVIEW!!!


jacob9706
18-08-2011, 01:38
I have been tinkering around with my Kinect as a joke to present to my team, but after having AMAZING success in object tracking and depth/ distance measurement i am now going to push my team towards finding a way of integrating one onto next years robot. I just hope it is deemed legal for competition use.

I am also wondering how you would get a USB input through the C-Rio. That is the part i have not looked into.:yikes:

If i get enough requests i will create a video showing how accurate it is.

lemiant
18-08-2011, 01:46
Hate to rain on your parade, but I seem to remember that lasers are illegal on FRC robots :confused: (I don't *think* that the fact they are invisible matters)

jacob9706
18-08-2011, 02:05
Hate to rain on your parade, but I seem to remember that lasers are illegal on FRC robots :confused: (I don't *think* that the fact they are invisible matters)

it doesn't use "lasers"...its an " infrared light source" according to Microsoft. :P

Tristan Lall
18-08-2011, 02:27
it doesn't use "lasers"...its an " infrared light source" according to Microsoft. :PLaser. (http://www.anandtech.com/show/4057/microsoft-kinect-the-anandtech-review/2)

jacob9706
18-08-2011, 02:33
Laser. (http://www.anandtech.com/show/4057/microsoft-kinect-the-anandtech-review/2)

I know. That's why I used quotes. Im just so hopeful that it is deemed legal because there are so many possibilities when you use it.

Gdeaver
18-08-2011, 07:52
The CRIO most likely does not have the processing power even if FIRST made them legal. Some atom boards could be had that have the processing power and would meet the cost constraints.

biojae
18-08-2011, 08:41
I have been tinkering around with my Kinect as a joke to present to my team, but after having AMAZING success in object tracking and depth/ distance measurement i am now going to push my team towards finding a way of integrating one onto next years robot. I just hope it is deemed legal for competition use.

I am also wondering how you would get a USB input through the C-Rio. That is the part i have not looked into.:yikes:

If i get enough requests i will create a video showing how accurate it is.

For the 2011 game, it was explicitly stated to be illegal:
http://forums.usfirst.org/showthread.php?t=16240

EricVanWyk
18-08-2011, 10:57
I have been tinkering around with my Kinect as a joke to present to my team, but after having AMAZING success in object tracking and depth/ distance measurement i am now going to push my team towards finding a way of integrating one onto next years robot. I just hope it is deemed legal for competition use.

I am also wondering how you would get a USB input through the C-Rio. That is the part i have not looked into.:yikes:

If i get enough requests i will create a video showing how accurate it is.

Very cool! Any chance you could share the code? :)

plnyyanks
18-08-2011, 12:16
Very cool! Any chance you could share the code? :)

I second that. I'd be very interested to check out that code.

jacob9706
18-08-2011, 13:37
Very cool! Any chance you could share the code? :)

I will strip out some of the unneeded stuff and post a YouTube video shooing what it can do with a link for chief Delphi users. Check back hear for code to unzip te project.

jacob9706
18-08-2011, 14:22
So i do not have a capture program on this laptop.... so i am just uploading the code. the file requires a password and it is VERY simple if you are involved in FIRST.

HINT: FIRST motto/ Value (GP)

http://www.2shared.com/file/pUNf4d89/Kinect_labview_86.html

Tom Bottiglieri
19-08-2011, 11:42
I am also wondering how you would get a USB input through the C-Rio. That is the part i have not looked into.:yikes:
There is no USB port on the current version of the cRIO, and based on the pictures I have seen of the new smaller one, none on there either.

Unless an NI person chirps in with something I don't know, I see only one feasible way to get the data from your PrimeSense unit (Kinect/PSDK5.0/asus xtion) to the cRIO.

You can use a seperate computer and pipe the data back over an ip connection. You can either use a cheap, lightweight system (ARM/NAND based, like the Pandboard or Beagleboard) and pump back the raw data for processing on the cRio, or you can use a heavier machine like an x86 netbook, do some of the vision processing on board there, and then pump back higher level data, like object locations and such. Who knows, you may even be able to pull enough power out of the little machine to do some tracking right on there. (Granted, you wouldn't have access to NI's vision libraries)

I really do hope FRC deems these PrimeSense rangers to be legal. Sure, 99% of the teams won't use them but it's not like they raise any kind of safety issues.

jacob9706
19-08-2011, 12:35
There is no USB port on the current version of the cRIO, and based on the pictures I have seen of the new smaller one, none on there either.

Unless an NI person chirps in with something I don't know, I see only one feasible way to get the data from your PrimeSense unit (Kinect/PSDK5.0/asus xtion) to the cRIO.

You can use a seperate computer and pipe the data back over an ip connection. You can either use a cheap, lightweight system (ARM/NAND based, like the Pandboard or Beagleboard) and pump back the raw data for processing on the cRio, or you can use a heavier machine like an x86 netbook, do some of the vision processing on board there, and then pump back higher level data, like object locations and such. Who knows, you may even be able to pull enough power out of the little machine to do some tracking right on there. (Granted, you wouldn't have access to NI's vision libraries)

I really do hope FRC deems these PrimeSense rangers to be legal. Sure, 99% of the teams won't use them but it's not like they raise any kind of safety issues.

I am thinking the same way. The kinect isn't going to hurt anyone and if it can micorsoft is a monster for selling it to kids.

But with the USB input that is the only way I have found that we could do it. A separate laptop under te price limit may be a little bit of a challenge especially if they concider software part of the price.

Vikesrock
19-08-2011, 15:05
But with the USB input that is the only way I have found that we could do it. A separate laptop under te price limit may be a little bit of a challenge especially if they concider software part of the price.

Each of the following would be separate components subjected to their own $400 price limit but even if they were considered a single COTS item and had to fit under the $400 collectively they would.

Atom D525 Motherboard ~$85 (http://www.logicsupply.com/products/d525mw)
125 watt automotive power supply ~$70 (http://www.logicsupply.com/products/m3_atx)
4GB DDR3 memory ~$26 (http://www.newegg.com/Product/Product.aspx?Item=N82E16820226019)
8GB Solid State HD ~$40 (http://www.newegg.com/Product/Product.aspx?Item=N82E16820139427)
Microsoft Kinect ~$150
Your favorite Linux Distro Free!

Total: ~$371

jacob9706
19-08-2011, 16:02
Each of the following would be separate components subjected to their own $400 price limit but even if they were considered a single COTS item and had to fit under the $400 collectively they would.

Atom D525 Motherboard ~$85 (http://www.logicsupply.com/products/d525mw)
125 watt automotive power supply ~$70 (http://www.logicsupply.com/products/m3_atx)
4GB DDR3 memory ~$26 (http://www.newegg.com/Product/Product.aspx?Item=N82E16820226019)
8GB Solid State HD ~$40 (http://www.newegg.com/Product/Product.aspx?Item=N82E16820139427)
Microsoft Kinect ~$150
Your favorite Linux Distro Free!

Total: ~$371

Wow. Look at me totally forgetting about Linux! Good thinking.

MaxKinect
20-08-2011, 16:19
Laptops are legal to use. Kinect -> usb -> laptop -> ethernet -> robot.

12 volts through fuse from robot to kinect.

maxwellt
03-11-2011, 19:19
Very cool! Any chance you could share the code? :)
i also would like to know if you be wondering if you would like to share the code

Mk.32
03-11-2011, 20:57
I believe none of the beta test are allowed to post code yet, since the code might change so they want to avoid confusion. They have a ND agreement.

Roger
04-11-2011, 10:51
If you notice, Jacob was tinkering back in August way before Dean's video announcement (http://www.youtube.com/watch?v=hlgA2nlXUF8) September 27th. Unless Jacob got some Alpha code...?

I wonder how they'll re-write the rules for <R02-D>? No lasers, except for what comes in the KOP? Will they insist on laser goggles? And now I want a robot with ALL those prohibited parts.

jacob9706
08-11-2011, 13:27
I had posted the code way back in February.... Sorry for just getting back on the forum. So much off season stuff going on with the team.

For all of you who don't read back in a post before asking for something here is the link again. I'm sure the code released by first is much more refined and just all around better written. I unfortunately did not get the chance to do alpha or beta testing for the next season. That's most likely because I'm part of the team 3574 which was a rookie team last year. (I am a student by the way, NOT a mentor)

http://www.2shared.com/file/pUNf4d89...abview_86.html

oh and the password is first's core value [gp]..... spell it out fellow FIRST members....

nyy132
11-01-2012, 07:02
Anybody know what the password for the download is?

engunneer
11-01-2012, 08:27
oh and the password is first's core value [gp]..... spell it out fellow FIRST members....

try it with and without the space

engunneer
11-01-2012, 14:10
gracious professionalism

TerminatrSlayer
11-01-2012, 16:12
Hate to rain on your parade, but I seem to remember that lasers are illegal on FRC robots :confused: (I don't *think* that the fact they are invisible matters)

This year the robots are using a kinect... so I don't think it is illegal anymore. Kinect as stated before, uses a "infrared light source".

come-at-me-bro
11-01-2012, 16:26
I would love to see a vidya of you demonstrating it.

autox_vette
11-01-2012, 16:26
This year the robots are using a kinect... so I don't think it is illegal anymore. Kinect as stated before, uses a "infrared light source".

Only reference I can find to laser is in [R8] example D which says that "Exposed lasers other than Class I" are examples of hazardous or unsafe materials (and the statement that any laser pointers used for alignment must be part of the robot [G2].

To me, this means that Class I lasers and laser pointers are allowed.

Kenton

Masonimal
11-01-2012, 17:12
Kinect uses depth to track objects that are in the way. The depth camera inside is used in adition to the skeletal tracker that traces the person standing in front of the camera. When programming the Kinect to you have to take into consideration that the skeletal tracker is used more than anything when you study the actions in the games that come with the Xbox. I play the Dance Central 2 game actively, along with Fruit Ninja Kinect. Both use the skeletal tracker to follow through with the requirements of the game. In Fruit Ninja, depth is used to trace an outline of the player and use that outline to place them into the game as a "shadow." The Kinect is a fun tool but it is also a very complex device that has seen several "hacks" used to innovate Microsofts new gadget. I am wondering how well the Kinect will be used into the robot, but at the same time, how will each team figure out how to make it work in the first place.