Voice Activated commands

[Amber H.]

Okay, I had this crazy idea this morning while I was working on the book (about a group of fictitious FIRST team members).

I have this computer program that will take voice activated commands for word processing and will pretty much type whatever I say after given a certain command.

How off the wall or unrealistic would it be to program a bot to respond to a set of vocal commands through a headset instestead of a joystick (or whatever). This way the command chain from strategist, to driver, to control panel would be eliminated.
The strategist becomes the driver, eliminating the "crowding in the box" (Or the driver and strategist are one and the same).

[Ian W.]

i don't think this would be as good as a joystick. for one, with the current controls, if it's programmed good , you know when you push forward, it's going forward. but, with a voice control system, it might not work. it's quite loud on the field. so, while it's a cool idea, and does have practical applications in the real world, in FIRST i don't think it will work right.

[evulish]

And then someone runs by the box screaming "TURN OFF AND START SMOKING"

[Amber H.]

The program I have recognizes only the one voice it is trained to. Background noise and joke commands from some sideline prankster wouldn't make a difference.

[Elgin Clock]

Hehehehe, What about the robot talking to us??? We did that this year through our blind drive system. Our robot would send a signal back to the players station to a laptop and then to a set of headphones and it would tell us what zone we were in and what not.

Don't know if it would work that well the other way with all the noise that is involved in a competition. It would get mixed signals unless you locked the voice frequency onto one person's voice range.

[Amber H.]

Oh, I forgot to mention that the program can store "training" for a few other voices as well.
That would mean backup in case the driver got sick or lost his/her voice. They simply log into the program like logging onto a desktop on a shared computer.

Any other obstacles or suggestions from the peanut gallery? They would be very welcome.

[Jnadke]

1. Analyzing the waveforms of the human voice requires a lot of processing power (you are not going to be able to do this on a Stamp chip). It also requires a lot of research. You are not allowed to use computers in your control system, since they are not in the digikey catalog. Computers can only be used for feedback, as said in the Rule Book. This means you can't use your computer program to control the robot.

2. It will be rather unresponsive. Do you really want to have to shout out commands to your robot? Think of every thing a robot does during a match. Now imagine shouting every single movement out... from 'move forward' to 'stop' to 'grab goal' and 'rotate right/left', etc. Some manuevers are complex and need to be done back-to-back.

[Amber H.]

Thanks guys! That was a big help.
Considering the rule about not using your computer program to control the bot pretty much nixes it.

Too bad. Would've been fun.

Thanks for your help. I need to make at least the part in the book where FIRST is portrayed believable.

This forum has been probably the most fun I've had in my research for the book so far. Thanks again.

[Chris Nowak]

hehe...that would be so cool.

Unfortunately there would be no way to do it accurately enough that you could reasonably control it....unless you had it change speed with the pitch of your voice or something...but that would be mad crazy.

[Amber H.]

Originally posted by Chris Nowak
hehe...that would be so cool.

Unfortunately there would be no way to do it accurately enough that you could reasonably control it....unless you had it change speed with the pitch of your voice or something...but that would be mad crazy.

Well...mad crazy is what a couple of the characters are developing into after seeing some of the stuff on this forum site .

Jnadke is right though. It takes way to much power for the program to "learn the voice" Although simply transferring it after it has "learned" might be an option. I think that would still take too much processing power though, just for the translating capability. Then of course, there are the rules *sigh*

[Ian W.]

if you were really desperate you could make something that could be used in the offseason. get a computer with many (4) serial ports, along with the converter to the stamp serial ports (i believe they use a different type to cut down on signal interference), and develop some program that sends the right input out. it's doable, just not under FIRST's rules. so, if for your book, you want to have them do that in the offseason or something, it's possible to do. just need someone who has no life and a lot of money to make it work...

[Amber H.]

["You are not allowed to use computers in your control system, since they are not in the digikey catalog. Computers can only be used for feedback, as said in the Rule Book. This means you can't use your computer program to control the robot."

From Jnadke


Where exactly is this rule and wht number and heading is it under?

All I have found so far is:

"GM9 -During a match the robots may be operated only by the students and/or SOFTWARE running the onboard control system."

Pleas forgive my ignorance, but couldn't the on board computer handle this? or is it too small? What are it's capabilities for memory and processing? It seems to me that all it would have to do is recieve the signal from the station. Or is it not equipped for that.
I'd really like to know. It's been a long time since I've dealt with anything of this nature.

I feel so totally ignorant for this challenge.

[Amber H.]

Originally posted by Ian W.
if you were really desperate you could make something that could be used in the offseason. get a computer with many (4) serial ports, along with the converter to the stamp serial ports (i believe they use a different type to cut down on signal interference), and develop some program that sends the right input out. it's doable, just not under FIRST's rules. so, if for your book, you want to have them do that in the offseason or something, it's possible to do. just need someone who has no life and a lot of money to make it work...

Cool! Off season is a great idea!

Hmm. could make an interesting plot twist somewhere. Thanks!

(Oh man have I got a lot of work to do!) (stuff to learn etc.)

It's hard when you've been out of the loop for fifteen years. Any input you guys had to offer would be a great help.

[ChrisH]

Originally posted by Miss Tree
[Pleas forgive my ignorance, but couldn't the on board computer handle this? or is it too small? What are it's capabilities for memory and processing? It seems to me that all it would have to do is recieve the signal from the station. Or is it not equipped for that.
I'd really like to know. It's been a long time since I've dealt with anything of this nature.

I feel so totally ignorant for this challenge.

Just so it's only ignorance. Ignorance can be fixed, it's stupid that's forever.

To answer you question, the STAMP processor currently used is much to small and probably too slow to do any voice processing. That is why they suggested using an auxillary processor.

A related factor is the noise during competition. While your filter may be able to pick out a voice from random noise, can it do so out of noise that is many times louder than the desired signal? Or have you ever tried to outshout 1000s of people?

The best drive team we have had were brothers, they never had to talk on the field, the manipulator guy "just knew" what to do based on the drivers actions. They claimed it was the result of 1000s of hours of playing video games together.

Now a telepathic robot, that might work! Oh wait Azimov did that one already.

[Amber H.]

Well.....The filter worked over four very noisy children that I thought sounded like a thousand at the time, but that's just a matter of perspective. The noise would definitely be a major problem in addition to the other seemingly insurmountable challenges.

The brothers as a drive team sounds interesting. I already have pair of brothers in the character list. Perhaps I should put them in as the drive team with a similar relationship. Interesting duo with a dramatic flair. They almost crash their van in a chase scene toward the end (coming to the rescue of their coach) because one of them decides that there should be some kind of music going in the stereo to accompany what their doing. (like a sound track to a movie) They get into a fight over it and veer into oncoming traffic while they struggle over the tape.