Chief Delphi

Chief Delphi (http://www.chiefdelphi.com/forums/index.php)
-   Scouting (http://www.chiefdelphi.com/forums/forumdisplay.php?f=36)
-   -   How does your team do scouting? (http://www.chiefdelphi.com/forums/showthread.php?t=104337)

dellagd 07-03-2012 16:56

How does your team do scouting?
 
This year my team has taken a big step forward. We now have six netbooks that we distribute to scouts in the stands with a scouting form on each one as an excel spreadsheet. The scouts create a new spreadsheet for each team, saving it as one workbook.

In total, we want it to run like this:
Scout make workbook of scouting form spreadsheets -> Upload to FTP server laptop -> Server takes separate excel workbooks and compiles all the spreadsheets in each workbook into one single workbook -> Server laptop runs a macro to give us our rankings

We still have a few hurdles to overcome before our next district competition though, as the netbooks we use are school property, and therefore do not allow you to run batch scripts to do the FTP ( :mad: ). Also, we do not have a way or auto-compiling multiple workbooks into one workbook at the moment.

Right now, were OK with having the scout manually run a program to upload the file to the FTP server, so thats not an issue.

Do you guys have any suggestions on how we could do these two things auto-magically?

Also, (and more importantly :) ) how does your team do scouting?

Ben Martin 07-03-2012 17:38

Re: How does your team do scouting?
 
I have a spreadsheet that compiles multiple workbooks into a master workbook:

http://www.chiefdelphi.com/media/papers/2646?

It's unprotected, and the code to do what you're requesting is in there.

dellagd 07-03-2012 20:21

Re: How does your team do scouting?
 
So Excel 2007 does not work with it?

smistthegreat 07-03-2012 20:48

Re: How does your team do scouting?
 
In the past, we've always had clipboards, 6 at a time, for scouting robots, with sheets being returned to a central data entering hub. This year, we were lucky enough to borrow 20 iPads from our school, so we wrote a scouting WebApp. If wifi is up in the arena, we upload data as soon as the match ends from the iPads to the database.

Randomness 07-03-2012 22:17

Re: How does your team do scouting?
 
We have 6 Nintendo DSs with custom programs. We then feed that data - I don't have the specifics on how - into excel, which is then analyzed by another program (which can do a lot of alliance selection stuff as well.)

Ben Martin 07-03-2012 23:46

Re: How does your team do scouting?
 
Quote:

Originally Posted by dellagd (Post 1140766)
So Excel 2007 does not work with it?

For the part you are working with, Excel 2007 will work. Excel 2010 is required for dealing with big matrices and OPR in the spreadsheet.

dellagd 08-03-2012 06:38

Re: How does your team do scouting?
 
Ah, ok. Thanks!

MooreteP 08-03-2012 07:01

Re: How does your team do scouting?
 
Our team is "old school".
We use a single sheet for each team.
With a photo of the Robot.
Each student follows one robot for a match.
We organize the sheets in an accordion folder. We use seven students.
One for each team in a match, and one who retrieves and passes out the sheets.

We gather on Friday night to share information and opinions. We especially begin discussing who we would pick as a #1 seed, and as a #8 seed.
We discuss "dark horses".
We rank teams according to our criteria.

Saturday proceeds and we stay in a group and adjust our list.

The use of iPads, Wifi, NetBooks, Excel, etc........ is a ruse, IMHO.
Much more effort than is needed, with the flawed assumption that quantitative is better than qualitative analysis.

The human brain is a more effective "computer".

Remember: There are three kinds of lies:
Lies,
Dam*n Lies, &
Statistics.

MysterE 08-03-2012 07:45

Re: How does your team do scouting?
 
Quote:

Originally Posted by MooreteP (Post 1140913)
Our team is "old school".
The use of iPads, Wifi, NetBooks, Excel, etc........ is a ruse, IMHO.
Much more effort than is needed, with the flawed assumption that quantitative is better than qualitative analysis.

The human brain is a more effective "computer".

Remember: There are three kinds of lies:
Lies,
Dam*n Lies, &
Statistics.

I would agree in part. Qualitative and quantitative analysis both have their places in scouting. It is easy to get caught up in the 'coolness' of a team when looking at it qualitatively. Likewise, it is easy to look at quantitative analysis and choose a robot that may be strong in the point arena but unable to work effectively with an elimination alliance.

We are using both methods. Our scouts will be using papers that ask them both for qualitative and quantitative data. Our data-entry person will be entering that information into a Microsoft Access DB. Before each match that we play, we will print up a sheet that provides all of the qualitative and quantitative commentary for our drivers to make the best decisions when it comes to working with our alliance and planning for the coopertition bridge.

Now, if I could get the Access DB to work on Ipads. . . .

Wizzard of Izz 08-03-2012 15:18

Re: How does your team do scouting?
 
Our first two years, we used qualitative scouting, then switched to a program for quantitative scouting. This year, we simply doubled our scouting team, and have room for both. The head scouts will mostly be entering match data into cowscout.com, and Myscout (http://www.chiefdelphi.com/forums/sh...hlight=myscout). You may want to look into these. Other scouts will focus on the qualitative analysis of the teams and their robots.

arbym 10-03-2012 14:10

Re: How does your team do scouting?
 
2 Attachment(s)
We subscribe to the "Moneyball" mentality. Lean toward all things numbers :) Collect EVERYTHING electronically then analyze analyze analyze... Here's a sample of heat map we can create.

logicbomb 12-03-2012 00:28

Re: How does your team do scouting?
 
Quote:

Originally Posted by MooreteP (Post 1140913)
Our team is "old school".
We use a single sheet for each team.
With a photo of the Robot.
Each student follows one robot for a match.
We organize the sheets in an accordion folder. We use seven students.
One for each team in a match, and one who retrieves and passes out the sheets.

We gather on Friday night to share information and opinions. We especially begin discussing who we would pick as a #1 seed, and as a #8 seed.
We discuss "dark horses".
We rank teams according to our criteria.

Saturday proceeds and we stay in a group and adjust our list.

The use of iPads, Wifi, NetBooks, Excel, etc........ is a ruse, IMHO.
Much more effort than is needed, with the flawed assumption that quantitative is better than qualitative analysis.

The human brain is a more effective "computer".

Remember: There are three kinds of lies:
Lies,
Dam*n Lies, &
Statistics.

hey my team also goes old school but mostly b/c we cant afford the good stuff. can i see your scouting sheets to see what you look for to see if i have missed anything on making ours and maybe i can even give you some ideas.

compuwiz12 13-03-2012 12:31

Re: How does your team do scouting?
 
We do scouting through a mobile (smartphone) optimized webpage. Eliminates wires and allows for quick viewing of results plus it's platform independent. It is completely quantitative.

junefish 01-04-2012 19:43

Re: How does your team do scouting?
 
In the past 294 has used a simple computer program (a field for team # and checkboxes for scoring & a few basic abilities) that uploaded to a text document unique to each computer. This was extremely difficult to compile, given that there was no way to automatically analyze the data or even to sort by team.
This year, one of our newest programmers created an HTML/PHP-based scouting app that automatically ranks teams based on scoring, defense, balancing, and match attendance (I think I'm missing a few variables . . . ). There are also several comment fields for qualitative analysis, although that's secondary. The picklist can be automatically generated, but at the Los Angeles regional we revised it based on the dossiers we had for each team.
Aside from some technical glitches :o it's worked pretty well, and hopefully in Spokane it'll be fairly smooth.

Good luck to all scouts :)

dellagd 01-04-2012 20:11

Re: How does your team do scouting?
 
He, this is cool

We have redone our scouting AGAIN since I made this thread!

We now use a Java application to upload to a server w/ all of the net books. All scouting rankings are instantly available and can be seen at any time through the competition, and can also be sorted by characteristics that we want.

DonRotolo 02-04-2012 21:51

Re: How does your team do scouting?
 
Quote:

Originally Posted by MooreteP (Post 1140913)
The use of iPads, Wifi, NetBooks, Excel, etc........ is a ruse, IMHO.
Much more effort than is needed, with the flawed assumption that quantitative is better than qualitative analysis

We use laptops feeding a custom database instead of paper, but otherwise we likely use very similar methods. I disagree that our method has any more effort than yours; indeed I believe that we exert far less effort to collect our data.

The only paper we ultimately generate is what the student takes on the field when selecting our alliance ;)

smistthegreat 02-04-2012 21:54

Re: How does your team do scouting?
 
Quote:

Originally Posted by DonRotolo (Post 1153232)
We use laptops feeding a custom database instead of paper, but otherwise we likely use very similar methods. I disagree that our method has any more effort than yours; indeed I believe that we exert far less effort to collect our data.

The only paper we ultimately generate is what the student takes on the field when selecting our alliance ;)

Same here, the iPads we use actually streamline everything a ton. Before, someone had to manually enter 1 sheet of paper per robot per match into our scouting database, and even with quick typists it was a tedious and error prone job. Now, as soon as the match ends, data enters the database immediately, where it can be viewed right away by scouts, drivers, and anyone else who might need it.

techhelpbb 02-04-2012 22:08

Re: How does your team do scouting?
 
If you look in the Google Play (Android) store you'll find a MORT scouting app. MORT's programmers wrote it and released it. They did a great job.

What we don't release (and I've been joking should come with a 'modest' fee) is PC application that collects data from that app and aggregates it.

That's how our team scouted this year.

We did port this to iOS but unfortunately there's a missing aspect of BlueTooth for the iPhone and considering the number of SQL databases and compatibility issues they didn't have time to write that sort of thing.

Alexa Stott 02-04-2012 22:09

Re: How does your team do scouting?
 
Quote:

Originally Posted by DonRotolo (Post 1153232)
We use laptops feeding a custom database instead of paper, but otherwise we likely use very similar methods. I disagree that our method has any more effort than yours; indeed I believe that we exert far less effort to collect our data.

The only paper we ultimately generate is what the student takes on the field when selecting our alliance ;)

This is very similar to what we do.

In the past, we have used custom-written programs to enter code. This year, we are simply using excel and a python script (written by Kristian Calhoun, who you may have seen around here on CD). We don't do anything really whacky with the data, it just helps us compile all the numbers into a format that's more easily readable. We don't have any sort of complex equations that tell us who the #1 robot is. It simply provides us with an easier way of pulling up a robot's overall stats for the event. We can view results by match or by team.

For example, if I wanted to see what 1676 did at Mt. Olive, I could get all that information in a few keystrokes. I could tell you how many balls they score in auto and teleop and if they balance on the bridges, etc. There are usually also people like me and Kristian who simply sit in the stands and watch matches and make observations. We take note on who we think is really standing out and use that to aid our decisions as well. We don't just use the numbers. We might notice that a really good robot did poorly in one match. In that case, we find the scout who was watching them and ask what happened so we know whether it's a serious problem (i.e. they made changes to their robot or code that affected their performance) or if it was just an off match for them (maybe they had connectivity issues or something).

We have done paper scouting and it's a bit, well, clumsy given the type of technology we have available to us now. Combine this with your observations and you can usually end up with pretty good results.

As for compiling a pick list, we make a list numbered 1-23 on Saturday/Friday night (Saturday for districts, Friday for other events). Usually the top 3-4 spots are easy picks. The rest is where we need to do a lot more legwork. This involves using our collected data, our observations, as well as match video. It's also good to have pictures of robots to jog your memory.

dellagd 02-04-2012 23:23

Re: How does your team do scouting?
 
Quote:

Originally Posted by Alexa Stott (Post 1153248)
This is very similar to what we do.

In the past, we have used custom-written programs to enter code. This year, we are simply using excel and a python script (written by Kristian Calhoun, who you may have seen around here on CD). We don't do anything really whacky with the data, it just helps us compile all the numbers into a format that's more easily readable. We don't have any sort of complex equations that tell us who the #1 robot is. It simply provides us with an easier way of pulling up a robot's overall stats for the event. We can view results by match or by team.

For example, if I wanted to see what 1676 did at Mt. Olive, I could get all that information in a few keystrokes. I could tell you how many balls they score in auto and teleop and if they balance on the bridges, etc. There are usually also people like me and Kristian who simply sit in the stands and watch matches and make observations. We take note on who we think is really standing out and use that to aid our decisions as well. We don't just use the numbers. We might notice that a really good robot did poorly in one match. In that case, we find the scout who was watching them and ask what happened so we know whether it's a serious problem (i.e. they made changes to their robot or code that affected their performance) or if it was just an off match for them (maybe they had connectivity issues or something).

We have done paper scouting and it's a bit, well, clumsy given the type of technology we have available to us now. Combine this with your observations and you can usually end up with pretty good results.

As for compiling a pick list, we make a list numbered 1-23 on Saturday/Friday night (Saturday for districts, Friday for other events). Usually the top 3-4 spots are easy picks. The rest is where we need to do a lot more legwork. This involves using our collected data, our observations, as well as match video. It's also good to have pictures of robots to jog your memory.

Sounds cool. We are having much the same thing. I'll try to "walk past you guys to my seat" at the MAR champs.

Kristian Calhoun 03-04-2012 23:08

Re: How does your team do scouting?
 
Quote:

Originally Posted by dellagd (Post 1153290)
Sounds cool. We are having much the same thing. I'll try to "walk past you guys to my seat" at the MAR champs.

Please do! Our head scout, Sue, and I would love to talk you about our scouting process and how it has evolved over the past couple of years. :)

zach1194 03-04-2012 23:21

Re: How does your team do scouting?
 
Team 1243 uses Team S.P.A.M.'s scouting data base. It works great and became a valuable asset during alliance selection and elimination.:cool:
http://www.chiefdelphi.com/forums/sh...d.php?t=102181

aldowyn 04-04-2012 09:27

Re: How does your team do scouting?
 
This year at OKC we went for a really organized method. Ignoring Thursday quantitatively, we went the pen & paper route (not enough laptops to go that way) and had 6 people, one for each team, recording points in each basket and in autonomous, attempted shots, balancing info, and extra notes for the qualitative aspect. After each match it was put into the master spreadsheet, which even had an algorithm to calculate our own personal ranking.

It showed us as 4th while our actual rank was 12th... so it valued scoring over bridge, especially the CP. 178 TP isn't anything to laugh at, but the 58 or so HP really hurt us.

Steve-Man 12-04-2012 02:34

Re: How does your team do scouting?
 
This year we handled scouting a little differently than we usually do. make some sort of sheet to fill out, print out a bunch of copies, get 6 clipboards, etc. Typical pen and paper stuff, but this year Team 1493 collaborated with Team 20 in a joint scouting venture. We had a rotation schedule, 3 people from 1493 and 3 people from 20 would scout ten matches, then 3 different people from both teams would switch in for the next ten matches. Otherwise, standard stuff as mentioned before, but...

Having two different teams scouting together seemed to help us catch things we'd normally miss. (More discussion of the match perhaps?) While the rotation basically kept us fresh and ready to scout. Not to say that Rebound Rumble isn't fun to watch, but watching one robot specifically on the field and trying to count how many seconds it took to balance on the bridge, or how many hybrid shots it took...a break really made all the difference. the sheet was pretty comprehensive and had room for other information it didn't cover.

Mongai 12-04-2012 13:28

Re: How does your team do scouting?
 
Wow, am I the only one who set up a MySQL server?

I got Debian on a flash drive and installed a MySQL server on it and used Microsoft Access as the front end. Each laptop had the same link information and they also had a query so they could see statistics for each team live as the day went on.

EDIT: Why not Excel? It makes me cringe because statistics is more of a pain than Access queries.

dellagd 12-04-2012 23:42

Re: How does your team do scouting?
 
well, VikingScout has really evolved in the last few days.

If you were at MAR champs, we were on the first level in one of the handicap accessible platforms that you go by right as you enter the stands (first level).

6 netbooks
1 server laptop
printer
100 feet of ethernet
8-port switch

complex to set up, but Oh so easy to scout with.

Working great!

junefish 14-04-2012 17:28

Re: How does your team do scouting?
 
Quote:

Originally Posted by Mongai (Post 1157289)
Wow, am I the only one who set up a MySQL server?

I know our scouting programmer set up an SQL database for automatic data compilation, but I'm not sure how it worked--I was on the collection end of the scouting data, not the programming end.


All times are GMT -5. The time now is 02:18.

Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi