Chief Delphi

Chief Delphi (http://www.chiefdelphi.com/forums/index.php)
-   Scouting (http://www.chiefdelphi.com/forums/forumdisplay.php?f=36)
-   -   Team 180 2014 Poor Man's Scouting System (http://www.chiefdelphi.com/forums/showthread.php?t=126603)

Warren Boudreau 16-02-2014 19:55

Team 180 2014 Poor Man's Scouting System
 
I have posted files for Team SPAM's 2014 Poor Man's Scouting System.

The files can be found here: http://www.chiefdelphi.com/media/papers/2943?

The DOC file is for Thursday scouting and is optional.

The Data Collection Sheet is available as a PDF files, if you do not want to make any changes, and as a MS Publisher files, if you do,

The Excel spreadsheet is the heart of the system. You are allowed to make whatever changes you want to the file.

Questions, suggestions, and comments are appreciated.

The spreadsheet and Thursday scouting files may be delayed in posting. But don't worry, they will be there soon. I hope.....

BEN35678 16-02-2014 20:45

Re: Team 180 2014 Poor Man's Scouting System
 
I don't see the excel file in the papers can you please upload it.

D.Allred 16-02-2014 23:48

Re: Team 180 2014 Poor Man's Scouting System
 
Warren,
Thanks for posting your sheets. I'm using your effective score method this year. I think it will be a great fit for this game.

What values are going to set for aquire, pass, and catch? I was thinking about 10 for acquire and 15 for catch.

Also, have you considered counting cycles? In my opinion, average contribution to a cycle plus pace of play have been overlooked by most scouting systems this year.

David

Warren Boudreau 17-02-2014 07:35

Re: Team 180 2014 Poor Man's Scouting System
 
First, BEN35678 the spreadsheet is delayed in being posted by CD. I put in a request last night. It is in the works.

Second, D.Allred you will be able to find the values that we baselined for each item in the Effective Score equations in the ESCoefs tab of the spreadsheet, when it gets posted.

We talked about counting cycles, but cycles are alliance dependent, not individual robot dependent. We rely on our "super-scouts" to gather subjective data on teams, such as do they take a long time to pick up a ball.

MysterE 18-02-2014 10:42

Re: Team 180 2014 Poor Man's Scouting System
 
Quote:

Originally Posted by Warren Boudreau (Post 1344362)
First, BEN35678 the spreadsheet is delayed in being posted by CD. I put in a request last night. It is in the works.

Second, D.Allred you will be able to find the values that we baselined for each item in the Effective Score equations in the ESCoefs tab of the spreadsheet, when it gets posted.

We talked about counting cycles, but cycles are alliance dependent, not individual robot dependent. We rely on our "super-scouts" to gather subjective data on teams, such as do they take a long time to pick up a ball.

Hmmm - "Super Scouts" sound like an interesting idea. Can you describe more about how you use these? Oh - and BTW - Team 3337 graciously accepts your invitation to use your scouting program. It completely lowered the stress level for our Scouting Captain - who is also a Chairman's Award presenter :-)

Max Boord 18-02-2014 11:14

Re: Team 180 2014 Poor Man's Scouting System
 
Thanks! 1523 has a minor problem where we don't have any returning members the stands and this will help us hugely. O and thanks to mecanum phobia we are alliance captains allot.

George1902 18-02-2014 11:49

Re: Team 180 2014 Poor Man's Scouting System
 
Quote:

Originally Posted by MysterE (Post 1345185)
Hmmm - "Super Scouts" sound like an interesting idea. Can you describe more about how you use these?

Our strategy team is structured in a hierarchy. All SPAM members at the event (minus the drive team and pit crew) work in data collection. Our actual strategy team members act as shift managers. We sprinkle them into the shift rotations so there's always an expert on hand to answer questions and for quality control. Our strategy team leaders are our super-scouts. They look at the data, draw conclusions, and then research why those things are true.

For example, our super-scouts might notice a team has a particularly high standard deviation of their effective score. They would then do more research to find out why that is the case. Is their effective score trending upward because they've been adding functionality to their robot? Was there a dip in their middle matches because something broke? Has it been fixed?

Most teams do a good job of collecting useful data. It's the sort of problem that can be solved with sufficient manpower. What will set you apart is analyzing that data, drawing useful conclusions.

[edit]Does it normally take 2 days for a file to be approved? I can see about hosting the spreadsheet somewhere else if it takes too much longer...[/edit]

Warren Boudreau 19-02-2014 09:39

Re: Team 180 2014 Poor Man's Scouting System
 
Hi All,

The spreadsheet and Thursday scouting files are posted out in the whitepaper.

Thank you Brandon, for figuring out what how to do it.

These two files are zipped, so you will have to unzip them after downloading.

Sorry for the extra step, maybe this will finally force me to step up to Office 2010. :mad:

Enjoy, and I hope you all survived the bag-and-tag night.

Warren Boudreau 21-02-2014 14:34

Re: Team 180 2014 Poor Man's Scouting System
 
I've updated the Scouting Database spreadsheet. I found a hack in the Standard Deviation equation. If you have already downloaded a copy and do not wish to re-download, be sure to fix the equation. PM me and I can show you how.

Gary Dillard 21-02-2014 15:58

Re: Team 180 2014 Poor Man's Scouting System
 
Thanks man, I've been waiting for this to show up so I can once again shamelessly steal it and use it.

Lil' Lavery 21-02-2014 16:02

Re: Team 180 2014 Poor Man's Scouting System
 
Will entering a value other than 0 or 1 in the "Ball Preloaded" category cause any issues with the spreadsheet? I'm hoping to fully track teams with multi-ball autonomous modes, including the shots they miss.

Warren Boudreau 21-02-2014 16:07

Re: Team 180 2014 Poor Man's Scouting System
 
The ball pre-load has no input limit, and we only track sums and averages for that piece of data.

However, it might mess up the effective score equation.

Look carefully at the coefficients and make sure that you are not double bookkeeping something.

XaulZan11 21-02-2014 16:17

Re: Team 180 2014 Poor Man's Scouting System
 
Quote:

Originally Posted by George1902 (Post 1345235)
Our strategy team is structured in a hierarchy. All SPAM members at the event (minus the drive team and pit crew) work in data collection. Our actual strategy team members act as shift managers. We sprinkle them into the shift rotations so there's always an expert on hand to answer questions and for quality control. Our strategy team leaders are our super-scouts. They look at the data, draw conclusions, and then research why those things are true.

For example, our super-scouts might notice a team has a particularly high standard deviation of their effective score. They would then do more research to find out why that is the case. Is their effective score trending upward because they've been adding functionality to their robot? Was there a dip in their middle matches because something broke? Has it been fixed?

Most teams do a good job of collecting useful data. It's the sort of problem that can be solved with sufficient manpower. What will set you apart is analyzing that data, drawing useful conclusions.

We're also implementing a similar 'Super Scout' system for our strategy team after testing it out last year at IRI. Over the years our students have done a great job collecting data, but when it comes down to actually talking about the teams during pre-match strategy planning and pick list meetings, they have struggled to remember much about the teams other than the data and the few comments on the scouting sheet. So, our strategy team will serve as Super Scouts and will be responsible for 10-20 teams at the event and record qualitive information (how quick is their pickup, how is their passing, where do they shoot from, where do they fit in an alliance...). The rest of the team (other than driveteam, core pit crew and chairmans) will serve as regular scouts and take shifts recording data. I think this system will give the students more owernship of our scouting/strategy while providing some accountability and better results.

ItalianMan 23-02-2014 22:12

Re: Team 180 2014 Poor Man's Scouting System
 
First off, I appreciate your team posting these every year, I used the system last year and it works great!

Why are some of the coefficients negative in when calculating things like a Low Goal Score?

Warren Boudreau 24-02-2014 16:35

Re: Team 180 2014 Poor Man's Scouting System
 
The Low Goal Score coefficient is -2 to offset the +3 coefficient for acquiring a ball. You will notice that the High Goal coefficient is 7 instead of 10.

It just helps balance the books.

These coefficients were established as a result of a considerable amount of discussion among the scouting and strategy crew.

Feel free to modify these coefficients in whatever way you want. That is why we set it up this way.

Whatever your scouting and strategy team think is the right way to evaluate a single robots contribution to a match is what you should use.


All times are GMT -5. The time now is 16:52.

Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi