Rookie scouting coordinator requesting input
 

I'm a rookie scouting coordinator for my team this year, and seeking input and/or some constructive criticism on my scouting system ive developed for this year. Attached are the sheets ive made for my team to do their scouting, both match and pit. My system involves randomly pairing up my team members with each other, then randomly assigning them teams that they have to fill out a pit scouting sheet for. Then that same pair of people will randomly be assigned certain matches that they have to scout during and a specific alliance station they have to scout for where they will fill out a match scouting sheet (attached below) based on the directions (match scouting sheet directions) The match assignment sheet i have attached should help to better show what i am trying to explain. any input would be very helpful, thanks

Re: Rookie scouting coordinator requesting input
 

the scout sheets look very nice and professional... one thing that i recommend is that you make the playfield diagram a little bigger... i was a scout for my team last year and i found using a small field diagram can be a little tricky... looks good though...

Re: Rookie scouting coordinator requesting input
 

thats what some of my team members told me as well, but ive stretched the field diagram as far as i can while still keeping it to one page

Re: Rookie scouting coordinator requesting input
 

Also on your match scoring sheet I would add a spot for match number. Looks like a great start so far!

Re: Rookie scouting coordinator requesting input
 

updated version of my match scouting sheet

Re: Rookie scouting coordinator requesting input
 

second one looks much better... good luck this year

Re: Rookie scouting coordinator requesting input
 

It like a great system depending on how many people you have to help you scout. Last year we had papers to fill out with a similar amount of information and we had to have quite a few people helping along with our scouting team to be able to fill it al out, so as long as you have enough people you should be fine. Nice job!

Re: Rookie scouting coordinator requesting input
 

For your Pit scouting I think you captured most of the relevant information except for Autonomous Period. If you added a section asking what Autonomous routines the team had that would round out your sheets.

The other issue I had with your Pit scouting sheet is the part where the team signs off on the sheet. What was your reasoning behind asking for that?

As for your match scouting sheet the information is extremely subjective. I have found in the past that if the scouting sheet is too subjective than you cannot determine a realistic account of what the robot can and cannot do.

What I would suggest is for the match scouting sheet come up with some more questions that ask for objective results (# Balls scored, # balls kicked, etc...)

Re: Rookie scouting coordinator requesting input
 

1. autonomus is not included on the pit scouting sheet because last year when i was working with the scouting team instead of leading it i found that we would get inaccurate descriptions (if any) for autonomus.

2. the signature is there in an attempt to crack down on people that slack off and do not do their pit scouting because last year the scouting team would hand out clip boards with blank forms and get them back with the same blank forms. At the worst, mentors from my team found clip boards with blank forms scattered around the arena.

Re: Rookie scouting coordinator requesting input
 

.pdf version of the scouting presentation i plan on giving to my team, any thoughts?

Re: Rookie scouting coordinator requesting input
 

Autonomous header is spelled wrong. Thought you ought to know.

Re: Rookie scouting coordinator requesting input
 

I agree what was said before with the subjectivity to your match scouting sheet. If you make it easy and just allow the scouters to just circle things like did the robot hang? yes/no. how many balls kicked? ___ how many balls scored? ___ any penalties? yes/no final score blue____ red____, etc.. This will give you better data for alliance selection and will make it easier and faster to filter through than, this robot moved forward in autonomous and then they moved around and kicked some balls and then they did this and then they did that then they tried to hang, overall I'd say this was a good robot.... numbers are better than peoples opinion and if you give a set place where the numbers will always be it will allow everything to be accumulated faster when you want stats on a team and stuff for matches and alliance selection

Re: Rookie scouting coordinator requesting input
 

thanks for the catch
thats what my original draft of the sheet was like, mentors from my team wanted it more open-ended for strategy purposes

Re: Rookie scouting coordinator requesting input
 

Maybe combine both then? Circles + numbers with room for explanation?

Re: Rookie scouting coordinator requesting input
 

there was something like that on the sheets last year, from my viewpoint working with the scouting team last year it did not work out very good

Re: Rookie scouting coordinator requesting input
 

Wildcat,

There is a way to test-drive both your match scouting process, and your analysis of the data you collect during the matches.

Use the 5th Gear simulator with live humans players and scouts to run a set of qual matches; and use your scouting methods as those matches unfold. Then use your analysis methods and see if you are happy with the result.

If the results look "off" you can review (using the replay feature) the pertinent matches to see if you can figure out why the scouts came up with inaccurate assessments, or to identify how to modify your metrics.

At the end you can decide if the scouting results identify the "best" potential allies for your team?

See this post (5th Gear Scouting-Aid Suggestion).

Also, by searching for the key words "5th Gear Scouting" you will find a couple of recent threads on the subject of scouting. At least one of them has formats and metrics you can compare to the ones you are planning to use.

Blake

Re: Rookie scouting coordinator requesting input
 

thanks for the info, it looks a lot simpler than what i originally had planned for a simulation... definitely gonna have to try this out

Re: Rookie scouting coordinator requesting input
 

Glad to hear it - Let us know what happens - by PM or in the forum

Re: Rookie scouting coordinator requesting input
 

In my 5 years of doing scouting, the two biggest items I have found useful are 1) how many points/game pieces each robot is worth and 2) pictures. An objective measure of driver ability is also useful (last year, how easily you got scored on was a limited measure of this). Last year, summing the average number of game pieces each team could score accurately predicted about 80% of the matches at the regionals we attended. This year, points may be used similarly (we'll see after week 1).

Re: Rookie scouting coordinator requesting input
 

I have to agree with this. I ran a scouting crew for 5 years (:ahh:, that scares even me!) and every year we got better.

As currently written, there's no way you'll be able to concisely summarize the information you have available. IMHO, what you need is numbers, and you don't need very many of them.

In my experience, the more information you ask for from scouts, the less you can trust it. In 2007 we asked for probably a dozen numbers per robot per match... and we ended up using only 2. The scouts didn't even report most of the other numbers, there was too much going on in the match. So in 2008 and 2009 we asked for way fewer numbers. In 2008 we asked for: # lines in auton, # of lines crossed in teleop, balls hurdled, balls placed. In 2009 we asked for: balls scored (approx), balls scored on robot (approx), and Empty Cells delivered. Ask for any more and the scouts won't get good numbers, and they'll get really mad at you really fast. :yikes:

That said, we also had a pair of experienced kids who kept subjective notes. It's important that you trust the judgement of the note keepers though, a parent you've just pulled in off the street probably won't be able to give you opinions you trust.

In pit scouting you've got a lot more room to play, but whatever you do, it needs to end up in an easy to digest format. And as others have said, pictures are really important. You've probably got that one kid who can keep all the robots at your event straight, but not everyone can do that.

PM me if you're interested, and I can see if I can hook you up with copies of our old stuff to look over. :cool:

Re: Rookie scouting coordinator requesting input
 

well i gave the presentation, got plenty of positive feedback on the powerpoint, 5th gear refused to work, and final update of match scouting sheet

Re: Rookie scouting coordinator requesting input
 

Have you maybe thought about going electronically?
I know I converted my team and now I make our teams scouting program. You know, save the trees!! Go Green!!

Re: Rookie scouting coordinator requesting input
 

Over the past few years, we've realized that the best information you can get from scouting is straight, qualitative numbers. Things like:

- How many balls scored
- How many balls passed into another zone
- How many shots/passes blocked

Gather those numbers for each zone (defense, midfield and offense). Then if you want to know the best defensive player out there, you look at the defense column - blocks + passes. For the midfield, look at the midfield column - blocks + scores + passes (or drop the passes if you want to pull back the offensive person to be a second midfielder). For offensive, look in the offensive column - scores.

Have good, objective numbers makes alliance picking extremely easy - and it makes selling yourself extremely easy too. It's hard to justify "well, our shots are more accurate than anyone else's" without numbers - being able to say "during our matches on Friday, we made 34/37 attempted shots on goal. We had the most attempted shots, and the highest success rate of anyone at the competition" will make your team look a lot better.

Re: Rookie scouting coordinator requesting input
 

I like the general path that you are going with.

I would have to reiterate the ideas of KISS, and simply asking them to right down the cold hard facts of what they see, and not try to interpret it. Lets face it, numbers do not lie, unless you twist them or put an interpretation behind them.

This is a link http://www.chiefdelphi.com/media/papers/2334? to our team's database. Being a former driver and coach, I can tell you that with information very similar to this, and knowing what each team is really capable of, you will be fine. We had a timeline of what we were to do and check every 15-20 sec during the match and change accordingly. Most of the time, we were right on from scouting (Thanks Steve - author of the database).

I was a scout my first 2 of 4 years on the team, and saw the reports go from labor intensive and lots of writing to something like this. The problem is, if the kids are writing the whole time, they are not watching the match and missing key events. I would recommend keeping it simple and looking at the numbers. The only thing left for interpretation usually is: Would we want them on our alliance?

Re: Rookie scouting coordinator requesting input
 

Can you give us more information about the problem? Our freeware installer has been giving some people a hard time, and another pernicious bug got tracked down this weekend; but many people have used it successfully. I'm disappointed that you had a problem you couldn't get past.

Blake

Re: Rookie scouting coordinator requesting input
 

i couldnt really tell much about why it wouldnt work, i since i found out about it a few days before presenting to my team, i wasn't really that concerned if it didnt work, just thought it wouldhave been a nice addition.

And to all who offered their input, thank you. after my first offical competition i think ive got the hang of it, aside from the near physical fights between my scouting team and the rest of the team everything went pretty good and has a positive outlook ahead

Re: Rookie scouting coordinator requesting input
 

I hope you meant quantitative. In any case, we did numbers last year, and it was a nightmare to collect it accurately. At Boilermaker, there was a 6 team scouting alliance in which each team contributed 3 people to scout a single team on the field. Not very efficient (I could have done a single team by myself).

This year because there is such a small spread, I'm only looking at a few basic numbers such as:
Success rate at elevation/suspension
Shooting % in autonomous
Time it mechanically takes to hang (once in place, mechanism deployment only)