|
|
|
![]() |
|
|||||||
|
||||||||
![]() |
|
|
Thread Tools |
Rating:
|
Display Modes |
|
|
|
#1
|
||||
|
||||
|
Re: Qualitative Scouting?
Qualitative information is 100% more useful than unused or misused quantitative information.
So many teams try to scout too many numbers. You have to be careful to not mis-record/under use/draw strange conclusions from this. Add me to the qualitative scout hype train. If given a choice between a qualitative and a quantitative system only for an average team, I would choose the qualitative 9 times out of 10. |
|
#2
|
|||
|
|||
|
Re: Qualitative Scouting?
In my experience heading up our team's scouting department, both qualitative and quantitative scouting can be VERY helpful, but you need to address the inevitable issues before the competition:
Generally speaking, the problem with qualitative information is that different scouts have different reactions on the same event, and some form of training/ rubric is extremely helpful, even 100% necessary if your scouts are, like ours, younger team members. If you go quantitative, you need to make sure that you can accurately interpret the data you get. If you don't attach any external meaning to a statistic you collect (shots, cycles, etc) it literally isn't a statistic any more, and looses its value as a result. Also, It's a good idea to add a "comments" area: some times, it's not obvious if action X should be counted in statistic Y, so allowing the individual scout to write it down is quite helpful. |
|
#3
|
||||
|
||||
|
Re: Qualitative Scouting?
Quote:
Remember, qualitative data is helpful alone, and so is quantitative data. However, when the two are combined efficiently and effectively, you can derive much more from the data than you could with either one alone. |
|
#4
|
||||
|
||||
|
Re: Qualitative Scouting?
As many people have said, both quantitative and qualitative (or as we call it on 910, objective and subjective) scouting are incredibly useful in different ways. Both have their strengths and their weaknesses. On 910, we do both but the jobs are handled by different people.
The objective/quantitative data is gathered via paper and pencil scouting on sheets mainly involving tally marks in boxes. These sheets contain a box for notes so that these scouts can record things they notice that are not accounted for on the sheet, but this is not their primary task. This is what the majority of scouts are doing at a competition. (Anywhere from 6 to 24 people depending on how many of our team members are able to attend competitions) The subjective/qualitative data is the responsibility of a much smaller group. These scouts use a legal pad to simply take notes on robot features, driving ability, general strategies, strengths, weaknesses, etc. These scouts earn their position, they take a test before our first competition and the head scouts and myself look over their answers and determine who will be given this position. We also factor in our observations regarding their abilities as an objective scout. In the past this group has been as small as two people but as our scouting system has become more refined and our team has grown we are lucky enough to have 6 subjective scouts this year, allowing them to each take a position (R1, R2, etc.) and focus on only one robot per match. While I am lucky enough to be working on a fairly large team, our overall system is able to be scaled to as few as 4 people if absolutely necessary. tl;dr In my experience both Qualitative and Quantitative scouting are important components of a successful scouting system. |
|
#5
|
||||
|
||||
|
I think I had a post about this last year, qualitative scouting can be good if it's detailed, and if scouters can properly recognize their own biases. If it's not detailed, like our team's qualitative notes last year... well... *war flashbacks of team captain standing at alliance selections for 10 minutes silent*
|
|
#6
|
|||
|
|||
|
2363 have done qualitative scouting since 2014, and it has resulted in a massive improvement in our ability to judge the quality of the rest of the teams at the competition. We had done the standard quantitative stuff for awhile, but the numbers gathered by quantitative methods are pretty much useless if presented without context, and qualitative scouting helps to confirm trends that are presented by the statistics.
Our system in 2014-15 involved 6 quantitative scouts on Kindle Fires, a coordinator who would manage the scouts and occasionally gather the tablets up to load them into a database, and 1-2 qualitative scouts (the strategy coordinator and someone else, usually) who would take notes on the teams currently playing in the match on index cards. |
|
#7
|
|||
|
|||
|
Re: Qualitative Scouting?
With a smaller field in CVR coming off a successful SD scouting endeavor we plan to fine tune our qualitative techniques and get it down to a science...love qualitative scouting. It works.. I was watching the eliminations going "yup there it is". Almost like you can predict how these teams play.
|
![]() |
| Thread Tools | |
| Display Modes | Rate This Thread |
|
|