Why do the offical published match results have only the bare minimum amount of data?

[DanL]

FIRST graciously publishes all match results. This is useful data, but it is extremely limited; only the final results are published. The only way to get preliminary result data (scores before penalties or bonuses like hanging are tacked on) is through manual scouting. Honestly, though, not every team has an army of freshman they can park in the bleachers to manually record every match. I would argue FIRST should publish all of these raw numbers with the final match results -- besides making well-informed scouting more accessible by leveling the field for teams that don't have 30 freshmen to spare, there is an important educational benefit to making this data public....

FIRST has been publishing match results ever since I participated "back in the day." Now that I'm on the other side mentoring a team, a trend I've noticed over the last few years is that a lot of teams are relying more and more on this data for scouting purposes. And not just simple win/loss scouting -- a lot of teams are doing some pretty sophisticated mathematical analysis with these numbers.

I've seen some pretty cool college-level linear algebra analysis like Offensive Power Ratings / OPR (post, PDF), Defensive Power Ratings / DPR (post), and Calculated Contribution to Winning Margin / CCWM (PDF). There are tons of scouting calculators/databases people have made. Basically, the students are getting more and more excited about the math behind the numbers. Google would be proud of this new generation of statisticians (and by proud, I mean wanting-to-hire).

I ask this of FIRST: why not publish all the raw data? There is no technical excuse: you guys already add everything up after every match and display it on the jumbotron... it's probably all electronic anyways. If people have come up with cool statistics like OPR's, DPR's, and CCWM's using just final numbers, imagine what other interesting analysis people will come up with once they start incorporating pre-penalty scores and bonuses into their algorithms.

Check out this 3-minute TED talk by Arthur Benjamin. He talks how the US high school math curriculum is geared towards one this: calculus. Don't get me wrong, as an EECS grad I have seen the divine beauty of calculus. But Benjamin makes the point that most people (unfortunately) don't becomes EECS grads. Many people -- everyone from doctors judging the efficacy of the latest study so that they can practice evidence-based medicine to your average Joe just trying to understand the latest political poll -- would benefit far more from understanding what a standard deviation is than from understanding derivatives. If you need more convincing, pick up a copy of Ian Ayres' NYTimes-best-selling Super Crunchers or read anything about how Google went from two grad students to one of the most powerful companies on the planet in less than a decade (the Ayres book is a really easy read and I encourage everyone to pick it up -- it's basically an extended PopSci article on various fascinating statistical analysis applications).

So FIRST: why not give us more data? Throw it out there... put it in an accessible format like CSV or XML that encourages us to play with it. Why keep it locked up and have the larger teams force their army of freshmen to sit in the stands and manually transcribe all this data like a bunch of monks in the middle ages? You already have awards for engineering, art, and leadership excellence... why not add a new "Interesting Application of Statistical Analysis Award"? Is there any reason NOT to give us this data?

[chessking132]

I agree i would really like to see first publish more scores that they already track but just do not publish. Team 75 is a large team and we have an army in the stands recording data but i would still like to see more first data made available to us. This would open the door for a team to relay prepare a good strategy for events that are later in the season. I also think that it would be really interesting to see how people would analyze this data.

[Tom Bottiglieri]

www.twitter.com/frcfms

[Chris is me]

I'm tempted to say FIRST shouldn't publish this data so that people don't try to scout with only OPR at a regional, but really, there's no reason not to make pre penalty scores available. While we're at it, how about alliance selections as well?

[FIRSTgirl675]

Originally Posted by DanL

You already have awards for engineering, art, and leadership excellence... why not add a new "Interesting Application of Statistical Analysis Award"?

I like this idea. Part of robotics is using the mathematics that you learn in and out of the classroom in applied situations.

[StevenB]

Originally Posted by Tom Bottiglieri

www.twitter.com/frcfms

It looks like all of the data is there, so it's just a matter of writing a little script to grab the stuff from the twitter posts, parse and sort it, and spit out some nice spreadsheets. Has someone already done this?