paper: Relative Success of Championship Teams based on Qualification Method

[Ken Streeter]

Originally Posted by Basel A

Are you ready for a graph with way too many lines? The new summary has been uploaded.

I ... have broken out the Alliance positions of the Regional Winners ...

Wow, that is very interesting.

I had expected that the Regional Winners Captains / 1st-picks would be high-performing, but still below the District CMP teams.

What I had not expected was that the "Regional Winner 2nd-picks" would underperform RCA, EI, and basically every other category of robot other than the Rookie All-Stars.

However, when thinking about it, if the ranking system is doing a reasonably good job of sorting robots by robot capability and the draft is doing a reasonably good job of ordering the remaining teams, then the 2nd-picks of a regional winner are likely about the 17th to 24th best robots at the regional. At a 40-team regional, these are about the middle of the pack. Thinking of that in world-wide terms: there are about 2500 teams worldwide - the middle of the pack would be robots ranked about 1200-1300 worldwide. It really shouldn't be surprising that very few of these robots appear in the elimination rounds at CMP, as the CMP eliminations would be expected to be 96 of the best robots in the world.

[Basel A]

Updated these numbers. New chart.

A few notes:

I only used the first 24 teams in elims from each division. I'm not deriding the role that 4th teams played on alliance, it was just to keep the number consistent from year to year. I can't pick out who the 25th through 32nd teams would have been for 2004-2013, so I chose to leave them out for 2014.

There's a downward trend in the district teams' success rate. Possible explanations include the increase in qualifying teams from Michigan, the addition of the NE and PNW district systems, regression to the mean, and random year-to-year variations. I personally think it's mostly the last one. If there's interest, I could break out the different district systems' success rates, which could shed some light.

This was a historically bad year for Rookies at the Championship. Only two made it to elims, and they were not in the top 24. It was also bad for registered teams, none of whom made elims, but that can mostly be explained by the very small number of registered teams at the CMP this year (four).