Here is what percentage of teams were selected for the playoffs at the 2016 Championship, broken down by how they qualified. Teams were sorted based on how they first qualified, so if a team won Engineering Inspiration at their first event and the Chairman's Award at their second event they will be placed in the Engineering Inspiration category.
The number of teams in each group is:
34 Regional Winner 1st Pick
18 Hall of Fame
4 Last Year's Winner
35 Regional Winner Captain
5 Original & Sustaining
14 Wildcard 1st Pick
171 District Points
29 Wildcard Captain
4 Last Year's Engineering Inspiration
53 Chairman's Award
53 Engineering Inspiration
50 Regional Winner 2nd Pick
60 Waitlist
13 Wildcard 2nd Pick
54 Rookie All Star
1 Regional Winner Backup
2 Wildcard Backup
Discussion
20-08-2016 10:05
ATannahill
Re: pic: 2016 Championship Alliance Selection Rates by Qualification Type
Quote:
Originally Posted by AGPapa
|
Do these numbers include the alliance captain at the Championship or not? The first sentence implies that they are excluded.
20-08-2016 11:51
AGPapa
Re: pic: 2016 Championship Alliance Selection Rates by Qualification Type
Quote:
Originally Posted by rtfgnow
Do these numbers include the alliance captain at the Championship or not? The first sentence implies that they are excluded.
|
They include everyone who made it to the playoff rounds at the championship. The captain, 1st pick, 2nd pick and sub (even if the sub wasn't used).
21-08-2016 02:47
Brian Maher
Re: pic: 2016 Championship Alliance Selection Rates by Qualification Type
These are some really neat stats, thank you for sharing!
Question: did you pull your data from the FMS API or TBA, and how did you differentiate between waitlist and points teams in districts? As someone who uses the TBA API, I've found this to be problematic.
If it's not too much trouble, I'd love to see the breakdown by:
- level of playoffs reached
- captain / first / second / third picks
I think it could be interesting to compare with overall alliance selection rates.
21-08-2016 11:48
AGPapa
Re: pic: 2016 Championship Alliance Selection Rates by Qualification Type
Quote:
Originally Posted by BMSOTM
These are some really neat stats, thank you for sharing!
|
Thanks! I found it interesting that the 1st picks did better than the captains.
Quote:
|
Question: did you pull your data from the FMS API or TBA, and how did you differentiate between waitlist and points teams in districts? As someone who uses the TBA API, I've found this to be problematic.
|
I took the list of qualified district teams from
http://frc-districtrankings.usfirst.org/ and removed all of the teams that had otherwise qualified. Then I took the top X teams (where X is the number of points slots for that district) and called those the district points teams and everybody else was waitlist. There was a pretty clear cut off from when the points spots end. It's a pretty tedious process so I just uploaded the spreadsheet as a
whitepaper if you want to use if for something else.
Quote:
If it's not too much trouble, I'd love to see the breakdown by:- level of playoffs reached
- captain / first / second / third picks
I think it could be interesting to compare with overall alliance selection rates.
|
Here's a
chart showing where these teams were picked. Some of the group sizes were small and created a noisy graph, so I removed every group that had fewer than 10 teams in it.
23-08-2016 09:11
IKE
Re: pic: 2016 Championship Alliance Selection Rates by Qualification Type
Quote:
Originally Posted by AGPapa
Thanks! I found it interesting that the 1st picks did better than the captains.
...snip...
|
So, it makes sense if you look at the probability of the two roles. You can end up in the #1 spot as a decent, but not the top performing team. In fact you may be not even a top 10 team at an event.
That first pick is almost always the top or 2nd from the top (when top team is #1).
I know when doing the initial points proposal for FiM, being the "first pick" at an event had the highest correlation with being most competitive and/or most likely to win during a season.
What would be really interesting is to see this chart from 2009 through about 2012. The district Points section would have been extremely high correlation through that time period.
23-08-2016 09:37
Chris is me
Re: pic: 2016 Championship Alliance Selection Rates by Qualification Type
Quote:
Originally Posted by IKE
So, it makes sense if you look at the probability of the two roles. You can end up in the #1 spot as a decent, but not the top performing team. In fact you may be not even a top 10 team at an event.
That first pick is almost always the top or 2nd from the top (when top team is #1).
I know when doing the initial points proposal for FiM, being the "first pick" at an event had the highest correlation with being most competitive and/or most likely to win during a season.
What would be really interesting is to see this chart from 2009 through about 2012. The district Points section would have been extremely high correlation through that time period.
|
Another factor to consider is that this year, being an alliance captain required a slightly different skill set than being the consistently highest scoring team at the competition. Being able to guarantee breach and capture inflated the ranks of particular classes of robots, particularly highly mobile low goal scorers, so more of them were top seeds. This is in addition to the normal variance caused by strength of schedule, strategy, reliability, etc.
23-08-2016 09:45
Basel A
Re: pic: 2016 Championship Alliance Selection Rates by Qualification Type
Quote:
Originally Posted by Chris is me
Another factor to consider is that this year, being an alliance captain required a slightly different skill set than being the consistently highest scoring team at the competition. Being able to guarantee breach and capture inflated the ranks of particular classes of robots, particularly highly mobile low goal scorers, so more of them were top seeds. This is in addition to the normal variance caused by strength of schedule, strategy, reliability, etc.
|
As seeding has gotten more accurate over the years (largely because of more matches?), 1st picks have gotten less good compared to their captains. This effect you mention is probably the only reason they were better this year.
https://www.chiefdelphi.com/media/papers/2843
23-08-2016 09:48
Chris is me
Re: pic: 2016 Championship Alliance Selection Rates by Qualification Type
Quote:
Originally Posted by Basel A
As seeding has gotten more accurate over the years (largely because of more matches?), 1st picks have gotten less good compared to their captains. This effect you mention is probably the only reason they were better this year.
https://www.chiefdelphi.com/media/papers/2843
|
As long as even some teams are carried, this gap will always exist. Every first pick* by the top seed is one of the top 3 robots at the event; but not every alliance captain is. Maybe that is offset by non-carried captains who declined from a low seed and won the event, I dunno.
*2014 is an exception to all of this because picks were very role based.