Special thanks to Brian Smist from 229 for doing half the work. As always, this is done by hand, please bring up any corrections.
Points:
This uses the most recent NE proposal from their site.
Qual Win: 2 pts
Qual Tie: 1 pt
QF: 5 pts
SF: 10 pts
F: 20 pts
W: 30 pts
Awards: 5 (Except RCA, EI, RAS)
Also, despite NE saying they will count the top two events, I did the first
two events for everyone.
Rankings with NY teams from Capital District should Conference Model be adopted:
You know, there’s supposed to be a post by one of the NE folks who created a district points simulator so that you could play with all the values ::coughKylecough::…just haven’t seen it yet
Just so I can tell if I’m understanding this. The points were calculated as if the regionals in N.E. were district events. They would then determine invitation to the proposed district championship, viz. the top 80, right? NE District championship to be played “this” weekend from which 30 or so teams being invited to CMP in St. Louis. Have I got it right?
Now can we discuss why this points summary may, or may not, be slightly misleading? First, there is the number of events attended by many of the teams. That is, not enough opportunity for the one-event teams to get points for their Q-wins in this summary. A supposed advantage to the district model is that teams will get more matches played as a result. Perhaps the points for single regional event teams could be amplified a bit to reflect this. E.g., the scores from 9 Q-matches at CT regional might get a multiplier of 14/9ths to predict performance in two district events with 7 Q-matches each.
Second, the relative size of regionals to district events would change the dynamics of those competitions somewhat. Not sure about what the effect on points would be, but I’m sure it would be there.
Then there’s the even more nebulous effect of the possibility of 8 hours “out of bag” preceding 2-day district events. Is this a factor? At present, teams attending 2-day events get to schedule a sort of “virtual Thursday” by logging time with their robot out of its bag before the competition. Will we allow this in the NE District?
My only questions is does this factor in teams that only attended one even? If so was anything done to factor the fact that they attended one event?
While obviously this is a very rough sketch and many of the metrics in Districts won’t apply, I think it’s a great way to see how things would play out.
Right - the results are informative but not a good predictive model of the district.
The rankings above from this year’s Regionals primarily reflect whether a team attended 1 or 2+ Regionals, but under the district model every team would be guaranteed 2 events.
The other impacts come from having smaller events, which increase the expected points awarded in several ways:
increasing the number of qualification matches per team,
increasing the probability of being selected for eliminations (e.g. 24/34 rather than 24/65 for a big regional),
increasing the probability of winning an award, and
arguably diluting the strength of elimination alliances, hence increasing the variance
of expected elimination points
Assuming district events average 34 teams each (155 teams attending 2 of 9 events), and a relatively gentle schedule of 12 qualification matches, then the expected point total under the proposed model would be 39.9 for competition performance only. Award points would be additional.
The average from the table above is only 23.2 including awards.
Its great that this conversation is happening. Please continue it, BUT also realize that this is NOT the final point structure. You are giving us good feedback on your thoughts and expectations of what the advancement criteria should look like. Encourage others to take part on this thread. Several of us are monitoring it daily.
The final rounds of meetings are taking place now among the movers and shakers of FIRST in New England to finalize a LOT of things that need finalizing before we go into negotiations with FIRST HQ. And a LOT of the things we are talking about are exctly the things you all brought up in theTown Hall meetings of last fall. So you are having an impact. Keep it up.
If this is true I’d like to add my two cents to the discussion.
First, I’d have preferred to see the 5/2 awards system in place in FiM and MAR. Although the point difference is kind of splitting hairs, I think it matters when a bid to CMP is on the line.
Secondly, I’d like to see the DCMP count more than a district. Frankly, a 60-80 team DCMP is way harder than a 30 team district and teams should be rewarded as such. I think the best points system for CMP qualification would be your best (or two best) district events and 2 x DCMP.
And lastly, I really like the points system for eliminations, however I have two things I’d like to see:
I think the points should be bumped to 10/15/25/35 because NE does not award points for selection the same way that FiM and MAR do. This rewards teams for making eliminations more than it did before, but not quite as much
I think that the points should also be adjusted to be lower for the third robot on an alliance similarly to how selection points are distributed in FiM. Maybe the first two robots on an alliance get 10/15/25/35 while the third robot gets 5/10/20/30.
I was actually planning on doing this during this week. Thanks for saving me a few days of work!
It seems that only the teams attending two regionals have a legitimate chance of doing really well. There are teams ranked below my own who I know are better than us, but we’ve attended two regionals, giving us a major boost.
I agree with your idea that the points should be bumped up for eliminations to really help teams that earned their spot in the eliminations. But I disagree with your point on giving the third robot less points. The randomness of qualifications and the possibility of robots breaking sometimes leads to teams qualification score not matching the true power of their robot and therefore they should not be penalized for how they are picked.
I agree with tkell. A team that builds a support-based or defense based robot that is still phenomenal in what it is built to do (i.e. 4334 last year and 2789 this year) shouldn’t be penalized for pursuing a different strategy than the powerhouse offensive teams. Third picks often make or break alliances, especially at deeper events.
I agree with the logic on making the third pick worth just as many points. The serpentine in particular makes this problematic - I would hate to be the 8th seed and have to pull up on my phone which team “needs” the 1st round pick points more and which team doesn’t.
Thanks! It’s so hard to get love for defensive play…because of our limitations (personnel, funding, etc.) and sponsor issues, it’s hard for us to crank out the robots we design and want. We’re forced to compensate with scouting and strategy. I’ve been concerned about district discussions down here in Texas because of how formulas rate defensive teams, in particular because of how the dynamics for eliminations matches are very different than dynamics for quals matches, and our strategy definitely makes a bigger impact in elims. It’s my hope that at the end of the month we’ll be able to make the point that a creative and smart team can still make a strong impact on the outcome of matches even if you don’t have the fanciest robot on the field…but needless to say, we are working on a few surprises for champs that will help us put points on the board
I definitely do agree that the points for the 3rd robot should be adjusted… Primarily because that means that the 3rd robot on the winning alliance gets more points than any other alliance’s robots (including the first two robots on all of the other alliances). Additionally, this method of assigning points gives very few points to the quarterfinalist alliances.
Although I suspect these points were removed in NE’s proposal because it makes things a bit more complicated, I think assigning points based on alliance selection order as FiM and MAR do (16 to first 2 bots on Alliance 1; 15 to first 2 bots on Alliance 2; 14 to first 2 bots on Alliance 3… and 8 points to 3rd robot on Alliance 8, 7 points to 3rd robot on Alliance 7, 6 points to 3rd robot on Alliance 6) is the best way to assign points for eliminations (in addition to points based on finish).
Using 2013 GSR and 2013 Pine Tree as case studies (I chose these two because they’re Week 1 vs Week 6, vary significantly in size, and Pine Tree is interesting because the red alliance won each matchup):
GSR Pick Order & Results:
610-4124-3609… W
138-131-58… QF
230-1991-1153… SF
885-1519-133… SF
151-229-1277… QF
1512-1922-1517… QF
61-175-172… F
2791-3467-78… QF
GSR Points (based on current NE proposal)
30-30-30… W
5-5-5… QF
10-10-10… SF
10-10-10… SF
5-5-5… QF
5-5-5… QF
20-20-20… F
5-5-5… QF
GSR Points (NE proposal + alliance selection points)
46-46-31… W
20-20-7… QF
24-24-13… SF
23-23-14… SF
17-17-10… QF
16-16-11… QF
30-30-27… F
14-14-13… QF
Pine Tree Pick Order & Results:
2648-3467-2386… W
176-125-63… F
1153-172-1831… SF
69-133-4564… SF
4473-58-1058… QF
78-1073-1922… QF
3930-4055-157… QF
3609-1071-181… QF
Pine Tree Points (based on current NE proposal)
30-30-30… W
20-20-20… F
10-10-10… SF
10-10-10… SF
5-5-5… QF
5-5-5… QF
5-5-5… QF
5-5-5… QF
Pine Tree Points (NE proposal + alliance selection points)
46-46-31… W
35-35-22… F
24-24-13… SF
23-23-14… SF
17-17-10… QF
16-16-11… QF
15-15-12… QF
14-14-13… QF
Seems like the current NE Proposal has several weaknesses:
1st and 2nd robots of each alliance get same reward as 3rd robot.
Winners get 6x the points that the quarterfinalists get (3x the semifinalists).
1st and 2nd robots of finalist alliance (theoretically 3rd and 4th best teams) get 66% the points of the 3rd robot of the winning alliance (theoretically lower than 20th in ranking of teams).
These particular issues are improved with the inclusion of the alliance selection points. It’d be interesting to also add in the win-loss information… but I don’t really have the time for that right now.
The one thing I dislike about the FiM system assigning points based on Alliance Selection is that it gives points for essentially the same thing QF gives points for. The thing I do like is it is a good way to breakdown credit on an alliance.
A proposal I would support would be 8 ranking points for AC1 and First pick, and decreasing from there. This would give 3rd robots 0 extra points compared to the pack, but the difference between the last robot and the first is only 8 rather than 6. Then the NE Eliminations points could be bumped to 10/15/25/35 to make up for the point loss and emphasize results more.
Alliance Points:
8-8-0
7-7-0
6-6-0
5-5-0
4-4-0
3-3-0
2-2-0
1-1-0
Using BAE as an example: (10/15/25/35 + Alliance Points)
43-43-35… W
17-17-10… QF
21-21-15… SF
20-20-15… SF
14-14-10… QF
13-13-10… QF
27-27-25… F
11-11-10… QF