|
|
|
![]() |
|
|||||||
|
||||||||
![]() |
| Thread Tools | Rate Thread | Display Modes |
|
#1
|
|||
|
|||
|
OPR vs Record at championship
One item that is amazing to me thus far is the discrepancy of OPR vs the record of the teams. At Michigan State Championship, it was a shoot out for most matches and OPR matched your ranking fairly well. So far from what I've seen, not so much so at St. Louis. But then again I am not there.
I can think of two reasons: 1) With 100 teams per division the field is not as deep as Michigan. 2) There are only 8 matches per team so the match difficulty is not equal. Or there is a lot left to the "luck of the draw" So my questions are: 1) do you agree with these observations? 2) is it that way every year because the issues are inherent to the way the system is set up? 3) Am I biased because I am in Michigan? ![]() |
|
#2
|
||||
|
||||
|
Re: OPR vs Record at championship
8 matches to sort 100 teams is a much coarser function than 12 matches drying 64.
|
|
#3
|
|||
|
|||
|
Re: OPR vs Record at championship
Well, several teams have stepped up their game since their last regional, so sometimes it's not "technically" a discrepancy, just problems getting fixed.
|
|
#4
|
||||
|
||||
|
Re: OPR vs Record at championship
How well does one metric poor at evaluating robot performance correlate to another metric poor at evaluating robot performance?
|
|
#5
|
||||
|
||||
|
Re: OPR vs Record at championship
Poorly?
|
|
#6
|
||||
|
||||
|
Re: OPR vs Record at championship
I forgot just how bad 8 matches is at sorting... add in the 40ish extra teams and its even worse... Smaller divisions are a must in the future.
For those who are way better at statistics than I am, would doubling the number of divisions, but halving the teams in each division result in better sorting? Same number of matches (more would be helpful) but a smaller group to sort... You could keep the same number of fields; heck there could be two "pools" per field and have the winners of the pool elims play each other to determine the field champion. The field champion would then represent the field on Einstein. Last edited by Ivan Malik : 27-04-2013 at 13:37. |
|
#7
|
||||
|
||||
|
Re: OPR vs Record at championship
The qualification ranking used in FRC is pretty poor. Even if you had some very good mathematical evaluation of robot performance (which in certain years, including this year, OPR is), it wouldn't correlate well because the standings are very often not a good evaluation of robot performance.
So really, there's a corollary to Lil Lavery's post: -A bad performance indicator (OPR in his opinion) doesn't correlate well with another bad performance indicator (standard qual rankings with 8 matches played) -Also, a good performance indicator (OPR in other's opinions) doesn't correlate well with a bad performance indicator. Given the definition of OPR: "the average number of points a robot's presence adds to its Alliance's score", the real question about OPR is not whether it predicts final standings, but rather whether it accurately predicts an upcoming match score given the input of matches played before. Last edited by Bongle : 27-04-2013 at 13:46. |
|
#8
|
||||
|
||||
|
Re: OPR vs Record at championship
Quote:
The answer: as you reduce the pool size, you reduce the chance of the objectively "best" robot actually winning the entire competition and increase the effect of luck - the best robot might have 4-5 mediocre robots in their pool to pick from, and so can't win the whole thing against an alliance of 3 medium robots from another pool. Put another way: the pool results would be very accurate (the best robot would tend to win all the time), but the overall results would be less accurate since the best robot might not have good robots to take to inter-pool play with it. The main way to make championships more "accurate" is to play more matches, which really comes down to field-hours: you either need more fields for the same hours, or to simply use the 4 fields you've got for longer hours in the days you've got. Or you need to use Einstein to play more matches. Last edited by Bongle : 27-04-2013 at 14:34. |
|
#9
|
|||||
|
|||||
|
Re: OPR vs Record at championship
IMHO, the 2013 ranking system is the least problematic ranking system ever devised by FIRST. Very straight forward, entirely based upon robot performance, no weirdness from coopertition or losing score.
The only way this system can be improved is with more matches. The more matches a team has, the better the odds are that luck will filter out and skill will filter in. |
|
#10
|
|||
|
|||
|
Re: OPR vs Record at championship
Quote:
When I was in the TBA chat, we talked about what I thought was a really cool idea: Have 6 divisions, with the same number of teams (I think there's room in the dome for 2 more fields, don't you?) That would dramatically increase the number of matches, and make for a more regional-like environment. But what do you do with the 6 division winners at Einstein, you ask? This was the really good idea someone suggested: have a round-robin to decide the 2 alliances for the finals. Yes, it would take more time - 13-15 matches before the Einstein finals, instead of 4-6. But if you cut down on the hour before Einstein and all the speeches, you could almost fit them without expanding the schedule at all... not to mention that, with the smaller divisions, you could start eliminations earlier. Any feedback? I think a round-robin would be really fun... |
|
#11
|
|||
|
|||
|
Re: OPR vs Record at championship
i think that if there is an OPR there should also be a DPR defensive power rating,
because like my team we were all most always playing defense and were put up against teams that we had a hard time playing defense against. So our ranking defiantly didn't show our potential. |
|
#12
|
||||
|
||||
|
Re: OPR vs Record at championship
Quote:
DPR = OPR - CCWM But it's not very useful, for reasons discussed elsewhere. [edit]fixed broken link[/edit] Last edited by Ether : 28-04-2013 at 16:41. Reason: fixed broken link |
|
#13
|
|||
|
|||
|
Re: OPR vs Record at championship
Quote:
thanks |
|
#14
|
||||
|
||||
|
Re: OPR vs Record at championship
Quote:
Of course, OPR can't predict exactly how many points you (or anyone else) will score in a given match. But in my experience, it does provide a fairly accurate way of predicting which alliance will win a given match. Why did champs seeding not correlate well to OPR? Because 8 matches is way too small of a statistical sample. |
|
#15
|
||||
|
||||
|
Re: OPR vs Record at championship
Quote:
OPR is becoming less reliable as teams in CMP divisions are coming in with pre-CMP match differences of up to 50. |
![]() |
| Thread Tools | |
| Display Modes | Rate This Thread |
|
|