Re: Is OPR an accurate measurement system?
 

Would you like to learn? I can post some links to discussion threads here on CD that are written at an accessible level.

... and if you have any questions I -- and others I'm sure -- would be glad to answer them.

Re: Is OPR an accurate measurement system?
 

To get the right answer, you first have to ask the right question ....

And

"... all models are wrong, but some are useful."

George Box

OPR is what is it is; and the OPR equations compute OPRs 100% accurately.

You need to ask/determine whether OPR is a useful tool for your purpose (or ask what things OPR is useful for).

I personally think that Chairman's Award submissions are a better (but still imperfect) tool to use than OPR is, if I'm (quoting the OP) searching for "... the best teams in FRC." ;)

Blake

Re: Is OPR an accurate measurement system?
 

Some teams have systems where scouters track irregularities like broken robots/ penalties and include that data in the OPR calculations to make the calculation more accurately reflect the performance of robots.

Re: Is OPR an accurate measurement system?
 

This. Too many people bash on OPR, and not enough people bash on the rankings.

Re: Is OPR an accurate measurement system?
 

Is anyone actually going to be computing component OPRs this year? I believe Ed Law is not doing that this year, so I need to find a new master scouting database to reference.

Re: Is OPR an accurate measurement system?
 

With the data that FIRST provides through the FRC Event API, we can certainly do much better than your typical OPR. For example, I can pull down that data and know exactly which defenses were on the field and which of those were crossed and damaged in every match any team played in. I can know exactly how many balls were scored in which goals, how many robots challenged, and how many robots climbed. Proper statistical analysis (think OPR, but for each individual category instead of just overall score) can get you much more detailed and specific data. It won't be the whole story, but I would be willing to bet it would be more accurate than just the overall OPR. And more useful in assembling an eliminations alliance with the capabilities you want.

Re: Is OPR an accurate measurement system?
 

Taking Northern Lights as an example the first robot that was picked had the Highest OPR, but was ranked 16th.

While 5232 helped their alliance win and probably was a good bargain for when they were picked, it appears that most teams at the event didn't think they were a top 15 team, otherwise they would have been picked sooner.

Re: Is OPR an accurate measurement system?
 

But they probably had the best challenge we will see all year in the double DECCer :). That was insane

Re: Is OPR an accurate measurement system?
 

OPR is no worse or no better than how they rank teams in sports.
Any given Saturday or Sunday?
NCAA March Madness tournament? 5 vs. 12 seeds? etc...

Re: Is OPR an accurate measurement system?
 

Because no ranking system is perfect, and people (usually) don't go around praising rankings like they are the god of all numbers.

People do that with OPR

Re: Is OPR an accurate measurement system?
 

If you're actually scouting matches, you have basically no use for OPR. Actual objective data will beat it every time.

Re: Is OPR an accurate measurement system?
 

My favorite statement on OPR will always be this comment from Karthik's 2012 Effective FIRST Strategies presentation.

Take OPR with a couple grains of salt and understand, within that year's game, why it might not be accurate. (Scroll back to ~50min in that video if you want to hear the whole spiel. Better yet, watch the whole thing.)

Re: Is OPR an accurate measurement system?
 

Or you could just go directly to 57:44 :rolleyes: .

Re: Is OPR an accurate measurement system?
 

Its easy for a single scout to track dead robots or any other measure throughout a competition and apply it into an OPR calculator. While this isn't as good as having experienced scouts watching every match some teams might not have enough experienced students to scout every match.

I have found that actual objective data collected and used by our students to make decisions sometimes yields what some would consider questionable decisions.

Sometimes teams don't know what data should be collected or overlook a key feature of the game. OPR can help account for a team's contribution even if they aren't the robot actually scoring the points or they do something significant that isn't accounted for in the collected data.

Re: Is OPR an accurate measurement system?
 

This comes up pretty much every year, the best answer is "it's okay", but the most important part is to understand how it's derived which Jared explained very well. If you understand what it actually means then it's a very useful tool.