OPR after Week Six Events

[Ed Law]

The OPR/CCWM numbers up to Week 6 events have been posted, please see

http://www.chiefdelphi.com/media/papers/2174

All events up to Week 5 are now included. If you find any error or have any questions, please let me know.

I will post this again after next week before the World Championship.

[Ether]

Of related interest:

Max Event OPR achieved by each of the 2,490 teams

Weeks 1-6 Twitter data spreadsheet

[DELurker]

Thanks Ed & Ether. 1370 used the OPR/CCWM spreadsheet this weekend with the auto-update feature and we got our first real solid scouting list going since the team was formed back in 2004. Of course, we then proceeded to lose our last two qualifying matches and become the third pick of the alliance we joined, but I'm not sure that I can completely lay the blame for this on either of you two or the spreadsheet.

Although I would like to...

[Steven Sigley]

Going by Max Event OPR is it safe to say that 624 is one of the best teams to not win a regional?

[Ed Law]

I found an error in the World Ranking tab. The number of teams that has played so far exceeded the total number of teams from last year. I thought I changed all the formulas but I guess I missed a few.

It is now version 6.1.

[TheMadCADer]

Originally Posted by Steven Sigley

Going by Max Event OPR is it safe to say that 624 is one of the best teams to not win a regional?

Absolutely, probably the best since 1477 won Razorback. Easily a top robot worldwide, but this year the #6 and #7 alliances were way stronger than usual (too strong?). Often there were more than 16 robots that could score well, but fewer than 24, so you'd get 3 decent scorers against two good scorers fairly often. This was particularly true at Lone Star.

It's ridiculous that they probably won't go to Championships. They could get lucky with the waitlist, but with Wildcards this year, it seems unlikely.

[Bongle]

Originally Posted by TheMadCADer

Absolutely, probably the best since 1477 won Razorback. Easily a top robot worldwide, but this year the #6 and #7 alliances were way stronger than usual (too strong?). Often there were more than 16 robots that could score well, but fewer than 24, so you'd get 3 decent scorers against two good scorers fairly often. This was particularly true at Lone Star.

It's ridiculous that they probably won't go to Championships. They could get lucky with the waitlist, but with Wildcards this year, it seems unlikely.

Although unfortunate for 624, it brings up an interesting question:
-What game was the most OPR-friendly? That is to ask: What year's game had the highest correlation between OPR and championship attendance?

You could probably ask the same thing (championship correlation level) for other neat parameters:
-Ranking after qualifications
-CCWM
-Auton OPR score (if we keep getting gifted with officially-recorded auton stats, this could get interesting over time, as it would provide a mathematical way to compare "how important autonomous was this year")

[Basel A]

Originally Posted by Bongle

Although unfortunate for 624, it brings up an interesting question:
-What game was the most OPR-friendly? That is to ask: What year's game had the highest correlation between OPR and championship attendance?

In which games is OPR the most accurate: Games where robot scoring is minimally interdependent. Some good factors would be a large supply of game pieces and very little defense. Also a linear relationship between robot tasks and robot scoring (like this year instead of 2011, when there were multipliers). I've heard from multiple reputable people that OPR was really good in 2008. From the numbers I've run for the past few years, it was terrible for 2009 and relatively good in 2010. It's quite good this year as well.

Not sure specifically about the correlation with Championship attendance, but I'd guess that there are too many confounding factors for the difference in those correlations to mean anything.

[karomata]

Thanks a lot for all your time and effort making these. Although my team chooses not to use OPRs and scouting data, I love using it for my own strategic endeavors.

[DELurker]

Our team has been looking at the OPR and CCWM data and we are coming away from it slightly confused. Hopefully, someone here (Ed? Ether?) can help me to understand it so that I can explain it to the rest of the team in a marginally coherent manner. Oh, wait ...

At TCNJ, we played an OK game and came away with a OPR of 22.3 and CCWM of 6.2 (both rounded to 1 decimal place via Excel). At Bridgewater, we played tremendously better (or so it felt) and our winning margin rose from 3.4 to 3.9 (+14.7%) and our average score rose from 19.6 to 24.1 (+23.0%), although our OPR dropped 0.5% (22.3 -> 22.2) and our CCWM went down 11 points to -5.0

If we're scoring better, more accurately, and more often while winning more matches, wouldn't our CCWM and OPR go up?

[Ether]

Originally Posted by DELurker

Our team has been looking at the OPR and CCWM data and we are coming away from it slightly confused. Hopefully, someone here (Ed? Ether?) can help me to understand it so that I can explain it to the rest of the team in a marginally coherent manner. Oh, wait ...

At TCNJ, we played an OK game and came away with a OPR of 22.3 and CCWM of 6.2 (both rounded to 1 decimal place via Excel). At Bridgewater, we played tremendously better (or so it felt) and our winning margin rose from 3.4 to 3.9 (+14.7%) and our average score rose from 19.6 to 24.1 (+23.0%), although our OPR dropped 0.5% (22.3 -> 22.2) and our CCWM went down 11 points to -5.0

If we're scoring better, more accurately, and more often while winning more matches, wouldn't our CCWM and OPR go up?

Assuming your team actually did score higher at Bridgewater that TCNJ, and all other things being equal, yes.

But what the OPR and CCWM is telling you is that there was some negative synergy (be it random or systemic) between your team and the other teams on the alliances you played with at Bridgewater, such that your alliance scores were a bit lower than would have been expected based on the other teams' performance on other alliances.

[Dragonking]

How do you download pictures to the database. I can't seem to figure it out.

[Chris Fultz]

Just as one data point on the accuracy of this modeling, our Crossroads OPR is calculated at 63.1. Our actual average scoring, based on scouting data, is 63.5.

This is a very accurate data system.

[Grim Tuesday]

Ed, Ether,


I was thinking about how to improve OPR and one of the biggest issues with it right now is that it does not take into account team improvement over the course of the event; it is an average.

In OPR we don't really want to do anything like throw out early data points as this would make everything less accurate overall.
So what if we weigh the later matches teams play more? To do this (and I'm sure there's an easier way) you could give them a multiplier on a scale of 1-2 with the increments being 1+(x/n), x being the current match they've played and n being the number of qualifications they will play. For example, for a teams 9th match out of 12 the multiplier would be 1 3/4, so that match counts into their OPR that much more than their earlier ones.

To do this with the current method of calculating OPR (and I don't know if this will make the matrices exponentially too complex) you just count the first match in a schedule of 12 12 times, the second match 13 times, and so on and so forth.

I'm probably overcomplicating it but it looks like it should be possible.

Just some thoughts.

[Ed Law]

Originally Posted by Dragonking

How do you download pictures to the database. I can't seem to figure it out.

You have to take your own pictures and rename the pictures to x.jpg where x is the team number.

If you don't have resources to take a picture of every robot, come to our pit tomorrow after lunch and I can give you a picture of every robot at MSC. You have to put the 64 pictures in the same directory as the scouting database.