Chief Delphi

Chief Delphi (http://www.chiefdelphi.com/forums/index.php)
-   General Forum (http://www.chiefdelphi.com/forums/forumdisplay.php?f=16)
-   -   OPR after Week Six Events (http://www.chiefdelphi.com/forums/showthread.php?t=115849)

efoote868 11-04-2013 02:33

Re: OPR after Week Six Events
 
Quote:

Originally Posted by Chris Fultz (Post 1260272)
Just as one data point on the accuracy of this modeling, our Crossroads OPR is calculated at 63.1. Our actual average scoring, based on scouting data, is 63.5.

OPR is snubbing you! :p

hiyou102 11-04-2013 11:22

Re: OPR after Week Six Events
 
I wonder if it would reasonable to assume that the top ~100 will make it to elims at worlds. Of course the are holes in this theory, but I would like to see how accurate this can be as a model of prediction.

MrForbes 11-04-2013 11:36

Re: OPR after Week Six Events
 
Quote:

Originally Posted by Ed Law (Post 1260328)
If you don't have resources to take a picture of every robot

I've found that the best way to get pictures of every robot, is to get to the venue early on Friday morning, and try to be one of the first people into the pits.

(this for normal regionals, not sure how it would work at a district or championship event)

Banderoonies 11-04-2013 11:39

Re: OPR after Week Six Events
 
YOu can also download pictures of most robots from the 2013 FRC tracker app. It will send you an email with all the robot pics available. I have about 200 pictures of robots attending champs

MikeE 11-04-2013 13:03

Re: OPR after Week Six Events
 
Quote:

Originally Posted by Grim Tuesday (Post 1260323)
Ed, Ether,


I was thinking about how to improve OPR and one of the biggest issues with it right now is that it does not take into account team improvement over the course of the event; it is an average.

In OPR we don't really want to do anything like throw out early data points as this would make everything less accurate overall.
So what if we weigh the later matches teams play more? To do this (and I'm sure there's an easier way) you could give them a multiplier on a scale of 1-2 with the increments being 1+(x/n), x being the current match they've played and n being the number of qualifications they will play. For example, for a teams 9th match out of 12 the multiplier would be 1 3/4, so that match counts into their OPR that much more than their earlier ones.

To do this with the current method of calculating OPR (and I don't know if this will make the matrices exponentially too complex) you just count the first match in a schedule of 12 12 times, the second match 13 times, and so on and so forth.

I'm probably overcomplicating it but it looks like it should be possible.

Just some thoughts.

OPR (and CCWM) use the very simple underlying model that each team's performance can be approximated as a single constant parameter. This makes the math fairly easy so we can use matrix inversion (or your favorite decomposition method) to find the optimal solution to the regression.

But we can extend the underlying model to almost any function and use more general optimization methods to find a solution 1.
In particular we can use a linear function (a*m+b) rather than just a constant for the underlying model of each team's score, so each team is characterized by 2 parameters rather than 1. In this linear model the parameter b is similar to OPR and a is a measure of how much better or worse a team gets each match.

I tried this last year for a couple of regionals and while it matched the results better (smaller residuals as expected) it was no better at predicting unseen matches. If time allows I'll redo the analysis for the 2013 game which is OPR friendly.

More importantly for scouting, having 2 parameters per team also makes it harder to rank them! Is a team where the model predicts 20 points every match (a=0;b=20) better or worse than a team where the model predicts 15 points initially but improving a point each match (a=1;b=15)?
I'll leave the ranking question to wiser minds.

1 Note that more complex functions may produce solutions which are not guaranteed to be optimal

Ed Law 12-04-2013 21:39

Re: OPR after Week Six Events
 
It was brought to my attention today that the macro to automatically update OPR and CCWM for MSC and MAR Championship do not work. For people at MSC, I was able to help them set it up there. For people at MAR Championship, sorry about the inconvenience. I did not set up the link at the beginning of the season because these two events do not have any teams registered at that time. I guess I forgot to do it when I published the spreadsheet after Week 6 events. You can download the new version 6.2spreadsheet at http://www.chiefdelphi.com/media/papers/2174.

Basel A 12-04-2013 21:52

Re: OPR after Week Six Events
 
Quote:

Originally Posted by Ed Law (Post 1261163)
It was brought to my attention today that the macro to automatically update OPR and CCWM for MSC and MAR Championship do not work. For people at MSC, I was able to help them set it up there. For people at MAR Championship, sorry about the inconvenience. I did not set up the link at the beginning of the season because these two events do not have any teams registered at that time. I guess I forgot to do it when I published the spreadsheet after Week 6 events. You can download the new version 6.2spreadsheet at http://www.chiefdelphi.com/media/papers/2174.

I meant to PM you about it when I noticed earlier this week, but it totally slipped my mind after I just set it up myself.. You also have problems with BAE (place where rankings query should be is instead qual match query) and Week 1 in general (not at all your fault; before FIRST switched away from using CP).

Ed Law 12-04-2013 21:57

Re: OPR after Week Six Events
 
Quote:

Originally Posted by Basel A (Post 1261169)
I meant to PM you about it when I noticed earlier this week, but it totally slipped my mind after I just set it up myself.. You also have problems with BAE (place where rankings query should be is instead qual match query) and Week 1 in general (not at all your fault; before FIRST switched away from using CP).

Unfortunately not everybody knows how to set it up. One of these days when I have time, I will put a detailed instructions how to do it in the spreadsheet in the Instruction tab. It is fairly simple once somebody shows you.


All times are GMT -5. The time now is 04:52.

Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi