Go to Post SWARF is evil! - Al Skierkiewicz [more]
Home
Go Back   Chief Delphi > Competition > Rules/Strategy > Scouting
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
Thread Tools Rate Thread Display Modes
  #16   Spotlight this post!  
Unread 16-04-2016, 16:46
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,101
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: Quick OPR Question

Quote:
Originally Posted by Ether View Post
There are at least three ways you could deal with this...
Eugene Fang and I have been PM'ing about this. He came up with a clever and very effective method. See his discussion here.


Reply With Quote
  #17   Spotlight this post!  
Unread 17-04-2016, 09:45
Ed Law's Avatar
Ed Law Ed Law is offline
Registered User
no team (formerly with 2834)
 
Join Date: Apr 2008
Rookie Year: 2009
Location: Foster City, CA, USA
Posts: 752
Ed Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond repute
Re: Quick OPR Question

Quote:
Originally Posted by Ether View Post
Eugene Fang and I have been PM'ing about this. He came up with a clever and very effective method. See his discussion here.


The method looks good but I am not sure if it is necessary. Here is my position on how to use OPR. Current event OPR should not be used until you have at least 4 or 5 matches depending on number of teams. Before that, I use max OPR from prior events. So in a way, it is similar to what Eugene Fang did. The match "prediction" using OPR is just a check. Since you are at the event, you should always use scouted data instead of OPR.
The work Eugene Fang did was great in showing how long it takes to converge.
__________________
Please don't call me Mr. Ed, I am not a talking horse.
Reply With Quote
  #18   Spotlight this post!  
Unread 17-04-2016, 10:06
Caleb Sykes's Avatar
Caleb Sykes Caleb Sykes is offline
Registered User
FRC #4536 (MinuteBots)
Team Role: Mentor
 
Join Date: Feb 2011
Rookie Year: 2009
Location: St. Paul, Minnesota
Posts: 1,059
Caleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond repute
Re: Quick OPR Question

Quote:
Originally Posted by Ether View Post
Eugene Fang and I have been PM'ing about this. He came up with a clever and very effective method. See his discussion here.


Are the xOPR and ixOPR calculations only possible if every attending team has competed at least once? If so, that severely limits the usefulness of this effort, because this criterion is not met for a large majority of events.
Reply With Quote
  #19   Spotlight this post!  
Unread 17-04-2016, 10:45
Caleb Sykes's Avatar
Caleb Sykes Caleb Sykes is offline
Registered User
FRC #4536 (MinuteBots)
Team Role: Mentor
 
Join Date: Feb 2011
Rookie Year: 2009
Location: St. Paul, Minnesota
Posts: 1,059
Caleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond repute
Re: Quick OPR Question

Quote:
Originally Posted by Caleb Sykes View Post
Are the xOPR and ixOPR calculations only possible if every attending team has competed at least once? If so, that severely limits the usefulness of this effort, because this criterion is not met for a large majority of events.
Obviously xOPR and ixOPR are possible without this constraint, since Eugene posted convergence graphs for Palmetto. What is the "other source for OPR initialization" that is used for cases like this?
Reply With Quote
  #20   Spotlight this post!  
Unread 17-04-2016, 11:12
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,101
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: Quick OPR Question

Quote:
Originally Posted by Caleb Sykes View Post
Obviously xOPR and ixOPR are possible without this constraint, since Eugene posted convergence graphs for Palmetto. What is the "other source for OPR initialization" that is used for cases like this?
I don't know what Eugene used.

I haven't done any numerical experiments yet to confirm this, but if there is no prior OPR value for a given team at an event, I think you can just pick a reasonable number to seed the calculation, and let the 2x iteration take care of things from there.


Reply With Quote
  #21   Spotlight this post!  
Unread 17-04-2016, 11:24
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,101
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: Quick OPR Question


Here is the basis/motivation for the ixOPR algorithm. Note how many matches must be played before the OPR stabilizes.
Attached Thumbnails
Click image for larger version

Name:	MICMP.png
Views:	85
Size:	50.8 KB
ID:	20617  Click image for larger version

Name:	GACMP.png
Views:	66
Size:	29.8 KB
ID:	20618  Click image for larger version

Name:	NECMP.png
Views:	65
Size:	82.0 KB
ID:	20619  Click image for larger version

Name:	INCMP.png
Views:	68
Size:	47.1 KB
ID:	20620  Click image for larger version

Name:	MRCMP.png
Views:	70
Size:	55.4 KB
ID:	20621  

Reply With Quote
  #22   Spotlight this post!  
Unread 17-04-2016, 11:28
Eugene Fang's Avatar
Eugene Fang Eugene Fang is offline
The Blue Alliance
no team
Team Role: Alumni
 
Join Date: Jan 2007
Rookie Year: 2000
Location: Bay Area, CA -> Pittsburgh, PA
Posts: 772
Eugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond reputeEugene Fang has a reputation beyond repute
Re: Quick OPR Question

Quote:
Originally Posted by Caleb Sykes View Post
Obviously xOPR and ixOPR are possible without this constraint, since Eugene posted convergence graphs for Palmetto. What is the "other source for OPR initialization" that is used for cases like this?
Quote:
Originally Posted by Ether View Post
I think you can just pick a reasonable number to seed the calculation, and let the 2x iteration take care of things from there.
What Ether said shares my view on the initialization.

In the graphs, I used 0 as the initialization, which I knew was a bad idea at the time. I've been trying out using the average match score for the event (up to the currently played match) as the initialization for teams without past events with better* results.

* There's a lot of "fuzzy math" going on here and I know OPR is a pretty poor metric for estimating a team's performance, whether there are few matches played or many matches played. I'm just curious to see how accurate one can expect match predictions to be using no other source of scouting data.
__________________
Eugene Fang
2010 Silicon Valley Regional Dean's List Finalist

Various FLL Teams - Student (2000-2006), Mentor (2007-2010)
FRC Team 604 - Student (2007-2010), Mentor/Remote Advisor (2011-2015)
FRC Team 1323 - Mentor/Remote Advisor (2011-2014)

The Blue Alliance | TBA GameDay | TBA Android App

Last edited by Eugene Fang : 17-04-2016 at 11:32.
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 20:27.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi