Go to Post I am surprised at the relative conservative capability you described on our 2006 machine. As for the 2007 machine, in anticipation of an aquatic game, we have completed a robot that "walks on water" and are well along with one that can "part the sea". - Bill Beatty [more]
Home
Go Back   Chief Delphi > ChiefDelphi.com Website > Extra Discussion
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 05-05-2015, 23:33
evanperryg's Avatar
evanperryg evanperryg is offline
IT'S THE BUMP N' DUMP
AKA: Evan Grove
FRC #4536 (The Minutebots)
Team Role: Mentor
 
Join Date: Apr 2013
Rookie Year: 2011
Location: Minneapolis, MN
Posts: 657
evanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond repute
pic: Archimedes Scouting: tote OPR vs. tote scoring

Reply With Quote
  #2   Spotlight this post!  
Unread 05-05-2015, 23:34
evanperryg's Avatar
evanperryg evanperryg is offline
IT'S THE BUMP N' DUMP
AKA: Evan Grove
FRC #4536 (The Minutebots)
Team Role: Mentor
 
Join Date: Apr 2013
Rookie Year: 2011
Location: Minneapolis, MN
Posts: 657
evanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond repute
Re: pic: Archimedes Scouting: tote OPR vs. tote scoring

If you have any general questions about the three scatter plots, feel free to post them here. As most of you probably guessed, they were generated in Tableau. OPRs are sourced from Ether's component OPR spreadsheet, actual scoring is based on 2338 scouting data.
__________________
FRCDesigns Contributor | "There is only one corner of the universe you can be certain of improving, and that's your own self." -Aldous Huxley
2012-2016 | FRC Team 2338: Gear it Forward
2013
Wisconsin Regional Winner 2014 Midwest Regional Finalist 2015 Midwest Regional Chairman's Award, Finalist, Archimedes Division Champion, IRI Semifinalist 2016 Midwest Regional Chairman's Award, Finalist, Archimedes Division Gracious Professionalism Award, R2OC Winner
2015 | FTC Team 10266: Mach Speed
2015
Highland Park Qualifier Winner, Motivate Award
2017-???? | FRC Team 4536: The Minutebots

Thanks to the alliances and friends I've made along the way: 33 74 107 111 167 171 234 548 1023 1089 1323 1625 1675 1732 1756 2064 2077 2122 2202 2358 2451 2512 2826 3936 3996 4039 4085 4241 5006 5401 5568 5847 5934
Reply With Quote
  #3   Spotlight this post!  
Unread 06-05-2015, 00:23
Jacob Bendicksen's Avatar
Jacob Bendicksen Jacob Bendicksen is offline
Figuring out what's next
no team
Team Role: Alumni
 
Join Date: Apr 2013
Rookie Year: 2012
Location: United States
Posts: 769
Jacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond reputeJacob Bendicksen has a reputation beyond repute
Re: pic: Archimedes Scouting: tote OPR vs. tote scoring

Cool charts!

Does OPR in this case refer to season-long OPR?
__________________
jacobbendicksen.com | @jacobbendicksen

Yale University Class of 2020

Team 1540 | 2012-2016
7 Chairman's Awards, 6 other awards, 2015 Dean's List Finalist, 1 event win, 2 finalist finishes. Thanks for an amazing ride.
Reply With Quote
  #4   Spotlight this post!  
Unread 06-05-2015, 02:43
SoftwareBug2.0's Avatar
SoftwareBug2.0 SoftwareBug2.0 is offline
Registered User
AKA: Eric
FRC #1425 (Error Code Xero)
Team Role: Mentor
 
Join Date: Aug 2004
Rookie Year: 2004
Location: Tigard, Oregon
Posts: 486
SoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant futureSoftwareBug2.0 has a brilliant future
Re: pic: Archimedes Scouting: tote OPR vs. tote scoring

That's a pretty good looking plot. I'm not sure if whatever draws it will tell you this, but do you know what sort of r squared value do you get for the line?
Reply With Quote
  #5   Spotlight this post!  
Unread 06-05-2015, 10:38
IKE's Avatar
IKE IKE is offline
Not so Custom User Title
AKA: Isaac Rife
no team (N/A)
Team Role: Mechanical
 
Join Date: Jan 2008
Rookie Year: 2003
Location: Michigan
Posts: 2,149
IKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond repute
Re: pic: Archimedes Scouting: tote OPR vs. tote scoring

Quote:
Originally Posted by SoftwareBug2.0 View Post
That's a pretty good looking plot. I'm not sure if whatever draws it will tell you this, but do you know what sort of r squared value do you get for the line?
The line shown on the graph is not a trendline, but instead the "ideal function" if OPR=Avg. Scoring Performance.<- this is incorrect. I was looking on too small of a screen to realize this was incorrect....

As has been said many time, OPR is often a good indicator, but is different than what the actuals are. Some interesting theories can be drawn from the deltas.

For instance, each alliance has 3 very easy to get to cans. If the alliance is comprised of 3 teams that on average typically utilize 1 can each, and they are all able to utilize that one can each in almost all of their matches, then OPR might coincide very well with their average scoring ability.

In Archimedes, I believe I heard that Bedford typically utilized 2 or 3 of those "easy" cans in almost every match. I will utilize them as an example as they were really awesome this year, and help illustrate some points. If they were partnered with 2 teams that typically utilized 1 of the 2 cans to consistently make a 4 stack plus an RC, then it would make the most sense for the alliance to have 1023 make the 3 stacks, and have the others either stack totes, or try to get a Can off of the center (which might take them a significantly longer amount of time). So, let's say goig into the match 1023 is averaging just below 20 auto+3x42pt. stacks or somewhere just below 146 total points. And they are partnered with two teams that again typically make 24 pt. stacks (4 totes + RC from the "easy" position). In this match, all 3 machines cannot get their typical score because they want to use some common resources. Thus 146+24+24 is unlikely (at least in that normal manner). The smart play would likely be to have 1023 do their 146pt. strategy (they were extremely consistent), and the others to adopt an alternate strategy. One might continue to just stack totes. Instead of an RC plus 4 totes, they might be able to get 6 total totes for a score of 12 pts. (instead of their normal 24). The other might work on getting the Coop stack, which might be a 50/50 on 40 points. If they hit it, they get a bump compared to their usual 24 point contribution. If they miss, (or the other alliance misses), then they would get nothing..
The OPR calculation does not care who does what above, it only uses the outcome to what the expected outcome is and tries to balance it. Thus if it was expecting 3+1+1=5, and instead 3expected+1expected+1expected=3 It may try to balance it out to 2+.5+.5=3

In the past, when looking at the data, some of the "deltas" have been indicators of interesting strategy. For instance, in 2010, 33 had a higher OPR than the number of actual points the team scored on average. This is because they primarily worked as a back and midfielder making passes into the home zone when they had a compitent home zone partner. This happened a lot at 2010 MSC that year where 2+2+2=8 or 3+2+1=10... Also that year, they had a very good win/loss record, but had a very low CCWM compared to many other high OPR teams. This was due to some concise strategy that because of the way ranking points were done that way, close high scoring matches were much more beneficial than blowing out an opponent, thus some matches you would use a a more cut throat strategy to ensure the win in a difficult match, but the next match might look like an easy victory, so you might use a much friendlier strategy so that your opponent could get a better score.

The opposite was true then for 2011. It was very difficult to get scores above 120* that year due to the regressive nature of the additional scores (each row lower was worth less points so the high point rows were filled first, also 30 pts. When to first minibot, but each additional minibot was worth less points). In 2011, it was not uncommon for 60+60+60=120...


*There were a lot of scores that year above the 120 mark as a number, but the percentage was small. If I remember correctly, 133 was the highest loosing score that could be achieved, and thus 134 was the minimum score that garuanteed a victory (this is not possible with some games).

Last edited by IKE : 06-05-2015 at 15:44. Reason: Highlighting incorrect statement.
Reply With Quote
  #6   Spotlight this post!  
Unread 06-05-2015, 11:09
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,097
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: pic: Archimedes Scouting: tote OPR vs. tote scoring

Quote:
Originally Posted by IKE View Post
The line shown on the graph is not a trendline, but instead the "ideal function" if OPR=Avg. Scoring Performance.
Without access to Evan's manual scoring data, I can't verify that it's a correct least-squares linear fit, but I can say it's not the "ideal function": the line does not pass through the point (40,40) nor, if you look very carefully, does it pass through the origin.

~
Reply With Quote
  #7   Spotlight this post!  
Unread 06-05-2015, 18:30
evanperryg's Avatar
evanperryg evanperryg is offline
IT'S THE BUMP N' DUMP
AKA: Evan Grove
FRC #4536 (The Minutebots)
Team Role: Mentor
 
Join Date: Apr 2013
Rookie Year: 2011
Location: Minneapolis, MN
Posts: 657
evanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond repute
Re: pic: Archimedes Scouting: tote OPR vs. tote scoring

Quote:
Originally Posted by Jacob Bendicksen View Post
Cool charts!

Does OPR in this case refer to season-long OPR?
The OPRs here are calculated from Archimedes only, it does not include data from any previous event.

Quote:
Originally Posted by IKE View Post
In Archimedes, I believe I heard that Bedford typically utilized 2 or 3 of those "easy" cans in almost every match.
They used all three, every qualifier. They literally did the exact same thing every single qualification match, and did it well. By the way, they're the point way over in the top right.
Quote:
In the past, when looking at the data, some of the "deltas" have been indicators of interesting strategy. For instance, in 2010, 33 had a higher OPR than the number of actual points the team scored on average. This is because they primarily worked as a back and midfielder making passes into the home zone when they had a compitent home zone partner. This happened a lot at 2010 MSC that year where 2+2+2=8 or 3+2+1=10... Also that year, they had a very good win/loss record, but had a very low CCWM compared to many other high OPR teams. This was due to some concise strategy that because of the way ranking points were done that way, close high scoring matches were much more beneficial than blowing out an opponent, thus some matches you would use a a more cut throat strategy to ensure the win in a difficult match, but the next match might look like an easy victory, so you might use a much friendlier strategy so that your opponent could get a better score.
Even though it was incredibly dysfunctional, 2010 was a fun game for strategy. You hit the nail on the head, though. OPR can get thrown off by alliance partners and strategies. However, the biggest thing I noticed upon looking at the data is that OPR was surprisingly precise with totes, okay with cans and auto, and completely useless for litter.

Quote:
Originally Posted by Ether View Post
Without access to Evan's manual scoring data, I can't verify that it's a correct least-squares linear fit, but I can say it's not the "ideal function": the line does not pass through the point (40,40) nor, if you look very carefully, does it pass through the origin.

~
Y(tote points) = 0.983517 * X(tote OPR) - 0.3000815 Pvalue <.0001

Quote:
Originally Posted by SoftwareBug2.0 View Post
That's a pretty good looking plot. I'm not sure if whatever draws it
It's tableau.
__________________
FRCDesigns Contributor | "There is only one corner of the universe you can be certain of improving, and that's your own self." -Aldous Huxley
2012-2016 | FRC Team 2338: Gear it Forward
2013
Wisconsin Regional Winner 2014 Midwest Regional Finalist 2015 Midwest Regional Chairman's Award, Finalist, Archimedes Division Champion, IRI Semifinalist 2016 Midwest Regional Chairman's Award, Finalist, Archimedes Division Gracious Professionalism Award, R2OC Winner
2015 | FTC Team 10266: Mach Speed
2015
Highland Park Qualifier Winner, Motivate Award
2017-???? | FRC Team 4536: The Minutebots

Thanks to the alliances and friends I've made along the way: 33 74 107 111 167 171 234 548 1023 1089 1323 1625 1675 1732 1756 2064 2077 2122 2202 2358 2451 2512 2826 3936 3996 4039 4085 4241 5006 5401 5568 5847 5934
Reply With Quote
  #8   Spotlight this post!  
Unread 06-05-2015, 18:38
evanperryg's Avatar
evanperryg evanperryg is offline
IT'S THE BUMP N' DUMP
AKA: Evan Grove
FRC #4536 (The Minutebots)
Team Role: Mentor
 
Join Date: Apr 2013
Rookie Year: 2011
Location: Minneapolis, MN
Posts: 657
evanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond reputeevanperryg has a reputation beyond repute
Re: pic: Archimedes Scouting: tote OPR vs. tote scoring

Version with a forced y-intercept of zero: https://i.imgur.com/3ok6XWN.jpg

Y = .963006X
__________________
FRCDesigns Contributor | "There is only one corner of the universe you can be certain of improving, and that's your own self." -Aldous Huxley
2012-2016 | FRC Team 2338: Gear it Forward
2013
Wisconsin Regional Winner 2014 Midwest Regional Finalist 2015 Midwest Regional Chairman's Award, Finalist, Archimedes Division Champion, IRI Semifinalist 2016 Midwest Regional Chairman's Award, Finalist, Archimedes Division Gracious Professionalism Award, R2OC Winner
2015 | FTC Team 10266: Mach Speed
2015
Highland Park Qualifier Winner, Motivate Award
2017-???? | FRC Team 4536: The Minutebots

Thanks to the alliances and friends I've made along the way: 33 74 107 111 167 171 234 548 1023 1089 1323 1625 1675 1732 1756 2064 2077 2122 2202 2358 2451 2512 2826 3936 3996 4039 4085 4241 5006 5401 5568 5847 5934
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 21:45.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi