Go to Post ..."A bad day at college is always better then a good day at work" - KyleGilbert45 [more]
Home
Go Back   Chief Delphi > FIRST > General Forum
CD-Events   CD-Media   CD-Spy   FRC-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 03-25-2012, 08:57 AM
fovea1959's Avatar
fovea1959 fovea1959 is offline
Registered User
AKA: Doug Wegscheid
FRC #3620 (The Average Joes)
Team Role: Mentor
 
Join Date: Jan 2011
Rookie Year: 2011
Location: St Joseph
Posts: 186
fovea1959 is an unknown quantity at this point
post-competition analysis of strength of allies vs strength of opposition

Sometimes it feels like our end-of-qualification position is all out of kilter with how the drivers and robot performed; we've had it go both ways (good standing with a robot having a bad weekend, 38th with a bot that seemed pretty solid).

One of the subjective things seems to be "our partners carried us" or "we just drew weak partners/great opposition in qualifications". I was going to do a little analysis of our past season qualification matches, and compare the average scores and ranking of alliance partners to the average scores and ranking of opposition in our qualifications to see if that subjective feel has basis in fact (recognizing that my robot being a loser *will* drag down my alliance partner's rankings and scores).

Are there existing tools for doing this analysis, or will I need to roll my own? It won't be hard, but I feel really lazy... <done for season, whew>
Reply With Quote
  #2   Spotlight this post!  
Unread 03-25-2012, 09:50 AM
Bongle's Avatar
Bongle Bongle is offline
Registered User
FRC #2702 (REBotics)
Team Role: Mentor
 
Join Date: Feb 2004
Rookie Year: 2002
Location: Waterloo
Posts: 1,016
Bongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond repute
Send a message via MSN to Bongle
Re: post-competition analysis of strength of allies vs strength of opposition

I know the feeling for sure - this year we seemed to end up about where our robot deserved to be, but 2702 has ended at the bottom of the standings some years when our robot was far better than that.

One mildly accurate evaluation of a given team's strength is OPR. You could look at the average OPR of your alliance partners, average OPR of your opponents, and see how those averages compare with the OPR distribution at the actual regional. Actually, I could probably throw that kind of average calculation into OPRNet in about an hour.

Example: at Waterloo this weekend, we have 33 opponents and 22 alliance members. If our alliance partners had an average OPR of 5.5 and our opponents had an OPR of 11, we could say we had a tough schedule.

There's a bunch of ways that people analyze schedule difficulty in pro sports. Here's a good starting point: http://en.wikipedia.org/wiki/Strength_of_schedule
Reply With Quote
  #3   Spotlight this post!  
Unread 03-25-2012, 10:03 AM
pfreivald's Avatar
pfreivald pfreivald is offline
Registered User
AKA: Patrick Freivald
FRC #1551 (The Grapes of Wrath)
Team Role: Mentor
 
Join Date: Jan 2007
Rookie Year: 2001
Location: Naples, NY
Posts: 2,059
pfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond repute
Re: post-competition analysis of strength of allies vs strength of opposition

At Buckeye, our robot had more functionality and was performing better than at FLR, and yet at FLR we were 8th seed overall and Buckeye found us near the very bottom of the heap (and yet we were picked 7th for the elimination rounds).

One of the interesting things about the coopertition bridge was how seeding turned out vs. individual robot performance -- good scouting was absolutely critical!
__________________
Patrick Freivald -- Mentor
Team 1551
"The Grapes of Wrath"
Bausch & Lomb, PTC Corporation, and Naples High School

I write books, too! Twice Shy. Blood List. Jade Sky.
Reply With Quote
  #4   Spotlight this post!  
Unread 03-25-2012, 10:23 AM
Bongle's Avatar
Bongle Bongle is offline
Registered User
FRC #2702 (REBotics)
Team Role: Mentor
 
Join Date: Feb 2004
Rookie Year: 2002
Location: Waterloo
Posts: 1,016
Bongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond repute
Send a message via MSN to Bongle
Re: post-competition analysis of strength of allies vs strength of opposition

OPRNet v24 (available here) now can do schedule analysis. From eyeballing my own team's schedule difficulty, as well as 1940 and 1551's, it doesn't look like it is that useful of a tool (there isn't much correlation with what the tool spits out vs how a team did ... maybe I should include the team in their alliance's strength)

Last edited by Bongle : 03-25-2012 at 10:25 AM.
Reply With Quote
  #5   Spotlight this post!  
Unread 03-25-2012, 10:39 AM
pfreivald's Avatar
pfreivald pfreivald is offline
Registered User
AKA: Patrick Freivald
FRC #1551 (The Grapes of Wrath)
Team Role: Mentor
 
Join Date: Jan 2007
Rookie Year: 2001
Location: Naples, NY
Posts: 2,059
pfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond repute
Re: post-competition analysis of strength of allies vs strength of opposition

Quote:
Originally Posted by Bongle View Post
OPRNet v24 (available here) now can do schedule analysis. From eyeballing my own team's schedule difficulty, as well as 1940 and 1551's, it doesn't look like it is that useful of a tool (there isn't much correlation with what the tool spits out vs how a team did ... maybe I should include the team in their alliance's strength)
Does the program include the elimination matches? Being on 188's alliance for eight elimination games would certainly skew the results toward "high alliance OPR" but not have anything whatsoever to do with seeding.
__________________
Patrick Freivald -- Mentor
Team 1551
"The Grapes of Wrath"
Bausch & Lomb, PTC Corporation, and Naples High School

I write books, too! Twice Shy. Blood List. Jade Sky.
Reply With Quote
  #6   Spotlight this post!  
Unread 03-25-2012, 10:45 AM
Bongle's Avatar
Bongle Bongle is offline
Registered User
FRC #2702 (REBotics)
Team Role: Mentor
 
Join Date: Feb 2004
Rookie Year: 2002
Location: Waterloo
Posts: 1,016
Bongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond repute
Send a message via MSN to Bongle
Re: post-competition analysis of strength of allies vs strength of opposition

Quote:
Originally Posted by pfreivald View Post
Does the program include the elimination matches? Being on 188's alliance for eight elimination games would certainly skew the results toward "high alliance OPR" but not have anything whatsoever to do with seeding.
OPRNet always ignores eliminations matches for precisely the reasons you ask.
Reply With Quote
  #7   Spotlight this post!  
Unread 03-25-2012, 10:50 AM
pfreivald's Avatar
pfreivald pfreivald is offline
Registered User
AKA: Patrick Freivald
FRC #1551 (The Grapes of Wrath)
Team Role: Mentor
 
Join Date: Jan 2007
Rookie Year: 2001
Location: Naples, NY
Posts: 2,059
pfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond reputepfreivald has a reputation beyond repute
Re: post-competition analysis of strength of allies vs strength of opposition

Well, maybe we were just awful, then.
__________________
Patrick Freivald -- Mentor
Team 1551
"The Grapes of Wrath"
Bausch & Lomb, PTC Corporation, and Naples High School

I write books, too! Twice Shy. Blood List. Jade Sky.
Reply With Quote
  #8   Spotlight this post!  
Unread 03-25-2012, 10:53 AM
Ian Curtis Ian Curtis is offline
Best Available Data
FRC #1778 (Chill Out!)
Team Role: Engineer
 
Join Date: Feb 2005
Rookie Year: 2004
Location: Puget Sound
Posts: 2,413
Ian Curtis has a reputation beyond reputeIan Curtis has a reputation beyond reputeIan Curtis has a reputation beyond reputeIan Curtis has a reputation beyond reputeIan Curtis has a reputation beyond reputeIan Curtis has a reputation beyond reputeIan Curtis has a reputation beyond reputeIan Curtis has a reputation beyond reputeIan Curtis has a reputation beyond reputeIan Curtis has a reputation beyond reputeIan Curtis has a reputation beyond repute
Re: post-competition analysis of strength of allies vs strength of opposition

I've always used DPR (I think you call it SAA) as a measure of schedule strength. Never actually done a statistical analysis, but I've found usually when someone says 'Dang our schedule stank!' they've had high DPR and when they coast to the top 8 it's a small number.
__________________
CHILL OUT! | Stability & Control Engineer
Adam Savage's Obsessions (TED Talk) (Part 2)
It is much easier to call someone else a genius than admit to yourself that you are lazy. - Dave Gingery
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 01:27 AM.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi