Go to Post We're basically using a two step process: 1. Smoke 2. Mirrors - Tom Bottiglieri [more]
Home
Go Back   Chief Delphi > ChiefDelphi.com Website > Extra Discussion
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 25-09-2013, 19:59
Jim Zondag's Avatar
Jim Zondag Jim Zondag is offline
Team Leader
FRC #0033 (Killer Bees)
Team Role: Engineer
 
Join Date: Nov 2001
Rookie Year: 1997
Location: Auburn Hills
Posts: 317
Jim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond repute
paper: FRC Event Comparison 2009-2013

Thread created automatically to discuss a document in CD-Media.

FRC Event Comparison 2009-2013 by Jim Zondag
Reply With Quote
  #2   Spotlight this post!  
Unread 25-09-2013, 20:09
Jim Zondag's Avatar
Jim Zondag Jim Zondag is offline
Team Leader
FRC #0033 (Killer Bees)
Team Role: Engineer
 
Join Date: Nov 2001
Rookie Year: 1997
Location: Auburn Hills
Posts: 317
Jim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond reputeJim Zondag has a reputation beyond repute
Re: paper: FRC Event Comparison 2009-2013

Since registration opens tomorrow and everyone is working to pick events, I figured I should post this again.
This sheet plots all Events played in the 2013 season on a 2-D scatter-plot.
What this plot shows is overall competitive strength of the event vs. the competitive balance of the event.


Higher on the chart means an overall stronger event
Further right on the chart means a more balanced event.

All of the raw data is available in tabular form in the OPR Event Data tab. The graph is pretty cluttered with the labels in the center regions.
I include the IRI as a reference point to set an upper limit to the "art of the possible" in event quality.

Due to the co=dependency of the variables used to generate this type of chart, the events will trend up and to the right as they get better.

Fun with math!
Good luck teams with registration. I hope everyone gets into the events they want.
__________________
"To learn what is possible, we must attempt the impossible." Arthur C. Clarke
Reply With Quote
  #3   Spotlight this post!  
Unread 25-09-2013, 20:26
AllenGregoryIV's Avatar
AllenGregoryIV AllenGregoryIV is offline
Engineering Coach
AKA: Allen "JAG" Gregory
FRC #3847 (Spectrum)
Team Role: Coach
 
Join Date: Jul 2008
Rookie Year: 2003
Location: Texas
Posts: 2,557
AllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond reputeAllenGregoryIV has a reputation beyond repute
Send a message via AIM to AllenGregoryIV
Re: paper: FRC Event Comparison 2009-2013

Very cool data Jim, thanks for posting this.
__________________

Team 647 | Cyber Wolf Corps | Alumni | 2003-2006 | Shoemaker HS
Team 2587 | DiscoBots | Mentor | 2008-2011 | Rice University / Houston Food Bank
Team 3847 | Spectrum | Coach | 2012-20... | St Agnes Academy
LRI | Alamo Regional | 2014-20...
"Competition has been shown to be useful up to a certain point and no further, but cooperation, which is the thing we must strive for today, begins where competition leaves off." - Franklin D. Roosevelt
Reply With Quote
  #4   Spotlight this post!  
Unread 26-09-2013, 08:36
Kevin Leonard Kevin Leonard is offline
Professional Stat Padder
FRC #5254 (HYPE), FRC #20 (The Rocketeers)
Team Role: College Student
 
Join Date: Oct 2011
Rookie Year: 2011
Location: Upstate New York
Posts: 1,253
Kevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond reputeKevin Leonard has a reputation beyond repute
Re: paper: FRC Event Comparison 2009-2013

Really cool stuff to look at!
Just a note- the Smoky Mountain Regional is listed pre-2013 as SmokyMountain, and in 2013 as SmokyMountains, and when you enter the latter into the Query Box, it returns an error. Might want to fix that.

EDIT: That same kind of bug occurs for a few other events too, including North Star which for 2013 is listed as MNNorthStar, and not Query-able.
__________________
All of my posts are my opinion only and do not reflect the views of my associated teams.
College Student Mentor on Team 5254, HYPE - Helping Youth Pursue Excellence
(2015-Present)
Alumni of Team 20, The Rocketeers (2011-2014)
I'm attempting a robotics blog. Check it out at RocketHypeRobotics.wordpress.com Updated 10/26/16

Last edited by Kevin Leonard : 26-09-2013 at 08:38.
Reply With Quote
  #5   Spotlight this post!  
Unread 26-09-2013, 08:47
Clem1640's Avatar
Clem1640 Clem1640 is offline
Head Mentor
AKA: Clem McKown
FRC #1640 (Sab-BOT-age)
Team Role: Leadership
 
Join Date: Mar 2009
Rookie Year: 2006
Location: Downingtown PA
Posts: 249
Clem1640 has a reputation beyond reputeClem1640 has a reputation beyond reputeClem1640 has a reputation beyond reputeClem1640 has a reputation beyond reputeClem1640 has a reputation beyond reputeClem1640 has a reputation beyond reputeClem1640 has a reputation beyond reputeClem1640 has a reputation beyond reputeClem1640 has a reputation beyond reputeClem1640 has a reputation beyond reputeClem1640 has a reputation beyond repute
Re: paper: FRC Event Comparison 2009-2013

Thanks! This is great work and very useful information.
__________________


Clem McKown
Head Mentor - FRC 1640 & FTC 7314
Chairman - Downingtown Area Robotics
Reply With Quote
  #6   Spotlight this post!  
Unread 26-09-2013, 16:10
Michael Hill's Avatar
Michael Hill Michael Hill is offline
Registered User
FRC #3138 (Innovators Robotics)
Team Role: Mentor
 
Join Date: Jul 2004
Rookie Year: 2003
Location: Dayton, OH
Posts: 1,576
Michael Hill has a reputation beyond reputeMichael Hill has a reputation beyond reputeMichael Hill has a reputation beyond reputeMichael Hill has a reputation beyond reputeMichael Hill has a reputation beyond reputeMichael Hill has a reputation beyond reputeMichael Hill has a reputation beyond reputeMichael Hill has a reputation beyond reputeMichael Hill has a reputation beyond reputeMichael Hill has a reputation beyond reputeMichael Hill has a reputation beyond repute
Re: paper: FRC Event Comparison 2009-2013

I'm familiar with SNR when it comes to "Signal-To-Noise Ratio" in Radar, but what does SNR mean here?

EDIT: Nevermind this. My monitor wasn't wide enough to notice the tab.

Last edited by Michael Hill : 26-09-2013 at 16:14.
Reply With Quote
  #7   Spotlight this post!  
Unread 27-09-2013, 09:28
Kims Robot's Avatar Unsung FIRST Hero
Kims Robot Kims Robot is offline
Onto a New Chapter...
AKA: Kim O'Toole Eckhardt
no team
 
Join Date: Aug 2004
Rookie Year: 1996
Location: Framingham, MA
Posts: 1,467
Kims Robot has a reputation beyond reputeKims Robot has a reputation beyond reputeKims Robot has a reputation beyond reputeKims Robot has a reputation beyond reputeKims Robot has a reputation beyond reputeKims Robot has a reputation beyond reputeKims Robot has a reputation beyond reputeKims Robot has a reputation beyond reputeKims Robot has a reputation beyond reputeKims Robot has a reputation beyond reputeKims Robot has a reputation beyond repute
Send a message via AIM to Kims Robot
Re: paper: FRC Event Comparison 2009-2013

Amazing Chart - I love this data... can't wait to see how New England stacks up! It looks like in 2013 & 2011 events were in the top 50%, but that over the years they have spanned the range (and interesting to see CT in the top 4 reg season events all but 2013). I'd be interested to see this correlated with how many NE vs non-NE teams... maybe I'll tackle that one of these days

It's also nice to actually nice to see that aside from the District CMPs that the CMP is actually still pulling "the best of the best". Not quite IRI style, but it's good to see it still on the upper end of the spectrum. Makes me feel a bit better about some of the deviation charts we've seen, but as we all move towards districts, I expect to see that get better.

Only thing I was thinking was that powerhouses tend to skew some of this, but SNR looks like it covers that. Am I reading it right that a more negative/lower SNR would indicate a much broader OPR spread (thus the likely presence of powerhouses and struggling teams)? It might be that Im looking at this before having caffeine...

Thanks for the great data!
__________________
~kim~
Kimberly O'Toole Eckhardt <3
Principal Systems Engineer & Program Manager
History - Team 176, Team 229, Team 1511, FIRST Volunteer!!
My new FIRST Photography Hobby & Angry Eric's Fan Page
Excellence - is the result of caring more than others think is wise, risking more than others think is safe, dreaming more than others think is practical, and expecting more than others think is possible.
Reply With Quote
  #8   Spotlight this post!  
Unread 27-09-2013, 09:54
IKE's Avatar
IKE IKE is offline
Not so Custom User Title
AKA: Isaac Rife
no team (N/A)
Team Role: Mechanical
 
Join Date: Jan 2008
Rookie Year: 2003
Location: Michigan
Posts: 2,149
IKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond repute
Re: paper: FRC Event Comparison 2009-2013

Quote:
Originally Posted by Kims Robot View Post
Amazing Chart - .....

Only thing I was thinking was that powerhouses tend to skew some of this, but SNR looks like it covers that. Am I reading it right that a more negative/lower SNR would indicate a much broader OPR spread (thus the likely presence of powerhouses and struggling teams)? It might be that Im looking at this before having caffeine...

Thanks for the great data!
You are correct Kim. What a couple of Powerhouses tend to do is push up the average, but if they are the only ones, it then causes a poor SNR value.

To cherry pick a few neat examples of 2013 data, in general the more teams play they better they get. Bedford was about 75% 3rd event teams, and had an amazing average. It also had a very good SNR as most teams could score reasonably well. While this s neat, check out Crossroads. It had a ton of overlap with Boilermaker. Crossroads also had a ton of second event teams. You see simlar trending between Traverse City and West Michgan (which is very similar overlap and timing). I did a quick check on Pine Tree, and there was a lot of overlap with BAE, and only 1 of the top 10 ranked was competing at their first regional for the year....

Fun data Jim. It is neat to see events "grow", and get more competitive.
Reply With Quote
  #9   Spotlight this post!  
Unread 27-09-2013, 11:46
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,098
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: paper: FRC Event Comparison 2009-2013


Hey Jim,

That is an excellent way to graphically present the data. Thanks for posting it!

I'm wondering how much the graphs would change, particularly near the top right corner, if you used median absolute deviation from the median divided by the median (MADM/M), instead of SNR of sigma. Sigma assumes Gaussian distribution (which OPRs tend not to be). MADM/M is more robust to distribution.

If you don't have the time for that, I'll volunteer to take a crack at it if you'll post the OPR data you used.


Reply With Quote
  #10   Spotlight this post!  
Unread 27-09-2013, 13:09
tr6scott's Avatar
tr6scott tr6scott is offline
Um, I smell Motor!
AKA: Scott McBride
FRC #2137 (TORC)
Team Role: Mentor
 
Join Date: Dec 2007
Rookie Year: 2005
Location: Oxford, MI
Posts: 522
tr6scott has a reputation beyond reputetr6scott has a reputation beyond reputetr6scott has a reputation beyond reputetr6scott has a reputation beyond reputetr6scott has a reputation beyond reputetr6scott has a reputation beyond reputetr6scott has a reputation beyond reputetr6scott has a reputation beyond reputetr6scott has a reputation beyond reputetr6scott has a reputation beyond reputetr6scott has a reputation beyond repute
Re: paper: FRC Event Comparison 2009-2013

Ike & Jim,

Bedford, 75% were 3rd event players, YIKES! I knew it was high, I did not realize it was that high... Were there any of the 25% 2nd event teams that made it though Bedford and on to MSC? (I know Bedford was on the bubble and got there by Chairman's)

Is the 75% playing for nothing district an anomaly, as I think I remember that Bedford may have not been on the original district list when registration opened last year?

Or do you typically see this in the last event before MSC?
__________________
The sooner we get behind schedule, the more time we have to catch up.

Reply With Quote
  #11   Spotlight this post!  
Unread 27-09-2013, 18:07
IKE's Avatar
IKE IKE is offline
Not so Custom User Title
AKA: Isaac Rife
no team (N/A)
Team Role: Mechanical
 
Join Date: Jan 2008
Rookie Year: 2003
Location: Michigan
Posts: 2,149
IKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond reputeIKE has a reputation beyond repute
Re: paper: FRC Event Comparison 2009-2013

Quote:
Originally Posted by tr6scott View Post
Ike & Jim,

Bedford, 75% were 3rd event players, YIKES! I knew it was high, I did not realize it was that high... Were there any of the 25% 2nd event teams that made it though Bedford and on to MSC? (I know Bedford was on the bubble and got there by Chairman's)

Is the 75% playing for nothing district an anomaly, as I think I remember that Bedford may have not been on the original district list when registration opened last year?

Or do you typically see this in the last event before MSC?
I believe there were a couple that made it through that would not otherwise. Last year, there were just barely enough teams to call for the extra district. This resulted in a lot of 3rd event teams. The 75% is an anomaly as previous years there were not a lot of lottery slots, and they were more evenly distributed. By the very nature of it though, this is most likely to occur at a late season event. Bedford was also a late add, so most teams had already signed up for and planned on attending two earlier events.
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 22:38.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi