This has to be the hardest, most complicated game I've ever seen the GDC develop - that's what makes it so much fun! - SteveGPage [more]
 Chief Delphi Success Metric
 Team 51 CD-Events CD-Media CD-Swap CD-Spy FRC-Spy Unsung FIRST Heroes WFA
The Chief Delphi Forums are sponsored by Innovation First International, Inc.

#1
05-06-2012, 11:59 PM
 zzzag Registered User FRC #1554 Join Date: Apr 2012 Rookie Year: 2010 Location: Long Island, NY Posts: 28
Success Metric

Basically, the question here is, is it possible to create a statistic to measure the probable success of a robot/alliance?
Details: Theoretically, given a field of any number of robots (around the size of a regional) assign those robots a number indicating the percentage of robots receiving a lower number. Be able to use this measurement to predict which alliance will win a match with reliable accuracy.

Is this possible, how accurate is it, and what is the formula to calculate it?
#2
05-07-2012, 09:39 AM
 FrankJ Robot Mentor FRC #2974 (WALT) Team Role: Mentor Join Date: Feb 2011 Rookie Year: 2009 Location: Marietta GA Posts: 412
Re: Success Metric

Would that also factor in FMS issues? What you are asking for, most teams would call scouting. While numbers are useful, intangibles also count for a lot.

At Einstein, & the division matches this year, things where pretty even. Run the whole thing over again, I not sure I would bet on who would be the winner. The quality of competition was pretty amazing.
#3
05-07-2012, 09:50 AM
 Andrew Schreiber Data Nerd no team (EWCP) Team Role: Mentor Join Date: Jan 2005 Rookie Year: 2000 Location: Tampa, FL Posts: 2,552
Re: Success Metric

Quote:
 Originally Posted by zzzag Is this possible, how accurate is it, and what is the formula to calculate it?
Is it possible? Sure, you can create a function to rank teams.

How accurate? Depends on your function and what accuracy you consider important. Is your goal to say who wins each match or to say by how much? Who wins can be pretty decent accuracy (well, higher than flipping a coin).

Formula? There is the kicker. Is it based on scoring? On strategy? Past performance?

People have been trying to do this with the OPR system (search how to solve for this) but it is not terribly accurate this year. (Co-Op Bridge is the most notable reason but the limited number of game pieces also factors in)

Ultimately though, humans are driving these machines so there is that factor as well. You also have to understand that an alliance is NOT the sum of its parts but is, in fact, greater or less than that.
__________________

27->397 > 2337 + 314 + 3450 > 79
#4
05-07-2012, 10:26 AM
 Peck worse then failing: proving murphy FRC #1619 (Up-A-Creek Robotics) and FTC # 4633) Team Role: College Student Join Date: Mar 2012 Rookie Year: 2007 Location: Colorado Posts: 237
Re: Success Metric

favorite piece of wisdom (forget who first said it): "everything is possible, there are simply many things nobody has done yet"

as for accuracy: it depends. by the same logic as used above, it is possible to make a program that perfectly predicts the results down to when each basket is scored, it is just highly unlikely.

The formula would likely be so long and complex it would require a live feed of data to fuel in order to run making it not very practical for FRC use.
__________________
Cad, Electrical, Machining, Debugging (old school), PR, Distraction elimination

TEAM 1619
__UP-A-Creek Robotics__
It ain't done till it's over-done
#5
05-07-2012, 11:25 AM
 Donovan0217 Registered User FRC #0217 (The Thunderchickens) Team Role: Mentor Join Date: Apr 2012 Rookie Year: 2012 Location: Michigan Posts: 17
Re: Success Metric

Quote:
 Originally Posted by zzzag Basically, the question here is, is it possible to create a statistic to measure the probable success of a robot/alliance? Details: Theoretically, given a field of any number of robots (around the size of a regional) assign those robots a number indicating the percentage of robots receiving a lower number. Be able to use this measurement to predict which alliance will win a match with reliable accuracy. Is this possible, how accurate is it, and what is the formula to calculate it?
While this is technically possible, it is far from accurate to calculate it with a number because some factors are intangible and unable to put a number to. One of these is the strategical factor, and it is really difficult to put a number to that, even as a ranking of the teams, because different types of strategies may be more effective then others at different points.

How would you choose to rank a team that is amazing at strategizing, but has an average to poor level robot, versus a team that has an amazing robot but a very low level strategy system?
__________________
Donovan
217 Thunderchickens

Student 2012
Junior Mentor 2013-xxxx
2013 Michigan State Champions (469, 3539, 217)
#6
05-07-2012, 01:25 PM
 Rangel(kf7fdb) John Rangel FRC #0842 (Falcon Robotics) Team Role: Programmer Join Date: Jan 2010 Rookie Year: 2009 Location: Phoenix, Arizona Posts: 278
Re: Success Metric

The wiimote scouting system 842 uses is very good at predicting the outcome of matches with enough data. Last year at championships our system predicted the correct outcome of every qualifying match on Saturday. This year there were a few wrong ones mostly due to bridges but overall its got insane accuracy. Eliminations though is a different story. This of course also doesn't account for breakage or field issues.
__________________
2012-2013 Team President
2012 Dean's List Winner

 Thread Tools Display Modes Rate This Thread Linear Mode Rate This Thread: 5 : Excellent 4 : Good 3 : Average 2 : Bad 1 : Terrible

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts vB code is On Smilies are On [IMG] code is Off HTML code is Off
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home Announcements     User Announcements FIRST     General Forum         FIRST E-Mail Blast Archive     Rumor Mill     Career     Robot Showcase     Moderated Discussion Technical     Technical Discussion     Robotics Education and Curriculum     Motors     Electrical         CAN     Programming         NI LabVIEW         WindRiver C++         Java         MATLAB & Simulink         Python     intelitek easyC/REC information         easyC v2 for Vex         easyC for FRC         REC/Learnmate         WPILib         easyC PRO     Control System         IFI Control System         FRC Control System         Sensors         USB Chicklet     Pneumatics     Kit & Additional Hardware     CAD         Inventor         SolidWorks         Pro ENGINEER / Creo     IT / Communications         3D Animation and Competition         Website Design/Showcase         Videography and Photography         Computer Graphics     National Instruments LabVIEW and Data Acquisition         LabView and Data Acquisition Competition     Awards         Chairman's Award     Rules/Strategy         Scouting         You Make The Call     Team Organization         Fundraising         Starting New Teams         Finding A Team         College Teams     Championship Event     Regional Competitions     FIRST in Michigan     Mid-Atlantic Robotics     Off-Season Events         Chief Delphi Invitational     Thanks and/or Congrats     FRC Game Design     OCCRA         OCCRA Q&A         OCCRA Programming Other     Unsung FIRST Heroes     Chit-Chat         Games/Trivia             Fantasy FIRST     Car Nack's Corner     College & University Education     Dean Kamen's Inventions     FIRST-related Organizations         Western Region Robotics Forum         Robot Chicks Union (RCU)         Southern California Regional Robotics Forum         Hearing-Impared Network         FIRST Interactive Rural SupporT         freelanceFIRST         FIRST Scouting Network         openFIRST         The Grand FIRST Team         FloridaFIRST         Inspiration Foundation Inc.         South Dakota FIRST         FIRST International Partners         FIRSTwiki         Ultimate Robot Challenge         East Coast Drivers Union         Team San Diego         CollegiateFIRST         Dream FIRST         FIRST Brasil         The Blue Alliance             Video Archives     FIRST Historians     FIRST-A-Holic's Anonymous Mailbox     FIRST In the News...     FIRST Lego League         Lego Mindstorm Discussion     FIRST Tech Challenge         FTC E-Mail Blast Archive     VEX         VEX Robotics Competition     Televised Robotics     Math and Science         NASA Discussion ChiefDelphi.com Website     CD Forum Support         Bulletins and Newsletters     Extra Discussion Old Forum Archives     1999     2000     2001

All times are GMT -5. The time now is 01:01 AM.

The Chief Delphi Forums are sponsored by Innovation First, Inc.

 -- English (12 hour) -- English (24 hour) Contact Us - Chief Delphi - Rules - Team Site - Archive - Top