Go to Post Just to be clear, NOTHING anyone says here is a confirmation. The ONLY source for official answers to questions like this is the FIRST Q&A system. - dlavery [more]
Home
Go Back   Chief Delphi > Competition > Rules/Strategy > Scouting
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
 
 
Thread Tools Rate Thread Display Modes
Prev Previous Post   Next Post Next
  #6   Spotlight this post!  
Unread 04-02-2006, 22:28
Ethulin Ethulin is offline
Too many hats to count
AKA: Erik Thulin
FRC #0492 (Titan Robotics)
Team Role: Leadership
 
Join Date: Mar 2005
Rookie Year: 2003
Location: Seattle
Posts: 245
Ethulin has much to be proud ofEthulin has much to be proud ofEthulin has much to be proud ofEthulin has much to be proud ofEthulin has much to be proud ofEthulin has much to be proud ofEthulin has much to be proud ofEthulin has much to be proud of
Send a message via AIM to Ethulin
Re: STAMP (Statistical Team Analysis of Match Performance) is off and running!

Quote:
Originally Posted by Bill Moore
Interesting concept, but performance can lie, if you only focus on scores. How do you account for a score of "0", when the best bot at a competition gets pushed over at the beginning of a match? The other bot may get penalized or DQ'd, but that doesn't help the bot laying on its' side unable to perform.

I have seen this every year since 2002, where a bot plays overaggressive penalized defense against one of the best bots at a comp, and the good bot is knocked over. This is where numbers go wrong. The best bot would score nothing for this match, and drop in your standings, but in the playoffs, these actions drawing a penalty would result in a DQ for the offending alliance. So, even though the best bot may not score in the playoffs, they would still be credited with a win. The "quality" of the best bots 0 score in the qualification match is very poor, because it was not earned through play, but by penalty. If the best bot played a full match and was blocked throughout, and was unable to score, then the 0 score would be fully deserved, and the "quality" of that number would be very high.

I can foresee matches this year, where a slower bot who can only score one ball at a time is ignored, to concentrate on stopping a better bot from scoring. The lesser bot, without anyone playing defense scores 15 points; the better bot, with three robots pushing him for the full 2 minutes 10 seconds scores 14 points. Which bot will you fear most come playoffs? At some point, just like all researchers, you have to assess the quality of the data you are collecting.
Hello Bill and thanks for your interest!

We will do as much as we can to account for this type of situations. For example we will discount mathematical outlier, such as the scenario above. We also have a handy dandy "Notes" section for each robot so you know what happened!

We will also calculate many other variables such as if the bot's performance is increasing or decreasing, and if so by what rate. We will calculate the consistency (their standard deviation from their mean score) as well as many other variables. It is no doubt there is still a "human" element. You need some one who knows what their doing to sift through all this data and rankings to really determine what you need to do to win, this just makes it easier and more accurate.

Hope that cleared up some of your questions!

- Erik
__________________
2003 Pacific Northwest Regional Website Award || 2003 Pacific Northwest Regional Finalist || 2003 Pacific Northwest Regional Engineering Inspiration Award || 2004 Pacific Northwest Website Award || 2004 Pacific Northwest Regional Champions (#1 seed) || 2004 Galileo Semi-Finalist || 2005 Pacific Northwest Regional General Motors Industiral Design Award || 2005 Pacific Northwest Regional Champions (#1 seed) || 2005 Galileo Finalist || 2006 Pacific Northwest Regional Chairman's
Stamp Scouting || Titan Robotics
 


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 23:51.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi