Go to Post I GET that FIRST is about more than winning on the field. BUT... ...it is my experience that the great programs of the FIRST world almost always build on a foundation of competitive robots. Success on the field begets success in other realms. - Joe Johnson [more]
Home
Go Back   Chief Delphi > Competition > Rules/Strategy > Scouting
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Closed Thread
Thread Tools Rate Thread Display Modes
  #16   Spotlight this post!  
Unread 03-02-2009, 16:23
Rick Wagner's Avatar
Rick Wagner Rick Wagner is offline
Registered User
FRC #3008 (Kalani Robotics)
Team Role: Mentor
 
Join Date: Jan 2006
Rookie Year: 2003
Location: Honolulu, Hawaii
Posts: 188
Rick Wagner is a splendid one to beholdRick Wagner is a splendid one to beholdRick Wagner is a splendid one to beholdRick Wagner is a splendid one to beholdRick Wagner is a splendid one to beholdRick Wagner is a splendid one to beholdRick Wagner is a splendid one to behold
Re: The Plus-Minus stat in Lunacy

As super cells count 7.5 times as much as moon rocks, scouting could be simplified by just reporting empty cells upgraded and super cells scored. Super cells will be match deciders when it comes to the elimination rounds.
  #17   Spotlight this post!  
Unread 03-02-2009, 20:35
JackG's Avatar
JackG JackG is offline
Internet is a series of ubertubes?
FRC #0001 (Juggernauts)
Team Role: College Student
 
Join Date: Nov 2006
Rookie Year: 2007
Location: Michigan, USA
Posts: 112
JackG is a splendid one to beholdJackG is a splendid one to beholdJackG is a splendid one to beholdJackG is a splendid one to beholdJackG is a splendid one to beholdJackG is a splendid one to beholdJackG is a splendid one to behold
Re: The Plus-Minus stat in Lunacy

Indeed, one would be hard pressed to find a better practicable method of grading the Lunacy bots. OPR-type methods may or may not be as useful this year. Personally, I like the +/- method myself.

Quote:
Originally Posted by Abwehr View Post
Is this stat perfect? Of course not. <G14> will affect the stat, to be sure. And teamwork is not fully acknowledged (e.g. I push this bot into the corner so you can dump into it, but I have scored no points myself). But I think it might be the best - if not simplest - representation (along with Win/Loss records) to score the robots of Lunacy.
Notice the last sentence. Robots of Lunacy is the operative term there. This method would seemingly take no measure of scoring done by humans players. In this year's game, the scoring/shooting capabilities of a team's HP may turn out to almost as important as those of the robot.

One possible way to account for this is to have the scouts track one trailer per person. Then, they could count the number of balls/points scored by each source. Putting the six sheets together should give plenty of data on which to base any metrics.
  #18   Spotlight this post!  
Unread 03-02-2009, 23:13
Bongle's Avatar
Bongle Bongle is offline
Registered User
FRC #2702 (REBotics)
Team Role: Mentor
 
Join Date: Feb 2004
Rookie Year: 2002
Location: Waterloo
Posts: 1,069
Bongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond reputeBongle has a reputation beyond repute
Send a message via MSN to Bongle
Re: The Plus-Minus stat in Lunacy

Quote:
Originally Posted by CaptainJack View Post
OPR-type methods may or may not be as useful this year. Personally, I like the +/- method myself.
I disagree. This year, there aren't even things like penalties, bonuses, multipliers, or autonomous to muck things up. Your score is simply how many balls are in your opponent's trailers, which means it should be fairly easy to calculate in an OPR-like style how many balls your team (on average) puts in your opponent's trailers. The best part is that you can (probably) run the opposite, so you can also find how many balls your team receives in its trailers and have that be a useful statistic to figure out which teams are better at avoiding getting scored on. Assuming that it does work both forwards and backwards, that means you can approximate +/- data this year, which you typically haven't been able to in the past.

Very little beats having people sit in stands tabulating data, but as a proxy (or addition) to scouting, OPR will be quite useful this year.

The stuff that really screws up OPR is exponential scoring or other non-linear scoring styles, because with exponential scoring, you end up with nearly meaningless results. Super cells might throw a small wrench into things, but I don't think they will, seeing as they are essentially equivalent to scoring 7.5 moon rocks.

Anyway, we'll see when the first set of scores comes out if an OPR ranking compares nicely with observed data.
  #19   Spotlight this post!  
Unread 03-02-2009, 23:41
EricH's Avatar
EricH EricH is offline
New year, new team
FRC #1197 (Torbots)
Team Role: Engineer
 
Join Date: Jan 2005
Rookie Year: 2003
Location: SoCal
Posts: 19,730
EricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond repute
Re: The Plus-Minus stat in Lunacy

Quote:
Originally Posted by Bongle View Post
I disagree. This year, there aren't even things like penalties, bonuses, multipliers, or autonomous to muck things up. Your score is simply how many balls are in your opponent's trailers, which means it should be fairly easy to calculate in an OPR-like style how many balls your team (on average) puts in your opponent's trailers.
I ran through a list of the rules with penalties... there's quite a few. The good news? They shouldn't be called very often and they're mostly just 10-pointers. The bad news? They're still there.

This type of ranking system could be very interesting to implement/calculate.
__________________
Past teams:
2003-2007: FRC0330 BeachBots
2008: FRC1135 Shmoebotics
2012: FRC4046 Schroedinger's Dragons

"Rockets are tricky..."--Elon Musk

  #20   Spotlight this post!  
Unread 03-02-2009, 23:51
jholman jholman is offline
Registered User
FRC #0753 (The High Desert Droids)
Team Role: Student
 
Join Date: Dec 2008
Rookie Year: 2006
Location: Bend, OR
Posts: 10
jholman is an unknown quantity at this point
Re: The Plus-Minus stat in Lunacy

I think +/- is a great stat since it show how good a team is at scoring and avoiding be scored upon. It is very important to take HP into account because their impact could be significant. The problem comes in trying to find 12 scouts (1 for each robot and 1 for each HP) who will be able to consistently be able to show up to matches (especially for small teams). But this could be one of the best scouting methods because it separates it's own score from it's alliance score.
  #21   Spotlight this post!  
Unread 04-02-2009, 08:35
Jared Russell's Avatar
Jared Russell Jared Russell is online now
Taking a year (mostly) off
FRC #0254 (The Cheesy Poofs), FRC #0341 (Miss Daisy)
Team Role: Engineer
 
Join Date: Nov 2002
Rookie Year: 2001
Location: San Francisco, CA
Posts: 3,075
Jared Russell has a reputation beyond reputeJared Russell has a reputation beyond reputeJared Russell has a reputation beyond reputeJared Russell has a reputation beyond reputeJared Russell has a reputation beyond reputeJared Russell has a reputation beyond reputeJared Russell has a reputation beyond reputeJared Russell has a reputation beyond reputeJared Russell has a reputation beyond reputeJared Russell has a reputation beyond reputeJared Russell has a reputation beyond repute
Re: The Plus-Minus stat in Lunacy

Good thoughts, people, and keep it coming!

I agree that the human player is a huge factor this year, and that they need to be scouted as well. Unfortunately there is no way that I can think of to track everything going on without a large number of scouts per round. That said, I think that scoring will be much slower and more controlled in general than people think (I think a good robot this season will score maybe a dozen balls in a round).

As far as special cases go (penalties, miscounting, etc.), I wouldn't get too hung up on them. We acknowledge that statistics have inherent error, and that they only capture a small subset of the "game experience". While we're at it, what about robot failure? I've seen great teams throw a chain early in a match and sit idly by. It happens. This could destroy any sort of averaging stat (especially this year).

All statistics are necessarily incomplete for any nontrivial challenge. Not all RBIs are equal in baseball. Not all touchdowns are equal in the NFL. Not all goals are equal in hockey. But stats are easier to express colloquially. They are meant to supplement our understanding of team performance - NOT be the bottom line.
  #22   Spotlight this post!  
Unread 09-02-2009, 12:26
Lil' Lavery Lil' Lavery is offline
TSIMFD
AKA: Sean Lavery
FRC #1712 (DAWGMA)
Team Role: Mentor
 
Join Date: Nov 2003
Rookie Year: 2003
Location: Philadelphia, PA
Posts: 6,592
Lil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond repute
Send a message via AIM to Lil' Lavery
Re: The Plus-Minus stat in Lunacy

Wow, I just posted a +/- stat as a scouting basis in another thread, before I noticed this one.

Is +/- perfect? No, absolutely not? Is Blake Wheeler the best player in the NHL? Hell no! Is Alexander Ovechkin 2.4x better than Sidney Crosby? Yes, but that's a different story.

But the core idea is what actually matters here. Four stats should be tracked to get an ideal measurement (one of which can be done after the match by looking at scores), "team" +/-, "robot" +/-, alliance +/-, human player balls scored. Potentially you can even have a super cell +/- category for each of those if you wanted.
Additionally each of these stats should be tracked for the event and each individual match.

Robot +/- is how many balls the robot scored against how many are in it's trailer. Team +/- is the robot +/- with the human player balls scored (by their HP) added to the "+" column.
Alliance +/- for an individual match would simply be the score (before penalties, possibly removing super cells if you wished). For an event you may replace this with an "OPR/DPR" style calculation if you prefer.

The ideal tracking solution would be 12 scouts per match. One scout is tracking each robot to see how many balls it scores. At the end of the match they note how many balls were scored in the trailer. That scout also notes some basic traits of how the match was played (robot was pinned, played defensively, etc.).
One scout is also assigned to each human player to track how many balls they score (accuracy can also be noted if you wish). General notes here also apply (throwing into field vs. "feeding" robots).

Both the average +/- and the individual match +/- are going to be very important data. The average should (theoretically) give a fairly imbiased estimation of which robots are best against the field of competitors. The individual match one will show outliers. What happened in those outliers is quite possibly the most important data of all.
Find what went right and what went wrong (based on the quick notes taken) and you ca figure out which teams are reliable, what strategies work for/against them, and what types of robots they match up well against.
That data is going to be a quicker and less subjective method of estimating the abilities of teams.
__________________
Being correct doesn't mean you don't have to explain yourself.
Closed Thread


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
CNC'ing the HL2 Logo plus more Valkyries_698 Chit-Chat 3 18-10-2008 15:07
2007 Excel Stat Tracking paulzeromi Rules/Strategy 2 27-01-2007 17:11
*LIVE* From The VA Stat Fair! Joe Matt Off-Season Events 1 25-09-2004 00:43
QotW 01-04-04: T-minus 5 days. Madison Rumor Mill 25 08-01-2004 01:02
T minus 9 hours archiver 2001 1 24-06-2002 01:35


All times are GMT -5. The time now is 23:26.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi