Go to Post Looks like I'm late, but in the grand tradition of Chief Delphi, I'll butt in and beat the dead horse anyway! - PayneTrain [more]
Home
Go Back   Chief Delphi > Competition > Rules/Strategy
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Closed Thread
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 23-03-2013, 00:13
TheSoftwareGuy TheSoftwareGuy is offline
Registered User
FRC #3410
 
Join Date: Mar 2013
Location: Miami
Posts: 5
TheSoftwareGuy is an unknown quantity at this point
Alliance Selection Strategy

My team is in the fortunate position of possibly being a top 8 team at the Bayou regional, and we would like some tips on how to you guys make your lists for Alliance selection?

Many thanks.
  #2   Spotlight this post!  
Unread 23-03-2013, 01:21
themccannman's Avatar
themccannman themccannman is offline
registered lurker
AKA: Jake McCann
FRC #3501
Team Role: Mentor
 
Join Date: Feb 2013
Rookie Year: 2011
Location: San Jose, CA
Posts: 432
themccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond repute
Re: Alliance Selection Strategy

Scouting, if you guys don't already have a scouting system set up I would just use OPR data to select teams. Also start researching how to make a good system for scouting for next year as it is one of the most important things your team can have. There should be plenty of threads on here with teams explaining how they do scouting. Our team records all offensive data of every robot then uploads it to MS excel and makes a ranked list of all the teams based on offensive performance. We also have 2 other "super-scouts" (I'm one of them) who record subjective data about robots that the statistical data doesn't tell us. Most of what the super-scouts record is information about robot's defensive capabilities, speed, and driving ability. The offensive data is most important for making your first pick and the subjective/defensive data is what we mostly use for making our second pick as we have usually seen that the best alliances are 2 offensive robots and 1 defensive robot. Hope that helps.
__________________
All posts here are purely my own opinion.
2011-2015: 1678
2016: 846
2017 - current: 3501
  #3   Spotlight this post!  
Unread 23-03-2013, 01:39
EricH's Avatar
EricH EricH is offline
New year, new team
FRC #1197 (Torbots)
Team Role: Engineer
 
Join Date: Jan 2005
Rookie Year: 2003
Location: SoCal
Posts: 19,803
EricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond repute
Re: Alliance Selection Strategy

Quote:
Originally Posted by themccannman View Post
Scouting, if you guys don't already have a scouting system set up I would just use OPR data to select teams.
I would start by throwing OPR into the nearest trash can. Skipping over the whole "setting up a scouting system" aspect, which should definitely be done at some point, here is what I would do:

1) Figure out what strategy will get you farthest in eliminations.
2) Compile a list of teams that have things you don't that will fit with the strategy (floor pickup, 30-point climb, full-court shot, etc.). You may need two or three lists, one for each feature.
3) Make sure you have a total of 24 teams at least; not all of them have to be in one category.
4) Consult your first pick as to preferred strategy/good second picks.

But before picking... Talk to some of the potential partners and see what would happen.
__________________
Past teams:
2003-2007: FRC0330 BeachBots
2008: FRC1135 Shmoebotics
2012: FRC4046 Schroedinger's Dragons

"Rockets are tricky..."--Elon Musk

  #4   Spotlight this post!  
Unread 23-03-2013, 02:50
2789_B_Garcia's Avatar
2789_B_Garcia 2789_B_Garcia is offline
Registered User
AKA: Bobby Garcia, AKA: #Catalyst
FRC #2789 (TEXplosion)
Team Role: Coach
 
Join Date: Mar 2011
Rookie Year: 2009
Location: Manor, Tx
Posts: 197
2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future2789_B_Garcia has a brilliant future
Re: Alliance Selection Strategy

Quote:
Originally Posted by EricH View Post
I would start by throwing OPR into the nearest trash can.
He's absolutely right. OPR is calculated with alliance stats in a match and the data can be very misleading about individual robots. Some people argue that the law of averages ultimately sets everything straight, but as the mentor of a predominantly defense-oriented team, I can tell you outright that it doesn't give you an accurate picture of individual robots, and it most certainly doesn't factor in the idea that this game is played with a three team alliance, and if all robots do the same thing, the alliance could easily lose to another alliance with lesser robots that are better organized around a more cohesive strategy.

Ideally, I would consider one offensive robot that plays the game differently from my robot and a good defensive robot...not an ok offensive robot that is put to play defense. One of the best parts of being a lower end picking seed is that you can basically get a decent offensive robot as your first pick and then choose the best defensive robot, but few low-end seeds actually do that.

As far as scouting goes, we keep a pretty extensive database on each robot at a regional and rank them based on their own individual merits. We didn't come up with this method on our own, though...we've asked for/stolen ideas on how to scout from the best teams we've been partnered with. One of the best parts about FIRST is the idea of coopertition (even though it doesn't always play out that way when it's been worked into the actual game), so if anything else, go up to an older, more established team and ask them to share scouting data and tips on how they've scouted the teams at Bayou. I can tell you firsthand that 118's scouting system is very visual, simple to understand and very powerful and informative.
__________________
I saw someone's signature on here say: "A good driver always beats a good robot," and I thought that was rather clever, so I'm using it as my signature.

2014 Texas Robot Roundup Winners (with 624, 118 & Pearland Robotics Pre-Rookie Team)
2014 Texas Robotics Invitational Finalists (with 148, 3735 & 3999)
2014 Dallas Regional Quarterfinalists (with 2587 & 5057)
2014 Alamo Regional Finalists (With 2468 & 148)

Last edited by 2789_B_Garcia : 23-03-2013 at 09:22.
  #5   Spotlight this post!  
Unread 23-03-2013, 09:44
TheSoftwareGuy TheSoftwareGuy is offline
Registered User
FRC #3410
 
Join Date: Mar 2013
Location: Miami
Posts: 5
TheSoftwareGuy is an unknown quantity at this point
Re: Alliance Selection Strategy

Thank you everybody for your replies.
  #6   Spotlight this post!  
Unread 23-03-2013, 10:51
jspatz1's Avatar
jspatz1 jspatz1 is offline
Registered User
AKA: Jeff
FRC #1986 (Team Titanium)
Team Role: Mentor
 
Join Date: Jan 2008
Rookie Year: 2007
Location: Lee's Summit, MO
Posts: 835
jspatz1 has a reputation beyond reputejspatz1 has a reputation beyond reputejspatz1 has a reputation beyond reputejspatz1 has a reputation beyond reputejspatz1 has a reputation beyond reputejspatz1 has a reputation beyond reputejspatz1 has a reputation beyond reputejspatz1 has a reputation beyond reputejspatz1 has a reputation beyond reputejspatz1 has a reputation beyond reputejspatz1 has a reputation beyond repute
Send a message via AIM to jspatz1
Re: Alliance Selection Strategy

5. Visit the pit of as many robots as possible from your list, and find out what the health/status of the robot is.
  #7   Spotlight this post!  
Unread 24-03-2013, 01:14
themccannman's Avatar
themccannman themccannman is offline
registered lurker
AKA: Jake McCann
FRC #3501
Team Role: Mentor
 
Join Date: Feb 2013
Rookie Year: 2011
Location: San Jose, CA
Posts: 432
themccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond repute
Re: Alliance Selection Strategy

I would just like to note that if you are picking a robot for the sole purpose of offense OPR is the best system you have you don't already have a scouting system. The OPR ranking has a .9 correlation with our teams actual, quantitative offensive ranking of teams (how many points each team actually scores in a match) so when you say OPR isn't accurate at telling you which robots are good offensive bots you are wrong, it is 90% accurate. For your third alliance partner you need to completely ignore OPR and seeded ranking and just look at what robots fit your strategy best, that might be a defensive robot with nothing but a drive train, or it might be a robot that can feed you disks half-court from the feeder station (if you have a aground pick-up) or it might be a bot that can climb for 30 points and stay out of your way for the rest of the match.

TL;DR: a good scouting system is irreplaceable, however OPR does tell you, with 90% accuracy, which robots score the most points consistently (this may not mean they are the best pick though).
__________________
All posts here are purely my own opinion.
2011-2015: 1678
2016: 846
2017 - current: 3501
  #8   Spotlight this post!  
Unread 24-03-2013, 10:37
Donut Donut is offline
The Arizona Mentor
AKA: Andrew
FRC #2662 (RoboKrew)
Team Role: Engineer
 
Join Date: Mar 2005
Rookie Year: 2004
Location: Goodyear, AZ
Posts: 1,302
Donut has a reputation beyond reputeDonut has a reputation beyond reputeDonut has a reputation beyond reputeDonut has a reputation beyond reputeDonut has a reputation beyond reputeDonut has a reputation beyond reputeDonut has a reputation beyond reputeDonut has a reputation beyond reputeDonut has a reputation beyond reputeDonut has a reputation beyond reputeDonut has a reputation beyond repute
Re: Alliance Selection Strategy

Quote:
Originally Posted by themccannman View Post
I would just like to note that if you are picking a robot for the sole purpose of offense OPR is the best system you have you don't already have a scouting system. The OPR ranking has a .9 correlation with our teams actual, quantitative offensive ranking of teams (how many points each team actually scores in a match) so when you say OPR isn't accurate at telling you which robots are good offensive bots you are wrong, it is 90% accurate. For your third alliance partner you need to completely ignore OPR and seeded ranking and just look at what robots fit your strategy best, that might be a defensive robot with nothing but a drive train, or it might be a robot that can feed you disks half-court from the feeder station (if you have a aground pick-up) or it might be a bot that can climb for 30 points and stay out of your way for the rest of the match.

TL;DR: a good scouting system is irreplaceable, however OPR does tell you, with 90% accuracy, which robots score the most points consistently (this may not mean they are the best pick though).
Is this always the case, or is it 90% accurate at just the regional you attended? I haven't checked the correlation at the Wisconsin regional, but comparing OPR data to the scouting data we collected on individual robot scoring from Friday shows OPR to be off quite a bit at a quick glance. 4212 was far and away the highest scoring average robot at the regional (by at least a 10 point margin) but was 4th in OPR. We (167) were about the 9th highest average scoring robot at the regional but are 26th in OPR. 1732 was 8th in OPR but I believe was closer to 3rd in actual robot scoring.

Of course, Wisconsin could also be an outlier in its own right as far as OPR correlation. I noticed off hand that the regional tended to be very balanced as far as quality scoring machines were concerned. There was not any clearly dominant scoring team like 987 or 2056 at the regional, instead there were 12 or so top teams that all scored between 40 and 60 points a match on average, then the average slowly dropped down until you had to get probably 24 teams in before teams were averaging less than 20 points a match.
__________________
FRC Team 498 (Peoria, AZ), Student: 2004 - 2007
FRC Team 498 (Peoria, AZ), Mentor: 2008 - 2011
FRC Team 167 (Iowa City, IA), Mentor: 2012 - 2014
FRC Team 2662 (Tolleson, AZ), Mentor: 2014 - Present
  #9   Spotlight this post!  
Unread 25-03-2013, 02:05
themccannman's Avatar
themccannman themccannman is offline
registered lurker
AKA: Jake McCann
FRC #3501
Team Role: Mentor
 
Join Date: Feb 2013
Rookie Year: 2011
Location: San Jose, CA
Posts: 432
themccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond reputethemccannman has a reputation beyond repute
Re: Alliance Selection Strategy

OPR has been within 90% accurate at all of the last 5 events we attended (6 once nationals rolls around) so if you don't have a quantitative scouting system to track every team OPR is your best bet.
__________________
All posts here are purely my own opinion.
2011-2015: 1678
2016: 846
2017 - current: 3501
  #10   Spotlight this post!  
Unread 25-03-2013, 08:12
Gregor's Avatar
Gregor Gregor is offline
#StickToTheStratisQuo
AKA: Gregor Browning
no team
Team Role: College Student
 
Join Date: Jan 2012
Rookie Year: 2012
Location: Kingston, Ontario, Canada
Posts: 2,447
Gregor has a reputation beyond reputeGregor has a reputation beyond reputeGregor has a reputation beyond reputeGregor has a reputation beyond reputeGregor has a reputation beyond reputeGregor has a reputation beyond reputeGregor has a reputation beyond reputeGregor has a reputation beyond reputeGregor has a reputation beyond reputeGregor has a reputation beyond reputeGregor has a reputation beyond repute
Re: Alliance Selection Strategy

Don't count out rookies, they can surprise you.
__________________
What are nationals? Sounds like a fun American party, can we Canadians come?
“For me, insanity is super sanity. The normal is psychotic. Normal means lack of imagination, lack of creativity.” -Jean Dubuffet
"Insanity is doing the same thing over and over again and expecting different results." -Albert Einstein
FLL 2011-2015 Glen Ames Robotics-Student, Mentor
FRC 2012-2013 Team 907-Scouting Lead, Strategy Lead, Human Player, Driver
FRC 2014-2015 Team 1310-Mechanical, Electrical, Drive Captain
FRC 2011-xxxx Volunteer
How I came to be a FIRSTer
<Since 2011
  #11   Spotlight this post!  
Unread 25-03-2013, 10:09
efoote868 efoote868 is offline
foote stepped in
AKA: E. Foote
FRC #0868
Team Role: Mentor
 
Join Date: Mar 2006
Rookie Year: 2005
Location: Noblesville, IN
Posts: 1,414
efoote868 has a reputation beyond reputeefoote868 has a reputation beyond reputeefoote868 has a reputation beyond reputeefoote868 has a reputation beyond reputeefoote868 has a reputation beyond reputeefoote868 has a reputation beyond reputeefoote868 has a reputation beyond reputeefoote868 has a reputation beyond reputeefoote868 has a reputation beyond reputeefoote868 has a reputation beyond reputeefoote868 has a reputation beyond repute
Re: Alliance Selection Strategy

Quote:
Originally Posted by Donut View Post
Is this always the case, or is it 90% accurate at just the regional you attended? I haven't checked the correlation at the Wisconsin regional, but comparing OPR data to the scouting data we collected on individual robot scoring from Friday shows OPR to be off quite a bit at a quick glance
At Boilermaker Regional, I calculated OPR as well as match predictions for Saturday (after teams had played 8 or 9 matches). It predicted the winning alliance correctly 20 out of 24 times. Score predictions were low by about 10-20 points on average, but that showed that robots were improving.

The other thing that surprised me about the Boilermaker OPR is that there were a couple of cases that demonstrated accuracy. There were 2 single purpose robots in particular - one that hung for 30 points and one that hung for 10 points. OPR after Friday was 29 and 11 respectively. Anecdotal evidence I'm sure, but it seems that this year's game is easy to decompose (even easier than last year).

OPR might be good at identifying top pick candidates, but nothing beats old fashioned scouting. My advice is to write down 5-10 attributes you think make a robot "good" for the game. This year, accuracy, distance, as well as how quickly can they hang, and floor pickup are good attributes. Attributes that are pretty universal between games describe robot drive trains, like speed and pushing power.

The next step is to find 3 or 6 dedicated students to watch robots from the stands. These students need to focus on a single robot during each match, writing down as much detail as they possibly can.

The last thing you might consider is writing down robot *features*. When I was watching matches this year, whenever I saw a battery move within a robot, I advised the scouters to note it. It's a hard lesson to learn, but it sunk my team and our alliance during eliminations in 2006 when our battery wasn't secured properly and knocked open our pneumatic release valve, and disabled the robot through the remainder of the match. There are other things like this that are easy to spot (bumpers dragging on the floor), that can potentially draw lots of fouls or a disabled robot.

Hope this helps your scouting effort!
__________________
Be Healthy. Never Stop Learning. Say It Like It Is. Own It.

Like our values? Flexware Innovation is looking for Automation Engineers. Check us out!
  #12   Spotlight this post!  
Unread 25-03-2013, 15:08
Lil' Lavery Lil' Lavery is offline
TSIMFD
AKA: Sean Lavery
FRC #1712 (DAWGMA)
Team Role: Mentor
 
Join Date: Nov 2003
Rookie Year: 2003
Location: Philadelphia, PA
Posts: 6,634
Lil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond repute
Send a message via AIM to Lil' Lavery
Re: Alliance Selection Strategy

Quote:
Originally Posted by efoote868 View Post
The other thing that surprised me about the Boilermaker OPR is that there were a couple of cases that demonstrated accuracy. There were 2 single purpose robots in particular - one that hung for 30 points and one that hung for 10 points. OPR after Friday was 29 and 11 respectively. Anecdotal evidence I'm sure, but it seems that this year's game is easy to decompose (even easier than last year).
Not going to get into a full OPR rant, but I will briefly mention something about this anecdote. Those OPR figures would only be accurate if those robots were 100% successful in their climbing attempts.
  #13   Spotlight this post!  
Unread 25-03-2013, 15:56
Joe Ross's Avatar Unsung FIRST Hero
Joe Ross Joe Ross is offline
Registered User
FRC #0330 (Beachbots)
Team Role: Engineer
 
Join Date: Jun 2001
Rookie Year: 1997
Location: Los Angeles, CA
Posts: 8,574
Joe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond repute
Re: Alliance Selection Strategy

Quote:
Originally Posted by themccannman View Post
OPR has been within 90% accurate at all of the last 5 events we attended (6 once nationals rolls around) so if you don't have a quantitative scouting system to track every team OPR is your best bet.
What data did you use to determine it was 90% accurate?
  #14   Spotlight this post!  
Unread 25-03-2013, 16:41
KrazyCarl92's Avatar
KrazyCarl92 KrazyCarl92 is offline
Registered User
AKA: Carl Springli
FRC #5811 (The BONDS)(EWCP)
Team Role: Mentor
 
Join Date: Jan 2010
Rookie Year: 2010
Location: Dayton, OH
Posts: 521
KrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond reputeKrazyCarl92 has a reputation beyond repute
Re: Alliance Selection Strategy

Quote:
Originally Posted by Joe Ross View Post
What data did you use to determine it was 90% accurate?
I have the same gripe. It sounds like they have found a correlation coefficient of 0.9 between the explanatory variable (OPR) and the dependent variable (Avg. Score). In this case it is poor interpretation to say that this is 90% accurate. However, due to an R^2 value of 0.81, it would be acceptable to say that 81% of the variation in Avg. Score can be explained by variation in OPR. Saying it is 90% accurate based on a correlation coefficient of 0.9 is poor analysis of a statistical regression (it sounds like this is the mathematical tool being used).
__________________
[2017-present] FRC 0020 - The Rocketeers
[2016] FRC 5811 - BONDS Robotics
[2010-2015] FRC 0020 - The Rocketeers
  #15   Spotlight this post!  
Unread 25-03-2013, 16:44
MisterG's Avatar
MisterG MisterG is offline
Think twice post once.
AKA: Alan Gilgenbach
FRC #2062 (C.O.R.E. - Community of Robotics Engineers)
Team Role: Team Spirit / Cheering
 
Join Date: Mar 2011
Rookie Year: 2011
Location: Waukesha, WI
Posts: 120
MisterG is a name known to allMisterG is a name known to allMisterG is a name known to allMisterG is a name known to allMisterG is a name known to allMisterG is a name known to all
Re: Alliance Selection Strategy

Collecting and compiling statistics on individual team contribution can be very helpful. This is the type of system that CORE uses for data collection and it is very labor intensive.

Scouting is a lot like building in that you need to consider the capability of your team in your planning.

For smaller/newer teams I would suggest some kind of partnership with a larger and/or more established team. You can get some data from them and then work on your own strategy using their numbers.

Otherwise, OPR or FRCminer are good sources of impartial data even if they are not 100% representative of the teams individual capabilities.

I hope the OP had a good outcome at Bayou and I would encourage all teams to keep practicing and growing your scout-egy capabilities. If you wait until you are going to need the data you probably will not get up to speed in time.

-mister g
__________________
Alan Gilgenbach
C.O.R.E 2062
Closed Thread


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 17:26.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi