Go to Post Be kind to you mentors. They are exhausted and you need them. - MrJohnston [more]
Home
Go Back   Chief Delphi > FIRST > General Forum
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
Thread Tools Rating: Thread Rating: 5 votes, 4.60 average. Display Modes
  #16   Spotlight this post!  
Unread 02-12-2012, 00:08
Ed Law's Avatar
Ed Law Ed Law is offline
Registered User
no team (formerly with 2834)
 
Join Date: Apr 2008
Rookie Year: 2009
Location: Foster City, CA, USA
Posts: 752
Ed Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond repute
Re: How to Win a Robotics Competition

Quote:
Originally Posted by JosephC View Post
Scouting isn't just important in Alliance selections; when your looking for the best robot to fit into your alliance, and not necessarily the best overall robot, but also in Match play.

Teams that do not scout will be going into matches blind, with no idea of what to do. Those who have collected data on robots can say, "Robot A is a really good shooter, we need to play defense on them; hey alliance partner B, since our data says your not the very best shooter would you mind playing defense on Robot A for us?"

Now for luck. Personally I believe that luck has very little to do with FRC. I've heard 5-6 teams say after a match, "Team A won because they got lucky." Unless there was a penalty that should of been called and it wasn't; then Team A used something called "Strategy". Strategy is this little thing that weaker teams use to beat stronger teams; and it isn't "Luck"

As for Quals; Teams can get lucky 2 or 3 matches and have some really good match ups; But I've never seen a bad robot be in the Top 8 after 12 matches. They may not be the best scorer, but they might be a great defensive robot.

Everything boils down to this:
FRC is 1% Luck; 40% skill and 90% Strategy.
I completely agree with you. Scouting and strategy are my passion. That's all I do at competitions. However I think you meant FRC is 0.76% Luck, 30.53% Skill and 68.71% Strategy.
__________________
Please don't call me Mr. Ed, I am not a talking horse.
Reply With Quote
  #17   Spotlight this post!  
Unread 02-12-2012, 00:54
F22Rapture's Avatar
F22Rapture F22Rapture is offline
College Student, Mentor
AKA: Daniel A
FRC #3737 (4H Rotoraptors)
Team Role: Mentor
 
Join Date: Jan 2012
Rookie Year: 2012
Location: Goldsboro, NC
Posts: 476
F22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant future
Re: How to Win a Robotics Competition

Quote:
Originally Posted by edwardj View Post
I'm not a scouting expert, but I think people tend to overcomplicate scouting with incredible amounts of data.

At a robotics tournament, the main difficulty with scouting is because there's way too much data on everyone's robot, and it's hard to process all of that data.
I agree 100%. While I'm sure this isn't true for everybody, I've always found that the majority of scouting data never really gets used to make a decision.
  • Robot's technical ability to complete each of the subtasks of autonomous, scoring, defending, and endgame from 0 to 10, judged to a certain extent on Thursday to be revised later
  • Overall performance from 0 to 10 from each of the 10 matches

Each of the subtasks will be weighted by importance to the game (30% for endgame, 40% scoring, etc.) and then averaged together, giving a single technical average to deal with.

The each of a team's performances from their10 matches are averaged together with the first 4 matches weighted 5%, second 2 matches weighted 10%, and the last four matches weighted 15%. This gives a single performance average to deal with.

It's very simple math, it's not much data to go through, and it can be easily done in Excel with no special scouting software. And once we've finished, it's very easy to sort, filter, and manipulate to get a good list of teams. It's perfect for smaller teams since it only takes 2-3 scouts to come up with a single performance score for each robot, and maybe a few comments to change their tech score and note their predominant strategies. And they can spend their time watching the match instead of writing.

It's not fancy, perhaps not Nate Silver levels of accuracy, but it's fast and can narrow a field of 40-80 teams down to only 10 or 15 almost instantly (with little information backlog), meaning that you can then focus your time and efforts on those teams when you start going around the pits to make connections.
__________________
Research is what I’m doing when I don’t know what I’m doing.
- Wernher von Braun
Attending: Raleigh NC Regional

Last edited by F22Rapture : 02-12-2012 at 00:57.
Reply With Quote
  #18   Spotlight this post!  
Unread 02-12-2012, 01:02
dcarr's Avatar
dcarr dcarr is offline
#HoldStrong
AKA: David Carr
FRC #3309 (Friarbots)
Team Role: Mentor
 
Join Date: Dec 2010
Rookie Year: 2009
Location: Anaheim
Posts: 954
dcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond repute
Re: How to Win a Robotics Competition

Quote:
Originally Posted by F22Rapture View Post
I agree 100%. While I'm sure this isn't true for everybody, I've always found that the majority of scouting data never really gets used to make a decision.
  • Robot's technical ability to complete each of the subtasks of autonomous, scoring, defending, and endgame from 0 to 10, judged to a certain extent on Thursday to be revised later
  • Overall performance from 0 to 10 from each of the 10 matches

Each of the subtasks will be weighted by importance to the game (30% for endgame, 40% scoring, etc.) and then averaged together, giving a single technical average to deal with.

The each of a team's performances from their10 matches are averaged together with the first 4 matches weighted 5%, second 2 matches weighted 10%, and the last four matches weighted 15%. This gives a single performance average to deal with.

It's very simple math, it's not much data to go through, and it can be easily done in Excel with no special scouting software. And once we've finished, it's very easy to sort, filter, and manipulate to get a good list of teams. It's perfect for smaller teams since it only takes 2-3 scouts to come up with a single performance score for each robot, and maybe a few comments to change their tech score and note their predominant strategies. And they can spend their time watching the match instead of writing.

It's not fancy, perhaps not Nate Silver levels of accuracy, but it's fast and can narrow a field of 40-80 teams down to only 10 or 15 almost instantly (with little information backlog), meaning that you can then focus your time and efforts on those teams when you start going around the pits to make connections.
If your final score for each team is based on its overall performance, however, this data isn't particularly useful in discerning the strengths of different teams and how they fit into an alliance.
__________________
Team 3309
2016 Los Angeles Chairman's Award Winner
2016 Orange County Regional Winner with 3476 & 6220
Team3309.org
Orange County Robotics Alliance
Reply With Quote
  #19   Spotlight this post!  
Unread 02-12-2012, 01:18
F22Rapture's Avatar
F22Rapture F22Rapture is offline
College Student, Mentor
AKA: Daniel A
FRC #3737 (4H Rotoraptors)
Team Role: Mentor
 
Join Date: Jan 2012
Rookie Year: 2012
Location: Goldsboro, NC
Posts: 476
F22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant future
Re: How to Win a Robotics Competition

Quote:
Originally Posted by dcarr View Post
If your final score for each team is based on its overall performance, however, this data isn't particularly useful in discerning the strengths of different teams and how they fit into an alliance.
Well, my overall point was that you can figure out the overall strength directly after the seeding matches end, and then spend the next 2 hours working out which robots of those are most compatible with your own and making connections with those teams. It's primarily a way of focusing your effort, not doing everything for you.
__________________
Research is what I’m doing when I don’t know what I’m doing.
- Wernher von Braun
Attending: Raleigh NC Regional

Last edited by F22Rapture : 02-12-2012 at 01:22.
Reply With Quote
  #20   Spotlight this post!  
Unread 02-12-2012, 01:29
dcarr's Avatar
dcarr dcarr is offline
#HoldStrong
AKA: David Carr
FRC #3309 (Friarbots)
Team Role: Mentor
 
Join Date: Dec 2010
Rookie Year: 2009
Location: Anaheim
Posts: 954
dcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond repute
Re: How to Win a Robotics Competition

Quote:
Originally Posted by F22Rapture View Post
Well, my overall point was that you can figure out the overall strength directly after the seeding matches end, and then spend the next 2 hours working out which robots of those are most compatible with your own and making connections with those teams. It's primarily a way of focusing your effort, not doing everything for you.
Got it. That makes sense. You want to be choosing a robot that fits your alliance needs from a subset that has been determined to be good.
__________________
Team 3309
2016 Los Angeles Chairman's Award Winner
2016 Orange County Regional Winner with 3476 & 6220
Team3309.org
Orange County Robotics Alliance
Reply With Quote
  #21   Spotlight this post!  
Unread 02-12-2012, 02:07
Ed Law's Avatar
Ed Law Ed Law is offline
Registered User
no team (formerly with 2834)
 
Join Date: Apr 2008
Rookie Year: 2009
Location: Foster City, CA, USA
Posts: 752
Ed Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond repute
Re: How to Win a Robotics Competition

Quote:
Originally Posted by F22Rapture View Post
I agree 100%. While I'm sure this isn't true for everybody, I've always found that the majority of scouting data never really gets used to make a decision.
  • Robot's technical ability to complete each of the subtasks of autonomous, scoring, defending, and endgame from 0 to 10, judged to a certain extent on Thursday to be revised later
  • Overall performance from 0 to 10 from each of the 10 matches

Each of the subtasks will be weighted by importance to the game (30% for endgame, 40% scoring, etc.) and then averaged together, giving a single technical average to deal with.

The each of a team's performances from their10 matches are averaged together with the first 4 matches weighted 5%, second 2 matches weighted 10%, and the last four matches weighted 15%. This gives a single performance average to deal with.

It's very simple math, it's not much data to go through, and it can be easily done in Excel with no special scouting software. And once we've finished, it's very easy to sort, filter, and manipulate to get a good list of teams. It's perfect for smaller teams since it only takes 2-3 scouts to come up with a single performance score for each robot, and maybe a few comments to change their tech score and note their predominant strategies. And they can spend their time watching the match instead of writing.

It's not fancy, perhaps not Nate Silver levels of accuracy, but it's fast and can narrow a field of 40-80 teams down to only 10 or 15 almost instantly (with little information backlog), meaning that you can then focus your time and efforts on those teams when you start going around the pits to make connections.
While this method is an easy way to reduce the number of teams that you have to focus your scouting, you may have screened out a team that may be very beneficial to your alliance. One number cannot tell you how to find a robot that has some special attributes that you need.
That's why we collect all the data that we need. We don't scout just to keep people occupied. We use every piece of information we gathered. If there is anything we didn't use, we remove it from the scouting sheet at the next event.
__________________
Please don't call me Mr. Ed, I am not a talking horse.
Reply With Quote
  #22   Spotlight this post!  
Unread 02-12-2012, 03:12
F22Rapture's Avatar
F22Rapture F22Rapture is offline
College Student, Mentor
AKA: Daniel A
FRC #3737 (4H Rotoraptors)
Team Role: Mentor
 
Join Date: Jan 2012
Rookie Year: 2012
Location: Goldsboro, NC
Posts: 476
F22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant futureF22Rapture has a brilliant future
Re: How to Win a Robotics Competition

Quote:
Originally Posted by Ed Law View Post
While this method is an easy way to reduce the number of teams that you have to focus your scouting, you may have screened out a team that may be very beneficial to your alliance. One number cannot tell you how to find a robot that has some special attributes that you need.
That's why we collect all the data that we need. We don't scout just to keep people occupied. We use every piece of information we gathered. If there is anything we didn't use, we remove it from the scouting sheet at the next event.
I tend to feel like that's something that's noticed in-person though, or in a specific note taken during, but not really gleaned from the statistics. If one of our scouts noticed that X team had something special that would really fit well with our team then there's no reason why we can't take note of that.
__________________
Research is what I’m doing when I don’t know what I’m doing.
- Wernher von Braun
Attending: Raleigh NC Regional
Reply With Quote
  #23   Spotlight this post!  
Unread 02-12-2012, 15:16
JosephC's Avatar
JosephC JosephC is offline
FF: Breakfast Company
AKA: Joseph Cupchack
no team (FiM Volunteer Extraordinaire)
 
Join Date: Sep 2010
Rookie Year: 2011
Location: Waterford, Michigan
Posts: 1,752
JosephC has a reputation beyond reputeJosephC has a reputation beyond reputeJosephC has a reputation beyond reputeJosephC has a reputation beyond reputeJosephC has a reputation beyond reputeJosephC has a reputation beyond reputeJosephC has a reputation beyond reputeJosephC has a reputation beyond reputeJosephC has a reputation beyond reputeJosephC has a reputation beyond reputeJosephC has a reputation beyond repute
Re: How to Win a Robotics Competition

Quote:
Originally Posted by F22Rapture View Post
I tend to feel like that's something that's noticed in-person though, or in a specific note taken during, but not really gleaned from the statistics. If one of our scouts noticed that X team had something special that would really fit well with our team then there's no reason why we can't take note of that.
This season we are doing the same thing the Ed Law does; as in having 6 students scout each match for quantitative data; and we are also having two students scout each match for qualitative data; giving us the best of both worlds. This setup does require 8 students at any given time, but it is by far the best system I've seen so far.
__________________
Referee: 2015 - ?
Field Reset/Supervisor: 2013 - ?
68 Team Member: 2011 - 2013
Reply With Quote
  #24   Spotlight this post!  
Unread 02-12-2012, 15:51
dcarr's Avatar
dcarr dcarr is offline
#HoldStrong
AKA: David Carr
FRC #3309 (Friarbots)
Team Role: Mentor
 
Join Date: Dec 2010
Rookie Year: 2009
Location: Anaheim
Posts: 954
dcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond reputedcarr has a reputation beyond repute
Re: How to Win a Robotics Competition

This is a scouting related question that somewhat relates to this thread: What are successful ways to motivate students to do a quality job scouting (both quantitatively and qualitatively) when they do not think their work will be used in the alliance selection process?

My answer would be: quality scouting data is essential for developing the strategy for any and every match, not just eliminations. Also, even if you are not ranked #1-8, but are within a few places of that, the possibility of getting bumped up as the top teams consolidate, and then needing to choose an alliance, is very real. In addition, when attending multiple regionals with a lot of the same teams participating, having quality data on a lot of the teams ahead of time has huge benefits.
__________________
Team 3309
2016 Los Angeles Chairman's Award Winner
2016 Orange County Regional Winner with 3476 & 6220
Team3309.org
Orange County Robotics Alliance
Reply With Quote
  #25   Spotlight this post!  
Unread 02-12-2012, 18:44
Golto's Avatar
Golto Golto is offline
Registered User
AKA: Pat Plude
FRC #4572 (BArlow RobAutics)
Team Role: Mentor
 
Join Date: Oct 2006
Rookie Year: 2007
Location: Bethel, CT
Posts: 91
Golto is a glorious beacon of lightGolto is a glorious beacon of lightGolto is a glorious beacon of lightGolto is a glorious beacon of lightGolto is a glorious beacon of light
Re: How to Win a Robotics Competition

We always did best when we took the emphasis off of winning the competition. The less pressure that is on the team, the better they tend to perform as a whole.

One thing to remember is that the bulk of FIRST competitions are not about the robot's performance, it has a more human touch to it.

Develop your team, get excited, have fun, and the ideas, innovation, and even the execution will flow much better. In short, take the pressure off.
__________________
Reply With Quote
  #26   Spotlight this post!  
Unread 02-12-2012, 20:32
Alpha Beta's Avatar
Alpha Beta Alpha Beta is offline
Strategy, Scouting, and LabVIEW
AKA: Mr. Aaron Bailey
FRC #1986 (Team Titanium)
Team Role: Coach
 
Join Date: Mar 2008
Rookie Year: 2007
Location: Lee's Summit, Missouri
Posts: 763
Alpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond reputeAlpha Beta has a reputation beyond repute
Re: How to Win a Robotics Competition

Quote:
Originally Posted by dcarr View Post
What are successful ways to motivate students to do a quality job scouting (both quantitatively and qualitatively) when they do not think their work will be used in the alliance selection process?
Let them be fans of the game, not just their own team. My College and Pro football teams are having (had) bad years. Making penny bets with family members or creating fantasy leagues helps keep the interest up. It can work with scouting groups too.

Challenge them to make a pick-list and give bragging rights to the scout who picks the closest to the actual draft.

Once the picking is done have each scout predict the elimination bracket including number of games per match and score (Similar to an NCAA bracket) Cover dinner for the winning scout.

Consider a head scout a 5th member of the drive team. Give it some prestige and have a member of the drive team come to the stands between matches to discuss their thoughts on the upcoming match.

Keep in mind that scouting can have a long-term payoff too. When my non-graduating team members tour the pit and evaluate the success of a design they are also expanding their engineering and best practices knowledge base. We encourage team members to jot down notes and take pictures of interesting robot features. I also encourage them to try to figure out how it works before asking for a tour of the robot features.

Robustness is a key attribute, and generally one or more robots will not survive the elimination rounds. A side bet on which robot will need to be replaced first can be interesting. Rooting for a robot to break is in poor taste, but while looking for candidates you are inadvertently making a list of teams that you might be able to offer mechanical assistance to.
__________________
Regional Wins: 2016(KC), 2015(St. Louis, Queen City), 2014(Central Illinois, KC), 2013(Hub City, KC, Oklahoma City), 2012(KC, St. Louis), 2011(Colorado), 2010(North Star)
Regional Chairman's Award: 2014(Central Illinois), 2009(10,000 Lakes)
Engineering Inspiration: 2016(Smoky Mountain), 2012(Kansas City), 2011(Denver)
Dean's List Finalist 2016(Jacob S), 2014(Cameron L), 2013(Jay U), 2012(Laura S), 2011(Dominic A), 2010(Collin R)
Woodie Flowers Finalist 2013 (Aaron Bailey)
Championships: Sub-Division Champion (2016), Finalist (2013, 2010), Semifinalist (2014), Quaterfinalist (2015, 2012, 2011)
Other Official Awards: Gracious Professionalism (2013) Entrepreneurship (2013), Quality (2015, 2015, 2013), Engineering Excellence (Champs 2013, 2012), Website (2011), Industrial Design (Archimedes/Tesla 2016, 2016, 2015, Newton 2014, 2013, 2011), Innovation in Control (2014, Champs 2010, 2010, 2008, 2008), Imagery (2009), Regional Finalist (2016, 2015, 2008)
Reply With Quote
  #27   Spotlight this post!  
Unread 02-12-2012, 23:37
Siri's Avatar
Siri Siri is offline
Dare greatly
AKA: 1640 coach 2010-2014
FRC #2641 (PCCR; Refs & RIs)
Team Role: Coach
 
Join Date: Jan 2008
Rookie Year: 2007
Location: PA
Posts: 1,639
Siri has a reputation beyond reputeSiri has a reputation beyond reputeSiri has a reputation beyond reputeSiri has a reputation beyond reputeSiri has a reputation beyond reputeSiri has a reputation beyond reputeSiri has a reputation beyond reputeSiri has a reputation beyond reputeSiri has a reputation beyond reputeSiri has a reputation beyond reputeSiri has a reputation beyond repute
Send a message via ICQ to Siri
Re: How to Win a Robotics Competition

Quote:
Originally Posted by dcarr View Post
What are successful ways to motivate students to do a quality job scouting (both quantitatively and qualitatively) when they do not think their work will be used in the alliance selection process?
You watch the scouting section of Karthik's presentation.

We're also considering running an internal Fantasy FIRST League: draft your own teams, become the all-around expert on them (prior events, pit scouting and match data).
__________________
Reply With Quote
  #28   Spotlight this post!  
Unread 03-12-2012, 01:07
Ed Law's Avatar
Ed Law Ed Law is offline
Registered User
no team (formerly with 2834)
 
Join Date: Apr 2008
Rookie Year: 2009
Location: Foster City, CA, USA
Posts: 752
Ed Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond reputeEd Law has a reputation beyond repute
Re: How to Win a Robotics Competition

Quote:
Originally Posted by dcarr View Post
This is a scouting related question that somewhat relates to this thread: What are successful ways to motivate students to do a quality job scouting (both quantitatively and qualitatively) when they do not think their work will be used in the alliance selection process?
When students see that the data they collect are used in every match we are in and how it helped us make better decision, they will try their best to collect accurate data. Another factor that works for our team is since I am the coach and I am intimately involved in scouting data, the students will never turn in a blank piece of paper.

This year we are moving to tablets (discussed in another thread). It makes it easier to add other fun things. As part of the data collection, the students will predict the alliance selection order. We have not decided what the reward is yet for the winner. I will let the team decide.
__________________
Please don't call me Mr. Ed, I am not a talking horse.
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 03:50.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi