Go to Post from time to time, we all need a good smack to make us see when we screwed up and did something we shouldn't have. - Andrew Schreiber [more]
Home
Go Back   Chief Delphi > Competition > Rules/Strategy > Scouting
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 20-01-2017, 19:39
Matt Flickinger Matt Flickinger is offline
Registered User
FRC #0068
 
Join Date: Jan 2015
Location: Ortonville
Posts: 1
Matt Flickinger is an unknown quantity at this point
2017 Proposed Scouting Methods

Hello,
I am a lead scouting and strategy member for Truck Town Thunder, and a dilemma we've come up with is that it will be nearly impossible to count the number of balls going into the low goal, and very hard to count the number of balls going into the high goal when the shooters are very fast. I am posting this thread to ask what other methods other people have come up with to get past this problem, or to possibly brainstorm ideas.
Sincerely, MF.
Reply With Quote
  #2   Spotlight this post!  
Unread 20-01-2017, 19:56
6101 Robert 6101 Robert is offline
Registered User
FRC #6101 (The Strange Quarks)
Team Role: Leadership
 
Join Date: Jun 2016
Rookie Year: 2016
Location: Ypsilanti, Michigan
Posts: 14
6101 Robert is an unknown quantity at this point
Re: 2017 Proposed Scouting Methods

What if you have your scouts estimate the average capacity of the team's hopper when they unload it (to the nearest 10^1) and count the number of times a teams unloads their hopper.

That wouldn't be accurate enough of a system to select alliance partners based simply off of an algorithm, but you would be able to graph (or otherwise display) how teams stacked up against each other in terms of fuel. To increase the accuracy of your estimation, you could ask them directly what their maximum capacity is.
Reply With Quote
  #3   Spotlight this post!  
Unread 20-01-2017, 19:59
JR0405's Avatar
JR0405 JR0405 is offline
Electrical & Pneumatics/Mechanical
AKA: Jack Ross
FRC #5822 (Wolfbyte)
Team Role: Driver
 
Join Date: Jan 2016
Rookie Year: 2011
Location: Chicago, IL
Posts: 141
JR0405 is a name known to allJR0405 is a name known to allJR0405 is a name known to allJR0405 is a name known to allJR0405 is a name known to allJR0405 is a name known to all
Re: 2017 Proposed Scouting Methods

As other people in other threads have said, this years game will require a lot more qualitative and opinion based scouting then past years. So instead of this team made 7 out of 10 shots your scouting sheet or app would have different groups of percentages.
__________________
#StaySavage
Reply With Quote
  #4   Spotlight this post!  
Unread 20-01-2017, 20:16
Jarren Harkema's Avatar
Jarren Harkema Jarren Harkema is offline
Dancing Drive Coach
FRC #4967 (That ONE Team)
Team Role: Mentor
 
Join Date: Sep 2013
Rookie Year: 2013
Location: Michigan
Posts: 171
Jarren Harkema is a name known to allJarren Harkema is a name known to allJarren Harkema is a name known to allJarren Harkema is a name known to allJarren Harkema is a name known to allJarren Harkema is a name known to all
Re: 2017 Proposed Scouting Methods

High speed camera footage. The only problem is finding someone willing to sit in a corner the entire tournament watching 1/2 or 1/4 speed footage and count balls flying in the air. I'm not sure if there are enough sugary treats in the world to bribe someone into watching that all day long though.

In all serious, some sort of estimation is going to be needed. I'm curious to see what data the FMS is going to record. If it distinguishes between high and low boiler fuel, you may be able to run an OPR-like algorithm against those values, and then compare to your scouters' estimated values. It's not going perfect, but it provide that balancing force if two different scouters estimate differently. This won't account for accuracy obviously. Arguably accuracy matters less if the total number of balls scored on average by one team is better than another during the entire length of the match.
__________________

Reply With Quote
  #5   Spotlight this post!  
Unread 20-01-2017, 20:32
Billfred's Avatar
Billfred Billfred is offline
...and you can't! teach! that!
FRC #5402 (Iron Kings); no team (AndyMark)
Team Role: Mentor
 
Join Date: Feb 2004
Rookie Year: 2004
Location: The Land of the Kokomese, IN
Posts: 8,568
Billfred has a reputation beyond reputeBillfred has a reputation beyond reputeBillfred has a reputation beyond reputeBillfred has a reputation beyond reputeBillfred has a reputation beyond reputeBillfred has a reputation beyond reputeBillfred has a reputation beyond reputeBillfred has a reputation beyond reputeBillfred has a reputation beyond reputeBillfred has a reputation beyond reputeBillfred has a reputation beyond repute
Re: 2017 Proposed Scouting Methods

Quote:
Originally Posted by Jarren Harkema View Post
In all serious, some sort of estimation is going to be needed. I'm curious to see what data the FMS is going to record. If it distinguishes between high and low boiler fuel, you may be able to run an OPR-like algorithm against those values, and then compare to your scouters' estimated values. It's not going perfect, but it provide that balancing force if two different scouters estimate differently. This won't account for accuracy obviously. Arguably accuracy matters less if the total number of balls scored on average by one team is better than another during the entire length of the match.
If FIRST releases the breakdown of data in their system (and what they made available for FIRST Stronghold makes me think they could), I might reallocate a 6-scout crew this way:

2 on Boilers: Divide the high and low boiler action across members of the alliance. (This is an estimate, but it changes the game from "count balls" to "who's doing a lot over there?" and makes the numbers equally screwy for the alliance since one person is grading all three.) Take these percentages and allocate balls to each robot accordingly.
2 on Airships: Who delivers gears? Who boards? Do we see overflow chute action (which is a mark against the other alliance)? Do we see the lift handles getting knocked out of the ports (which is a huge mark against the alliance onboard)?
1 on Hoppers: Who's getting dumps? When? How much is going in the robot? (I don't care whether they're scoring it here--I have people watching the boilers for that.)
1 on Neutral Zone: Who's collecting a lot? Who's dishing defense, or avoiding it well?

(I wonder how long it'll be until some team starts farming this data coding out as Mechanical Turk tasks using someone's unlimited data plan...)
__________________
William "Billfred" Leverette - Gamecock/Jessica Boucher victim/Marketing & Sales Specialist at AndyMark

2004-2006: FRC 1293 (D5 Robotics) - Student, Mentor, Coach
2007-2009: FRC 1618 (Capital Robotics) - Mentor, Coach
2009-2013: FRC 2815 (Los Pollos Locos) - Mentor, Coach - Palmetto '09, Peachtree '11, Palmetto '11, Palmetto '12
2010: FRC 1398 (Keenan Robo-Raiders) - Mentor - Palmetto '10
2014-2016: FRC 4901 (Garnet Squadron) - Co-Founder and Head Bot Coach - Orlando '14, SCRIW '16
2017-: FRC 5402 (Iron Kings) - Mentor

94 events (more than will fit in a ChiefDelphi signature), 14 seasons, over 61,000 miles, and still on a mission from Bob.

Rule #1: Do not die. Rule #2: Be respectful. Rule #3: Be safe. Rule #4: Follow the handbook.

Last edited by Billfred : 20-01-2017 at 20:36.
Reply With Quote
  #6   Spotlight this post!  
Unread 20-01-2017, 20:34
Edxu's Avatar
Edxu Edxu is offline
Strategy/Scouting Mentor
AKA: Edwin Xu
FRC #4476 (W.A.F.F.L.E.S Robotics)
Team Role: Mentor
 
Join Date: Jan 2013
Rookie Year: 2013
Location: Toronto, Canada
Posts: 190
Edxu has a brilliant futureEdxu has a brilliant futureEdxu has a brilliant futureEdxu has a brilliant futureEdxu has a brilliant futureEdxu has a brilliant futureEdxu has a brilliant futureEdxu has a brilliant futureEdxu has a brilliant futureEdxu has a brilliant futureEdxu has a brilliant future
Re: 2017 Proposed Scouting Methods

You could estimate their balls scored with variance of 3 for high and 9 for low by simply counting the score and seeing if that value is reasonable or not by inspection.

Since gear values go up in intervals of 40, any changes in the ones column must be from scored balls, so if you can tell if the balls are scored high or low, then you should be okay.

However, this system breaks when more than 1 robot is scoring at a time, so good luck with that.
__________________
2013 FRC World Champions (1477, 1241, 610)
Queens University Computing Class of 2020


2013-2016: Team 610
2017-????: Team 4476
Reply With Quote
  #7   Spotlight this post!  
Unread 20-01-2017, 20:45
Joy4201 Joy4201 is online now
Registered User
FRC #4201 (The Vitruvian Bots)
Team Role: CAD
 
Join Date: Feb 2016
Rookie Year: 2016
Location: Redondo Beach, CA
Posts: 7
Joy4201 is an unknown quantity at this point
Re: 2017 Proposed Scouting Methods

This question (with lots of suggestions on how to solve the problem) are also here: https://www.chiefdelphi.com/forums/s...light=low+goal
Reply With Quote
  #8   Spotlight this post!  
Unread 20-01-2017, 21:40
New Lightning's Avatar
New Lightning New Lightning is offline
Master of Tactics
AKA: Scott Hasek
FRC #1987
Team Role: Mentor
 
Join Date: Oct 2014
Rookie Year: 2013
Location: Lee's Summit, MO
Posts: 171
New Lightning has a spectacular aura aboutNew Lightning has a spectacular aura about
Re: 2017 Proposed Scouting Methods

What I think could be a potential solution would be to still try and count the number of balls scored per emptying of a teams hopper and then compare that number to how many point were just scored.

Hopefully the FMS would do something similar to 2014 with number of assist with the three green dots when there is a partial kPa scored in the boiler, have three green dots above the total score for the high goal and 9 dots below to represent the low goal. Your scouts would have to be attentive to what the score is prior to the scoring and what the score is now post ball scoring. That way the can do the math to figure out how much was actually scored by the robot and then multiply by either 3 or 9 depending on how many points were scored.
Reply With Quote
  #9   Spotlight this post!  
Unread 20-01-2017, 21:42
SPang SPang is offline
Registered User
FRC #1124 (the ÜberBots)
 
Join Date: Aug 2016
Rookie Year: 2014
Location: Avon, CT
Posts: 2
SPang is an unknown quantity at this point
Re: 2017 Proposed Scouting Methods

You can also simply have your pit scouters ask teams about their hopper capacity. There's going to be the usual dissonance between reality and what teams believe they're capable of, but it helps with making estimates more accurate to the robot's actual scoring ability. You can probably amend this by subtracting a certain percentage based on ball packing or how full they actually fill their hopper while cycling in matches.

It's much less effort to make educated approximations rather than spending a disproportionate amount of time on trying to be slightly more accurate.
Reply With Quote
  #10   Spotlight this post!  
Unread 21-01-2017, 00:22
Jarren Harkema's Avatar
Jarren Harkema Jarren Harkema is offline
Dancing Drive Coach
FRC #4967 (That ONE Team)
Team Role: Mentor
 
Join Date: Sep 2013
Rookie Year: 2013
Location: Michigan
Posts: 171
Jarren Harkema is a name known to allJarren Harkema is a name known to allJarren Harkema is a name known to allJarren Harkema is a name known to allJarren Harkema is a name known to allJarren Harkema is a name known to all
Re: 2017 Proposed Scouting Methods

Quote:
Originally Posted by Billfred View Post
If FIRST releases the breakdown of data in their system (and what they made available for FIRST Stronghold makes me think they could), I might reallocate a 6-scout crew this way:

2 on Boilers: Divide the high and low boiler action across members of the alliance. (This is an estimate, but it changes the game from "count balls" to "who's doing a lot over there?" and makes the numbers equally screwy for the alliance since one person is grading all three.) Take these percentages and allocate balls to each robot accordingly.
2 on Airships: Who delivers gears? Who boards? Do we see overflow chute action (which is a mark against the other alliance)? Do we see the lift handles getting knocked out of the ports (which is a huge mark against the alliance onboard)?
1 on Hoppers: Who's getting dumps? When? How much is going in the robot? (I don't care whether they're scoring it here--I have people watching the boilers for that.)
1 on Neutral Zone: Who's collecting a lot? Who's dishing defense, or avoiding it well?

(I wonder how long it'll be until some team starts farming this data coding out as Mechanical Turk tasks using someone's unlimited data plan...)
This is an interesting idea. Kind of reminds me how referees observe matches. Don't they typically watch certain locations rather than specific robots? Theoretically the data collected would be much more consistent between matches. That's my biggest fear of an estimation system; my 50% guess is your 60% guess.

I will bring this up to our scouting team and see if there is anything they can take from it.

Quote:
Originally Posted by SPang View Post
You can also simply have your pit scouters ask teams about their hopper capacity. There's going to be the usual dissonance between reality and what teams believe they're capable of, but it helps with making estimates more accurate to the robot's actual scoring ability. You can probably amend this by subtracting a certain percentage based on ball packing or how full they actually fill their hopper while cycling in matches.

It's much less effort to make educated approximations rather than spending a disproportionate amount of time on trying to be slightly more accurate.
I'm just waiting to see a student walking around in the pits with a trash bag slung over the shoulder full of fuel. He or she just walks up, dumps the contents of the bag into a robot (asking first of course), and then picks them out while counting. He or she then makes a note, thanks the pit crew, and hurries on to the next team.
__________________

Reply With Quote
  #11   Spotlight this post!  
Unread 26-01-2017, 11:53
Skyehawk's Avatar
Skyehawk Skyehawk is offline
Nuts N' Bolts
AKA: Skye Leake
FRC #0876 (Thunder Robotics)
Team Role: Mentor
 
Join Date: Nov 2012
Rookie Year: 2011
Location: Northwood, ND
Posts: 275
Skyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to all
Re: 2017 Proposed Scouting Methods

Quote:
Originally Posted by Jarren Harkema View Post
I'm just waiting to see a student walking around in the pits with a trash bag slung over the shoulder full of fuel. He or she just walks up, dumps the contents of the bag into a robot (asking first of course), and then picks them out while counting. He or she then makes a note, thanks the pit crew, and hurries on to the next team.
I'm. So. Tempted.

In reality though, I was going to just measure the inside of their hopper and use the loose random packing density of spheres ~60-61% as my number. If a team is willing to verify with an actual random fuel dump I will give them points for honesty. Honesty points may move them on our pick lists.
__________________
My time in FIRST has made me a better person, frankly I don't know where I'd be without it.



2011 Lake Superior Regional Champs (Thanks 2512 & 3747)
2015 Central Illinois Regional Engineering Inspiration Award recipients
2016 Central Illinois Regional Champs (Thanks 2481 & 2220)
Reply With Quote
  #12   Spotlight this post!  
Unread 26-01-2017, 12:03
MARS_James's Avatar
MARS_James MARS_James is offline
Always Scouting
AKA: James Comstock
FRC #0179 (The Children of The Swamp)
Team Role: Tactician
 
Join Date: Jan 2010
Rookie Year: 2006
Location: Jupiter, Florida
Posts: 1,968
MARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond repute
Send a message via AIM to MARS_James
Re: 2017 Proposed Scouting Methods

Quote:
Originally Posted by Jarren Harkema View Post
I'm just waiting to see a student walking around in the pits with a trash bag slung over the shoulder full of fuel. He or she just walks up, dumps the contents of the bag into a robot (asking first of course), and then picks them out while counting. He or she then makes a note, thanks the pit crew, and hurries on to the next team.
That seems counter productive if people design large hoppers, why not just have a bag of 50 or so, and count the ones that don't fit?
__________________
Driving Record: 24-8
Coaching Record: 66-31
2014 South Florida Regional Woodie Flowers Finalist


Reply With Quote
  #13   Spotlight this post!  
Unread 26-01-2017, 12:06
Trevor1523's Avatar
Trevor1523 Trevor1523 is offline
Meme Queen
FRC #1523 (MARS / 6685 RPBHSR)
Team Role: Mentor
 
Join Date: May 2015
Rookie Year: 2014
Location: South Florida
Posts: 71
Trevor1523 is an unknown quantity at this point
Re: 2017 Proposed Scouting Methods

This was spoken about last night at our build space. Yes, it is nearly impossible to count the amount of fuel going into the boiler. At the regional level it isn't really relevant.

Something I would focus more on is how accurate teams are at getting fuel into the boiler. It doesn't really count if one team can shoot 100 fuel at the high goal and only have 10-20 go in because their shooter isn't accurate. But if there's a team that can shoot 40-50 fuel at one time and only miss a few? That's a lot more valuable and a lot less likely to waste time during the match.

In summation; just look for how efficient/accurate teams shooter's are.
__________________
2015 Orlando Regional Finalists

FRC Team 1523 [2014-xxxx]
FRC Team 6685 [2017]

Last edited by Trevor1523 : 26-01-2017 at 12:09.
Reply With Quote
  #14   Spotlight this post!  
Unread 26-01-2017, 12:10
Skyehawk's Avatar
Skyehawk Skyehawk is offline
Nuts N' Bolts
AKA: Skye Leake
FRC #0876 (Thunder Robotics)
Team Role: Mentor
 
Join Date: Nov 2012
Rookie Year: 2011
Location: Northwood, ND
Posts: 275
Skyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to all
Re: 2017 Proposed Scouting Methods

Quote:
Originally Posted by Trevor1523 View Post
This was spoken about last night at our build space. Yes, it is nearly impossible to count the amount of fuel going into the boiler. At the regional level it isn't really relevant.

Something I would focus more on is how accurate teams are at getting fuel into the boiler. It doesn't really count if one team can shoot 100 fuel at the high goal and only have 10-20 go in because their shooter isn't accurate. But if there's a team that can shoot 40-50 fuel at one time and only miss a few? That's a lot more valuable and a lot less likely to waste time during the match.

In summation; just look for how efficient teams shooter's are.
To take your example to the extreme:
If I had a fuel cycle in which I shot 9 balls (my entire hopper) and made 8/9 of them in 10 seconds I would be ranked higher than a team the shoots 75 balls in 10 seconds and makes 50 of them? You need some way to bring your ratio (make %) onto a level basis for comparison.

Just some thoughts.
__________________
My time in FIRST has made me a better person, frankly I don't know where I'd be without it.



2011 Lake Superior Regional Champs (Thanks 2512 & 3747)
2015 Central Illinois Regional Engineering Inspiration Award recipients
2016 Central Illinois Regional Champs (Thanks 2481 & 2220)
Reply With Quote
  #15   Spotlight this post!  
Unread 26-01-2017, 12:25
JesseK's Avatar
JesseK JesseK is offline
Expert Flybot Crasher
FRC #1885 (ILITE)
Team Role: Mentor
 
Join Date: Mar 2007
Rookie Year: 2005
Location: Reston, VA
Posts: 3,735
JesseK has a reputation beyond reputeJesseK has a reputation beyond reputeJesseK has a reputation beyond reputeJesseK has a reputation beyond reputeJesseK has a reputation beyond reputeJesseK has a reputation beyond reputeJesseK has a reputation beyond reputeJesseK has a reputation beyond reputeJesseK has a reputation beyond reputeJesseK has a reputation beyond reputeJesseK has a reputation beyond repute
Re: 2017 Proposed Scouting Methods

Quote:
Originally Posted by Billfred View Post
... "who's doing a lot over there?" ...
Presuming FIRST FMS releases data on BOILER points, I think Billfred hit the nail on the head with the fuzzy logic: do they spend a lot of time at the boiler, or not?

Record a fuzzy group number for each load of balls taken to the boiler - 1=Less than 10-count, 3=more than 30-count, or 2=in between. Put a Gold Star if the team seemed to focus on fuel that match.

Take all gold star bots, divide amount of boiler points per match by the average grouping. Voila! Imperfect, but possibly-good-enough way to determine the best fuel bots at a competition. It won't order them bot-for-bot, but at most events bots rated in the middle-of-the-pack for fuel will likely be used in elims roles that include, but do not revolve around, fuel.
__________________

Drive Coach, 1885 (2007-present)
2017 Scoring Model
CAD Library | GitHub
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 13:57.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi