Go to Post I think this is the forest that ChiefDelphi often misses as we're picking the branches off every tree. - Libby K [more]
Home
Go Back   Chief Delphi > Competition > Rules/Strategy > Scouting
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 20-01-2017, 11:42
Tod Traughber Tod Traughber is offline
Registered User
FRC #3937
 
Join Date: Mar 2016
Location: Arkansas
Posts: 6
Tod Traughber is an unknown quantity at this point
Data Entry Form for Steamworks

My name is Tod Traughber and I am the Public Relations mentor for 3937 Breakaway. I am sharing a link to the prototype for our scouting data-entry form. We would like to open-source our ideas and create streams of collaboration regarding scouting concepts for this year's game.

https://drive.google.com/open?id=0By...05QWjVQUDZqams

Although there are available packages for doing this, we create a Microsoft Access database for data-entry and analysis mainly to teach students concepts and procedures in the use of a database.

I welcome input, constructive criticism, and dialogue regarding our entry form and further questions about what questions to ask of the data and how best to use it to maximize tournament play.
Reply With Quote
  #2   Spotlight this post!  
Unread 20-01-2017, 11:54
Rangel's Avatar
Rangel Rangel is offline
John Rangel
FRC #0842 (Falcon Robotics)
Team Role: Mentor
 
Join Date: Jan 2010
Rookie Year: 2009
Location: Phoenix, AZ
Posts: 747
Rangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond repute
Re: Data Entry Form for Steamworks

I like the subjective scouting in terms of speed and accuracy opinions. I definitely think more opinion based scouting is going to be needed than in recent years. Few things I might add would be fuel intake speed, gear placement speed and retrieval station speed(how fast can a robot line up and load up on game pieces).

For ball scoring, we plan to mostly just figure out how many balls each robot can hold and use fire speed and accuracy to measure ball scoring ability. We think it will be too unreliable to count how many balls each robot scores.

For making pick-lists, subjective averages are probably going to be our baseline but final sorting of robots are likely going to be going over each robot individually.
__________________
2012 Dean's List Winner
2011-2014 Arizona Regional Winners
2016 Las Vegas Regional Winner
2014-? Mentor


Reply With Quote
  #3   Spotlight this post!  
Unread 20-01-2017, 12:06
NShep98's Avatar
NShep98 NShep98 is offline
Registered User
AKA: Nathan Shepherd
FRC #2079 (4H ALARM Robotics)
Team Role: Mechanical
 
Join Date: Oct 2015
Rookie Year: 2015
Location: Franklin, MA
Posts: 264
NShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud of
Re: Data Entry Form for Steamworks

Some additions I might make are approximate time, i.e. cycle times, how long it takes to place a gear or shoot, etc.

Also for fuel intake add the human player station. I'm not quite sure what "South" is referring to in the auto section.

Good stuff overall!
__________________


FRC 2079 - 4H ALARM Robotics 2015 - 2017

FLL 2011, 2013
Reply With Quote
  #4   Spotlight this post!  
Unread 20-01-2017, 12:12
MARS_James's Avatar
MARS_James MARS_James is offline
Always Scouting
AKA: James Comstock
FRC #0179 (The Children of The Swamp)
Team Role: Tactician
 
Join Date: Jan 2010
Rookie Year: 2006
Location: Jupiter, Florida
Posts: 1,968
MARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond reputeMARS_James has a reputation beyond repute
Send a message via AIM to MARS_James
Re: Data Entry Form for Steamworks

Can I ask what South is in autonomous?
__________________
Driving Record: 24-8
Coaching Record: 66-31
2014 South Florida Regional Woodie Flowers Finalist


Reply With Quote
  #5   Spotlight this post!  
Unread 20-01-2017, 12:18
Tod Traughber Tod Traughber is offline
Registered User
FRC #3937
 
Join Date: Mar 2016
Location: Arkansas
Posts: 6
Tod Traughber is an unknown quantity at this point
Re: Data Entry Form for Steamworks

Thx - North/South refers to the hopper position on the field. North is the hopper closest to the scorers table and South is the hopper closest to the audience position. Yes, I know "The enemy's gate is down", but it helps us reference the attempted hopper without adding another numbered system (we already have peg number and shooting zone number).

We want to know if a robot has the code to adjust where they can fuel up in auto as different starting positions should be able to more easily access the north hopper or south hopper based upon location. If they are coded to only fuel up at a particular hopper, we can adjust and go to the other to maximize ball intake for the alliance.
Reply With Quote
  #6   Spotlight this post!  
Unread 20-01-2017, 12:21
NShep98's Avatar
NShep98 NShep98 is offline
Registered User
AKA: Nathan Shepherd
FRC #2079 (4H ALARM Robotics)
Team Role: Mechanical
 
Join Date: Oct 2015
Rookie Year: 2015
Location: Franklin, MA
Posts: 264
NShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud ofNShep98 has much to be proud of
Re: Data Entry Form for Steamworks

Quote:
Originally Posted by Tod Traughber View Post
Thx - North/South refers to the hopper position on the field. North is the hopper closest to the scorers table and South is the hopper closest to the audience position. Yes, I know "The enemy's gate is down", but it helps us reference the attempted hopper without adding another numbered system (we already have peg number and shooting zone number).

We want to know if a robot has the code to adjust where they can fuel up in auto as different starting positions should be able to more easily access the north hopper or south hopper based upon location. If they are coded to only fuel up at a particular hopper, we can adjust and go to the other to maximize ball intake for the alliance.
Did you mean to include "North" then as well? As of your above post there is only a "South" option and no label for that data field.
__________________


FRC 2079 - 4H ALARM Robotics 2015 - 2017

FLL 2011, 2013
Reply With Quote
  #7   Spotlight this post!  
Unread 20-01-2017, 12:22
Tod Traughber Tod Traughber is offline
Registered User
FRC #3937
 
Join Date: Mar 2016
Location: Arkansas
Posts: 6
Tod Traughber is an unknown quantity at this point
Re: Data Entry Form for Steamworks

Ball capacity * percentage accuracy is an interesting way to determine shot total, but extremely difficult to measure on a per/cycle basis. In autonomous, maybe not a hard, but how are you going to measure capacity if you have a gear-centric bot who only shoots every third gear cycle in teleop? We figure only the elite teams are going to shoot at a rate beyond a fair guestimate, though of course that remains to be seen.
Reply With Quote
  #8   Spotlight this post!  
Unread 20-01-2017, 12:23
Tod Traughber Tod Traughber is offline
Registered User
FRC #3937
 
Join Date: Mar 2016
Location: Arkansas
Posts: 6
Tod Traughber is an unknown quantity at this point
Re: Data Entry Form for Steamworks

Oops yes - there is a North adjacent to the South
Reply With Quote
  #9   Spotlight this post!  
Unread 20-01-2017, 12:32
Tod Traughber Tod Traughber is offline
Registered User
FRC #3937
 
Join Date: Mar 2016
Location: Arkansas
Posts: 6
Tod Traughber is an unknown quantity at this point
Re: Data Entry Form for Steamworks

Quote:
Originally Posted by Tod Traughber View Post
Oops yes - there is a North adjacent to the South
This has been adjusted on the original.
Reply With Quote
  #10   Spotlight this post!  
Unread 20-01-2017, 12:52
Rangel's Avatar
Rangel Rangel is offline
John Rangel
FRC #0842 (Falcon Robotics)
Team Role: Mentor
 
Join Date: Jan 2010
Rookie Year: 2009
Location: Phoenix, AZ
Posts: 747
Rangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond reputeRangel has a reputation beyond repute
Re: Data Entry Form for Steamworks

Quote:
Originally Posted by Tod Traughber View Post
Ball capacity * percentage accuracy is an interesting way to determine shot total, but extremely difficult to measure on a per/cycle basis. In autonomous, maybe not a hard, but how are you going to measure capacity if you have a gear-centric bot who only shoots every third gear cycle in teleop? We figure only the elite teams are going to shoot at a rate beyond a fair guestimate, though of course that remains to be seen.
You won't. Ball capacity will be tricky. Our plan is to use a combination of pit scouting and visual guessing on the field(bin of fuel is roughly ~50 fuel.).

But my question is, is it more important to figure out exactly what each robot did in every match or what their actual capabilities are? For example, a robot that does mostly gears but ball scoring when able to is going to have a very low average for ball scoring, whereas a team that only does ball scoring might have double or triple the average despite being a far worse ball scorer. For us at least, we will be caring more about how good robots are at each task rather than how many times they do it in a match. Of course I'm sure match data can be useful too. Especially for determining what the robot will probably try to do. I would just avoid arguments of this robot scores this many balls on average vs this robot when discussing who is the best at any particular task.
__________________
2012 Dean's List Winner
2011-2014 Arizona Regional Winners
2016 Las Vegas Regional Winner
2014-? Mentor


Reply With Quote
  #11   Spotlight this post!  
Unread 20-01-2017, 13:07
Skyehawk's Avatar
Skyehawk Skyehawk is offline
Nuts N' Bolts
AKA: Skye Leake
FRC #0876 (Thunder Robotics)
Team Role: Mentor
 
Join Date: Nov 2012
Rookie Year: 2011
Location: Northwood, ND
Posts: 275
Skyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to all
Re: Data Entry Form for Steamworks

There is sure a lot going on here. I understand you want to cover all the bases, but you need to to keep an eye on extraneous information. Now maybe I'm dead nuts wrong, maybe you can gather, tabulate, and analyze all that data, taking it all into account. But I've found there are only a few categories one can evaluate at a time. That being said this sheet is built for data acquisition.

For 2017 (before the game was even revealed), I was planning on trying to move towards a more qualitative methodology, for the express purpose of more eyes-on-field time. As long as you have a few unique bases of comparison the desired result of ranking can easily be accomplished. The trick is to know what you are looking for and focus any additional scouting resources on teams that for those criteria. Qualitative to get the big picture, quantitative for close evaluation.

I am glad to see you have a quasi-qualitative implementation for shooter accuracy, I would break it down into; 0-33%,33-66%,66-95%,95+%, but that's just me. The other qualitative fields are also well done, (with too many options your accuracy may go up but precision goes down, with fewer options the data accuracy decreases but the precision rises), I have found 4-5 options in qualitative to be the 'sweet-spot'.

My big takeaway from this sheet is; good organization, it's logical, and complete. It includes some qualitative data points where appropriate. My suggestions are: watch for extraneous information, no sense in collecting it if you are not using it, redefine/adjust on your qualitative distributions to catch the outliers more efficiently, and cut down on the large black areas. your printer won't like it and it will be harder to read.

Overall excellent sheet for logging everything a team is doing over the entire match. Good job.

EDIT: Human error is a huge factor, you will always want to mitigate it with your alliance partners. It may be worth your time to force the user to evaluate a team's human components.
__________________
My time in FIRST has made me a better person, frankly I don't know where I'd be without it.



2011 Lake Superior Regional Champs (Thanks 2512 & 3747)
2015 Central Illinois Regional Engineering Inspiration Award recipients
2016 Central Illinois Regional Champs (Thanks 2481 & 2220)

Last edited by Skyehawk : 20-01-2017 at 13:22.
Reply With Quote
  #12   Spotlight this post!  
Unread 20-01-2017, 13:07
Tod Traughber Tod Traughber is offline
Registered User
FRC #3937
 
Join Date: Mar 2016
Location: Arkansas
Posts: 6
Tod Traughber is an unknown quantity at this point
Re: Data Entry Form for Steamworks

Quote:
Originally Posted by Rangel View Post
But my question is, is it more important to figure out exactly what each robot did in every match or what their actual capabilities are? For example, a robot that does mostly gears but ball scoring when able to is going to have a very low average for ball scoring, whereas a team that only does ball scoring might have double or triple the average despite being a far worse ball scorer. For us at least, we will be caring more about how good robots are at each task rather than how many times they do it in a match. Of course I'm sure match data can be useful too. Especially for determining what the robot will probably try to do. I would just avoid arguments of this robot scores this many balls on average vs this robot when discussing who is the best at any particular task.
Understood. I am currently ABD in my quest for my doctoral degree and have struggled with qualitative research and writing. In my quest to be as quantitatively black and white as possible (which is impossible with this game), I am seeking snapshots of performance in order to support my allies and strategically weaken my opponents. Part of the process is minimizing human differences of opinion. We run waves of 18 students in scouting at a tournament with various levels of technical understanding and honestly - interest. Keeping it as yes/no as possible helps focus the picture for the scout team leaders when its 1:00 am Saturday morning and we are punch-drunk trying to determine possible alliance selections.
Reply With Quote
  #13   Spotlight this post!  
Unread 20-01-2017, 13:44
Fields's Avatar
Fields Fields is offline
Classic
no team
Team Role: Engineer
 
Join Date: Dec 2014
Rookie Year: 2015
Location: Minneapolis
Posts: 118
Fields is a name known to allFields is a name known to allFields is a name known to allFields is a name known to allFields is a name known to allFields is a name known to all
Re: Data Entry Form for Steamworks

Quote:
Originally Posted by NShep98 View Post
Some additions I might make are approximate time, i.e. cycle times, how long it takes to place a gear or shoot, etc.

Also for fuel intake add the human player station. I'm not quite sure what "South" is referring to in the auto section.

Good stuff overall!
Probably won't need to do cycle times (amongst the many other items you're watching for)
If they only get 2 cycles of fuel and 1 gear, you can get a good idea of cycle time.

Would want to add notes afterward like they played mostly defense or two robots tried playing def against them the whole time.
__________________
Wait... you built what now?
Reply With Quote
  #14   Spotlight this post!  
Unread 20-01-2017, 13:51
Skyehawk's Avatar
Skyehawk Skyehawk is offline
Nuts N' Bolts
AKA: Skye Leake
FRC #0876 (Thunder Robotics)
Team Role: Mentor
 
Join Date: Nov 2012
Rookie Year: 2011
Location: Northwood, ND
Posts: 275
Skyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to allSkyehawk is a name known to all
Re: Data Entry Form for Steamworks

Quote:
Originally Posted by Fields View Post
Probably won't need to do cycle times (amongst the many other items you're watching for)
If they only get 2 cycles of fuel and 1 gear, you can get a good idea of cycle time.

Would want to add notes afterward like they played mostly defense or two robots tried playing def against them the whole time.
Hold the Phone!
Cycle times are indeed important, at a high level of play it is important to know that a team can consistently do 3 consistent fuel cycle at 20 seconds apiece, a gear at 30 seconds, and the rest of the time is spent on 'other', you may be able to squeeze out another gear cycle. It is this reason that averages can be very misleading. When in elims the distribution of resources in an efficient manner is super important, the balance of absolute and competitive advantages dictates the scoring potential more than you may realize...
__________________
My time in FIRST has made me a better person, frankly I don't know where I'd be without it.



2011 Lake Superior Regional Champs (Thanks 2512 & 3747)
2015 Central Illinois Regional Engineering Inspiration Award recipients
2016 Central Illinois Regional Champs (Thanks 2481 & 2220)
Reply With Quote
  #15   Spotlight this post!  
Unread 20-01-2017, 13:58
Fields's Avatar
Fields Fields is offline
Classic
no team
Team Role: Engineer
 
Join Date: Dec 2014
Rookie Year: 2015
Location: Minneapolis
Posts: 118
Fields is a name known to allFields is a name known to allFields is a name known to allFields is a name known to allFields is a name known to allFields is a name known to all
Re: Data Entry Form for Steamworks

Quote:
Originally Posted by Rangel View Post
You won't. Ball capacity will be tricky. Our plan is to use a combination of pit scouting and visual guessing on the field(bin of fuel is roughly ~50 fuel.).
.
Not sure why anyone would consider capacity, speed or accuracy separately at all. If someone can pick up 9 fuel and buck-shot them high 100% with a 5s cycle time or another can scoop 54 and drop in the low goal with 10s cycle the end result is the same. Again same as someone scooping 27 and scores high 33% in 5s.

Main thing I would look for there is end kPa score contribution. Don't get me wrong, that will be tricky in itself (unless you have a counting app you can press), but it does combine accuracy, target, capacity and cycle into one.

Same with gear placements. Total gear placements with a note of did they specifically stop after rotor 2 or 4 (like if they're getting no help from the alliance and shift their focus to fuel) and if they are dropping a bunch in the way.

And of course climb
__________________
Wait... you built what now?
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 13:57.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi