Go to Post Genius is one percent inspiration and 99 percent perspiration, which is why engineers sometimes smell really bad. - Koko Ed [more]
Home
Go Back   Chief Delphi > FIRST > General Forum
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
Thread Tools Rate Thread Display Modes
  #46   Spotlight this post!  
Unread 21-03-2011, 15:18
mwtidd's Avatar
mwtidd mwtidd is offline
Registered User
AKA: mike
FRC #0319 (Big Bad Bob)
Team Role: Mentor
 
Join Date: Feb 2005
Rookie Year: 2003
Location: Boston, MA
Posts: 714
mwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond repute
Re: Top 25 ETCs after Week 3

Quote:
Originally Posted by Wayne TenBrink View Post

In general, an observer can tell who is capable of doing what, and they instinctively know when to dismiss certain match data. We tend to rate teams based on their expected capabilities when things are working properly. Recent performance is generally a better indication of future performance than historical average because of all the continuous improvement that goes on in FIRST. I think that ETC's might better reflect true capabilities if they omitted one or two of the lowest matches, or perhaps looked at a 10 match running average, like some golfing handicaps.

Regardless of the imperfection of any system, they have their merits. Many thanks to those who do the work to make them possible.
Thanks for the insights on the golfing handicaps, and its definitely something I am trying to figure out. The logistics of removing the lowest match is a little difficult as I keep a running sum which is adjusted as matches are added. Definitely on my todo list this week.

Thanks!
__________________
"Never let your schooling interfere with your education" -Mark Twain
Reply With Quote
  #47   Spotlight this post!  
Unread 21-03-2011, 16:46
mwtidd's Avatar
mwtidd mwtidd is offline
Registered User
AKA: mike
FRC #0319 (Big Bad Bob)
Team Role: Mentor
 
Join Date: Feb 2005
Rookie Year: 2003
Location: Boston, MA
Posts: 714
mwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond repute
Re: Top 25 ETCs after Week 3

Found a bug....
I think you guys will like these new #s better

__________________
"Never let your schooling interfere with your education" -Mark Twain
Reply With Quote
  #48   Spotlight this post!  
Unread 21-03-2011, 18:07
Adam Freeman's Avatar
Adam Freeman Adam Freeman is offline
Forever HOT!
FRC #0148 (Robowranglers)
Team Role: Engineer
 
Join Date: Jan 2007
Rookie Year: 2005
Location: Rockwall, TX
Posts: 497
Adam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond reputeAdam Freeman has a reputation beyond repute
Re: Top 25 ETCs after Week 3

Mike,

Here is some scouting data that I pulled on the teams that have been mentioned from the WM district:

* These are for qualification matches only, since I am pretty sure that is what your ETC, ERC, and EMC are calculated with.

Average Scores
Team Auto Teleop Minibot Total
67 5.00 39.75 23.33 68.08
2054 6.00 28.92 20.83 55.75
74 4.25 25.83 18.75 48.83
27 2.00 25.42 19.17 46.58
1918 0.50 27.83 11.25 39.58
2767 0.00 1.33 18.75 20.08

From the scouting data, I can see if/where a team scored an Uber-tube and what place their minibot scored. For teleop I can see how many tubes and where they scored them. Since I know where 67 scored tubes and created logos, I made an assumption that any tube scored by a team was part of a logo...so the team received the contribution of points for that tube as if it was part of a logo.

It's interesting to see how the raw data correlates not only to your estimates, but also to my subjective ratings for each of these teams.

Hopefully this helps further adjust your metrics.
__________________

2005 FIRST World Champions (330, 67, 503)
2009 FIRST World Champions (111, 67, 971)
2010 FIRST World Champions (294, 67, 177)

Last edited by Adam Freeman : 21-03-2011 at 18:14.
Reply With Quote
  #49   Spotlight this post!  
Unread 21-03-2011, 18:34
mwtidd's Avatar
mwtidd mwtidd is offline
Registered User
AKA: mike
FRC #0319 (Big Bad Bob)
Team Role: Mentor
 
Join Date: Feb 2005
Rookie Year: 2003
Location: Boston, MA
Posts: 714
mwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond repute
Re: Top 25 ETCs after Week 3

Quote:
Originally Posted by Adam Freeman View Post
Mike,

Here is some scouting data that I pulled on the teams that have been mentioned from the WM district:

* These are for qualification matches only, since I am pretty sure that is what your ETC, ERC, and EMC are calculated with.

Average Scores
Team Auto Teleop Minibot Total
67 5.00 39.75 23.33 68.08
2054 6.00 28.92 20.83 55.75
74 4.25 25.83 18.75 48.83
27 2.00 25.42 19.17 46.58
1918 0.50 27.83 11.25 39.58
2767 0.00 1.33 18.75 20.08

From the scouting data, I can see if/where a team scored an Uber-tube and what place their minibot scored. For teleop I can see how many tubes and where they scored them. Since I know where 67 scored tubes and created logos, I made an assumption that any tube scored by a team was part of a logo...so the team received the contribution of points for that tube as if it was part of a logo.

It's interesting to see how the raw data correlates not only to your estimates, but also to my subjective ratings for each of these teams.

Hopefully this helps further adjust your metrics.
Thanks for these #'s this helps out a ton.

I don't think EMC can get much better than this, an error of +/- 3 is something I'm happy with. I think I've killed most of the inflation that was going on there. It seems robot (auton + teleop) is still a little low, but i will be working on a filter to knock out teams who really don't contribute. As you found 1918 had a 1.33 but I had them at a 5. Obviously there's a bit of point inflation there. Hopefully I can filter that out and get a better read.

Thanks again!
__________________
"Never let your schooling interfere with your education" -Mark Twain
Reply With Quote
  #50   Spotlight this post!  
Unread 21-03-2011, 20:30
railerobotics's Avatar
railerobotics railerobotics is offline
Registered User
FRC #0935
 
Join Date: Jan 2006
Location: Newton, KS
Posts: 190
railerobotics will become famous soon enough
Re: Top 25 ETCs after Week 3

Take a look at Teams 935 and 932 from the OKC Regional.
935 Had and Average of 60 points per match and 30 point bonus off there bot 9 out of 10 in Qualification matchs. Then in the finals the 6 matchs they ran they never missed with 1.6 mini bot with a .5 deployment.

932 did not have mini bot but Scored about the same tube average. This being said keep in mind the OKC regional had a number of rookie and w 2nd year teams that did not score very many tubes.
__________________
Inspiration of Today,
Technology of Tomorrow.
Team 935
http://www.team935.com
Reply With Quote
  #51   Spotlight this post!  
Unread 21-03-2011, 21:23
mwtidd's Avatar
mwtidd mwtidd is offline
Registered User
AKA: mike
FRC #0319 (Big Bad Bob)
Team Role: Mentor
 
Join Date: Feb 2005
Rookie Year: 2003
Location: Boston, MA
Posts: 714
mwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond repute
Re: Top 25 ETCs after Week 3

Quote:
Originally Posted by railerobotics View Post
Take a look at Teams 935 and 932 from the OKC Regional.
935 Had and Average of 60 points per match and 30 point bonus off there bot 9 out of 10 in Qualification matchs. Then in the finals the 6 matchs they ran they never missed with 1.6 mini bot with a .5 deployment.

932 did not have mini bot but Scored about the same tube average. This being said keep in mind the OKC regional had a number of rookie and w 2nd year teams that did not score very many tubes.
932 had a EMC of 0 and a ERC of 56
935 had a EMC of 24 and a ERC of 43

looking for good minibots I see
2773
2352
476

2165 and 704's minibots look like they'd be worth checking out
probably 3660 too

as far as robots go it looks like you two dominated
1108 is up there with you guys though with a 31
the next ERC tier would start around 20 but theres quite a few robots there.

let me know how close I got
__________________
"Never let your schooling interfere with your education" -Mark Twain
Reply With Quote
  #52   Spotlight this post!  
Unread 21-03-2011, 21:59
Debbie's Avatar
Debbie Debbie is offline
Registered User
AKA: Debbie May
FRC #1023 (Bedford Express)
Team Role: Coach
 
Join Date: Mar 2008
Rookie Year: 2000
Location: Michigan
Posts: 318
Debbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond repute
Re: Top 25 ETCs after Week 3

It is an honor to be listed among all of those great teams! Thanks for your time spent crunching numbers! We are looking forward to our second district next week and are hoping to improve on those numbers!
__________________
FRC 1023 - Bedford Express - Coach, 2009 - present
FTC 160 - Dana Broncobytes Coach - 2007 - 2009
FLL - Dana Unicorns Coach - 2000 - 2006

Bedford Express Varsity Letter Video BX Facebook
Reply With Quote
  #53   Spotlight this post!  
Unread 22-03-2011, 07:52
Pjohn1959's Avatar
Pjohn1959 Pjohn1959 is offline
Registered User
AKA: Paul W. Johnson
no team
Team Role: Teacher
 
Join Date: Feb 2006
Rookie Year: 2005
Location: Houston, Texas
Posts: 543
Pjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond reputePjohn1959 has a reputation beyond repute
Re: Top 25 ETCs after Week 3

OK, I give up.

No where is it described what an ETC, EMC, etc. is. Can you help out by explaining what you are talking about.

Thanks,
Reply With Quote
  #54   Spotlight this post!  
Unread 22-03-2011, 08:13
Debbie's Avatar
Debbie Debbie is offline
Registered User
AKA: Debbie May
FRC #1023 (Bedford Express)
Team Role: Coach
 
Join Date: Mar 2008
Rookie Year: 2000
Location: Michigan
Posts: 318
Debbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond repute
Re: Top 25 ETCs after Week 3

Quote:
Originally Posted by Pjohn1959 View Post
OK, I give up.

No where is it described what an ETC, EMC, etc. is. Can you help out by explaining what you are talking about.

Thanks,
HA! Glad I'm not the only one that had problems with that. It is either Estimated Team Contribution (or expected - not really positive) and Estimated Robot Contribution and Estimated MiniBot Contribution... I think...
__________________
FRC 1023 - Bedford Express - Coach, 2009 - present
FTC 160 - Dana Broncobytes Coach - 2007 - 2009
FLL - Dana Unicorns Coach - 2000 - 2006

Bedford Express Varsity Letter Video BX Facebook
Reply With Quote
  #55   Spotlight this post!  
Unread 22-03-2011, 09:20
mwtidd's Avatar
mwtidd mwtidd is offline
Registered User
AKA: mike
FRC #0319 (Big Bad Bob)
Team Role: Mentor
 
Join Date: Feb 2005
Rookie Year: 2003
Location: Boston, MA
Posts: 714
mwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond reputemwtidd has a reputation beyond repute
Re: Top 25 ETCs after Week 3

Quote:
Originally Posted by Debbie View Post
HA! Glad I'm not the only one that had problems with that. It is either Estimated Team Contribution (or expected - not really positive) and Estimated Robot Contribution and Estimated MiniBot Contribution... I think...
Its supposed to be estimated, but you're right.

Based on the data I'm verifying on in West Michigan EMC is doing pretty well. +/-3 of their actual average contribution.

The ERC isn't quite as accurate, its about 10 pts off, but if you look at it as a scale I think its still useful. I worked yesterday to fix EMC and hopefully I'll have ERC better by the end of the day.
__________________
"Never let your schooling interfere with your education" -Mark Twain
Reply With Quote
  #56   Spotlight this post!  
Unread 03-04-2011, 23:25
Debbie's Avatar
Debbie Debbie is offline
Registered User
AKA: Debbie May
FRC #1023 (Bedford Express)
Team Role: Coach
 
Join Date: Mar 2008
Rookie Year: 2000
Location: Michigan
Posts: 318
Debbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond reputeDebbie has a reputation beyond repute
Re: Top 25 ETCs after Week 3

Are you posting a new one including this weekend's events? I am curious to see how your rating compares to the one we calculated with scouting.
__________________
FRC 1023 - Bedford Express - Coach, 2009 - present
FTC 160 - Dana Broncobytes Coach - 2007 - 2009
FLL - Dana Unicorns Coach - 2000 - 2006

Bedford Express Varsity Letter Video BX Facebook
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 16:35.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi