View Single Post
  #4   Spotlight this post!  
Unread 05-03-2007, 00:39
nuggetsyl's Avatar
nuggetsyl nuggetsyl is offline
Registered User
FRC #0025
Team Role: Coach
 
Join Date: Sep 2001
Location: north brunswick
Posts: 869
nuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond repute
Re: Veteran Teams have No Advantage

Quote:
Originally Posted by dtengineering View Post
A low team number means absolutely NOTHING when it comes to predicting the team's performance in qualification rounds.

Now that I've got your attention, allow me to explain. I was inspired by discussion in this thread "Random" match Schedules discussing the apparent lack of randomness in assigning alliances for qualifying matches. It was stated that FIRST intentionally schedules matches so that alliances have roughly equal seniority, based on the assumption (presumably) that this will lead to a more balanced match.

That didn't seem fair to me....

So I downloaded the results from the first weekend's competitions, and dropped them into excel. Based on these 270 data points there is abolutely NO relationship between team number and seeding. The teams numbered below 300 had an average seed of 26, while teams numbered above 2000 had an average seed of 27.8. Hardly an advantage (although, admittedly I didn't calculate exactly how much difference would be required to be statistically significant here). Running a correlation coefficient over the whole data set shows a .007 coefficient of correlation between team number and seeding... and in some regionals the coefficient is negative (but also insignficant.)

This leads me to three possible hypothesis:

1) We are all mistaken about the advantage that senior teams have. Hey, I've done it... you've done it... and now it is alleged that FIRST is doing it. We're looking at a few very successful veteran teams and saying "wow... watch out for the teams with low numbers" and completely forgetting that for every veteran out there rocking the rack that there is another one struggling with their design, and a rookie team that is doing even better.

2) Veteran teams do have an advantage, but something is being done to prevent that advantage from helping them to win matches. It is possible that a scheduling system that pits veterans against veterans removes the legitimate advantage that comes from years of hard work and development.

3) My statistical analysis is incorrect or incomplete. I'm always willing to admit the possibility that I might be wrong. I challenge anyone, however, to prove that veteran teams have done signficantly better in qualification matches than newer teams. Math, here, please people... not anecdotes. We humans are really good at seeing relationships that don't really exist.

I'm open to suggestions, and to someone willing to examine finals matches and outcomes to see if veteran teams have any statistical advantage on Saturday afternoon... or to someone who can find some better predictor of success (perhaps previous year's rankings can be a reliable indicator) but until then.... I say that veteran teams have no advantage when it comes to winning matches and that a scheduling system that (allegedly) uses team numbers as a factor is not only unjustified, but unscientific.

Jason

P.S. Yes, veteran teams (my gosh... we're one now, I think...) have many advantages (and challenges) that junior teams might not have... but not ones that significantly affect the outcomes of qualifying matches.
maybe the reason why your data is so close is because teams are playing numbers close to each other. Example 11 and 25 played each other 4 times. one team is going to be seeded lower then the other and the average will always be in the middle. Your excel sheet would be better if you used last years numbers.
__________________
00,12Championship winner
03,06,08 Championship finalist
02A,03C,06N,08C,11N,12G Division winner
00,03,06,07,08,10,12 NJ / MAR winner
11 VCU winner
06,10 Las Vegas winner
12 MAR Mt Olive
red is for team 348