Go to Post FIRST is supposed to be a learning experience. Learn first, win awards later. - evulish [more]
Home
Go Back   Chief Delphi > FIRST > General Forum
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
View Poll Results: Do you think that the scoring system was bad?
Yes 16 11.68%
No 111 81.02%
No Opinion 10 7.30%
Voters: 137. You may not vote on this poll

Reply
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 27-03-2004, 19:25
Eugene Eugene is offline
Registered User
#0321 (Lancers)
 
Join Date: Jan 2002
Location: Philadelphia
Posts: 55
Eugene is on a distinguished road
Send a message via AIM to Eugene
Angry Worst Scoring System in Years

Every year we think that the FIRST came up with the worst possible scoring system and every year they beat the previous year. Here are the ranks from the Philadelphia regional according to the average match scares. Notice the wide discrepancy between the ranks by scores and ranks by QPs in some of the lower scoring teams. I attached the excel datasheet if anybody wants to check my math.

Eugene



EDIT - I think that the game on other hand was one of the best, especially the partnership of the human and the robot, and the beacons.

EDIT - As you notice the results of the ranking by different methods were most similar at the extremes, while the middle ranks fluctuated wildly.

EDIT - Please do not take the title of the thread as an insult to FIRST. This was just an attention grabber. I honestly believe that every year FIRST tries its best to make sure we have a great game.
Attached Thumbnails
Click image for larger version

Name:	Ranks by Score.gif
Views:	102
Size:	25.8 KB
ID:	2033  
Attached Files
File Type: xls RawScores.xls (38.0 KB, 38 views)

Last edited by Eugene : 27-03-2004 at 21:37.
Reply With Quote
  #2   Spotlight this post!  
Unread 27-03-2004, 19:37
Cory's Avatar
Cory Cory is offline
Registered User
AKA: Cory McBride
FRC #0254 (The Cheesy Poofs)
Team Role: Engineer
 
Join Date: May 2002
Rookie Year: 2001
Location: Redwood City, CA
Posts: 6,814
Cory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond repute
Send a message via AIM to Cory
Re: Worst Scoring System in Years

This game is not defined by points, it is defined by wins.

Your argument is irrelevant.

Cory
__________________
2001-2004: Team 100
2006-Present: Team 254
Reply With Quote
  #3   Spotlight this post!  
Unread 27-03-2004, 19:39
nuggetsyl's Avatar
nuggetsyl nuggetsyl is offline
Registered User
FRC #0025
Team Role: Coach
 
Join Date: Sep 2001
Location: north brunswick
Posts: 869
nuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond reputenuggetsyl has a reputation beyond repute
Re: Worst Scoring System in Years

Quote:
Originally Posted by Eugene
Every year we think that the FIRST came up with the worst possible scoring system and every year they beat the previous year. Here are the ranks from the Philadelphia regional according to the average match scares. Notice the wide discrepancy between the ranks by scores and ranks by QPs in some of the lower scoring teams. I attached the excel datasheet if anybody wants to check my math.

Eugene
It is going to be something to say but i love this years scoring system. It simple and lets the stragties stay simlar in the finals. Not saying it the best first can do but it is a huge step foward.

shaun
Reply With Quote
  #4   Spotlight this post!  
Unread 27-03-2004, 19:40
Will Hanashiro Will Hanashiro is offline
GM/Kettering Mentor
FRC #0322 (F.I.R.E)
Team Role: Mentor
 
Join Date: Apr 2003
Rookie Year: 1999
Location: Flint, Michigan
Posts: 151
Will Hanashiro is just really niceWill Hanashiro is just really niceWill Hanashiro is just really niceWill Hanashiro is just really niceWill Hanashiro is just really nice
Send a message via AIM to Will Hanashiro
Re: Worst Scoring System in Years

Quote:
Originally Posted by Eugene
Every year we think that the FIRST came up with the worst possible scoring system and every year they beat the previous year. Here are the ranks from the Philadelphia regional according to the average match scares. Notice the wide discrepancy between the ranks by scores and ranks by QPs in some of the lower scoring teams. I attached the excel datasheet if anybody wants to check my math.

Eugene
i'd argue the opposite... i feel that this is one of the best scoring systems FIRST has come up with. its easy for any parent or viewer to follow, and i also feel that wins is what determines a dominant robot, not QP's.
__________________

West Michigan Regional #1 Seed
2006 GLR Motorola Quality Award
2006 WMR GM Industrial Design Award

Kettering University ME Class of 2009
Reply With Quote
  #5   Spotlight this post!  
Unread 27-03-2004, 19:47
Eugene Eugene is offline
Registered User
#0321 (Lancers)
 
Join Date: Jan 2002
Location: Philadelphia
Posts: 55
Eugene is on a distinguished road
Send a message via AIM to Eugene
Exclamation Re: Worst Scoring System in Years

I think that the rank should reflect the overall performance of the team. I do not think that using the definition of the game as the proof that the rank adequately reflects the performance is a good argument.

Consider the following scenario. Team A and Team B both had high scores but team A won by a few points. Team C and Team D both had low scores and team C won by a few points. According to FIRST, Team C should be ranked above team B. I do not consider that fair. The system used by FIRST would have worked had every team played every other team. Unfortunately that is not possible.

Eugene

P.S. Note that I’m not crying here about the fact that the scoring system was unfair to my team. In fact, we ranked 15 places higher by using FIRST’s system than by using the match scores.
Reply With Quote
  #6   Spotlight this post!  
Unread 27-03-2004, 19:49
Eugene Eugene is offline
Registered User
#0321 (Lancers)
 
Join Date: Jan 2002
Location: Philadelphia
Posts: 55
Eugene is on a distinguished road
Send a message via AIM to Eugene
Question Re: Worst Scoring System in Years

Will:

So you are saying that we should favor the attractiveness to spectators over fairness?

Eugene
Reply With Quote
  #7   Spotlight this post!  
Unread 27-03-2004, 19:54
Cory's Avatar
Cory Cory is offline
Registered User
AKA: Cory McBride
FRC #0254 (The Cheesy Poofs)
Team Role: Engineer
 
Join Date: May 2002
Rookie Year: 2001
Location: Redwood City, CA
Posts: 6,814
Cory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond repute
Send a message via AIM to Cory
Re: Worst Scoring System in Years

I still maintain that a win is a win. It doesnt matter how it happened, or how many points were scored. Generally, barring machines breaking, the better alliance/robot will win.

In previous years, a team could win every single match, but not score a ton of points, but some not so good robots would get paired with real good teams, and then theyd get a ton of points, when they didnt really deserve them, or just score lots of points but not win. Guess who ended up on top? Team #2. Now THAT is unfair.

It all boils down to one thing. It doesnt matter how many points you score, it only matters if you win.

Cory
__________________
2001-2004: Team 100
2006-Present: Team 254
Reply With Quote
  #8   Spotlight this post!  
Unread 27-03-2004, 19:58
RogerR's Avatar
RogerR RogerR is offline
its spelled *ya'll*, not *y'all*
AKA: Roger Riquelme
FRC #3844 (Wildbots)
Team Role: Teacher
 
Join Date: Feb 2003
Rookie Year: 2001
Location: Somerset, KY
Posts: 913
RogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond repute
Send a message via AIM to RogerR Send a message via MSN to RogerR
Re: Worst Scoring System in Years

Quote:
Originally Posted by Eugene
Consider the following scenario. Team A and Team B both had high scores but team A won by a few points. Team C and Team D both had low scores and team C won by a few points. According to FIRST, Team C should be ranked above team B. I do not consider that fair. The system used by FIRST would have worked had every team played every other team. Unfortunately that is not possible.
either you don't understand FIRST's ranking system, or I'm mis-understanding your post. I'll assume its the second...

In my mind, if Team B lost consistantly and Team C won consistantly, if only by a few points (therefore creating the above scenerio) then team C definatly deserves to be ranked higher. If this competition were based soley on points, and not wins and losses, i think it would be considerably less exciting, with teams foccussing on the points, as in previous years (i.e. collusion 03, chokehold 02, etc...), instead of the overall game.
__________________
"But to say that the race is a metaphor for life is to miss the point. The race is everything. It obliterates whatever isn't racing. Life is a metaphor for the race." -- Donald Antrim
Reply With Quote
  #9   Spotlight this post!  
Unread 27-03-2004, 20:00
Will Hanashiro Will Hanashiro is offline
GM/Kettering Mentor
FRC #0322 (F.I.R.E)
Team Role: Mentor
 
Join Date: Apr 2003
Rookie Year: 1999
Location: Flint, Michigan
Posts: 151
Will Hanashiro is just really niceWill Hanashiro is just really niceWill Hanashiro is just really niceWill Hanashiro is just really niceWill Hanashiro is just really nice
Send a message via AIM to Will Hanashiro
Re: Worst Scoring System in Years

Quote:
Originally Posted by Eugene
Will:

So you are saying that we should favor the attractiveness to spectators over fairness?

Eugene
well, i guess what i'm trying to say is that this system is both fair and spectator friendly. if you win, then your ranked higher, and if you lose, your ranking drops. its as simple as that.

in no way am i saying that this system is perfect, just that its one of the better FIRST systems. i'm sure that we will be able to find flaws in whatever scoring systems FIRST comes up with in the future, and the "perfect" system will be hard to develope.

overall, i feel that this is a very good scoring system, and it is both fair and spectator friendly.
__________________

West Michigan Regional #1 Seed
2006 GLR Motorola Quality Award
2006 WMR GM Industrial Design Award

Kettering University ME Class of 2009
Reply With Quote
  #10   Spotlight this post!  
Unread 27-03-2004, 20:01
P.J. Baker's Avatar
P.J. Baker P.J. Baker is offline
needs a clever user title
FRC #0177 (Bobcat Robotics)
Team Role: Engineer
 
Join Date: May 2001
Rookie Year: 1999
Location: Hebron, CT
Posts: 110
P.J. Baker is a glorious beacon of lightP.J. Baker is a glorious beacon of lightP.J. Baker is a glorious beacon of lightP.J. Baker is a glorious beacon of lightP.J. Baker is a glorious beacon of light
Re: Worst Scoring System in Years

Quote:
Originally Posted by Eugene
Will:

So you are saying that we should favor the attractiveness to spectators over fairness?

Eugene
For reasons stated by others above, I too think that this is the best scoring system in years.

As far as fairness is concerned, the scoring system is fair because every team had the opportunity design their robot and strategy around it. I could only really view it as unfair if they changed it mid way through the build season in a way that would make some designs and strategies much better than others.
Reply With Quote
  #11   Spotlight this post!  
Unread 27-03-2004, 20:04
Eugene Eugene is offline
Registered User
#0321 (Lancers)
 
Join Date: Jan 2002
Location: Philadelphia
Posts: 55
Eugene is on a distinguished road
Send a message via AIM to Eugene
Re: Worst Scoring System in Years

Cory:

I think that the alliance partner is an uncontrolled variable present in both scoring systems; therefore that argument cannot be used. To me scoring points represents performance, while winning represents chance. Hence, I think our argument boils down to what matters, winning or building a robot that can successfully complete the task.

Eugene
Reply With Quote
  #12   Spotlight this post!  
Unread 27-03-2004, 20:14
RogerR's Avatar
RogerR RogerR is offline
its spelled *ya'll*, not *y'all*
AKA: Roger Riquelme
FRC #3844 (Wildbots)
Team Role: Teacher
 
Join Date: Feb 2003
Rookie Year: 2001
Location: Somerset, KY
Posts: 913
RogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond reputeRogerR has a reputation beyond repute
Send a message via AIM to RogerR Send a message via MSN to RogerR
Re: Worst Scoring System in Years

Quote:
Originally Posted by Eugene
Cory:

I think that the alliance partner is an uncontrolled variable present in both scoring systems; therefore that argument cannot be used. To me scoring points represents performance, while winning represents chance. Hence, I think our argument boils down to what matters, winning or building a robot that can successfully complete the task.

Eugene
first of all, since points scored is the sum of the points scored by the alliance, it is just as dependent on the ally as winning (notice how the alliance with higher points wins?). secondly, since they rank by wins, then a highly ranked team is probably a very effective one. unlike past years, this system doesn't punish a defensive strategy.
__________________
"But to say that the race is a metaphor for life is to miss the point. The race is everything. It obliterates whatever isn't racing. Life is a metaphor for the race." -- Donald Antrim
Reply With Quote
  #13   Spotlight this post!  
Unread 27-03-2004, 20:20
white_ChocOlat8's Avatar
white_ChocOlat8 white_ChocOlat8 is offline
Registered User
AKA: white chocolate
FRC #1902 (Team EMOTICONS)
Team Role: Marketing
 
Join Date: Jan 2004
Rookie Year: 2003
Location: orlando
Posts: 51
white_ChocOlat8 can only hope to improve
Send a message via AIM to white_ChocOlat8
Re: Worst Scoring System in Years

Quote:
Originally Posted by Cory
This game is not defined by points, it is defined by wins.

Your argument is irrelevant.

Cory
I second this; you should not be putting down FIRST but yet embracing it to your advantage. Teams that win all of their matches deserver to be ranked the highest
__________________
EXPLODING BACON!

OINK OINK BOOM
Reply With Quote
  #14   Spotlight this post!  
Unread 27-03-2004, 20:21
Eugene Eugene is offline
Registered User
#0321 (Lancers)
 
Join Date: Jan 2002
Location: Philadelphia
Posts: 55
Eugene is on a distinguished road
Send a message via AIM to Eugene
Post Re: Worst Scoring System in Years

To All:

I totally agree that winning matters. What bothers me is the fact that there are only 8 games that are played. Excluding the variable presented by the alliance partner and assuming that the team scores do not fluctuate much (the data supports that), if the ranking was done by scores than no matter how the teams were paired, the better performing teams would consistently be an top whereas by using the win/lose system the ranks would fluctuate far more. If you look at the table that I compiled, you would notice that the difference in ranks by different methods is huge. One of the statistical methods (which is what we should use in our argument if we were to consider ourselves scientists, as in fir_S_t) that is used to evaluate the validity of the test is the correlation of scores between that test and other tests. In that aspect, the current scoring system would not be considered valid.

Eugene
Reply With Quote
  #15   Spotlight this post!  
Unread 27-03-2004, 20:24
Eugene Eugene is offline
Registered User
#0321 (Lancers)
 
Join Date: Jan 2002
Location: Philadelphia
Posts: 55
Eugene is on a distinguished road
Send a message via AIM to Eugene
Smile Re: Worst Scoring System in Years

I think that anyone who participated in FIRST for four years can be considered a first-a-holic. I totally love the competition and in no way did I mean to put it down.

Eugene
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Seeding System Koci Rules/Strategy 23 25-03-2004 15:27
Five years in FIRST and I am very proud! SkywayWheels General Forum 4 06-02-2004 22:48
What do you wish you knew about the new control system? Joe Ross Control System 2 09-01-2004 21:47
Do you think this years game will be... Brian Savitt General Forum 26 09-12-2001 22:43
Scoring system. Joel J Technical Discussion 7 13-06-2001 18:10


All times are GMT -5. The time now is 03:57.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi