Chief Delphi

Chief Delphi (http://www.chiefdelphi.com/forums/index.php)
-   Regional Competitions (http://www.chiefdelphi.com/forums/forumdisplay.php?f=10)
-   -   AZ Regionals: Incorrect Scoring? (http://www.chiefdelphi.com/forums/showthread.php?t=36154)

ArmoredFairy698 13-03-2005 22:24

AZ Regionals: Incorrect Scoring?
 
**PLEASE NOTE:**

We know it's too late to change anything; regionals ended yesterday, but we want to bring it to your attention that we don't think FIRST's scoring software is working correctly. Here's why:

**

As of Friday evening (the second day of the AZ Regional event), the FIRST Robotics scoring software was down, due to a program malfunction. The score board was back up on Saturday morning, and all was fine...or so we thought. Throughout the course of the day, our scores were messed up, including at one point on Friday as well. It was brought to our attention by one of our mentors that they had messed up on the win-loss-tie portion of our score, which subsequently misplaced us in the ranking. We spoke to the judges and the error was corrected, no problem. We had a running tally of our points and ranking on a huge white board at our pit, so we knew where we stood in the game at all times. On Saturday afternoon before it was time to choose alliances, we noticed that again, our score was messed up. We were posted as having won 6 matches, lost 6 matches. Instead, it should have said that we won 7 matches, and lost 5. So, a friend and I from the team went up and spoke with a judge, and we were told that due to software malfunctions, the scoring that was currently up was incorrect and considered void, and not to worry because it was going to be corrected.

Well, it came time to pick alliances, and in the whirl-wind of it all, I was chosen to represent my team on the field and we were, in turn, picked by Chandler High to be in alliance with them for the finals. I was under the impression that we were in 11th place at the time, because that was how we we were told that we finished...but during alliance picking, the top 8 teams became consolidated, and so #9 and #10 were called in to be alliance captains. I expected us to be #11, and when it came time to call in an 11th captain, there was a debate...the FIRST officials pulled off to the side and had a discussion for a few minutes as to who was to move up in the ranking list...and we weren't called. It struck me as odd, but I let it go. I guess my gut was right and I should have asked a judge what was going on. Thanks again to Chandler High though, we were picked and made it to finals, even though we didn't win.

Here's the catch: the final scored posted for the AZ regionals put us in 15th place, with 6 wins and 6 losses. Unless the judges changed something without my team's knowledge, we are all still under the impression that we won 7 matches and lost 5. If you check out this site of the final scoring positions: http://www2.usfirst.org/2005comp/Eve.../rankings.html , you will see that we should have come in 9th place, or even tied for 8th. That means that with the way alliance were chosen, we would have been team #8 or #9, making me, (as representative for my team #698), an alliance captain.

I've spoken to my mentor. He told me I could take this to FIRST (and I am) to at least find out why the scores are incorrect, or if they changed it for a valid reason. I know it's probably to late for any hope of nationals (we lost the final matches), but at least maybe this will be an effective word of warning to other teams about the scoring.

**IF YOUR SCORES COME UP INCORRECT, FIX IT IMMEDIATLY! YOU MIGHT EVEN CONSIDER TALKING TO AT LEAST TWO JUDGES TO BE SURE OF YOUR POSITION.**

Best of luck to all teams that are preparing to compete, and watch out for that scoring software!!!

Vin211 13-03-2005 22:31

Re: AZ Regionals: Incorrect Scoring?
 
Oh wow, that is quite a mistake they made. You would think with FIRST they would have a programming error fixed immediately. It sounds like a simple program that can easily be fixed. I wonder what happened and why? Are you suggesting that FIRST find a better way to score and have a back up system in place? If so, I agree with you!

When it comes to scores and rankings, believe me, I don't want any mistakes to happen. 1 position is crucial to whom you may be allied with or competing against. I guess this is very valuable lesson for programmers at FIRST and hopefully the same mistakes won't happen next weekend at other Regionals.

Donut 13-03-2005 22:39

Re: AZ Regionals: Incorrect Scoring?
 
I do not know if the actual rankings at the end of regionals were off, but I do know the scores and rankings on FIRST right now are off, and that they were screwed up during the playoffs on Saturday (they looked correct at the end of qualifiers on Saturday, but for some reason changed during the playoffs despite the fact no new qualifying matches were played). At the end of competition, there were 5 teams that finished 9-3 and held rankings 1-5. Last check on the site (and on Sat.), 2 of the teams were listed as 10-2, two of them were listed as 9-3, and one was listed as 8-4.

We wrote our own program for our scouting team to keep track of records (as well as stats like caps, total points, autonomous caps, etc.), and relied on that the later part of Friday to determine the rankings as closely as we could. We do not have the qualifying points section set up in our program, but I might be able to check it and see how the records of your team as well as the team that moved up to #8 (team 64) compared.

falconmaster 13-03-2005 22:45

Re: AZ Regionals: Incorrect Scoring?
 
Quote:

Originally Posted by ArmoredFairy698
**PLEASE NOTE:**

We know it's too late to change anything; regionals ended yesterday, but we want to bring it to your attention that we don't think FIRST's scoring software is working correctly. Here's why:

**

As of Friday evening (the second day of the AZ Regional event), the FIRST Robotics scoring software was down, due to a program malfunction. The score board was back up on Saturday morning, and all was fine...or so we thought. Throughout the course of the day, our scores were messed up, including at one point on Friday as well. It was brought to our attention by one of our mentors that they had messed up on the win-loss-tie portion of our score, which subsequently misplaced us in the ranking. We spoke to the judges and the error was corrected, no problem. We had a running tally of our points and ranking on a huge white board at our pit, so we knew where we stood in the game at all times. On Saturday afternoon before it was time to choose alliances, we noticed that again, our score was messed up. We were posted as having won 6 matches, lost 6 matches. Instead, it should have said that we won 7 matches, and lost 5. So, a friend and I from the team went up and spoke with a judge, and we were told that due to software malfunctions, the scoring that was currently up was incorrect and considered void, and not to worry because it was going to be corrected.

Well, it came time to pick alliances, and in the whirl-wind of it all, I was chosen to represent my team on the field and we were, in turn, picked by Chandler High to be in alliance with them for the finals. I was under the impression that we were in 11th place at the time, because that was how we we were told that we finished...but during alliance picking, the top 8 teams became consolidated, and so #9 and #10 were called in to be alliance captains. I expected us to be #11, and when it came time to call in an 11th captain, there was a debate...the FIRST officials pulled off to the side and had a discussion for a few minutes as to who was to move up in the ranking list...and we weren't called. It struck me as odd, but I let it go. I guess my gut was right and I should have asked a judge what was going on. Thanks again to Chandler High though, we were picked and made it to finals, even though we didn't win.

Here's the catch: the final scored posted for the AZ regionals put us in 15th place, with 6 wins and 6 losses. Unless the judges changed something without my team's knowledge, we are all still under the impression that we won 7 matches and lost 5. If you check out this site of the final scoring positions: http://www2.usfirst.org/2005comp/Eve.../rankings.html , you will see that we should have come in 9th place, or even tied for 8th. That means that with the way alliance were chosen, we would have been team #8 or #9, making me, (as representative for my team #698), an alliance captain.

I've spoken to my mentor. He told me I could take this to FIRST (and I am) to at least find out why the scores are incorrect, or if they changed it for a valid reason. I know it's probably to late for any hope of nationals (we lost the final matches), but at least maybe this will be an effective word of warning to other teams about the scoring.

**IF YOUR SCORES COME UP INCORRECT, FIX IT IMMEDIATLY! YOU MIGHT EVEN CONSIDER TALKING TO AT LEAST TWO JUDGES TO BE SURE OF YOUR POSITION.**

Best of luck to all teams that are preparing to compete, and watch out for that scoring software!!!

We agree that the scoring should have been fixed immediately!! That is unexceptable for a first event. We think the score is wrong too. Team 842 Falcon Robotics, we thought "they" knew something we didn't.

Vin211 13-03-2005 23:18

Re: AZ Regionals: Incorrect Scoring?
 
FIRST always knows something we don't lol!

But I will agree with you, scoring errors due to programming is very unexceptable. Yes these things happen but they have to be fixed immediately.

Mark Pettit 13-03-2005 23:42

Re: AZ Regionals: Incorrect Scoring?
 
I hope that FIRST gets a handle on this stuff before the rest of the season. That's terrible that we've all struggled to make our robots and teams ready to compete only to be stymied by blunders like these.
We pointed out an issue with the ranking system early Friday morning. The errors were in our (991's) favor. FIRST thanked us for our gracious professionalism and informed us that when scores/rankings are posted they are final.
There were apparently also issues with the competition control system that we all plug in to. The buzzer to end a match came on about 5 seconds into RC mode in one of our matches and that, oddly, coincided with disablement of our robot. The IFI rep told us that our backup battery hit the controller reset button. We jiggled it around and it didn't look to us like that was possible, but like all FIRST judgements, that was final (it is what it is).
Regardless of the problems with the sanctioning body, The AZ Regional Planning Committee put on a wonderful show and we all had a blast playing the game!

Kevin Sevcik 13-03-2005 23:51

Re: AZ Regionals: Incorrect Scoring?
 
Ranking errors are definitely unacceptable. I was under the impression that the current issues were only with the web results and occasional oddness during matches the we experienced at GLR. I can deal with bad web results and MCs having to tell teams to ignore the extraneous buzzers and gongs. If it appears that the actual rankings are off, then the issue is either isolated to some incorrect entries by scorekeepers or it's a much deeper issue with the software possibly improperly updating records or some such. I've made scoring errors in the rush of a regional, but I've always had the matches on paper and a heck of a Head Ref at Lone Star that'd figure the scores himself and let me know if there was a discrepency. If there's no paper backup this year or the game is too complicated for refs to score themselves, then this could be a factor.

Also, to repeat what I've said in a few other threads..

From what I've seen of all the scoring displays, etc., it looks like FIRST has gone with a completely new scoring system this year and they're still working all the bugs out. Last year's system was mostly brand new as well. (I think the software was based on some team's prior efforts) Last year there were lots of glitches and oddness in the first couple of weeks, and even all the way till Lone Star when I was running it. By Atlanta, last year's scoring system was working very well, so one can hope that they'll get all the bugs out of this year's new system by then as well.

jgannon 14-03-2005 00:19

Re: AZ Regionals: Incorrect Scoring?
 
At Sacramento, we won one of our early qualifying matches. There were no penalties, and it looked from the stands like we had been beaten, so I was surprised. Later in the day, the win disappeared from our record, and our ranking dropped significantly. When we talked to the officials, we were told that there had been a mistake. I don't know where the mistake occurred, or if it is at all related to the problem at hand. However, I know that the officials were far too busy to be double-checking everything, so the way that the mistake came to light was probably by someone pointing it out. I don't know how many other problems like this were missed. It's hard to be critical of FIRST, but I hope they get this all straightened out soon. It's a real bummer to do everything you need to do with your robot and your alliance, only to have it fouled up by the computers.

Joe Domingo 14-03-2005 00:38

Re: AZ Regionals: Incorrect Scoring?
 
The link you point to here is also wrong, we were 9-3 not 10-2 neither was 555, we were all tied for 1st place and we got it because of 15 qualifing points against 12, I am sure they will fix it before it gets posted on the FIRST page.
Hey but how about the good things ? For the smallest Regional this year In think that the highest score in the nation must be when 498,1492 and 1290 managed to score 112 points!!
We really enjoyed the week-end , the game is exciting and we will keep working on that elusive vision tetra.
see you all in SVR.

Quote:

Originally Posted by ArmoredFairy698
**PLEASE NOTE:**

We know it's too late to change anything; regionals ended yesterday, but we want to bring it to your attention that we don't think FIRST's scoring software is working correctly. Here's why:

**

As of Friday evening (the second day of the AZ Regional event), the FIRST Robotics scoring software was down, due to a program malfunction. The score board was back up on Saturday morning, and all was fine...or so we thought. Throughout the course of the day, our scores were messed up, including at one point on Friday as well. It was brought to our attention by one of our mentors that they had messed up on the win-loss-tie portion of our score, which subsequently misplaced us in the ranking. We spoke to the judges and the error was corrected, no problem. We had a running tally of our points and ranking on a huge white board at our pit, so we knew where we stood in the game at all times. On Saturday afternoon before it was time to choose alliances, we noticed that again, our score was messed up. We were posted as having won 6 matches, lost 6 matches. Instead, it should have said that we won 7 matches, and lost 5. So, a friend and I from the team went up and spoke with a judge, and we were told that due to software malfunctions, the scoring that was currently up was incorrect and considered void, and not to worry because it was going to be corrected.

Well, it came time to pick alliances, and in the whirl-wind of it all, I was chosen to represent my team on the field and we were, in turn, picked by Chandler High to be in alliance with them for the finals. I was under the impression that we were in 11th place at the time, because that was how we we were told that we finished...but during alliance picking, the top 8 teams became consolidated, and so #9 and #10 were called in to be alliance captains. I expected us to be #11, and when it came time to call in an 11th captain, there was a debate...the FIRST officials pulled off to the side and had a discussion for a few minutes as to who was to move up in the ranking list...and we weren't called. It struck me as odd, but I let it go. I guess my gut was right and I should have asked a judge what was going on. Thanks again to Chandler High though, we were picked and made it to finals, even though we didn't win.

Here's the catch: the final scored posted for the AZ regionals put us in 15th place, with 6 wins and 6 losses. Unless the judges changed something without my team's knowledge, we are all still under the impression that we won 7 matches and lost 5. If you check out this site of the final scoring positions: http://www2.usfirst.org/2005comp/Eve.../rankings.html , you will see that we should have come in 9th place, or even tied for 8th. That means that with the way alliance were chosen, we would have been team #8 or #9, making me, (as representative for my team #698), an alliance captain.

I've spoken to my mentor. He told me I could take this to FIRST (and I am) to at least find out why the scores are incorrect, or if they changed it for a valid reason. I know it's probably to late for any hope of nationals (we lost the final matches), but at least maybe this will be an effective word of warning to other teams about the scoring.

**IF YOUR SCORES COME UP INCORRECT, FIX IT IMMEDIATLY! YOU MIGHT EVEN CONSIDER TALKING TO AT LEAST TWO JUDGES TO BE SURE OF YOUR POSITION.**

Best of luck to all teams that are preparing to compete, and watch out for that scoring software!!!


Jeffrafa 14-03-2005 00:43

Re: AZ Regionals: Incorrect Scoring?
 
We had many similar problems for our team at the Pacific Northwest Regional.

Friday morning we first competed in round 3, which was announced as a win for us (17-6). We were 4-0-0 at lunch when the placement screen suddenly changed and put us as 3-1-0 without us ever hearing any reasoning. After talking to the pit administration and field officials, we were told sometime in the afternoon that this was because round 3 had been miss-scored and was really supposed to be a loss for us with a score outcome of 4-6. We questioned the scoring having been changed hours after the match but were disregarded and told that the judges call was final. This disagrees with the regulation that scoring disputes must be settled within minutes of the round conclusion - especially considering that there were no questions raised from either side about the outcome. This severely impacted our ranking at the time, dropping us from 2nd to below 10th.

After Friday's matches concluded the ranking for teams was also unavailable, leaving many teams including us unsure about our placement and unable to do our needed scouting research for the Saturday afternoon alliance selections. Friday night we found we were able to pull up the placement sheet online, but we were again shocked to see our record saying we were 6-3-0 when we had only run 8 matches during Friday’s rounds. Further research of the lists available online showed that we had lost a match that we hadn’t even played yet with a score of 0-3. This also affected our ranking, which would have screwed up any other teams that were resourceful enough to check online while doing their scouting research. Saturday morning’s match ended up being a win for us (25-23) after re-running the match due to field equipment malfunction and one of our allies unable to control their robot.

Our greatest concern was with the errors made during the alliance selection process. We were ranked 7th before alliance selection began, but as teams shifted during the first two alliance selections, we disappeared off the list rather than moving up. One of our team leaders immediately brought this to the attention of the nearest referee and a judge on the field without much response and after persistence the ref finally went to talk with someone about it as alliance selections continued. At the same time, our student coach who was in the pits watching the screen noticed and went directly to the pit administration desk where he was told that they would look into it. Somehow we reappeared on the screen when it came to calling the 5th seed alliance captain and we were called up, as we should have been. The problem with these multiple errors and not stopping the process was that we were not visible to representatives on the higher alliances who may have otherwise chosen us. Other team’s representatives were questioning where our team was on the screen and claimed it impacted their selection. Our team leaders went to speak with the head computer person as soon as possible. No one could figure out how the error had occurred. At the same time, another team also came to report that they too had been dropped from the seed team lists at the same time. We were told that the alliances have been selected and they didn’t think there was anything that could be done but would discuss it. When we checked later during lunch, we were told that nothing could be done and that our team would receive a personal apology for graciously accepting the circumstance. Paul Shay apologized to the driving team while they were waiting for their first quarterfinals game.

sanddrag 14-03-2005 00:50

Re: AZ Regionals: Incorrect Scoring?
 
I don't know all the details of the situations and I do know FIRST is trying very hard at the job they have to do, but from what I read here this is just plain unacceptable. I'm terribly sorry for anyone that had to go through this. One can only hope that the future brings success.

ArmoredFairy698 14-03-2005 01:27

Re: AZ Regionals: Incorrect Scoring?
 
Quote:

Originally Posted by Donut
I do not know if the actual rankings at the end of regionals were off, but I do know the scores and rankings on FIRST right now are off, and that they were screwed up during the playoffs on Saturday (they looked correct at the end of qualifiers on Saturday, but for some reason changed during the playoffs despite the fact no new qualifying matches were played). At the end of competition, there were 5 teams that finished 9-3 and held rankings 1-5. Last check on the site (and on Sat.), 2 of the teams were listed as 10-2, two of them were listed as 9-3, and one was listed as 8-4.

We wrote our own program for our scouting team to keep track of records (as well as stats like caps, total points, autonomous caps, etc.), and relied on that the later part of Friday to determine the rankings as closely as we could. We do not have the qualifying points section set up in our program, but I might be able to check it and see how the records of your team as well as the team that moved up to #8 (team 64) compared.

Oh boy, you have NO IDEA how much I would appreciate it if you could check your records. If you can't, I'm totally fine with it, but it you have that availability, I would be so happy if you could. If you'd rather, you can email me personally at CaitlynMcH@aol.com.

Just to let you know...I am still going to contact FIRST personally and see if I can get any more information out of this dispute. I know our chances of nationals are over, but I would rest easier if I knew the judges made a scoring error or something and had legitimate reasons for changing our wins/losses tally.

Keep an eye out for any errors! :ahh: We are obviously not the first teams here to have experienced problems!! Thank you all for your gracious support in these mess-ups, and best of luck to each and every team.

The Lucas 14-03-2005 04:31

Re: AZ Regionals: Incorrect Scoring?
 
We had ranking problems at the Pittsburg Regional. It wasn't a problem with wins and losses, but rather a problem with the rankings in the alliance selection program. During the first round of alliance selection, teams picked among the top eight seeded teams. The selection program needed to fill the voids with new alliance captains. Unfortunately, the program did not pick the next highest seeded teams to fill the voids as it should have. They went through both rounds of the selection process without noticing this.

During lunch, they had to hold a second draft, starting with the new alliance captains in the seventh and eighth spots. Everything worked out ok, and I commend the FIRST officials for holding a second draft to fix the problem.

FIRST still has to iron out the bugs in its new software (which runs on Windows :rolleyes: ). If you are in a potential picking position (ranks 9-15) make sure you know your ranking and the rankings of other potential pickers so you will notice a problem as it arises.

JonBell 14-03-2005 06:40

Re: AZ Regionals: Incorrect Scoring?
 
At the UTC semifinals, we lost our first match, but then in our second match, we won by two points. However, the judges didn't count one of the tetras, and even though we had the entire field on video, they didn't want to watch the video - we ended up losing by one point and falling out of the finals. We told them right after they put the score up! I guess that I can see where the judges are coming from in that they don't want to waste time reviewing every single play, but perhaps there should be some contingency for ties or 1 point differences in scores?

Then again, we were blue, so perhaps it was part of the communist scheme? :P

Kevin Sevcik 14-03-2005 06:56

Re: AZ Regionals: Incorrect Scoring?
 
If I recall correctly, the process at Lone Star Regional usually involves the Head Ref checking the score with the teams before it goes in, so we'll hopefully avoid most of these problems in Houston....


All times are GMT -5. The time now is 23:26.

Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi