Re: FRC Top 25 week 3 results
 

The FRC Top 25 list is a lot of fun to watch & it is an honor to be included. However, I don't read too much into it. Being a popular poll, I think people vote for the teams that they know or have some exposure to. The finals at West Michigan last weekend got a lot of attention (including video) on CD. In this week's poll, we moved up, and 27, 67, and 2054 all joined the list. They are all well deserving in my opinion, but if others had gotten the same exposure, they may have gotten the same recognition.

Re: FRC Top 25 week 3 results
 

If you want to complain about the expert polls, consider this: for Week 3, only 4 of the 10 expert voters have a list in. Find the rest of them and have them get lists in before you complain about that.

Re: FRC Top 25 week 3 results
 

I have considered that, and I don't think it makes a difference, I am looking at the "experts" who have updated one at a time. Atleast one of the "experts" seems to have no agreement with the others about what bots are best (4 of his/her to 10 are not in any one elses 25, and he/she did not include 2 teams in his/her 25 that are in every one elses top 10.

There are only 8 teams on all 4 expert lists:
111
1114
148
2056
217
33
330
40

(Any given year I would say at least 7 of these teams would make the top 25)

There is no way that number can go up if more "experts" post. I wouldn't expect every ones lists to match, but the diferences should be in the lower ranked teams. If you look at college sports polls then there is usually consensus between the experts, it is pretty rare to see a team raked #3 by one person and not ranked by any one else.

I don't know who the "experts" are but I have to say I agree with Tom, I would not take the rankings too seriously.

Re: FRC Top 25 week 3 results
 

As an expert (gasp!), I'm not posting because I didn't see any teams not at WPI during week 2, and I didn't see anybody week 3. I feel it's better to post when I at least have a rough idea, instead of no idea.

Re: FRC Top 25 week 3 results
 

I didn't post one particular week because while I had internet before the posting period (and watched several events), I had no internet access during the posting period.

College sports poll comparisons can fail: I wouldn't be surprised if before those lists come out, the experts confer at least a bit and call attention to a missed team. Here, I don't think the experts even know who the other experts are (unless someone comes out and says they're an expert).

Re: FRC Top 25 week 3 results
 

Right, which is why Justin and I started this whole FRC Top 25 thing for FUN. And you're right, it is rare.. but that's because this whole system is based on matter of opinion. In one person's mind XXXX team is the best team out there, but to someone else they're not. It's opinion. It's hard to see every robot in every match of every regional. Rankings are going to be all over the place.

And guys, the public poll is the same exact way! You just can't see how each person voted, as you can in the expert poll. Everyone who votes in the public poll votes differently as well- it's life. No one is paid to make these rankings- like in football. If the experts did this as a full time job like in NCAA, you can bet they would sit down for 8 hours a day analyzing match videos and data to find the best teams; and then I think you would see some more consensus between the voters. But that's not reality.

So everyone just needs to relax, and enjoy the friendly competition this brings. And as Justin said on the show last night, "It's not a matter of finding 25 teams, its a matter of finding which 25 teams." There are so many GREAT robots out there. Soooo many great teams were left off the list. So don't take any of this personal. Just enjoy the spirit it brings to FIRST. It's been so much fun chatting and communicating with all of you, and doing the show, and I hope you guys have enjoyed it! :)

Re: FRC Top 25 week 3 results
 

Something to keep in mind is there are between 100 and 150 NCAA Div. 1 football teams. Picking a top 25 out of that is deciding on the 1/4 to 1/6th best teams. This is just slightly harder than making a pick-list for a FRC Championship Division (a little under 90 teams). Picking a Top 25 out of a current 800-ish teams is picking the top couple of percent. This would be pretty tough. If you think about it, if you and draw a random 25 out of a deck of 100, we will likely have around 6 matching teams. Do the same experiment on a deck of 800, and you are likely to have 1 or fewer matches.

I really appreciate the folks contributing and putting this together. If you have ever made a pick-list at an event, you know how tough it can be trying to sort out teams.
What actually surprises me is that there are not a ton more on the mention list. I figured there would be a fair amount of overlap for the top 10, but the next 15 or so would be much more random thus the mention list would be HUGE.

Re: FRC Top 25 week 3 results
 

I think there's a cutoff. I'm sure there are a few more than listed--there's just a cutoff; if you don't get more points than the cutoff, you don't get listed.

Re: FRC Top 25 week 3 results
 

The mention list could be quite huge if we choose it to be!
For example, this week 111 different teams were at least voted for once. So what Justin and I do is we look at the teams ranked 25 through about 45, and find in our "Totals" column on our spreadsheet where there's a big gap between teams in the 25-45 range. So for this week 201, 245, 359, 1023, 1126, 1503 and 1676 all fell close to the Top 25 (26th-32nd Rank). So the 33rd ranked team after that group of 7 was quite behind in number of votes. If you notice on the website for this week it says "55 Ranking Point Qualifier". So 201, 245, 359, 1023, 1126, 1503 and 1676 all had at least 55 Points). The 33rd ranked team this week had 46 Points. So that's where our steep drop of was this week. Each week the Qualifier number will be different based on the number of voters.
I hope that made sense- it probably didn't though.. If it's not let me know, I can try and clear it up some.

Exactly!

Re: FRC Top 25 week 3 results
 

Understood. What would be neat to see - especially after week 6 - would be a graph of ranking points on the Y axis and rank on the X axis, all the way out to 120 (or however many got 2 or more votes). I'm interested in the places where steep drops occur.

Re: FRC Top 25 week 3 results
 

Have you ever really looked at analysis of all the voters in a major poll? It is full of "extreme voters". For comparison lets look at Week 3 of the AP CFB poll on pollspeak.com (I will admit that I am enough of a college football geek that I do occasionally look at polls, Jeff Sagarin computer rankings and listen to a recruiting podcast)

Let's look at this one team: Auburn. Some voters had them as high as 10 while others had them unranked. How did that turn out for them? BCS Champions. Lets look at one that went the other way: Michigan. Highest 8th Lowest: unranked. Interestingly enough, James Madison University received a few votes as high as 19 after their big upset of VA Tech (then went on to miss the playoffs of the FCS).

So maybe the one extreme voter you mention is the "Scott Wolf" of the group. However, it brings up other issues in the trying to put together a list of Top 25 robots, who has actually seen the #3 robot in question. I was at Chesapeake so I didn't see any of the SAC webcast or any archive vids. All I know is their OPR was 21.064 and lost in the QF, probably not a #3 by those metrics, but I still have no clue what their robot actually does (maybe it ran a successful double Uber and they had hard luck in the #8 Alliance). I would like to see that expert comment on their unique pick and maybe we would learn something. Mike and Justin, is there going to be expert comments added to the website any time soon.

According to the overall OPR list, there have been 1337 non unique robots at 3 weeks worth of events (no I didn't make that # up to be leet). Noone could possibly have processed all of those performances at regionals when trying to make a list of 25, the process is inherently difficult and inaccurate. You can reduce your sample size somewhat by only considering elim alliances, but then you run into a new problem: How do you split the credit among alliance members for the win? At Alamo, 16 went undefeated, 148 put up the double uber, both put up their share of tubes and minibots to dominate the elims, who gets the bigger share of the win pie. The 3 team alliance nature of all recent FIRST games makes it more difficult to evaluate individual robot performance. More archived vids wold help everyone vote better, and it is not as simple as setting your DVR to recored a Sat of College Football or watching highlights on College Football Final. I'm sure Mike an Justin would love to play highlights, but that would take a larger community effort and a longer show.

I'm frankly glad this poll does't reach the "consensus" of the major college polls. As I pointed out before they don't totally reach a consensus, but similarities in their votes are largely due to pressure to conform with other voter's past votes. This starts with the baseless "Preseason Poll", which is all hype loosely related to last year's performance (which is at least the same game unlike FIRST). That Preseason poll gets cemented in future polls as pollsters are reluctant to move anyone down until they lose despite all other evidence to the contrary. FRC Top25 has the rule that you can't vote for someone that hasn't competed to prevent this sort of mentality.

The poll will never be perfect and at this stage it is still new and getting the kinks out. However the poll and the show is fun and that is the point. I need to encourage the scouts on my team that watch webcasts to vote (along with me) in the public poll and join in the fun & community.

Re: FRC Top 25 week 3 results
 

Everyone seems to be in consensus that it is hard if not impossible for people to rank a true top 25 due to the number of team, limited amount of time to view matches, and limited cross over between teams and regions. This is exactly why I said in my two previous posts that I would not take the rankings too seriously. I appreciate the difficulty of scouting large numbers of teams and trying to make a ranking list of the top ~2%, I am not criticizing the people who are trying to do this, simply putting out a warning for those who might not realize that this list is (probably) not accurate that they might not want to put much weight into these rankings.

Re: FRC Top 25 week 3 results
 

Some people take this stuff way too seriously. Just have fun.

Re: FRC Top 25 week 3 results
 

Haha. You got it! We pretty much say that every show. These are people's opinions.. not facts.

Absolutely! That was the whole reason behind the show. Just to have fun and to get people talking about robotics!! The poll is not the "master picklist" to have at Championship. :)

Re: FRC Top 25 week 3 results
 

Thank you for the compliment. The kids had a blast making this robot and just
as much fun competing. As for making polls, we are plenty comfortable just
working under the radar before championship and having fun doing it! That's what it is about.:D