Chief Delphi

Chief Delphi (http://www.chiefdelphi.com/forums/index.php)
-   General Forum (http://www.chiefdelphi.com/forums/forumdisplay.php?f=16)
-   -   A True 2010 World Ranking (http://www.chiefdelphi.com/forums/showthread.php?t=85969)

Ed Law 31-05-2010 01:08

A True 2010 World Ranking
 
I have been thinking about doing this for a long time and I finally did it.

I took all the district, regional (including Israel) and championship data, including qualifying and elimination round matches and assemble it into a giant 1799 X 1799 matrix. Then solve for OPR and CCWM. I was not sure if my laptop can handle it but it ran without any problem in about 5 minutes.

The purpose of this is to avoid compaing OPR/CCWM between different events and the argument that some events are stronger than others. This also eliminates the issue about which OPR/CCWM data to use: latest, average, weighted average etc. Since all the matches are included, all interactions between teams are taken into account. This is the ultimate way of calculating world ranking.

The data can be found in the following white paper, http://www.chiefdelphi.com/media/papers/2174

The file name is Team_2834 2010_Scouting_Database Championship v6.zip

Enjoy reading through the data. If you find any errors, please let me know.

davidthefat 31-05-2010 01:15

Re: A True 2010 World Ranking
 
Eh... is this really necessary? Its not like the NFL or NCAA football or something, but good job I guess on your efforts?


edit: LOLs I think the NCAA Football should replace teh BCS with this system

Chris is me 31-05-2010 01:36

Re: A True 2010 World Ranking
 
Quote:

Originally Posted by davidthefat (Post 964610)
Eh... is this really necessary? Its not like the NFL or NCAA football or something, but good job I guess on your efforts?

It's actually a lot like both! Think of teams as players and alliances as teams and it's very analogous.

pSYeNCe 31-05-2010 11:12

Re: A True 2010 World Ranking
 
Woah. This is pretty amazing... Indeed, I'd say it's the ultimate scouting resource. You sure put a lot of work into this- good job!

Radical Pi 31-05-2010 12:19

Re: A True 2010 World Ranking
 
Is this supposed to have 2010 data? I looked up my team and it returned our 2009 records (which we honestly were horrible in)

apalrd 31-05-2010 12:23

Re: A True 2010 World Ranking
 
There is a file further down that has 2010 data. I actually made the same mistake.

Great data.

davidthefat 31-05-2010 12:26

Re: A True 2010 World Ranking
 
Why not make it into a website? I personally think it would be 10x easier to update and distribute than an excel spreadsheet.

timothyb89 31-05-2010 16:43

Re: A True 2010 World Ranking
 
Quote:

Originally Posted by davidthefat (Post 964652)
Why not make it into a website? I personally think it would be 10x easier to update and distribute than an excel spreadsheet.

That's basically what we did with FRC-DB :D
*ahem* Sorry, shameless plug, but I couldn't help it.

Ed Law 01-06-2010 09:12

Re: A True 2010 World Ranking
 
Quote:

Originally Posted by davidthefat (Post 964652)
Why not make it into a website? I personally think it would be 10x easier to update and distribute than an excel spreadsheet.

The data is only interesting to people involved with scouting and alliance selection. It may be a good idea to put the data into a website. There are a number of reasons I don't.

(1) If the purpose is only to search for past events from static data, then a website will make sense. However my spreadsheet can be used in real time during a competition using real time data. Unfortunately not every venue gives us internet access so a spreadsheet works better.
(2) Many teams use my data and customize/enhance to fit their needs. It is easiest for them if I give the data in a spreadsheet.

IKE 01-06-2010 09:42

Re: A True 2010 World Ranking
 
Thanks Ed for posting this up. Is there any chance you could put a Word file in the file tree that explains (ever so basic) OPR vs. CCWM. I know it is in the thread of the original file structure, but a stand-alon word doc would be interesting.
My special interest in this is how strategy may effect those metrics. Certain strategies effected OPR and CCWM differently.

JamesBrown 01-06-2010 09:57

Re: A True 2010 World Ranking
 
There is a PDF that explains the difference.

These rankings are interesting. It seems that OPR is the better metric this season (in my opinion) however I think this is mainly due to this years ranking algorithm. It also seems that the Isreal regional greatly skews the ccwm data, there are multiple teams in the top 20 (by CCWM) with only 4 matches, I checked a couple and they competed only in Isreal.

Ed Law 01-06-2010 09:59

Re: A True 2010 World Ranking
 
Quote:

Originally Posted by IKE (Post 964758)
Thanks Ed for posting this up. Is there any chance you could put a Word file in the file tree that explains (ever so basic) OPR vs. CCWM. I know it is in the thread of the original file structure, but a stand-alon word doc would be interesting.
My special interest in this is how strategy may effect those metrics. Certain strategies effected OPR and CCWM differently.

It is already there on page 16 and 17 of the updated presentation file. The file name is "Team 2834 Scouting Database Presentation (Updated in 2010)". Those two pages discuss the Interpretation of OPR and CCWM. I will try to expand on that in the future.

Ed Law 01-06-2010 10:07

Re: A True 2010 World Ranking
 
Quote:

Originally Posted by JamesBrown (Post 964761)
There is a PDF that explains the difference.

These rankings are interesting. It seems that OPR is the better metric this season (in my opinion) however I think this is mainly due to this years ranking algorithm. It also seems that the Isreal regional greatly skews the ccwm data, there are multiple teams in the top 20 (by CCWM) with only 4 matches, I checked a couple and they competed only in Isreal.

I agree with you regarding OPR being the better metric this year. That is what I used. I did not use CCWM at all. I computed it just for completeness.

I don't quite understand why CCWM was affected by the Israel regional but OPR was not affected. My only interpretation of the data is that the very high OPR numbers put up by some teams were greatly reduced when the few Israel teams went to Atlanta and did not put up those numbers. The effect is that all Israel teams get lower OPR than they got at Israel regional because of that. However, perhaps the Israel teams that went to Atlanta did contribute to the winning margin about the same as they did in Israel regional so all Israel team's CCWM data did not get reduced. This is just a guess and I did not check the actual match results of those teams.

IKE 01-06-2010 10:43

Re: A True 2010 World Ranking
 
Quote:

Originally Posted by Ed Law (Post 964762)
It is already there on page 16 and 17 of the updated presentation file. The file name is "Team 2834 Scouting Database Presentation (Updated in 2010)". Those two pages discuss the Interpretation of OPR and CCWM. I will try to expand on that in the future.

Thanks, I forgot about that. Pretty simple ID10T error on my part.

I was a bit shocked when compairing our OPR vs. CCWM rank until I re-read the paper. Basically, our strategy this year was to have as low as possible Winning Margin while still executing the win (since loser points were worth double).

the man 01-06-2010 10:59

Re: A True 2010 World Ranking
 
Thats very cool!:D


All times are GMT -5. The time now is 22:53.

Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi