Chief Delphi

Chief Delphi (http://www.chiefdelphi.com/forums/index.php)
-   General Forum (http://www.chiefdelphi.com/forums/forumdisplay.php?f=16)
-   -   Offensive Power Rankings for 2008 (http://www.chiefdelphi.com/forums/showthread.php?t=66388)

Bongle 30-03-2008 14:18

Offensive Power Rankings for 2008
 
1 Attachment(s)
Inspired by a post by sw293 in one of my long-past stats threads from 2006, I re-implemented his/her Offensive Power Rankings algorithm. Essentially, it tries to determine approximately how much each team, on average, contributed to their alliance.

You can see the math behind it detailed here: http://www.chiefdelphi.com/forums/sh...0&postcount=19.

In essence, it looks at a team's accumulated score over the course of a weekend as a sum of the offensive power ratings of all the other teams, multiplied by the number of times that team was paired with each team.

Example: 1565's first match at GTR was with 2198 and 1870, and they played 8 matches total. The '...' would be all their other alliance partners through qualifying, multiplied each time by how many times they were allied with them.

TotalScore(1565) = OPR(1565)*8 + OPR(2198)*1 + OPR(1870)*1 + ...

Once you arrange the scores of all the teams from a regional in this way, then you end up with N equations (one big sum of scores per team) and N unknowns (the offensive power ratings). This can be solved to find out the OPRs.

Without further ado, here they are for GTR. I'll be doing other regionals in the very near future.

OZ_341 30-03-2008 14:34

Re: Offensive Power Rankings for 2008
 
These power rankings were a great help in 2006. (very accurate and very predictive) Of course they did not predict the exact outcome of matches, but it certainly let a team know what they were up against and who they were partnered with. It was a big part of our Championship scouting routine in 2006.

Thanks for offering to do this!

IndySam 30-03-2008 14:38

Re: Offensive Power Rankings for 2008
 
The penalties are such a huge factor this year, unless you find a way to account for them, this formula won't accurately reflect a teams offensive ability.

Bongle 30-03-2008 14:42

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by IndySam (Post 727044)
The penalties are such a huge factor this year, unless you find a way to account for them, this formula won't accurately reflect a teams offensive ability.

Exactly correct. These shouldn't be used as the be-all end-all of scouting, but perhaps as pointers to find gems in the rough. There are many things that can happen in this game (and in other years) that aren't encapsulated in a simple number.

Joe Ross 30-03-2008 14:48

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by IndySam (Post 727044)
The penalties are such a huge factor this year, unless you find a way to account for them, this formula won't accurately reflect a teams offensive ability.

This is actually better then a team's offensive ability. It shows a teams point contribution. If a team is consistently penalized, they will have a lower OPR then a team that scores the same points per match but does so without penalties. You would obviously want the latter on your alliance.

Another interesting thing is that a team that constantly gets in the way of it's alliance parters would have a lower OPR then one that scores the same number of points but allows it's alliance partners to live to their full potential.

cziggy343 30-03-2008 14:52

Re: Offensive Power Rankings for 2008
 
are thier going to be ones for every regional? or would that be an endeavour of the individual teams to do?

Bongle 30-03-2008 15:07

Re: Offensive Power Rankings for 2008
 
1 Attachment(s)
Just finished the complete list. This includes every single 2nd-week and later regional. The first-week regionals have slightly different formatting for match results, and I couldn't include them easily. At least based on this analysis, we finally have an answer for the question: "Is anyone CLOSE to 1114?". The answer: no.

The top 50:
Code:

1114        79.0239
2056        52.583
987        51.736
40        50.8061
233        50.1563
330        48.7413
494        47.7625
525        47.3403
217        47.1941
1625        46.0802
1024        45.6433
25        45.2803
103        45.2493
33        45.1412
39        44.6339
175        44.0685
1731        42.2656
1124        42.2552
67        42.1626
368        39.0168
20        37.4932
1718        37.472
191        37.3548
1086        37.3254
16        36.6151
126        36.0601
1251        35.7449
968        35.0079
1574        34.6153
100        34.5714
141        34.3271
1218        34.3093
836        34.1721
381        34.1544
1126        34.0365
383        33.3622
69        33.1613
79        33.0133
469        33.0073
1717        32.3547
254        31.4165
501        31.3563
365        31.2399
111        30.847
1098        30.7075
997        30.6114
1507        30.6009
1156        30.5231
1153        30.4529
47        30.3471

See the attachment for the rest.

MCahoon 30-03-2008 16:46

Re: Offensive Power Rankings for 2008
 
I don't see entries for any teams I remember from Microsoft-Seattle Regional (Week 4). :confused:

IndySam 30-03-2008 16:58

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Joe Ross (Post 727050)
This is actually better then a team's offensive ability. It shows a teams point contribution. If a team is consistently penalized, they will have a lower OPR then a team that scores the same points per match but does so without penalties. You would obviously want the latter on your alliance.

Another interesting thing is that a team that constantly gets in the way of it's alliance parters would have a lower OPR then one that scores the same number of points but allows it's alliance partners to live to their full potential.

A team can have a great scoring record and have few penalties but can still have their rating ruined by being on alliances that have scored penalties.

If you can't factor out alliance penalties then there is way too much "luck of the draw" possible in this chart.

Bongle 30-03-2008 17:04

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by MCahoon (Post 727116)
I don't see entries for any teams I remember from Microsoft-Seattle Regional (Week 4). :confused:

It had funny formatting, but upon thinking about it some more, I don't think it should badly affect my program's ability to read it. I'll put it in and re-do them.

In fact, I can think of a way I should be able to get the week 1 regionals working as well.

Check this thread again in 10 minutes, I should have an updated one up.

Greg Marra 30-03-2008 17:07

Re: Offensive Power Rankings for 2008
 
If you let me know a precise format you want, I can give you a huge CSV dump into the formatting you want from The Blue Alliance's database.

Gaurav27 30-03-2008 17:12

Re: Offensive Power Rankings for 2008
 
I would also like to see standings of all teams ranked based on their record at the attended official events (Win-Loss-Tie). :)

Bongle 30-03-2008 17:16

Re: Offensive Power Rankings for 2008
 
1 Attachment(s)
Quote:

Originally Posted by Greg Marra (Post 727132)
If you let me know a precise format you want, I can give you a huge CSV dump into the formatting you want from The Blue Alliance's database.

"Red1 <tab> Red2 <tab> red3 <tab> blue1 <tab> blue2 <tab> blue3 <tab> redscore <tab> bluescore <line feed or carriage return or end of line or whatever>" is all I need. That'd be great. CSV is good too, I'm not particular about the delimiter.

So including week 1, the top 50 now looks like:
Code:

1114        68.5388
2056        53.7198
987        51.0249
233        50.3309
330        48.6782
39        44.2954
103        43.4295
1731        42.7127
1124        42.087
67        42.0777
525        41.482
175        40.3134
25        40.2684
217        40.0997
1024        39.8043
1718        38.6849
1086        37.4098
191        37.0664
20        36.9179
40        36.6407
1251        36.1213
368        35.623
121        35.5714
1625        35.182
968        35.1251
494        35.0843
1218        35.0123
1574        34.6153
383        34.1952
141        34.1791
1126        33.9523
79        33.8184
469        33.2445
1717        32.6876
69        32.3057
254        32.2835
126        32.1564
33        32.0724
365        31.1953
1507        30.8839
47        30.8582
1156        30.7724
16        30.6096
1065        30.3857
836        30.1605
381        30.1114
93        29.8324
195        29.8271
1512        29.78


Greg Marra 30-03-2008 19:04

Re: Offensive Power Rankings for 2008
 
The CSV is too big to attach. Find it here: http://www.thebluealliance.net/cdvid...30_matches.csv

Let me know if that works for you :)

Kyler 30-03-2008 23:15

Re: Offensive Power Rankings for 2008
 
Okay I somewhat understand how this is all calculated but I am guessing that somebody has already made an excel file to calculate all this? I tried to download one from '06 but the link was broken so can somebody please upload a new one? Thanks.

Guy Davidson 31-03-2008 12:28

Re: Offensive Power Rankings for 2008
 
Could you help me make sure I understand the linear algebra involved?

I understand that p is what we're looking to find, or the average number of points a team contributes per match. s and M we can calculate from the results coming from each regional. Since Mp = s, we can conclude that p = (M-1)s (where M-1 denotes M inverse). It seems to me from thinking about it that M is symmetric, and as such M = M-1. Is that actually the case?

I'll probably try to write a program to take a csv dump and spit out rankings if I understand the math.

Bongle 31-03-2008 14:01

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by sumadin (Post 727725)
I understand that p is what we're looking to find, or the average number of points a team contributes per match. s and M we can calculate from the results coming from each regional. Since Mp = s, we can conclude that p = (M-1)s (where M-1 denotes M inverse). It seems to me from thinking about it that M is symmetric, and as such M = M-1. Is that actually the case?

M is indeed symmetric. M[i][j] indicates how many matches team i played with team j. Therefore, it makes sense that M[i][j] = M[j][i].

I don't think the inverse of a symmetric matrix is necessarily symmetric. The transpose of a symmetric matrix M would be equal to its non-transpose, but I don't think that carries for symmetry. To prove that M-1 is not necessarily equal to M for a symmetric matrix, just think of the symmetric matrix 2I, where I is the identity matrix.

If (M)-1 = (M) for symmetric matrices like you are proposing, and we know MM-1 = I for any matrix and its inverse, then (2I)(2I) must equal I, but this is not the case.

I didn't have to write the matrix solver myself, I used a library I found online. If there are any tricks it used, I'm not aware of them.

Guy Davidson 31-03-2008 14:44

Re: Offensive Power Rankings for 2008
 
You're right. For some reason, I was thinking of the transpose rather than the inverse. I'll see how I handle the inversion of the matrix when I get there. In the meantime, I'm working through the easy stuff: reading the csv and making and populating s and M.

Mr. Lim 31-03-2008 15:05

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by sumadin (Post 727725)
It seems to me from thinking about it that M is symmetric, and as such M = M-1. Is that actually the case?

M is symmetric, but that doesn't mean M = M inverse.

Symmetry means that M = M transpose (flipped along the identity axis), which is different than M inverse.

It's easy to confuse the two (I remember doing that plenty of times, thank Ms. Martin).

Here's an example where M = M inverse, and you quickly see that M is definitely not symmetric:

Code:

|  9  5 | |  9  5 | - |  1  0 |
| -16  -9 | | -16  -9 | - |  0  1 |


MCarron 31-03-2008 16:50

Re: Offensive Power Rankings for 2008
 
Just an FYI...all of the match data is NOT included from the Peachtree regional. The scoring system failed so all of the elimination matches and many of the qualifying matches from Saturday are not included. As an example...team 343 finished 12-4 at that regional. We are still shown as 5-3 on the Blue Alliance. That means there are eight matches not accounted for on us alone. That would/could be the same for many of the other teams who attended Peachtree.

Is there anybody that has that manual data? Can it be manually entered into the Blue Alliance?

Thanks,
Mike Carron
Team 343

Joe Ross 31-03-2008 17:00

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by MCarron (Post 727921)
Is there anybody that has that manual data?

See here: http://www.chiefdelphi.com/media/papers/2102

cziggy343 31-03-2008 17:33

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Joe Ross (Post 727924)

but...was anyone planning on putting this manuel score on tba... b/c i have no way to do it...

Eugene Fang 31-03-2008 22:23

Re: Offensive Power Rankings for 2008
 
if there was a normally very high scoring team that happened to malfunction in a match where they were in your alliance, or was defended a lot in your particular round, wouldn't your score be highly skewed?

Kyler 31-03-2008 23:04

Re: Offensive Power Rankings for 2008
 
Okay, I have created a basic program to make the n X n matrix as defined in the post that sort of explains the rankings but what do I do from there? I am only in trig and we have definitely not learned that stuff with matrices. Can somebody give me an example of "M(k1)p(1)+M(k2)p(2)+...+M(kn)p(n) should equal s(k)" or clarify that please? Thanks!

fuzzy1718 31-03-2008 23:18

Re: Offensive Power Rankings for 2008
 
We were hevily defended all through GLR hurdling only 2-3 times a match where we usualy hurdle 4-6 times and at Detroit we were broken 3 of the matches, but we are still high on the list:ahh: . That shouldn't effect it much.

Guy Davidson 31-03-2008 23:18

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Kyler (Post 728216)
Okay, I have created a basic program to make the n X n matrix as defined in the post that sort of explains the rankings but what do I do from there? I am only in trig and we have definitely not learned that stuff with matrices. Can somebody give me an example of "M(k1)p(1)+M(k2)p(2)+...+M(kn)p(n) should equal s(k)" or clarify that please? Thanks!

From there you need to invert M and multiply it by s. The are libraries doing the first all over the internet - however, I do not know the algorithm they use. I know how to do it manually, but that would take way too much time for anything this scale.

Then you need to multiply M inverse by s. What you're looking to get out is another column vector, or list of numbers, similar to the one you have in s, although with different numbers. To do that, simply multiply each element in a column of M inverse (with a fixed row) by each element in the corresponding row in s (which has only one column). For example, to find the 10th element of p, or the average number of points contributed by the team in the 10th row, add up M(10,1)*s(1) + M(10,2)*s(2) + M(10,3)*s(3) + ...

Doing that for each row in M will get you p, the vector you're looking for.

If this didn't make much sense, look at http://mathdemos.gcsu.edu/mathdemos/matvec/matvec.html or http://en.wikipedia.org/wiki/Matrix_multiplication

Greg Marra 01-04-2008 00:46

Re: Offensive Power Rankings for 2008
 
I added Peachtree missing matches to the database. I'll do another database dump after the NYC regional is finished. Thanks for pointing me to the data!

BornaE 01-04-2008 03:11

Re: Offensive Power Rankings for 2008
 
Looks like the system is working well, but I think if we add a little to it it would work much better.

Right now it is set up to calculate the average points contributed to an alliance by one team. This method does not take care of the defence.

you guys who did the calculations, can you add defence to it as well.

so example:
Red Score = RedA_O + RedB_O + RedC_O - BlueA_D - BlueB_D - BlueC_D
then solve for Team_O which is the average points added to their alliance, and Team_D which is the average points one team take away from their Opponent's alliance.

Kyler 01-04-2008 07:58

Re: Offensive Power Rankings for 2008
 
Just a few questions left but the post above helped a bunch. Do i want M inverse or transverse? Also, do I want it to equal s and multiply by p or the other way around? Lastly, M(10,1)*s(1) + M(10,2)*s(2) + M(10,3)*s(3) Means to take whatever value is in the matrix at (10,1) and multiple by s and by 1 right? thanks!

neshera 01-04-2008 11:52

Re: Offensive Power Rankings for 2008
 
Hey Kyler:
Do you want me to send a slide rule with Nathan tomorrow to help you out?
Nesher

Beldo 01-04-2008 13:45

Re: Offensive Power Rankings for 2008
 
Bongle-

Are you going to do recreate the rankings after all the regionals are done and before the finals in Atlanta?

Kyler 01-04-2008 16:29

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by neshera (Post 728430)
Hey Kyler:
Do you want me to send a slide rule with Nathan tomorrow to help you out?
Nesher

Lol I think I can have the computer do most of the math for me. I just have to understand it... thats my hope at least.

Bongle 01-04-2008 18:12

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Beldo (Post 728519)
Bongle-

Are you going to do recreate the rankings after all the regionals are done and before the finals in Atlanta?

I could re-do them once this week's regionals are complete, that's not a problem.

I'll do an Atlanta-only one after ATL too if there is demand.

IKE 01-04-2008 18:49

Re: Offensive Power Rankings for 2008
 
I am not a programmer, but here is an interesting challenge for someone with some time on their hands. Once Atlanta divisions are posted, use the OPR to pick the winning alliance assuming that the rankings and draft follow the OPR (alliances would be 1,2,24-3,4,23-5,6,22......). Obviously the OPR will pick 1114 and some other powerful hurdler as the winners, but I am curious how closely it may actually predict things.

Bongle 01-04-2008 22:14

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by IKE (Post 728745)
I am not a programmer, but here is an interesting challenge for someone with some time on their hands. Once Atlanta divisions are posted, use the OPR to pick the winning alliance assuming that the rankings and draft follow the OPR (alliances would be 1,2,24-3,4,23-5,6,22......). Obviously the OPR will pick 1114 and some other powerful hurdler as the winners, but I am curious how closely it may actually predict things.

To go even further:
Use the match scheduling algorithm to generate a schedule, then simulate each division's games, assuming that the alliance with the higher OPR always wins. Now you've got more accurate simulated rankings, because you may even have a weaker team get into the top 8 due to luck with the scheduling. However, you'd have issues because in the real world there'll be draft rejections which you can't plan for.

Then do the division playoffs and Einstein simulation. I may do that after my first exam when I have a long time off.

IKE 02-04-2008 12:21

Re: Offensive Power Rankings for 2008
 
Hate to ask for more, but here goes:
I noticed our OPR drop dramatically when week 1 was added in (we had a lot of technical difficulties). Is anyone planning on doing an OPR ranking only using a teams last regional? This may more acurately show how the teams will perform at Atlanta....

XaulZan11 02-04-2008 13:18

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by IKE (Post 729171)
Hate to ask for more, but here goes:
I noticed our OPR drop dramatically when week 1 was added in (we had a lot of technical difficulties). Is anyone planning on doing an OPR ranking only using a teams last regional? This may more acurately show how the teams will perform at Atlanta....

That's a really good point. I know when I'll prescout for my team, I'll focus on the team's last regional because it usually the best predictor to see how a team will preform. Maybe you can weigh the different regionals (such as if a team attends 2 regionals, the first regional may be 30% while the second will be 70% of thier total score).

OZ_341 02-04-2008 13:22

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by IKE (Post 729171)
Hate to ask for more, but here goes:
I noticed our OPR drop dramatically when week 1 was added in (we had a lot of technical difficulties). Is anyone planning on doing an OPR ranking only using a teams last regional? This may more acurately show how the teams will perform at Atlanta....

Good point! We are definitely a much better machine now then we were at Chesapeake. Our drivers also have more confidence in the machine.

Kyler 02-04-2008 17:50

Re: Offensive Power Rankings for 2008
 
Well, just something interesting I have found. Its to be expected and nothing major but it dies go to show being very percise (adding 4 decimal points) Can change things quite a bit in ranking the teams. To test my own Power Ranking program I ran the GTR results and found my results were different that bongles by up to a point (might not seem like much but once you get to the lower power rankings it is 10 % +) and it changes orders a lot. Here's what i found.



Nevermind, I entered one score wrong. My results are the exact same but with 4 excta decimal points.



I only included a few differences because the teams start to change then and I was too lazy to sort that all out. Also, a big THANKYOU! to everyone that helped me understand this stuff.

Jacob Plicque 02-04-2008 22:53

Re: Offensive Power Rankings for 2008
 
Kyler,
Will you post your program code for review? I think that your are on to something by adding precision to your calculation.:)

Guy Davidson 03-04-2008 00:26

Re: Offensive Power Rankings for 2008
 
Wee, I managed to break java :P

My inversion algorithm for the 1465x1465 or so matrix runs out of heap space. I'm currently working on an alternative way to get p. Right now, I'm going from Mp = s to p = Minverses. I might try to create an augmented matrix and rref it to get the solution. Any other ideas?

EDIT: Nevermind, I just solved the equation Mp = s.

Greg, I now have the OPR's generated from the entire csv dump you generated. Is there any way you could generate other csv dumps to analyze? By regional, by week, over the last three weeks, etc., all sounds like interesting sets of data to analyze.

Guy Davidson 04-04-2008 13:37

Re: Offensive Power Rankings for 2008
 
1 Attachment(s)
I have the rankings generated from Greg Marra's csv dump of the TBA database.

Top 50:
Code:

1114        66.10642467
2056        54.11894734
233        50.73081127
330        48.61296306
987        48.40552663
39        48.06177403
525        45.48888639
67        44.23000818
1731        42.99226989
1124        42.40054838
217        42.10281885
103        41.29156933
40        40.86592771
175        39.4420245
191        39.06592804
469        37.90116922
20        37.75470786
79        37.65042852
1717        37.34613148
141        37.32830996
1024        37.2668216
968        35.93916079
1086        35.8662985
1126        35.81116812
368        35.65581359
494        35.0189302
2171        33.98399753
25        33.89508807
1625        33.79257371
365        33.63738509
254        32.91821392
1718        32.54432471
47        32.49881588
93        32.23816608
1477        32.14182287
1251        31.57996364
1806        31.33327422
16        31.18613493
69        31.04681657
1629        31.01151072
33        30.94122998
1418        30.31278837
195        30.2915486
27        29.90208154
383        29.89513167
71        29.87541039
287        29.76950247
171        29.71637571
148        29.4612061
877        29.34477514

The entire spreadsheet is attached. I'm working with Greg Marra on getting some more specific data sets and analyzing them, and after I do that, I'll post the results. Any specific requests?

cziggy343 04-04-2008 14:13

Re: Offensive Power Rankings for 2008
 
for some reason, i dont think that ours is right... b/c we have had three hurdles or more in 75% of our matches and it shows that we score about 26 points per match, which w/ three hurdles (including lines) we should be just a little under 30... but of course i dont know what went into the compiling:cool:

IndySam 04-04-2008 14:17

Re: Offensive Power Rankings for 2008
 
Is this data supposed to be your average score or your potential average? What exactly is your number supposed to mean?

Bongle 04-04-2008 15:41

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by IndySam (Post 730566)
Is this data supposed to be your average score or your potential average? What exactly is your number supposed to mean?

It is an estimate of how many points your teams contributes per match. Note that it isn't simply your total score / 3, but by using the magic of linear algebra, you can solve for something a bit more accurate. It can help weed out robots that simply had good partners, and should be able to discern robots who many not have placed well but still contributed each round.

Quote:

for some reason, i dont think that ours is right... b/c we have had three hurdles or more in 75% of our matches and it shows that we score about 26 points per match, which w/ three hurdles (including lines) we should be just a little under 30... but of course i dont know what went into the compiling
If you took a substantial number of penalties (1 every couple matches), that'd result in your offensive rating going down. This is because in addition to adding to an alliance score by hurdling, you'd be subtracting from it due to penalties. It's not a perfect number because we don't have an infinite number of matches to base it off of, but it seems to correlate nicely with observed robot performance.

JB987 04-04-2008 15:53

Re: Offensive Power Rankings for 2008
 
ss
Quote:

Originally Posted by sumadin (Post 730527)
I have the rankings generated from Greg Marra's csv dump of the TBA database.

Top 50:
Code:

1114        66.10642467
2056        54.11894734
233        50.73081127
330        48.61296306
987        48.40552663
39        48.06177403
525        45.48888639
67        44.23000818
1731        42.99226989
1124        42.40054838
217        42.10281885
103        41.29156933
40        40.86592771
175        39.4420245
191        39.06592804
469        37.90116922
20        37.75470786
79        37.65042852
1717        37.34613148
141        37.32830996
1024        37.2668216
968        35.93916079
1086        35.8662985
1126        35.81116812
368        35.65581359
494        35.0189302
2171        33.98399753
25        33.89508807
1625        33.79257371
365        33.63738509
254        32.91821392
1718        32.54432471
47        32.49881588
93        32.23816608
1477        32.14182287
1251        31.57996364
1806        31.33327422
16        31.18613493
69        31.04681657
1629        31.01151072
33        30.94122998
1418        30.31278837
195        30.2915486
27        29.90208154
383        29.89513167
71        29.87541039
287        29.76950247
171        29.71637571
148        29.4612061
877        29.34477514

The entire spreadsheet is attached. I'm working with Greg Marra on getting some more specific data sets and analyzing them, and after I do that, I'll post the results. Any specific requests?

Curious...what data or calculation changes explain the reduction of up to almost 3 points from the previous ranking for some teams listed? If the previous calculations were based on results through the 5th week regionals and there has been no additional results/data, what explains the changes observed for this list?

Bongle 04-04-2008 16:26

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by JB987 (Post 730609)
ss

Curious...what data or calculation changes explain the reduction of up to almost 3 points from the previous ranking for some teams listed? If the previous calculations were based on results through the 5th week regionals and there has been no additional results/data, what explains the changes observed for this list?

Since Sumadin and I went off of different data sets (him from TBA CSV's, me from usfirst.org) and used different algorithms, some perturbation is expected. There could've been a few missed matches in one of our data sets. This is my best guess for why there is a difference between our outputs.

Also, different methods of inverting the matrix could cause somewhat substantial differences in the floating-point input.

I haven't had the time to update my program to use TBA's CSV dump, so we won't be able to compare until probably tuesday when my classes end.

Joe Ross 04-04-2008 16:46

Re: Offensive Power Rankings for 2008
 
1 Attachment(s)
Quote:

Originally Posted by Bongle (Post 730629)
Since Sumadin and I went off of different data sets (him from TBA CSV's, me from usfirst.org) and used different algorithms, some perturbation is expected. There could've been a few missed matches in one of our data sets. This is my best guess for why there is a difference between our outputs.

The Blue Alliance data includes elimination matches, which I would assume accounts for the majority of the difference. I think the result is probably better with only the qualifying matches.

The Blue Alliance data also gives scores of -1 for the missing peachtree matches (which are now in TBA database, so they would be included for the next data dump).

I've attached just the GTR qualifying matches (which I pulled from TBA's big dump) so that it is possible for sumadin to check his results against Bongle and Kyler's.

IndySam 04-04-2008 16:54

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Bongle (Post 730602)
It is an estimate of how many points your teams contributes per match. Note that it isn't simply your total score / 3, but by using the magic of linear algebra, you can solve for something a bit more accurate. It can help weed out robots that simply had good partners, and should be able to discern robots who many not have placed well but still contributed each round.

Our actual average score was 23.11 for our two regionals including penalties. You have us at 13.585. That's a huge difference.

I also see a couple of teams on your list that I know who's scores are way to high.

As I have said from the beginning the algorithm just won't work unless the penalties are somehow added in. They are just to important to this years game.

Karthik 04-04-2008 16:59

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by IndySam (Post 730649)
Our actual average score was 23.11 for our two regionals including penalties. You have us at 13.585. That's a huge difference.

I also see a couple of teams on your list that I know who's scores are way to high.

As I have said from the beginning the algorithm just won't work unless the penalties are somehow added in. They are just to important to this years game.

I don't think you're following what Bongle and others are doing. They're not calculating simple averages. They're using basic linear algebra to calculate the average expected value of pure points contributed to the alliance by a single team. This is used by setting up a system of equations which sum to the amount points scored at the regional. Since penalties are already removed from the final scores of all matches, this method takes them into account. The penalties are already "added in". This method is a far more accurate predictor of a team's contribution then just looking at a simple mean. Naturally you team's result is going to be lower than your average score, because this statistic is just looking at your team's contribution.

Guy Davidson 04-04-2008 17:04

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Joe Ross (Post 730642)
I've attached just the GTR qualifying matches (which I pulled from TBA's big dump) so that it is possible for sumadin to check his results against Bongle and Kyler's.

Here are my GTR numbers. If they look wrong, and someone java-literate feels like checking my algorithm, I'd love to send it to you.

Code:

Team #        OPR
1114        85.15226558
2056        59.33395475
1310        34.64482448
703        33.03214195
176        28.96394877
1507        28.88990882
843        28.21126973
1565        27.22743171
247        26.1033492
1334        25.79040538
1246        25.39034964
771        25.3041279
2166        24.09227148
188        23.71808394
1503        23.54927373
772        23.45548442
2386        23.31079522
1241        23.28145949
1676        19.79855182
2200        18.77658592
2505        17.48254181
1859        17.45000723
781        16.0161082
1075        15.90296028
1305        15.89858958
854        15.69463168
1141        15.06495691
1870        14.73720734
2198        14.73609737
378        14.47812438
1482        14.45778707
1221        14.31262296
2624        13.45441951
1547        12.97880742
1605        12.97081727
1312        12.72903502
1053        12.31981296
2625        10.56083704
2013        9.900241288
1244        9.708875262
1564        9.600009496
1404        9.377591833
610        9.133722417
2626        9.08257019
919        8.254425484
1006        7.228797019
1620        6.76173277
1219        6.42921342
1325        6.212867948
907        5.392902881
2670        5.28688774
1835        4.499976969
2634        2.964469403
1814        2.838298002
1514        2.750910246
2076        1.743258698
1846        0.608947798
1815        -1.060063643
1558        -2.177781773
865        -3.154743822
2427        -4.468775757
2254        -5.065213583
296        -5.98087571
758        -6.886956522
1680        -8.189157537
2185        -9.563978454


Karthik 04-04-2008 17:07

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by sumadin (Post 730654)
Here are my GTR numbers. If they look wrong, and someone java-literate feels like checking my algorithm, I'd love to send it to you.

Guy,

You might want to look into using Maple or Matlab. They're design for these types of computation, plus I'm sure you'll find plenty of other uses for them. I've found them to be indispensable tools.

Joe Ross 04-04-2008 17:09

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by sumadin (Post 730654)
Here are my GTR numbers. If they look wrong, and someone java-literate feels like checking my algorithm, I'd love to send it to you.

They are exactly the same as Bongle's to 4 decimal places. Good job!

Guy Davidson 04-04-2008 17:16

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by JB987 (Post 730609)
Curious...what data or calculation changes explain the reduction of up to almost 3 points from the previous ranking for some teams listed? If the previous calculations were based on results through the 5th week regionals and there has been no additional results/data, what explains the changes observed for this list?

I was running the TBA data set. It seems that my numbers for GTR match Bongle's so the computation seems to be correct. Is it possible he isn't using elimination round scores? Because that might cause a drop.

Bongle 04-04-2008 17:24

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by sumadin (Post 730660)
I was running the TBA data set. It seems that my numbers for GTR match Bongle's so the computation seems to be correct. Is it possible he isn't using elimination round scores? Because that might cause a drop.

Yeah, I didn't use elimination rounds because I feel they kind of distort the results. Playing matches with random robots against random opponents, I think you'll get a better feel for a team's contribution than when they are playing with a self-selected team against the creme de la creme at the regional. Although I guess if you want to take these numbers as scouting pointers rather than for entertainment value, a team's elimination performance is important.

For instance, take 1114 at GTR in the eliminators: they were playing with a team that they founded and they had won 3 regionals with. That team of robots will probably work together much better than a random team in qualifications, and so the scores will be different.

Another thing is that during eliminations, robots steadily get worn down: mechanisms break that can't get repaired in time, batteries slowly get discharged, motors overheat, and so you get things other than the team's competitiveness affecting the scoring level.

Plus, at a shallower regional like at waterloo, you'll end up with things like 1114/2056 against 3 teams who can't even hurdle, and the scores will be ludicrously high.

Quote:

I don't think you're following what Bongle and others are doing. They're not calculating simple averages. They're using basic linear algebra to calculate the average expected value of pure points contributed to the alliance by a single team. This is used by setting up a system of equations which sum to the amount points scored at the regional. Since penalties are already removed from the final scores of all matches, this method takes them into account. The penalties are already "added in". This method is a far more accurate predictor of a team's contribution then just looking at a simple mean. Naturally you team's result is going to be lower than your average score, because this statistic is just looking at your team's contribution.
Said much better than I ever could.

IndySam 04-04-2008 17:52

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Karthik (Post 730652)
I don't think you're following what Bongle and others are doing. They're not calculating simple averages. They're using basic linear algebra to calculate the average expected value of pure points contributed to the alliance by a single team. This is used by setting up a system of equations which sum to the amount points scored at the regional. Since penalties are already removed from the final scores of all matches, this method takes them into account. The penalties are already "added in". This method is a far more accurate predictor of a team's contribution then just looking at a simple mean. Naturally you team's result is going to be lower than your average score, because this statistic is just looking at your team's contribution.

I understand that, what I am saying is that their calculation of my teams expected contribution is no where near my teams actual contribution including subtracting the penalties.

Also I see several teams who's expected contribution is way to high from my experience of their performance this year.

If you guys want this tool to be useful you need to figure out why.

It's just my theory that it can't property calculate the impact of penalties, if you think this theory is wrong then you need to figure out what is causing the figure to be so different than the actual results.

Karthik 04-04-2008 18:10

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by IndySam (Post 730683)
I understand that, what I am saying is that their calculation of my teams expected contribution is no where near my teams actual contribution including subtracting the penalties.

Also I see several teams who's expected contribution is way to high from my experience of their performance this year.

If you guys want this tool to be useful you need to figure out why.

It's just my theory that it can't property calculate the impact of penalties, if you think this theory is wrong then you need to figure out what is causing the figure to be so different than the actual results.

Mathematically, this method is 100% sound. Whether you see any value in the mathematical model is for you to determine. I'd like to know your mathematical reasoning for why this method doesn't take penalties into account. If all you're relying on is selected cases of anecdotal evidence, your theory holds very little weight with me.

By no means am I suggesting that this model is perfect. From the numbers that Team 1114 has run, there are some definite anomalies. That being said, for the most part this model seems to agree with the specific match data we've collected at three events we attended.

Like with most statistics, the value is all in how you interpret them. If you don't think they're accurate, ignore them.

Mr. Lim 04-04-2008 18:10

Re: Offensive Power Rankings for 2008
 
Just to emphasize the quality of OPR as a predictor of who will be playing on Saturday afternoon. Keep in mind, this was a 66 team regional, and predicting 24 robots out of the field is no small feat.

Here's the top 24 OPR from the GTR, and whether they were picked in the elims:

Code:

1114        #1 Captain
2056        #1 1st Pick
1310        #2 1st Pick
703        Removed themselves from the elims due to technical problems
176        #7 Captain
1507        #3 Captain
843        #5 Captain
1565        #4 1st Pick
247        #3 2nd Pick
1334        #6 Captain
1246        Not Picked
771        #5 2nd Pick
2166        #1 2nd Pick
188        #2 Captain
1503        #3 1st Pick
772        #8 1st Pick
2386        #6 1st Pick
1241        #4 Captain
1676        #7 1st Pick
2200        #5 1st Pick
2505        #2 2nd Pick
1859        Not Picked
781        #4 2nd Pick
1075        Not Picked

20/24 is a ridiculously decent hit rate. It should be higher since you couldn't expect this algorithm to predict that 703 would graciously withdraw.

Expect all good scouting teams to be using these stats in the very near future.

IndySam 04-04-2008 18:27

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Karthik (Post 730689)
Mathematically, this method is 100% sound. Whether you see any value in the mathematical model is for you to determine. I'd like to know your mathematical reasoning for why this method doesn't take penalties into account. If all you're relying on is selected cases of anecdotal evidence, your theory holds very little weight with me.

By no means am I suggesting that this model is perfect. From the numbers that Team 1114 has run, there are some definite anomalies. That being said, for the most part this model seems to agree with the specific match data we've collected at three events we attended.

Like with most statistics, the value is all in how you interpret them. If you don't think they're accurate, ignore them.

I am not a mathematician, I saw numbers that were wrong (not a little wrong, WILDLY wrong) and I posed a theory based on my feeling not on any math.

We are not competing in Atlanta so I have no need for this data, all I am saying some of what I see in spreadsheet is very wrong.

You can ignore it, I don't care.


Edit: I'll still buy you a doughnut in Atlanta.

Protronie 04-04-2008 19:08

Re: Offensive Power Rankings for 2008
 
All I understand is 1114 has an impressive score...
Which seems to fit their impressive robot.

Nice work... this will make a excellent tool to help newbies .

Jacob Plicque 04-04-2008 19:48

Re: Offensive Power Rankings for 2008
 
Sumadin
Your latest OPR must have an error (86 1.478877681). All the previous OPR data runs had Team 86 with an OPR between 8.8 and 9.2 points. Our actual average for the Florida Regional was 11.5 points. The difference of over 2 points can be explained by the fact that our 1st match included two no show partners. However, I can not figure out the 10 point difference in your post today

DonRotolo 04-04-2008 20:11

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by SlimBoJones (Post 730690)
Just to emphasize the quality of OPR as a predictor of who will be playing on Saturday afternoon. Keep in mind, this was a 66 team regional, and predicting 24 robots out of the field is no small feat.

Note that 1676, #1 pick for Alliance #7, was ranked in the high 40's based on win/loss record. Similarly, we were ranked in the 50s in NJ, but were picked for the 8th alliance.

Why? What team in their right mind would choose a team with a 3-5-0 record?

Teams that understand the math behind the scouting, that's who.

Don

Bongle 04-04-2008 20:11

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Jacob Plicque (Post 730737)
Sumadin
Your latest OPR must have an error (86 1.478877681). All the previous OPR data runs had Team 86 with an OPR between 8.8 and 9.2 points. Our actual average for the Florida Regional was 11.5 points. The difference of over 2 points can be explained by the fact that our 1st match included two no show partners. However, I can not figure out the 10 point difference in your post today

Sumadin's included eliminations. It is possible that your alliance partners during eliminations were both scoring below their qualifying performance (which would make sense, given the increased quality of the opposition), and the algorithm 'attributed' that to you. This is why I didn't include eliminations in the ones I ran, they're a whole different beast. It probably isn't a bug in his code, because we both independently developed our own code and our results match, so unless the math foundations we're basing this on are shaky, it's probably an effect of using the finals data.

In other news:
Quote:

Just to emphasize the quality of OPR as a predictor of who will be playing on Saturday afternoon. Keep in mind, this was a 66 team regional, and predicting 24 robots out of the field is no small feat.
This intrigued me, so I did it for a few more:
GLR: 20/24
Florida: 19/24
VCU: 17/24

So it is a somewhat accurate predictor, but it doesn't take into account that a team's 3rd pick is likely to be a lower-scoring lap bot because of the game only having 2 trackballs. Picking strictly by OPR is a fast way to get eliminated, because you'd probably end up with 3 delicate, relatively slow hurdlers fighting over 2 trackballs, rather than a more-ideal combination of 1 robust lapper/defender and 2 hurdlers.

MasterChief 573 04-04-2008 20:45

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Bongle (Post 730746)
Sumadin's included eliminations. It is possible that your alliance partners during eliminations were both scoring below their qualifying performance (which would make sense, given the increased quality of the opposition), and the algorithm 'attributed' that to you. This is why I didn't include eliminations in the ones I ran, they're a whole different beast. It probably isn't a bug in his code, because we both independently developed our own code and our results match, so unless the math foundations we're basing this on are shaky, it's probably an effect of using the finals data.

In other news:

This intrigued me, so I did it for a few more:
GLR: 20/24
Florida: 19/24
VCU: 17/24

So it is a somewhat accurate predictor, but it doesn't take into account that a team's 3rd pick is likely to be a lower-scoring lap bot because of the game only having 2 trackballs. Picking strictly by OPR is a fast way to get eliminated, because you'd probably end up with 3 delicate, relatively slow hurdlers fighting over 2 trackballs, rather than a more-ideal combination of 1 robust lapper/defender and 2 hurdlers.

Can I see the OPR from GLR?

Bongle 04-04-2008 20:51

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by MasterChief 573 (Post 730754)
Can I see the OPR from GLR?

(based on qualifying matches only)
Code:

217        50.7032
494        42.5188
27        41.5673
67        40.5394
1718        40.2957
33        38.5823
47        36.6663
469        34.469
326        31.1764
201        29.9324
65        29.6645
862        28.1615
291        24.9495
245        24.7518
70        24.0254
910        23.0301
68        23.0027
107        21.8664
573        20.1932
548        20.0728
66        20.0018
1023        18.233
1998        18.132
1732        17.8759
1747        17.6147
2137        16.5689
503        16.2864
894        16.1329
2676        15.6698
451        15.5634
2612        15.3752
2627        14.1293
2163        13.1382
2050        12.7314
1596        11.5487
1646        11.4519
2591        10.9547
470        9.91908
1015        9.73652
306        9.57384
1701        9.53248
2608        8.05458
830        7.30086
279        7.24847
308        7.11791
226        7.03603
1189        6.30477
1216        5.67063
63        4.94421
123        4.81491
280        4.45936
322        3.07761
1941        2.84981
240        2.57329
2620        2.49713
2224        2.32567
1322        2.18991
2673        0.819399
406        0.778652
2576        -0.147101
461        -0.978711
1549        -2.05435
313        -7.22184


cziggy343 04-04-2008 21:28

Re: Offensive Power Rankings for 2008
 
do you have one for each regional? b/c if you do, i would like to see palmetto... b/c i never got to see any statistics:(

Bongle 04-04-2008 21:32

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by cziggy343 (Post 730767)
do you have one for each regional? b/c if you do, i would like to see palmetto... b/c i never got to see any statistics:(

I have to generate them manually per-regional, so for now I'm going to keep it on a request basis. Enjoy!

Palmetto
Code:

845        34.6689
1251        34.1576
343        29.7443
1249        29.2152
342        26.3919
1261        25.5961
1466        22.6852
386        22.5882
1539        21.2896
1746        18.6837
2237        16.7312
2483        16.524
1026        16.3271
1319        16.0827
2187        13.6184
665        12.8638
2430        12.8461
1225        12.8339
2092        12.4018
281        12.147
1758        11.297
1398        8.26199
1102        8.01401
1553        7.85424
1051        7.1118
1876        6.23695
393        5.72104
804        4.95519
1959        4.86179
2362        3.91176
900        2.86289
1293        2.82464
1270        2.02667
1369        0.548534
2425        0.18277
1436        -4.56816


GBilletdeaux930 04-04-2008 21:38

Re: Offensive Power Rankings for 2008
 
So all i gotta do is say

"Can i see the opr's for the wisconsin regional?"

and they will magically appear a few posts down from this one?

cziggy343 04-04-2008 21:39

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by GBilletdeaux930 (Post 730773)
So all i gotta do is say

"Can i see the opr's for the wisconsin regional?"

and they will magically appear a few posts down from this one?

thats how mine worked:D

XaulZan11 04-04-2008 21:40

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by GBilletdeaux930 (Post 730773)
So all i gotta do is say

"Can i see the opr's for the wisconsin regional?"

and they will magically appear a few posts down from this one?

Ha, I was just gonna ask for the same. I'm interested to see how this compares to the statistics of points scored per match that we scouted.

GBilletdeaux930 04-04-2008 21:41

Re: Offensive Power Rankings for 2008
 
well we'll see if this magic works...


ABRAWisconsinRegionalKADABRA!!!

Bongle 04-04-2008 21:50

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by GBilletdeaux930 (Post 730776)
well we'll see if this magic works...


ABRAWisconsinRegionalKADABRA!!!

Lol, subtle

Wisconsin Regional
Code:

1625        49.8168
141        35.6332
1730        32.0028
1736        25.5406
2169        24.3109
2062        24.019
930        21.573
171        20.006
2547        19.1146
1675        18.0718
2481        17.3041
93        17.1033
166        15.6925
2549        15.4527
2606        15.3803
2535        14.9615
2545        14.8528
2526        14.6634
1091        14.3247
2437        13.5781
1816        13.1077
2574        12.4494
1739        11.8769
2530        11.2592
2116        10.8958
2077        10.7748
1652        10.6515
1103        10.364
2202        9.8298
2194        9.37814
1850        9.05741
2039        8.87432
857        8.77189
1988        8.39986
2153        8.3983
2143        7.923
2667        7.88136
1259        7.56955
537        7.14274
1716        6.86105
167        5.99421
904        5.74562
2136        5.62584
2129        5.27883
269        4.51404
74        3.56688
1306        3.53685
2220        3.22949
1714        2.86169
1732        2.31474
2506        2.25164
2538        1.84231
1864        0.955353
754        -0.576295
706        -1.18242
81        -2.20895
1984        -2.30947
1268        -2.98356
2586        -7.35126
2561        -9.22469


IKE 04-04-2008 21:51

Re: Offensive Power Rankings for 2008
 
Again, not a programmer, but I have an interesting idea for writing a DPR (Defensive Power Rating) algorithm. Take your OPR values, apply them to the matches. The delta between the expected score and the actual score would be the raw value for a DPR score. Use your OPR techniques to then factor out the DPR each team might provide.

One thought on why your average score is much higher than your OPR is that a decent hurdler may actually slow down the scoring of an exceptional hurdler. Take for instance an 1114. I know they have done 7 hurdles and may even have done 8 in a match. The match where they did 8, probably would not occur with 2 other decent hurdlers as they may hurdle also and thus accidentally slow down an 1114.

Thanks for posting your results.

GBilletdeaux930 04-04-2008 21:54

Re: Offensive Power Rankings for 2008
 
oh thank you it seems like there really is magic in this world

*looks up with his fingers interlaced in a weird disney like pose*

Adam Freeman 04-04-2008 23:00

Re: Offensive Power Rankings for 2008
 
Bongle, not that you need additional validation but your numbers match up exactly with the numbers that our guys have calculated.

This information in the hands of teams that know how to use it will be very dangerous :) ...

I know that I plan to have up to date information in Atlanta for our division.

Although there is no replacement for watching matches and see teams improve through out the weekend. I will have to keep my 'black magic' going and pull more 503s out of my hat, or they just might replace me with a OPR scoring database.

The Lucas 04-04-2008 23:03

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by SlimBoJones (Post 730690)
Expect all good scouting teams to be using these stats in the very near future.

Although I love these numbers as and overall indicator of offensive contribution among many teams many matches, they are no substitution for scouting at your event and recording "actual" contributions. These numbers are great to scout with going into Championship. However, if you only use the numbers from 5 qualification matches (per team) to evaluate teams and generate your list on Friday night, there is something wrong with your methods. (Shawn, I know you were not thinking of these number as replacements for all other scouting)

My explanation for why the data is seams like it is skewed towards the extremes is team coordination, track speed, and defense. When very good teams get to together, this is a different game (you can see it in the elims). They are able to coordinate their strategy better (particularly hybrid mode). Ex. If a partner's hybrid routine bumps knocks off their higher-scoring partner's hybrid, that can easily cost the alliance 20+ points (which would reflect very badly on the the OPR of lower scoring bot). When good scoring machines are together (particularly when they are on both alliances) the track moves a lot quicker and there are very few traffic jams, so everyone scores more. If there is defense being played, it will likely only slow down the higher scoring machine, so the impact of the scoring capabilities of the partners is increased. These reasons should also explain some of the differences between regionals. Of coarse there is always the random variable of luck, but we will assume that is zero mean:D Well thats my $0.02

cwood 04-04-2008 23:13

Re: Offensive Power Rankings for 2008
 
personally i like these numbers. No its not a substitute for scouting but it atleast lets you know who you may want to pay closer attention to. I also like the new list as 1629 moved up to 40th!!

Doug G 05-04-2008 11:54

Re: Offensive Power Rankings for 2008
 
I'm not sure I saw this yet, but thought it would be interesting to cross reference the OPR with the CMP teams that are currently on the list... Here's the top 50 CMP OPRs...


Code:

Team        Reg Wins        OPR
1114        3        66.10642467
2056        2        54.11894734
233        2        50.73081127
330        1        48.61296306
987        1        48.40552663
39        2        48.06177403
525        1        45.48888639
67        1        44.23000818
1124        1        42.40054838
217        2        42.10281885
103        1        41.29156933
40        2        40.86592771
175        1        39.4420245
191        1        39.06592804
469        1        37.90116922
20        2        37.75470786
79        0        37.65042852
1717        2        37.34613148
141        0        37.32830996
1024        3        37.2668216
968        1        35.93916079
1086        1        35.8662985
1126        1        35.81116812
368        1        35.65581359
494        0        35.0189302
2171        1        33.98399753
25        1        33.89508807
1625        1        33.79257371
365        1        33.63738509
254        2        32.91821392
47        0        32.49881588
93        1        32.23816608
1477        2        32.14182287
1251        1        31.57996364
1806        2        31.33327422
16        1        31.18613493
1629        0        31.01151072
33        0        30.94122998
1418        1        30.31278837
195        0        30.2915486
27        0        29.90208154
71        1        29.87541039
171        1        29.71637571
148        1        29.4612061
126        0        29.13224379
1156        0        28.94799245
1065        0        28.73082662
121        1        28.65599825
45        0        28.31597278


MasterChief 573 05-04-2008 12:06

Re: Offensive Power Rankings for 2008
 
Can you do the full CMP list as of now?

Guy Davidson 05-04-2008 12:10

Re: Offensive Power Rankings for 2008
 
Doug, 191 was a member of the winning alliance at FLR.

Jacob Plicque 05-04-2008 14:38

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Bongle (Post 730746)
Sumadin's included eliminations. It is possible that your alliance partners during eliminations were both scoring below their qualifying performance (which would make sense, given the increased quality of the opposition), and the algorithm 'attributed' that to you. This is why I didn't include eliminations in the ones I ran, they're a whole different beast. It probably isn't a bug in his code, because we both independently developed our own code and our results match, so unless the math foundations we're basing this on are shaky, it's probably an effect of using the finals data.

In other news:

This intrigued me, so I did it for a few more:
GLR: 20/24
Florida: 19/24
VCU: 17/24

So it is a somewhat accurate predictor, but it doesn't take into account that a team's 3rd pick is likely to be a lower-scoring lap bot because of the game only having 2 trackballs. Picking strictly by OPR is a fast way to get eliminated, because you'd probably end up with 3 delicate, relatively slow hurdlers fighting over 2 trackballs, rather than a more-ideal combination of 1 robust lapper/defender and 2 hurdlers.

Bongle
Your assumption is correct that Team 86 was a lapbot/defender. Our alliance won the elimination 6-0 at the Florida Regional with scores the ranged from 60 to 116 for 77 point average. I earlier tried to include the use the eliminations for the Florida Regional like Sumadin and the results were very skewed. So the matrices have a problem when the elimination match data is used to solve the matrix. I am still puzzled as to why the eliminations skew the OPR results so drastically (8,8 OPR no elims versus 1.47 OPR with elim)

Joe Ross 05-04-2008 14:55

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Jacob Plicque (Post 731009)
Bongle
Your assumption is correct that Team 86 was a lapbot/defender. Our alliance won the elimination 6-0 at the Florida Regional with scores the ranged from 60 to 116 for 77 point average. I earlier tried to include the use the eliminations for the Florida Regional like Sumadin and the results were very skewed. So the matrices have a problem when the elimination match data is used to solve the matrix. I am still puzzled as to why the eliminations skew the OPR results so drastically (8,8 OPR no elims versus 1.47 OPR with elim)

233 and 1251's OPR add to 81, so overall the alliance underperformed* based on the qualifying OPRs. Therefore all three robot's OPRs should go down a little. Those 6 elim matches were 20% of the matches that 233 and 1251 played this year (they went to other regionals too). It was over 40% of 86's matches this year, so 86 would see more of an effect.

Also 233 performed much better at Hawaii then they did in Florida. Since there is only one OPR for the year, it looks like Pink underperformed at Hawaii and overperformed at Florida. I think that 86's OPR would change less when adding in the elims if you were looking at the Florida data only.

*by underperformed, I mean as far as OPR is concerned. It's likely that more defense was played in the finals and was the cause.

Jacob Plicque 05-04-2008 16:30

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Joe Ross (Post 731018)
233 and 1251's OPR add to 81, so overall the alliance underperformed* based on the qualifying OPRs. Therefore all three robot's OPRs should go down a little. Those 6 elim matches were 20% of the matches that 233 and 1251 played this year (they went to other regionals too). It was over 40% of 86's matches this year, so 86 would see more of an effect.

Also 233 performed much better at Hawaii then they did in Florida. Since there is only one OPR for the year, it looks like Pink underperformed at Hawaii and overperformed at Florida. I think that 86's OPR would change less when adding in the elims if you were looking at the Florida data only.

*by underperformed, I mean as far as OPR is concerned. It's likely that more defense was played in the finals and was the cause.

Joe,
The Hawaii data for 233 is 53.16 pts versus 35.63 pts at the Florida regional. This 18 point change in OPR probably reflects on the fact that the current matrix mathematics would need a strength of schedule adjustment when comparing 40+ regionals. Has 233 improved its offence by 150% in Hawaii or is the competition 66% as strong? In contrast 1251's OPR varied by only 1 point between Florida and South Carolina.:D

daf 05-04-2008 16:37

Re: Offensive Power Rankings for 2008
 
can you post the boston regional OPR?

IbleedPink233 05-04-2008 17:16

Re: Offensive Power Rankings for 2008
 
I'd think that the change in our scoring average could be due to a few things:
At Florida, there were 3 qualifying matches where our tower was 100% inoperable and 2 elimination matches where our top roller did not work, leading to below-average scores there. Also, our autonomous scored about twice as many points in Hawaii than it did in Florida.

Doug G 05-04-2008 21:01

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by MasterChief 573 (Post 730958)
Can you do the full CMP list as of now?

There may be a few more to add in this next week as NYC finishes up.

Quote:

Originally Posted by Guy Davidson (Post 730959)
Doug, 191 was a member of the winning alliance at FLR.

I simply took the TBA list and crossed it with the OPR list. TBA must not have 191 as winning. But I'll update the posted list.

David Guzman 05-04-2008 21:23

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Jacob Plicque (Post 731049)
In contrast 1251's OPR varied by only 1 point between Florida and South Carolina.:D

Yea, this was mostly due to the fact that at palmetto our partners weren't as good. Also having a bull's eye on the robot doesn't help... :D

I love this power rankings, judging by the teams at the top and what I have seen at competitions. It is a good indication of what teams are scoring. This would be a good tool to do some scouting on what teams to watch for on Thursday at the Championship. (Once divisions come out.)

Nawaid Ladak 05-04-2008 21:23

Re: Offensive Power Rankings for 2008
 
can we please get a top 50 with the elimination rounds. i think it would be intresting to see these stats

Joe Ross 05-04-2008 21:40

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by Nawaid Ladak (Post 731139)
can we please get a top 50 with the elimination rounds. i think it would be intresting to see these stats

Guy's values in the following post include eliminations:

http://www.chiefdelphi.com/forums/sh...7&postcount=42

cziggy343 06-04-2008 12:37

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by David Guzman (Post 731138)
Yea, this was mostly due to the fact that at palmetto our partners weren't as good. Also having a bull's eye on the robot doesn't help... :D

yeah... one of our mentors actually put a bullseye on our robot:D it was quite entertaining to me!

hillale 06-04-2008 12:52

Re: Offensive Power Rankings for 2008
 
So... I'm really curious to see the OPRs for the Colorado Regional...

Josh Drake 06-04-2008 13:57

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by David Guzman (Post 731138)
Also having a bull's eye on the robot doesn't help... :D

If I recall correctly, there was a match at Palmetto in which a cretain orange robot made a bee line to ours once their elevator broke.:D Too bad one of us didn't end up winning it. Good luck in ATL.

cziggy343 06-04-2008 14:32

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by DRAKE343 (Post 731431)
If I recall correctly, there was a match at Palmetto in which a cretain orange robot made a bee line to ours once their elevator broke.:D Too bad one of us didn't end up winning it. Good luck in ATL.

yes, i think i remember that too josh;)

Aren_Hill 06-04-2008 15:18

Re: Offensive Power Rankings for 2008
 
Quote:

Originally Posted by hillale (Post 731410)
So... I'm really curious to see the OPRs for the Colorado Regional...

ABRAcoloradoregionalKADABRA! lol i'm curious too:D

Andy L 06-04-2008 15:41

Re: Offensive Power Rankings for 2008
 
SVR and Davis please?

Bongle 06-04-2008 16:42

Re: Offensive Power Rankings for 2008
 
Sorry, I've been out with friends and doing homework for the last couple days.

Colorado
Code:

1625        44.1421
1158        34.1294
1592        30.3363
1996        27.6142
1986        24.7011
1710        21.2959
443        19.26
1619        17.5055
1552        16.9992
2261        13.9418
2400        12.6815
662        11.613
1339        11.3174
1764        11.1782
1245        11.1402
1785        11.0254
1357        10.2145
1799        10.1786
159        9.40661
1296        9.23699
1332        9.14622
1408        8.56112
1583        8.46295
2036        8.30176
2543        7.97485
1303        6.33346
1977        6.31416
1348        5.95235
2250        5.48558
2240        5.40541
1789        3.9818
1584        3.76991
1410        3.68494
1157        2.56378
1377        2.27597
2083        2.1554
1375        0.744309
1691        0.117632
1847        -1.1462
2275        -1.81653
2259        -5.57234
1361        -5.94798

SVR
Code:

100        37.5837
192        31.8033
2024        27.1285
692        23.3598
2035        19.4172
254        18.9625
190        18.0702
766        17.645
971        17.5077
2473        16.7927
1280        14.8616
840        13.9741
668        13.9041
2628        13.453
846        13.2023
973        12.3591
1868        12.3273
1700        12.2685
670        11.7811
972        11.0111
115        10.905
253        9.9941
114        9.73564
2446        9.4606
1548        8.76499
2367        8.23913
2643        8.21591
2144        7.75092
8        7.39362
1834        6.80273
2141        5.82024
2629        5.77631
2489        5.76177
581        5.52981
649        5.24234
1560        4.94077
1072        4.7824
675        4.11086
256        2.83506
1967        2.76003
2159        2.53348
604        1.99006
1458        1.51235
1351        1.44784
1516        1.33837
2090        -1.52543
2283        -1.73087
2135        -7.20089

Davis
Code:

766        35.6844
997        30.954
2551        27.7521
692        25.7874
1662        22.8678
1388        22.7622
2035        22.436
2122        21.7512
2073        20.3156
1678        20.2854
1323        16.5556
2063        15.938
2144        15.7774
2390        15.4715
2633        15.0656
1516        14.7347
1351        14.3233
114        13.3008
2623        12.9547
2085        9.92073
2367        9.79919
1458        9.51097
2456        9.39205
2159        8.91843
701        8.54408
2156        8.25189
675        8.19112
2598        8.10967
2189        7.63435
295        6.77582
115        4.20432
1147        3.99845
2204        3.19376
1072        2.03249
852        1.96495
841        1.33425
2135        -1.02026


MasterChief 573 06-04-2008 17:35

Re: Offensive Power Rankings for 2008
 
Can we expect a CMP OPR by sometime tonight or tomorrow?

cziggy343 06-04-2008 17:42

Re: Offensive Power Rankings for 2008
 
probably more like wednesday or thursday... horray for fill-ins!:p

Guy Davidson 06-04-2008 17:42

Re: Offensive Power Rankings for 2008
 
I'll post a championship OPR by division once the division lists come out, so probably sometime this or next week.

MasterChief 573 06-04-2008 17:43

Re: Offensive Power Rankings for 2008
 
GRR!!! Must have scouting information!


All times are GMT -5. The time now is 20:28.

Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi