Chief Delphi

Chief Delphi (http://www.chiefdelphi.com/forums/index.php)
-   General Forum (http://www.chiefdelphi.com/forums/forumdisplay.php?f=16)
-   -   2014 OPR After Week One Events (http://www.chiefdelphi.com/forums/showthread.php?t=127360)

Ether 02-03-2014 22:23

Re: 2014 OPR After Week One Events
 
Quote:

Originally Posted by dellagd (Post 1352268)
Could you possibly run the calculation again with Sunday data for us Hatboro-Horsham teams?

There is no Twitter data available for Hatboro-Horsham.



Anupam Goli 02-03-2014 22:29

Re: 2014 OPR After Week One Events
 
You know, I'm actually quite surprised at how accurate OPR is for Palmetto. What we're seeing in the data matches our team's scouting data for the most part. I was under the impression that OPR would not be a good indicator, but I suppose that is dependent on the strength of every team at an event. I suppose the stronger the event is, the less accurate OPR becomes as a statistic.

Ed Law 03-03-2014 01:24

Re: 2014 OPR After Week One Events
 
The OPR/CCWM week 1 numbers have been updated. Please go to

http://www.chiefdelphi.com/media/papers/2174

There are a number of points I would like to make:

1) Team Standings for Centerline is not posted on FIRST website. I posted what the FTA gave me but I am not certain the subscores are in the right columns. There were only two columns in the FTA report and I guess they are for Autonomous points and Teleop points. I will update them once the Team Standings are posted on the FIRST website.

2) Team Standings for Greater Toronto West has incomplete data. I did not include these data in Query.

3) I added the Adjusted OPR in column AE for each event, which removes the Foul Points from the total score before computing OPR. The foul points came from Twitter data. I did not use the match score from Twitter data because they are not 100% accurate. For events without twitter data, no Adjusted OPR is computed.

4) World ranking is computed using OPR because some events do not have twitter data to calculate Adjusted OPR.

5) I added a tab called Adjusted OPR Results. Events without twitter will show 0 for Adjusted OPR.



If you find any error or have any questions, please let me know.

Bongle 03-03-2014 07:37

Re: 2014 OPR After Week One Events
 
Quote:

Originally Posted by efoote868 (Post 1351775)
Would anyone like to speculate on how OPR fits true robot scoring abilities or alliance contributions this year compared to previous years?

One thing I see that is different this year is that any particular alliance can do much better (or much worse) than the sum of the individual teams since robots can't do their own thing for an entire match.

It should be pretty excellent at giving a rating for a team's contributions this year, and in fact should be fantastic at finding teams who contribute to their alliance without doing the prestige tasks. A team that adds two assists on every ball but doesn't shoot it through the goal will get a good OPR.

However: even moreso than in past years, you won't want to scout with it. A team might get a 60-70pt OPR without ever firing a ball. If you also don't shoot a ball, you probably want to find a shooter or a low-goal specializer. If you already have a fantastic shooter, you may not want to pick a team that earned their OPR with a shooter. In past years you could maybe get away with picking the top 3 in OPR for an alliance, but with such different functionalities and roles, you'll want to make sure that everyone is compatible.

Also, keep in mind that you can't always compare across events with OPR - an event where everyone tends to play offense and keep to themselves will elevate all their robots OPRs, compared to an event with heavier defense.

Another thought about the penalties: It would be interesting to not only remove the penalties from scores (as has been done), but to actually subtract them from the team that caused them when putting inputs into an OPR-solver. This would help find teams that are racking up a lot of penalties, since their OPRs would go much lower.

tl,dr: OPR will be great for entertainment purposes to do comparisons across robots who do different tasks, but poor for scouting.

JamesCH95 03-03-2014 09:42

Re: 2014 OPR After Week One Events
 
Any particular reason that GSDE isn't included in this data?

Ether 03-03-2014 10:39

Re: 2014 OPR After Week One Events
 
1 Attachment(s)
Quote:

Originally Posted by Bongle (Post 1352453)
Another thought about the penalties: It would be interesting to not only remove the penalties from scores (as has been done), but to actually subtract them from the team that caused them when putting inputs into an OPR-solver. This would help find teams that are racking up a lot of penalties, since their OPRs would go much lower.

Or you could just do an "OPR" on foul points.

(Note: This uses Twitter data. The usual Twitter data caveats apply).

markmcgary 03-03-2014 11:51

Re: 2014 OPR After Week One Events
 
Quote:

Originally Posted by Ether (Post 1352525)
Or you could just do an "OPR" on foul points.

(Note: This uses Twitter data. The usual Twitter data caveats apply).

Just so I understand the "OPR" on foul points, is lower OPR a good thing?

(Thanks to all contributors for this data. Very interesting stuff.)

Ether 03-03-2014 12:07

Re: 2014 OPR After Week One Events
 
Quote:

Originally Posted by markmcgary (Post 1352584)
Just so I understand the "OPR" on foul points, is lower OPR a good thing?

Since the point of the computation was to try to estimate the fouls committed by each team, lower is better.

See cell G1 in the spreadsheet.



markmcgary 03-03-2014 12:31

Re: 2014 OPR After Week One Events
 
Quote:

Originally Posted by Ether (Post 1352601)
See cell G1 in the spreadsheet.

Sigh... I can no longer complain about my customers who do not read the instructions.

Thank you.

Citrus Dad 03-03-2014 13:51

Re: 2014 OPR After Week One Events
 
Quote:

Originally Posted by Bongle (Post 1352453)
It should be pretty excellent at giving a rating for a team's contributions this year, and in fact should be fantastic at finding teams who contribute to their alliance without doing the prestige tasks. A team that adds two assists on every ball but doesn't shoot it through the goal will get a good OPR.

However: even moreso than in past years, you won't want to scout with it. A team might get a 60-70pt OPR without ever firing a ball. If you also don't shoot a ball, you probably want to find a shooter or a low-goal specializer. If you already have a fantastic shooter, you may not want to pick a team that earned their OPR with a shooter. In past years you could maybe get away with picking the top 3 in OPR for an alliance, but with such different functionalities and roles, you'll want to make sure that everyone is compatible.

Also, keep in mind that you can't always compare across events with OPR - an event where everyone tends to play offense and keep to themselves will elevate all their robots OPRs, compared to an event with heavier defense.

Another thought about the penalties: It would be interesting to not only remove the penalties from scores (as has been done), but to actually subtract them from the team that caused them when putting inputs into an OPR-solver. This would help find teams that are racking up a lot of penalties, since their OPRs would go much lower.

tl,dr: OPR will be great for entertainment purposes to do comparisons across robots who do different tasks, but poor for scouting.

At Inland Empire, we had a robot that only had a drive train playing only defense--no shooter or pick up mechanism with a middling OPR (and ended up an alliance captain), and another that was having quite an offensive day (our 3rd alliance member) with a low OPR despite showing high in our scouting data. The OPR this year seems to be greatly influenced by the schedule and win-loss record. And with 13 matches apiece, this was the best possible statistical mix of any event.

Debbie 03-03-2014 14:05

Re: 2014 OPR After Week One Events
 
Thanks Ed, and Jim, and everyone that is working on this. Ed, is the Center Line data updated yet? Thanks for taking out the penalty points. They were ridiculous! (and that's all I will say on that subject here) Can you please let me know when it is?
Thanks!!!

dellagd 03-03-2014 18:18

Re: 2014 OPR After Week One Events
 
Im not that good at using excel, but I can't find the adjusted OPR for Hatboro even though the regular OPR data is there. Is this due to the lack of twitter data as Ether said?

Ether 03-03-2014 18:32

Re: 2014 OPR After Week One Events
 
Quote:

Originally Posted by dellagd (Post 1352876)
Im not that good at using excel, but I can't find the adjusted OPR for Hatboro even though the regular OPR data is there. Is this due to the lack of twitter data as Ether said?

Yes. The Twitter data has foul points. The Team Standings data lumps foul points together with TeleOp Goal points.



JohnGilb 03-03-2014 19:06

Re: 2014 OPR After Week One Events
 
As regards teams with negative "Foul OPR:"

Does that essentially mean that not only do they rarely (if ever) commit fouls, but also that their presence on an alliance reduces the chance/severity of their allies committing fouls as well?

If so, we should really be asking teams 2493 and 4981 what they're doing to keep the game clean. =]

Ether 03-03-2014 20:09

Re: 2014 OPR After Week One Events
 
Quote:

Originally Posted by JohnGilb (Post 1352916)
As regards teams with negative "Foul OPR:"

Does that essentially mean that not only do they rarely (if ever) commit fouls, but also that their presence on an alliance reduces the chance/severity of their allies committing fouls as well?

Statistically, yes. But all the usual OPR caveats apply.




All times are GMT -5. The time now is 21:57.

Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi