Quote:
Originally Posted by evanperryg
/snip/
Say you ranked each team's drivetrain/driving abilities on a scale of 1-5, and only viewed the 4s and 5s. This, of course, raises a few inevitable questions:
-what's the difference between a 4 and a 5? You'll need a list of differences between a 4 and a 5, which will include even more subjective criteria.
-how important is the difference between a 4 and a 5, versus the more objective quantitative data? What if there's a team with a 5 that can't do any scoring, but there's a 4 that could score a few points in auto, and a few in teleop if needed?
|
Oh god subjective rating systems make me cringe.
For some reason, in 2013, we had a metric on some of our match scouting sheets called "Speed". It was a rating of 1-5 based on what they saw during the match. We never used it for strategy (so I don't know why we had it), but it was funny to see what different students rated different robots. Sometimes teams with 2-speed, aggressively geared drivetrains were given 1's and 2's, while some robots with single-speed, relatively slow drivetrains were given 4's and 5's. Most notably was the fact that somehow our single speed 12 fps tank drive from that year had the highest "average speed rating" at the event, due to obvious bias in the scouts.
We've tried since then to weed out poor, subjective rating systems like that.