How many times is enough to prove consistency?

[Knufire]

Remember, quantitative data is ALWAYS better than qualitiative. You have a goal in mind (measuring the consistency of robots crossing defenses). How can you measure this with a hard, factual number?

If you have a bunch of qualitative ratings that scouters can choose from, the robot will be at the mercy of the scouter's opinion. Different scouters on your team might have different standards as to what a "good" vs "struggle" crossing is.

I also don't see that many "unsuccessful" crossings happen. An unsuccessful crossing can only happen two ways; you either fail to get over the obstacle and back up, or you get stuck. If you're stuck, you're done for the match unless a partner comes and helps you out, and that probably only counts as one (albeit massive) failure. If you have to back up and try again, you'll probably get the same result (re. definition of insanity) unless you try to Duke of Hazzard it over.

My initial thought was to record not whether the robot crossed or not, but the time it took the robot to cross. Having the average time to cross each obstacle for every team at a tournament would be an extremely valuable piece of data. Downside is that this is probably only practical to record with some sort of electronic scouting system. For this method, I'd also define crossing per the manual definition of a CROSS for clarity.