IYO, whats most important

[JesseK]

Originally Posted by Lil' Lavery

Simple. You create a "range" of scores you deem to be reliable (say, a range of +/-15 points from average). You see how many scores fall within that range of their average score and how many do not. You can then rank teams by reliability.

Aka standard deviation. The range of scores from (mean - 1 std. dev) to (mean + 1 std dev.) should hold 75% of all of the data points for a team. The smaller this number, the more consistency there is in the scoring. The great thing about it is that standard deviation is independent of the actual value of the mean (aka average). So if a team consistently scores +/- 15 points from an mean of 20 points per match (i.e. the range is a 5 point match low score to a 35 point match high score), that team will have the same standard deviation as a team who's mean is way up there at 80 who also has a +/- 15 point range.

Then of course, it will be up to the scouts who are watching to eliminate out any outliers from the data. Outliers are matches in which (for example) both of your alliance partners did not work, which is not typical of a match your team is capable of, hence the reason for the very low score.