How about we follow the Official Rubik's Cube competition rule (Link Check 9f8)
Here's how it works:
Step 1: We want the average score of N judges on each submission.
Step 2: Get N+2 judges rate the batch.
Step 3: For each submission, omit the highest and the lowest scores and compute the average of the remaining scores.
Pros:
- Less bias
- Less drama (If a submission gets a low score with this method, it means that more than one judge gave a low score, thus preventing typical "omg my fiel almost made it through if it weren't for <Insert a name here>" drama)
Cons:
- Needs more judges
Thoughts?
Here's how it works:
Step 1: We want the average score of N judges on each submission.
Step 2: Get N+2 judges rate the batch.
Step 3: For each submission, omit the highest and the lowest scores and compute the average of the remaining scores.
Pros:
- Less bias
- Less drama (If a submission gets a low score with this method, it means that more than one judge gave a low score, thus preventing typical "omg my fiel almost made it through if it weren't for <Insert a name here>" drama)
Cons:
- Needs more judges
Thoughts?
Comment