Here is how to explore more deeply the judgements made on a candidate's script

It is common for judges and coordinators to want to find out why a particular candidate achieved a particular score - there may perhaps be concerns that the score was too low or too high. To explore this more deeply, we can look at the decisions made for that candidate, who they were compared against, and the probability that the decision was 'correct'.

After the judging is completed, go to the Check results section and then highlight the candidate you want to look at by clicking on the box next to them.

Then click on the Decisions for Candidate button (the button with the three lines):

You will then see this page:

Here are the important aspects of this Candidate Decisions page:

• Name of the candidate being looked at - at the top, you will see the candidate's name and you can click on the name to view their script;
• Scaled Score - also at the top, the resulting Scaled Score for this candidate;
• Judge - which judge made the given judgement;
• Opponent - who the candidate was being compared against for this judgement. You can view the opponent's script by clicking on their name;
• Opponent Score - the resulting Scaled Score for the opponent. The colour of this indicates whether, in this judgement, the candidate concerned won against or lost against this opponent;
• Time Taken - the time taken for this one judgement;
• Probability - based on the resulting candidate's Scaled Score and the opponent's Scaled Score, we can calculate the probability that this judgement was 'correct' based on other judges' decisions on the task. Or rather, the higher this probability, the more likely the decision was in agreement with the other judges.