Why the judge needs its own validation
When a language model is used to evaluate outputs for bias, a second model becomes part of the measurement. If that judge is not checked, it can introduce new bias into the very results meant to surface bias.
The approach in this guide is to treat the judge model as a measurement instrument: one that is validated, calibrated, and logged before its results are relied on. The sequence below summarizes the workflow, and each step is covered in the sections that follow.
Judge evaluation workflow
- IsolateSelect a judge separate from the system under test.
- ConstrainUse rubric-anchored prompts and randomized presentation.
- CalibrateValidate scores against human-labeled ground truth.
- RecordLog versions, prompts, and decisions for audit.
Choose and isolate the judge, then structure the rubric
Isolate the judge from the system under test
Select a judge that is separate from the system under test, so the judge is isolated from the system it measures.
Constrain the judge with a rubric
Use rubric-anchored prompts, so that the criteria for each score are explicit rather than left to the judge's own interpretation.
Randomize what the judge sees
Randomize the presentation of the material the judge evaluates, so that the way it is presented does not shape the scores.
Validate the judge against human-labeled ground truth
Before a judge's scores are used, check them against human-labeled examples. Report two things from that comparison:
- Agreement: how closely the judge's scores match the human labels.
- Subgroup error rates: how often the judge is wrong within each subgroup, reported separately rather than only in aggregate.
These figures show whether the judge can be trusted as an instrument and where it may be adding error of its own.
Log decisions so results can be audited and defended
Log every judge version, prompt, and score. A recorded trail lets reviewers trace any result back to the exact judge configuration that produced it.
Judge-introduced biases and the controls that address them
The controls described above are summarized here for reference.
| Control | How it is applied |
|---|---|
| Isolation | Select a judge separate from the system under test. |
| Rubric | Use rubric-anchored prompts to constrain scoring. |
| Randomization | Randomize the presentation of what the judge sees. |
| Human calibration | Validate scores against human-labeled ground truth. |
| Reliability reporting | Report agreement and subgroup error rates. |
| Audit logging | Log every judge version, prompt, and score. |