LLM as judge
Using a model with a rubric to grade another model’s output.
Useful where exact checks are impossible: tone, faithfulness to a source, whether an answer covers the question. The judge needs a precise rubric and its own checks: a judge that agrees with everything measures nothing.
Related terms
- Evals: A repeatable test set that scores an AI feature, so changes can be measured instead of guessed.
