# What is LLM-as-Judge?

Using a model to grade outputs against a rubric so evals can score thousands of cases. Trust it only once its grades agree with human labels on a sample, and recheck whenever the judge model or the rubric changes.

## In real work

Before trusting the LLM-as-Judge on 5,000 summaries, the team compared its grades with 150 human labels and rewrote the rubric line where they disagreed most.

## Related terms

- [Capability](https://prompthausapp.com/learn/capability.md)
- [Tool Use](https://prompthausapp.com/learn/tool-use.md)
- [Computer Use](https://prompthausapp.com/learn/computer-use.md)
- [Model Generation](https://prompthausapp.com/learn/model-generation.md)
- [Golden Set](https://prompthausapp.com/learn/golden-set.md)

## How is this different from Googling it?

Google gives a definition. Prompthaus pairs each term with how it shows up in standups, PRs, prompts, and design reviews. Then it quizzes you until the word sticks. One term a day on iPhone.

- Category: AI Product
- HTML: https://prompthausapp.com/learn/llm-as-judge
- App Store: https://apps.apple.com/us/app/prompthaus-ai-vocabulary/id6776314407