# What is Preference Data?

Pairs or rankings of model outputs where people marked the one they preferred. Post-training uses it to teach a model which response is better, so a skewed group of raters teaches a skewed taste.

## In real work

Consenting users picked the better of two draft replies, and research used that preference data in the next post-training run.

## Related terms

- [Capability](https://prompthausapp.com/learn/capability.md)
- [Tool Use](https://prompthausapp.com/learn/tool-use.md)
- [Computer Use](https://prompthausapp.com/learn/computer-use.md)
- [Model Generation](https://prompthausapp.com/learn/model-generation.md)
- [Golden Set](https://prompthausapp.com/learn/golden-set.md)

## How is this different from Googling it?

Google gives a definition. Prompthaus pairs each term with how it shows up in standups, PRs, prompts, and design reviews. Then it quizzes you until the word sticks. One term a day on iPhone.

- Category: AI Product
- HTML: https://prompthausapp.com/learn/preference-data
- App Store: https://apps.apple.com/us/app/prompthaus-ai-vocabulary/id6776314407