AI Product

What is Preference Data?

Pairs or rankings of model outputs where people marked the one they preferred. Post-training uses it to teach a model which response is better, so a skewed group of raters teaches a skewed taste.

10 pairs · 2 chosen in 8 · 10 picks logged

Finish the sentencePrompthaus

Preference data records…

Practice this term

Write it in your own words in the app.

In real work

Consenting users picked the better of two draft replies, and research used that preference data in the next post-training run.

In the illustration

The refractor flips between lens 1 and lens 2 and the viewer picks one; each pick is logged on a card. After ten picks, the prescription is set from the choices.

Use it in a prompt

Prepare preference data in your model for these 20 tickets: write two reply drafts for each that differ in one way, and name the difference so our support leads can pick the better one.

Try it now

The fastest way to learn a word is to use it. Open this line in the agent you already work in and watch what it does. Change the tool to the one you use.

Go further

  1. 01Practice

    Make it stick

    One term a day, a short quiz, and sentence practice that checks your own words.

    Get the app →

  2. 02Verify

    Prove you know it

    Pass the quiz and keep it in a Skills Wallet you can share with anyone who needs proof.

    How verification works →

  3. 03Career

    Find the work that uses it

    See which roles lean on this vocabulary, and what they pay in year one.

    All career pathways →

Learn the next term tomorrow.

Google gives a definition. Prompthaus pairs each term with how it shows up in standups, PRs, prompts, and design reviews. Then it quizzes you until the word sticks. One term a day on iPhone.

Markdown for agents