What is Preference Data?
Pairs or rankings of model outputs where people marked the one they preferred. Post-training uses it to teach a model which response is better, so a skewed group of raters teaches a skewed taste.

10 pairs · 2 chosen in 8 · 10 picks logged
Preference data records…
Write it in your own words in the app.
In real work
Consenting users picked the better of two draft replies, and research used that preference data in the next post-training run.
In the illustration
The refractor flips between lens 1 and lens 2 and the viewer picks one; each pick is logged on a card. After ten picks, the prescription is set from the choices.
Prepare preference data in your model for these 20 tickets: write two reply drafts for each that differ in one way, and name the difference so our support leads can pick the better one.
Try it now
The fastest way to learn a word is to use it. Open this line in the agent you already work in and watch what it does. Change the tool to the one you use.
Go further
01Practice
Make it stick
One term a day, a short quiz, and sentence practice that checks your own words.
02Verify
Prove you know it
Pass the quiz and keep it in a Skills Wallet you can share with anyone who needs proof.
03Career
Find the work that uses it
See which roles lean on this vocabulary, and what they pay in year one.





