What is Inference Cost?
What each model call costs to run, driven mostly by the model chosen and the tokens in and out. Agents multiply it, since one task can trigger dozens of calls.
1 task · 30 calls · $0.68 total
Inference cost is…
Write it in your own words in the app.
In real work
Moving ticket summaries to a smaller model cut inference cost per ticket with no drop on the golden set, so the large model now handles escalations only.
In the illustration
Each envelope is weighed and franked: a light one costs little, a heavy one more. Then a single agent task feeds a stack of 30 envelopes through and the total climbs.
Estimate the inference cost in your model for one agent task: calls per task, tokens in and out per call, and the per-token prices I paste below, then the cost per 1,000 tasks.
Try it now
The fastest way to learn a word is to use it. Open this line in the agent you already work in and watch what it does. Change the tool to the one you use.
Go further
01Practice
Make it stick
One term a day, a short quiz, and sentence practice that checks your own words.
02Verify
Prove you know it
Pass the quiz and keep it in a Skills Wallet you can share with anyone who needs proof.
03Career
Find the work that uses it
See which roles lean on this vocabulary, and what they pay in year one.
More in AI Product
All terms →
Learn the next term tomorrow.
Google gives a definition. Prompthaus pairs each term with how it shows up in standups, PRs, prompts, and design reviews. Then it quizzes you until the word sticks. One term a day on iPhone.
