# What is Inference Cost?

What each model call costs to run, driven mostly by the model chosen and the tokens in and out. Agents multiply it, since one task can trigger dozens of calls.

## In real work

Moving ticket summaries to a smaller model cut inference cost per ticket with no drop on the golden set, so the large model now handles escalations only.

## Related terms

- [Capability](https://prompthausapp.com/learn/capability.md)
- [Tool Use](https://prompthausapp.com/learn/tool-use.md)
- [Computer Use](https://prompthausapp.com/learn/computer-use.md)
- [Model Generation](https://prompthausapp.com/learn/model-generation.md)
- [Golden Set](https://prompthausapp.com/learn/golden-set.md)

## How is this different from Googling it?

Google gives a definition. Prompthaus pairs each term with how it shows up in standups, PRs, prompts, and design reviews. Then it quizzes you until the word sticks. One term a day on iPhone.

- Category: AI Product
- HTML: https://prompthausapp.com/learn/inference-cost
- App Store: https://apps.apple.com/us/app/prompthaus-ai-vocabulary/id6776314407