aiapicostcalcUnit economicsPricesBrandsCompareBenchmarksSkills & PluginsFind my modelGuidesChanges

Self-host vs API break-even calculator

Short answer: Self-hosting wins when utilization stays above 11.1% for these inputs. With the example inputs — $2.00 per GPU-hour, 500 output tokens/sec and 50% utilization — one GPU serves 657,000,000 output tokens a month for $1,460, which is $2.22 per 1M output tokens versus $10.00 per 1M output on Claude Sonnet 5.5. The break-even GPU rate at 50% utilization is $9.00/hour.

Last verified 2026-11-18 · Sources: official provider pricing pages, copied into src/prices.json (checked 2026-11-18) · Report an error

1

Defaults are example inputs, not market prices: use your GPU quote and a throughput you measured on your model.

2
GPU cost per month (730 h, always billed)$1,460
Output tokens per month657,000,000
Self-host cost per 1M output tokens$2.22
API output price · Claude Sonnet 5.5$10.00
Break-even utilization vs API output11.1%
Break-even GPU $/hour at 50% utilization$9.00
API blended price · 3:1$4.00
Break-even utilization vs blended API27.8%

At 50% utilization, the self-host estimate is $2.22 per 1M output tokens, below the $10.00 API output price. It stays below the API price while utilization is above 11.1%.

Every number in the receipt is an estimate from the formula below. The only sourced price is the API list rate; the GPU cost and throughput are your inputs.

The formula

With a GPU or multi-GPU node billed at G dollars per hour, generating T output tokens per second while active, active U percent of the time, and an API price P per 1M tokens:

self-host $/1M output tokens = (G × 1,000,000) ÷ (T × 3,600 × U)

break-even U = (G × 1,000,000) ÷ (T × 3,600 × P)

break-even G = (P × T × 3,600 × U) ÷ 1,000,000

U is a fraction in the formulas (50% = 0.5) and prices are USD per 1M tokens. The 730-hour month cancels out: monthly GPU cost is G × 730 and monthly output is T × 3,600 × 730 × U, so dividing cost by tokens removes the month length. That is why the result is a rate, not a monthly bill.

SymbolMeaningWhere it comes from
GGPU or node cost per hourYour quote or invoice
TOutput tokens per second while servingYour measured throughput on your model and batch size
UShare of wall-clock time the GPU is generatingYour serving logs or queue metrics
PAPI price per 1M tokensOfficial provider pricing page, checked 2026-11-15

Reading the result

Choose inputs you can defend

What the estimate leaves out

Where the API price comes from

The model selector uses the same verified list prices as the price table; every model page links its official provider page and check date. The default, Claude Sonnet 5.5, comes from Anthropic pricing, checked 2026-11-15. No GPU price is published on this page; GPU costs are inputs because they depend on your hardware, region and contract. How prices are checked and how unverified ones are excluded is documented in the verification method.

Questions

Is self-hosting cheaper than an API?

Not in general; it depends on the GPU rate, utilization and the API price. With the example inputs on this page ($2.00 per GPU-hour, 500 output tokens/sec, 50% utilization), one GPU costs $2.22 per 1M output tokens against $10.00 output on Claude Sonnet 5.5, so self-hosting is cheaper above 11.1% utilization. Change the inputs to match your quote and logs.

What utilization should I use?

The share of wall-clock time the GPU is actually generating tokens at load. Read it from serving logs or queue metrics over a full week, not from a peak-hour sample. A box that is busy four hours a day and idle the rest is at about 17%.

Which GPU or model should I use?

This page does not recommend hardware and does not publish GPU prices or throughput benchmarks. Enter the hourly cost of the box you would rent or buy and the tokens/sec you measured on the model and batch size you would serve.

Why compare with both the output price and a blended price?

Tokens/sec measures generation, so the output price is the like-for-like API rate. A blended price includes cheaper input tokens, which is the right comparison for prompt-heavy work but a harder test for self-hosting. Input/prefill processing is not counted on the self-host side, so the estimate already leans in self-hosting's favour.

Does the 730-hour month matter?

No. Monthly cost is G × 730 and monthly output is T × 3,600 × 730 × U, so 730 cancels when you divide cost by tokens. The result is a rate per 1M tokens; any month length gives the same rate.

Next step → See how the API price changes with the token mix

Price data last checked 2026-11-18 against official sources · how we verify

Price-change alerts

One short email when a provider changes a price or a promo ends. No spam, unsubscribe any time.