Cost & PricingThe ROI of Flat-Rate Billing for AI Development Work
The break-even maths for flat-rate AI plans, why usage variance decides the answer more than the average does, and the workloads where metered billing still wins.
ReadNotes on models, agents, and what inference costs
Practical writing for developers building with large language models — how they work, how to pick one, and how to keep the bill predictable.
Cost & Pricing
Cost & PricingThe Self-Hosting Break-Even Point, With Honest Inputs
Self-hosting beats per-token pricing above some volume. Working out where that point sits once engineering time and idle capacity are included.
Read
Cost & PricingThe Token Cost of Long Context: When 1M Is Worth Filling
A million-token window makes enormous prompts possible, not advisable. What filling it costs across model tiers, and when retrieval wins instead.
Read
Cost & PricingThe Token Cost of Reasoning Models: Paying for Hidden Output
Reasoning models emit tokens you never see and are billed for at output rates. How much that adds, and when the accuracy is worth it.
Read
Cost & PricingThe Token Cost of Tool Calls: Definitions Bill Every Turn
Tool definitions and results are prompt content, charged on every turn of every session. What a tool actually costs over a run, and how to shrink it.
Read
ModelsThe Z.ai GLM Family Explained: What GLM-5.2 Changes
GLM-5.2 pairs MIT licensing with a 128K output ceiling and two reasoning modes. What the family offers, and the workloads it is uniquely good at.
Read
FundamentalsThroughput vs Latency: The Trade-off Behind Your Bill
Serving more tokens per second and serving them faster are opposing goals. The knob that reconciles them is batch size, and it decides both speed and price.
Read
FundamentalsTime to First Token: What It Measures and What Moves It
TTFT is dominated by prefill compute, queueing and network distance rather than by model speed. What each contributes, and how to measure it without fooling yourself.
Read
GuidesTimeout Tuning for LLM Calls: Picking Numbers That Hold
Connect, first-token and idle timeouts do different jobs. How to pick each from your own latency data, propagate deadlines, and avoid the default ten-minute wait.
ReadFundamentalsToken Costs by Language: Why the Same Text Bills Differently
The same sentence costs more in some languages than in English, and code has its own profile. Where the multiplier comes from and how to measure yours.
Read
FundamentalsTokenizer Differences: Why the Same Text Costs Different Amounts
Two models quoting the same price per million tokens can cost different amounts for identical text. Why tokenizers vary and what it does to your bill.
Read
FundamentalsTokens Per Second Explained: Reading the Number Correctly
Tokens per second means different things depending on who is measuring. What drives generation speed, why quoted figures disagree, and how to measure yours.
ReadShowing 265–276 of 404 articles