FundamentalsToken Costs by Language: Why the Same Text Bills Differently
The same sentence costs more in some languages than in English, and code has its own profile. Where the multiplier comes from and how to measure yours.
ReadNotes on models, agents, and what inference costs
Practical writing for developers building with large language models — how they work, how to pick one, and how to keep the bill predictable.
Fundamentals
FundamentalsTokenizer Differences: Why the Same Text Costs Different Amounts
Two models quoting the same price per million tokens can cost different amounts for identical text. Why tokenizers vary and what it does to your bill.
Read
FundamentalsTokens Per Second Explained: Reading the Number Correctly
Tokens per second means different things depending on who is measuring. What drives generation speed, why quoted figures disagree, and how to measure yours.
Read
AI AgentsTool Call Retries: Retry the Transport, Not the Judgement
Agents retry constantly, and most of it is wasted. How to tell a transport failure from a wrong decision, and what each one actually needs.
ReadAI AgentsTool Result Formatting: Shaping What the Model Reads Back
Tool output is the largest block of prompt content you never wrote. How to shape it so agents stay accurate, cheap and able to decide what to do next.
Read
AI AgentsTool Schema Design: The Prompt You Forgot You Were Writing
Tool definitions are prompt content the model reads on every turn. Design choices there change agent reliability more than model selection does.
Read
FundamentalsTop-K Sampling Explained, and Why Top-P Replaced It
Top-k cuts the tail at a fixed count, which is right sometimes and wrong often. How nucleus sampling adapts, and which knob to actually touch.
Read
AI AgentsTracing Multi-Step Agents: Building a Trace Tree That Holds
A flat log of model calls cannot explain a twenty-step run. How to shape spans, propagate context through subagents and async tools, and replay a run from its trace.
Read
FundamentalsTransformer Architecture Explained for Working Developers
What a transformer block actually contains, why the design won, and which parts of it explain the behaviour you observe when using a model.
Read
Cost & PricingTrial Abuse and Fair Use on Flat-Rate AI Plans
Why a flat-rate AI plan needs a fair-use boundary at all, what abuse looks like in the usage data, and how a heavy user stays clearly on the right side of it.
Read
FundamentalsUnicode and Tokenization: Where Text Handling Goes Wrong
Emoji that cost five tokens, accented text that costs double, and truncation that produces broken characters. How Unicode meets the tokenizer, and what breaks.
ReadCost & PricingUsage Caps and Overages: Limits That Do Not Break Work
Hard caps stop runaway spend and stop your pipeline with it. How to design caps, warning paths and overage pricing that protect budget without outages.
ReadShowing 601–612 of 731 articles