Cost & PricingComparing Provider Pricing Models Without Getting Fooled
Per-token, per-seat, credits, tiers and flat rate all quote different units. Here is how to normalise them onto one number you can actually compare.
ReadNotes on models, agents, and what inference costs
Practical writing for developers building with large language models — how they work, how to pick one, and how to keep the bill predictable.
Cost & Pricing
GuidesConnection Pooling for LLM APIs: Sizing the Client Right
Long-lived streaming requests break the assumptions behind default HTTP pools. How to size keepalive connections, avoid pool starvation, and stop creating a client per call.
Read
FundamentalsConstitutional AI: Alignment From Written Rules, Not Labels
Instead of paying humans to rank thousands of responses, write the principles down and have the model apply them. How the method works and where it strains.
Read
Cost & PricingContext Bloat: Paying Repeatedly for Tokens Nobody Reads
Every token added to a prompt is billed on that call and every call after it. Where bloat accumulates and what it actually costs to leave it there.
Read
AI AgentsContext Compaction: Keeping Agents Alive Past Turn Twenty
Agent transcripts grow until quality degrades and cost climbs. What to summarise, what to drop, and what must never be compacted away.
Read
FundamentalsContext Length vs Effective Context: The Number You Can Use
A model advertising a one-million-token window does not reliably use one million tokens. The gap between the spec sheet and what actually works.
Read
ModelsContext Windows Compared: Input, Output and What It Costs
Filling a million-token window costs between fourteen cents and three dollars depending on the model. The full comparison, including output ceilings.
Read
FundamentalsContinuous Batching: How Servers Keep GPUs Busy
Continuous batching lets finished requests leave a batch and new ones join mid-flight. It is why modern inference servers hold high load without stalling.
Read
Cost & PricingCost Per 1K Lines of Code: A Tempting, Mostly Bad Metric
Lines of code is the easiest denominator for AI spend and one of the worst. Where it misleads, where it genuinely works, and what to measure instead.
Read
Cost & PricingCost Per Agent Run: Why Input Dominates the Bill
Agent costs are driven by resent transcript, not generated output. Working out what one run actually costs and which lever moves it.
Read
Cost & PricingCost Per Code Review: What Automated Review Actually Costs
Automated review looks cheap per pull request until you count re-reviews, large diffs and false positives. Working out the real per-review figure.
ReadCost & PricingCost Per Refactor: Estimating a Multi-File Change Up Front
Refactors are the worst case for context bloat because every touched file must stay in view. A method for estimating the bill before you start the run.
ReadShowing 409–420 of 731 articles