AI AgentsAgent Timeout Strategies: Bounding a Loop That Cannot Stop
An agent has no instinct for when it has taken too long. The four limits worth setting, where to put them, and how to fail without losing the work.
ReadNotes on models, agents, and what inference costs
Practical writing for developers building with large language models — how they work, how to pick one, and how to keep the bill predictable.
AI Agents
AI AgentsAgent Token Budgets: Capping Spend Without Capping Capability
An unbounded agent can spend arbitrarily much on one task. How to set budgets that stop runaway sessions without killing legitimate long ones.
Read
AI AgentsAgent-to-Agent Protocols: What They Solve and What They Do Not
Protocols for agents talking to other agents are arriving. Here is the problem they address, how they differ from MCP, and when you genuinely need one.
Read
ModelsAgentic Coding Models Compared: Who Survives the Loop
Chat benchmarks say little about a model driven in a loop for forty turns. What agentic performance actually measures, and how the 2026 field ranks on it.
Read
Cost & PricingAI Cost Anomaly Detection That Catches Real Problems
How to spot abnormal LLM spend in token data: per-workload baselines, rate-of-change thresholds, and telling a runaway agent apart from real growth.
ReadCost & PricingAlerting on Token Spikes Before the Invoice Explains Them
Runaway LLM spend is usually discovered at month end. What to alert on, what thresholds actually work, and how to avoid alarms nobody reads.
Read
AI AgentsApproval Gates in Agents: Where to Put the Human
Asking a human to approve everything trains them to approve nothing. How to place gates so the few that remain still get read carefully.
Read
ModelsArena Elo Explained: What a Preference Rating Measures
Arena ratings come from blind pairwise votes, not from tests. What the number means, why gaps under fifty points are noise, and where it misleads.
Read
FundamentalsAttention Mechanisms Explained Without the Linear Algebra
What attention actually computes, why it made transformers work, and why its cost scaling explains almost every practical limit you hit with long context.
ReadCost & PricingBatch API Savings: Trading Latency for a Real Discount
Batch endpoints offer a meaningful discount in exchange for delayed results. Which workloads qualify, and what the switch actually costs to build.
Read
FundamentalsBatch Size and Throughput: The Trade Behind Every Token Price
Batching is why per-token prices are low and why latency varies under load. How it works, where it stops helping, and what it means for your requests.
Read
FundamentalsBeam Search vs Sampling: Why Chat Models Do Not Search
Beam search finds higher-probability text and worse text. Why sampling won for open-ended generation, and where search-like decoding still earns its place.
ReadShowing 25–36 of 404 articles