Model Routing: Send Cheap Work to Cheap Models
Most requests do not need your most capable model. Routing by task cuts cost sharply and adds resilience — here is how to build it without a mess.
ReadPractical writing for developers building with large language models — how they work, how to pick one, and how to keep the bill predictable.
Most requests do not need your most capable model. Routing by task cuts cost sharply and adds resilience — here is how to build it without a mess.
ReadTwo credible teams published opposite advice on multi-agent architectures within a day of each other. Both were right, because the answer depends on the task.
ReadA multimodal model does not see an image. It sees patch embeddings projected into the same space as text tokens. What that implies for cost and accuracy.
ReadEditor extension, terminal agent, CI job and a script all pointing at the same endpoint. The env var conventions, the per-tool quirks, and key hygiene that scales.
ReadDownloadable weights are not the same thing as open source. Here is what the licences actually permit, and which differences change what you can ship.
ReadKimi K3, GLM-5.2, DeepSeek V4, MiniMax M3 and Qwen compared on the axes that decide deployment: licence terms, active parameters, serving cost and benchmark shape.
ReadOpenClaw ignores the base URL environment variables you expect. Here is the provider block in openclaw.json that actually works, plus the model policy gotcha.
ReadMetered inference makes sense until you start using agents. Here is the arithmetic that decides which billing model is cheaper for how you actually work.
ReadCache writes cost more than normal input, so caching only pays above a read threshold. Here is the arithmetic for TTL choice, hit rate and breakpoint placement.
ReadPrompt caching reuses the prefill work for a repeated prefix, cutting cost and first-token latency. The whole technique comes down to one ordering rule.
ReadClever phrasing barely moves the needle. What actually improves agent output is what you put in front of it, in what order, with what constraints.
ReadAn agent that reads untrusted content can be instructed by it. The fix is not a better prompt — it is treating the model as an untrusted client.
ReadShowing 361–372 of 404 articles