GuidesPII in Prompts: How It Gets There and How to Get It Out
Personal data reaches model context through stack traces, fixtures and pasted tickets rather than through design. Detection, tokenisation and what to ask a vendor.
ReadNotes on models, agents, and what inference costs
Practical writing for developers building with large language models — how they work, how to pick one, and how to keep the bill predictable.
Guides
ModelsPinning Model Versions: Why Aliases Break Production Quietly
A stable model alias can point at different weights over time. How that breaks tuned prompts without any error, and what to pin instead.
Read
FundamentalsPlanning Storage for Self-Hosted Model Weights
How to size disk for open-weight models: what drives checkpoint size, why quantisations and versions multiply it, and why storage is rarely the real constraint.
ReadFundamentalsPositional Encoding: How a Transformer Knows Token Order
Attention is order-blind by default. How position gets injected, why the method decides how far context can stretch, and what you see when it fails.
Read
GuidesPre-Commit Hooks That Call an LLM: Worth It or Not?
How to wire a model into a git pre-commit hook, which checks actually belong there, and the latency and cost budget that decides whether the team keeps it.
Read
Cost & PricingPrepaid vs Postpaid AI Billing: Credits or an Invoice
Prepaid credits cap your downside and expire. Postpaid invoices never block work and arrive after the damage. How to pick when usage is unpredictable.
Read
FundamentalsPretraining vs Post-Training: Where a Model Gets Its Behaviour
Pretraining decides what a model knows. Post-training decides how it behaves. Knowing which stage owns a problem tells you whether prompting can fix it.
ReadCost & PricingPrompt Caching Savings: The Arithmetic Nobody Runs
Cached input is priced far below uncached input. Working out what that is worth for your workload, and what prompt structure it demands.
Read
AI AgentsPrompt Regression Testing: A CI Gate for Fuzzy Output
Prompt edits regress silently and every score is noisy. How to build a golden set, pick a scorer, handle variance and gate merges without a permanently red build.
Read
GuidesPrompt Templates and Versioning: Treating Prompts as Code
Prompts drift, break silently and get edited in production. How to template them safely, version them properly and know which version produced which output.
Read
GuidesProxying LLM Traffic: What a Gateway Has to Get Right
Putting a gateway in front of an inference provider centralises keys, budgets and routing. Here is what breaks if you get streaming, headers or cancellation wrong.
Read
Cost & PricingQuantization Cost Savings and the Quality You Trade Away
Lower precision cuts memory and raises throughput, which is what makes single-GPU hosting possible. What it costs in quality is not evenly distributed.
ReadShowing 529–540 of 731 articles