GuidesGitHub Actions LLM Setup: A Workflow That Reviews PRs
A working GitHub Actions job that calls an OpenAI-compatible model on pull requests — repository secrets, timeouts, rate limits, PR comments and cost control.
ReadNotes on models, agents, and what inference costs
Practical writing for developers building with large language models — how they work, how to pick one, and how to keep the bill predictable.
Guides
GuidesGitLab CI LLM Setup: Masked Variables and MR-Only Jobs
A GitLab CI job that calls an OpenAI-compatible model on merge requests — masked variables, rules, artifacts versus MR notes, runner choice and cost control.
Read
ModelsGLM-5.2 vs DeepSeek V4 Flash: Ten Times the Price
Both are MIT-licensed with 1M context, but one costs ten times the other. Where the expensive model earns the gap, and where the cheap one quietly wins.
Read
ModelsGLM-5.2 vs MiniMax M3: Long-Horizon Code or Cheap Multimodal
Both ship 1M context and target coding. GLM-5.2 is built for unattended agent runs; M3 is multimodal and cheaper. Which one your workload actually needs.
Read
ModelsGLM-5.2 vs Qwen 3.6: Sparse and Huge, or Dense and Small
Both are permissively licensed and strong at code. One is a 744B mixture-of-experts, the other a dense 27B on a single GPU. The architecture is the decision.
Read
GuidesGoose Setup Guide: Providers, Extensions and Safe Defaults
Configure Goose against a custom OpenAI-compatible endpoint, understand what its extensions cost you per request, and set approvals you can live with.
Read
FundamentalsGPU Memory for Inference: What Actually Fills the Card
Weights are only the first line of the memory budget. Where the rest goes, why concurrency runs out before compute does, and how to size a deployment.
Read
Cost & PricingGPU Rental Cost Math: Utilisation Decides Everything
A rented accelerator bills by the hour whether or not you use it. How to work out effective cost per token from your own traffic shape.
Read
FundamentalsGrouped-Query Attention: Why Long Context Got Affordable
GQA shrinks the KV cache by sharing keys and values across query heads. What it costs in quality, and why it is on the spec sheet of nearly every model.
ReadGuidesHandling SSE Disconnects Without Losing the Response
Streamed completions fail silently after a 200. How to detect a truncated SSE stream, set idle timeouts, survive proxy hops, and decide when a retry is safe.
Read
ModelsHow to Read a Model Card Without Being Misled
Model cards mix hard facts, marketing and careful omissions. Which fields are reliable, which need checking, and what an absent section tells you.
Read
AI AgentsIdempotency in Agent Actions: Safe to Repeat by Design
Agents retry, resume and duplicate calls constantly. Idempotency keys, natural keys and check-then-act patterns that stop one action happening three times.
ReadShowing 457–468 of 731 articles