GuidesOpenAI Node SDK Setup Against a Custom Base URL
Configure the official Node client for any OpenAI-compatible endpoint: retries, timeouts, abort signals, streaming, typed errors and the runtime traps in serverless.
ReadNotes on models, agents, and what inference costs
Practical writing for developers building with large language models — how they work, how to pick one, and how to keep the bill predictable.
Hands-on setup for the tools developers actually use.
Guides
GuidesOpenAI Python SDK Setup for Any Compatible Endpoint
Configure the official Python client against a custom base URL: retries, timeouts, async, streaming, tool calls and the error hierarchy you should be catching.
ReadGuidesopencode Setup Guide: Custom Providers in the Terminal
Configure opencode against your own OpenAI-compatible endpoint — the provider block, model naming, per-mode model choice, and how to verify tool calls work.
ReadGuidesPII in Prompts: How It Gets There and How to Get It Out
Personal data reaches model context through stack traces, fixtures and pasted tickets rather than through design. Detection, tokenisation and what to ask a vendor.
Read
GuidesPre-Commit Hooks That Call an LLM: Worth It or Not?
How to wire a model into a git pre-commit hook, which checks actually belong there, and the latency and cost budget that decides whether the team keeps it.
Read
GuidesPrompt Templates and Versioning: Treating Prompts as Code
Prompts drift, break silently and get edited in production. How to template them safely, version them properly and know which version produced which output.
ReadGuidesProxying LLM Traffic: What a Gateway Has to Get Right
Putting a gateway in front of an inference provider centralises keys, budgets and routing. Here is what breaks if you get streaming, headers or cancellation wrong.
ReadGuidesRedacting Secrets From Prompts Before They Leave Your Machine
Credentials reach model context through error output, config files and git history. Pre-send scanning, why gitignore is no defence, and rotating on suspicion.
ReadGuidesStreaming an OpenAI-Compatible API in TypeScript
Consuming SSE from a chat completions endpoint in TypeScript: reading the body stream, buffering partial frames, assembling tool-call deltas and cancelling cleanly.
Read
GuidesStreaming in Python: Reading SSE From an LLM API
Consume an OpenAI-compatible token stream in Python — the raw wire format, parsing data lines, partial chunks, tool-call deltas, timeouts and what buffering breaks.
ReadGuidesTimeout Tuning for LLM Calls: Picking Numbers That Hold
Connect, first-token and idle timeouts do different jobs. How to pick each from your own latency data, propagate deadlines, and avoid the default ten-minute wait.
ReadGuidesUsing an LLM for Database Schema Design, Carefully
A model will produce a plausible schema in seconds. Plausible is the problem. How to brief it with queries, review the parts it gets wrong, and keep migrations safe.
ReadShowing 37–48 of 77 articles