Retrieval & RAG
Chunking, hybrid search, reranking and debugging retrieval-augmented generation.
Topics
Seven areas of LLM system design. Pick one to see every article in it, or browse by tag.
Cost, Latency & Serving
Make LLM systems cheaper and faster: caching, routing, batching and GPU serving.
Agents & Tool Use
Reliable tool calling, agent loops, long-term memory and structured output.
Evaluation & Reliability
Eval suites, LLM-as-a-judge and keeping hallucinations in check.
Security & Privacy
Defend agents against prompt injection and keep personal data away from models.
Fine-tuning & Adaptation
When to fine-tune instead of prompting or RAG, and how to do it with LoRA.
Production Engineering
Streaming, tracing, safe rollbacks and running chat for millions of users.