Tagged: RAG

Articles

• Part 1Retrieval & RAG

  Designing a RAG System for 10 Million Documents

  How to size, build and measure retrieval-augmented generation over 10M documents: ingestion, hybrid retrieval, reranking, ACLs, cost and evals.

• Part 2Retrieval & RAG

  Debugging a RAG System That Gives Wrong Answers

  A stage-by-stage method for localizing RAG failures: build a replayable failure set, attribute each case to a stage, fix the biggest bucket, and gate on it.

• Part 3Retrieval & RAG

  Chunking Legal Contracts for Retrieval

  Why fixed-size chunks fail on contracts, and how to chunk by clause with context headers, defined terms, cross-references and amendment lineage.

• Part 4Retrieval & RAG

  BM25 vs Dense vs Hybrid Search: When to Use Each

  How lexical, dense, learned-sparse and late-interaction retrieval fail differently, how to fuse them with RRF, and how to choose on your own traffic.

• Part 14Evaluation & Reliability

  Detecting and Reducing LLM Hallucinations

  Separate hallucination types, detect them with claim-level verification and uncertainty signals, and reduce them without making the model useless.

• Part 19Fine-tuning & Adaptation

  Fine-Tuning vs RAG vs Prompting: An Eval-First Decision Procedure

  Diagnose whether your gap is knowledge or behavior, then climb from prompting to RAG to fine-tuning only when the cheaper rung plateaus.