Tagged: Retrieval

Articles

• Part 1Retrieval & RAG

  Designing a RAG System for 10 Million Documents

  How to size, build and measure retrieval-augmented generation over 10M documents: ingestion, hybrid retrieval, reranking, ACLs, cost and evals.

• Part 3Retrieval & RAG

  Chunking Legal Contracts for Retrieval

  Why fixed-size chunks fail on contracts, and how to chunk by clause with context headers, defined terms, cross-references and amendment lineage.

• Part 4Retrieval & RAG

  BM25 vs Dense vs Hybrid Search: When to Use Each

  How lexical, dense, learned-sparse and late-interaction retrieval fail differently, how to fuse them with RRF, and how to choose on your own traffic.

• Part 5Retrieval & RAG

  Adding a Reranker and Proving It Helped

  How to add a cross-encoder reranker to a RAG pipeline, size it, and prove the gain with paired offline evals, end-to-end checks and a guarded A/B test.

• Part 12Agents & Tool Use

  Designing Long-Term Memory for an LLM Assistant

  A tiered memory design with explicit write, read and forgetting policies, plus the benchmarks and production signals that show it works.