Tagged: Vector search

Articles

• Part 1Retrieval & RAG

  Designing a RAG System for 10 Million Documents

  How to size, build and measure retrieval-augmented generation over 10M documents: ingestion, hybrid retrieval, reranking, ACLs, cost and evals.

• Part 4Retrieval & RAG

  BM25 vs Dense vs Hybrid Search: When to Use Each

  How lexical, dense, learned-sparse and late-interaction retrieval fail differently, how to fuse them with RRF, and how to choose on your own traffic.

• Part 8Cost, Latency & Serving

  Designing a Semantic Cache with Hit-Rate Tracking

  A layered semantic cache for LLM responses: scoped keys, tuned thresholds, borderline verification, invalidation, and false-hit-aware hit-rate metrics.