Fine-tuning & Adaptation

When to fine-tune instead of prompting or RAG, and how to do it with LoRA.

Part 19
Fine-Tuning vs RAG vs Prompting: An Eval-First Decision Procedure
Diagnose whether your gap is knowledge or behavior, then climb from prompting to RAG to fine-tuning only when the cheaper rung plateaus.
Part 20
Fine-Tuning a Small Model with LoRA on 5,000 Examples
A practical LoRA recipe for an 8B model on 5K examples: data hygiene, hyperparameters, a real GPU memory budget, and eval-driven checkpoint selection.

Articles