Interpretability · Part 3Interpretability
Linear Probes: Reading What a Model's Activations Encode
Train one-matrix classifiers on GPT-2 small and Qwen2.5-0.5B to read part of speech and truth from every layer, then check whether the probe did the work.