Interpretability · Part 2Interpretability
The Residual Stream and the Logit Lens
Decode a model's half-finished predictions layer by layer with the logit lens, train a tuned lens on a laptop, and see where the simple version breaks.
Tagged: Tuned lens
1 article.