Tagged: Logit lens

Articles

• Interpretability · Part 2Interpretability

  The Residual Stream and the Logit Lens

  Decode a model's half-finished predictions layer by layer with the logit lens, train a tuned lens on a laptop, and see where the simple version breaks.