Tagged: Sparse autoencoders

Articles

• Interpretability · Part 7Interpretability

  Sparse Autoencoders: Pulling Features Out of a Model

  Train a sparse autoencoder on GPT-2 small on a laptop, compare it with public ones, then explore and score Gemma Scope features on Gemma 2 2B.

• Interpretability · Part 9Interpretability

  Steering With Activations: The Refusal Direction, Measured

  Find one direction that controls refusal in an open chat model, remove it and add it, measure the side effects, and compare SAE steering with a mean difference.

• Interpretability · Part 12Interpretability

  Limits and Open Problems in Interpretability

  The series in review: every part's headline result, a robustness audit of three of them, the field's sharpest critiques, and the problems still open.