Hugging Face's logo
tim-lawson 's Collections
Learning to Skip the Middle Layers of Transformers
Multi-Layer SAEs
Multi-Layer SAEs with Tuned Lens
Multi-Layer SAEs with Transformers
Multi-Layer SAEs with Tuned Lens and Transformers
Single-Layer SAEs
Single-Layer SAEs with Transformers
timkl

Single-Layer SAEs

TopK SAEs trained on the residual stream activation vectors from a single transformer layer.