decoderesearch/gemma-4-saes

Gemma-4 SAEs for use with the SAELens library

This repository contains the following SAEs:

Gemma-4-E2B

• gemma-4-e2b/btk-mat-layer-6-k-100
• gemma-4-e2b/btk-mat-layer-17-k-100
• gemma-4-e2b/btk-mat-layer-28-k-100

Gemma-4-E4B

• gemma-4-e4b/btk-mat-layer-7-k-100
• gemma-4-e4b/btk-mat-layer-21-k-100
• gemma-4-e4b/btk-mat-layer-35-k-100

Load these SAEs using SAELens as below:

from sae_lens import SAE

sae = SAE.from_pretrained("decoderesearch/gemma-4-saes", "<sae_id>")