JBlock SAEs

davidquarel 's Collections

shk_FINAL

gpt2 SAEs

residmid-residpost

residpre-residpost

mlpin-mlpout

staircase SAEs

JBlock SAEs

jsae_xavier (mlpin -> mlpout)

jsae shakespeare 64x4 max_steps=20k (mlpin -> mlpout)

jsae shakespeare 64x4 V2

jsae shakespeare_64x4

mlp topk SAEs shakespeare_64x4

topk shakespeare_64x4

Shakespeare 64x4 SAEs

SPAR SAEs

SPAR models

updated Jul 17

Pairs of Jacobian SAEs, 8 in total. Each pair is placed across the MLP blocks, one on resid_mid, one on resid_post. Uses DyT

Upvote

davidquarel/jblock.shk_64x4-sparse-1.0e-01

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.0e-02

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.0e-03

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.0e-04

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.0e-05

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.0e-06

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.5e-01

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.5e-02

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.5e-03

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.5e-04

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.5e-05

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-1.5e-06

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-2.2e-01

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-2.2e-02

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-0.0ep00

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-2.2e-03

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-2.2e-04

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-2.2e-05

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-2.2e-06

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-3.3e-01

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-3.3e-02

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-3.3e-03

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-3.3e-04

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-3.3e-05

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-3.3e-06

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-4.7e-01

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-4.7e-02

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-4.7e-03

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-4.7e-04

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-4.7e-05

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-4.7e-06

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-6.8e-01

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-6.8e-02

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-6.8e-03

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-6.8e-04

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-6.8e-05

216k • Updated May 9
davidquarel/jblock.shk_64x4-sparse-6.8e-06

216k • Updated May 9

Upvote

Collection guide
Browse collections