Aquinlabs/gte-small-sae

gte-small SAEs (layers 0–11)

Sparse autoencoders for the embedding model thenlper/gte-small.

Layout

layer0_4096_top32/
  sae.pt
  meta.json
...
layer11_4096_top32/
  sae.pt
  meta.json
umap_points.json

Specs

Field	Value
Base model	thenlper/gte-small
Model type	sentence embedding encoder
Layers	0–11 (12 SAEs)
d_model	384
d_sae	4096
Activation	TopK (k=32)
Architecture	topk
Package size	~145 MiB

Files

• sae.pt — SAE checkpoint for that layer
• meta.json — layer metadata (model_slug, layer, d_model, d_sae, k, arch)
• umap_points.json — feature UMAP coordinates

License

This SAE release is under Apache License 2.0.

Acknowledgements

• Base model: thenlper/gte-small (MIT)