Synthetic Model for SAE Training

This repository contains a SyntheticModel for use with SAELens.

Model Info

  • Number of features: 131,072
  • Hidden dimension: 512
  • Hierarchy: Yes
    • Root nodes: 64
    • Total nodes: 131072
    • Max depth: 3
  • Feature correlation: Yes (scale 0.2)

Usage

from sae_lens.synthetic import SyntheticModel

model = SyntheticModel.from_pretrained("chanind/synthetic-model-131k")
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support