Synthetic Model for SAE Training

This repository contains a SyntheticModel for use with SAELens.

Model Info

  • Number of features: 16,384
  • Hidden dimension: 768
  • Hierarchy: Yes
    • Root nodes: 42
    • Total nodes: 16384
    • Max depth: 3
  • Feature correlation: Yes (scale 0.1)

Usage

from sae_lens.synthetic import SyntheticModel

model = SyntheticModel.from_pretrained("chanind/synth-sae-bench-16k")
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support