Synthetic Model for SAE Training
This repository contains a SyntheticModel for use with SAELens.
Model Info
- Number of features: 16,384
- Hidden dimension: 768
- Hierarchy: Yes
- Root nodes: 42
- Total nodes: 16384
- Max depth: 3
- Feature correlation: Yes (scale 0.1)
Usage
from sae_lens.synthetic import SyntheticModel
model = SyntheticModel.from_pretrained("chanind/synth-sae-bench-16k")
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support