Synthetic Model for SAE Training
This repository contains a SyntheticModel for use with SAELens.
Model Info
- Number of features: 131,072
- Hidden dimension: 512
- Hierarchy: Yes
- Root nodes: 64
- Total nodes: 131072
- Max depth: 3
- Feature correlation: Yes (scale 0.2)
Usage
from sae_lens.synthetic import SyntheticModel
model = SyntheticModel.from_pretrained("chanind/synthetic-model-131k")
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support