CLIP_TopKSAE / config.json
Mayfull's picture
Training in progress, step 178
2fe2553 verified
{
"architectures": [
"TopKSAE"
],
"dtype": "float32",
"expansion_factor": 16,
"hidden_size": 768,
"k": 32,
"latent_size": 0,
"model_type": "topk_sae",
"multi_topk": false,
"normalize_decoder": true,
"transformers_version": "4.57.6"
}