abir-hr196 commited on
Commit
877a4dc
·
verified ·
1 Parent(s): dfcd488

Add cfg.json to saes_sql_interp_bm2_cs1_experiment_4.3_syn=True/k=32

Browse files
saes_sql_interp_bm2_cs1_experiment_4.3_syn=True/k=32/model.layers.23.post_attention_layernorm/cfg.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"expansion_factor": 15, "normalize_decoder": true, "num_latents": 0, "k": 32, "multi_topk": false, "skip_connection": false, "d_in": 896}