tylercosgrove
/

mistral-7b-sparse-autoencoder-layer16

Model card Files Files and versions

tylercosgrove commited on Aug 7, 2024

Commit

f195ce4

·

verified ·

1 Parent(s): 1eab1f3

fix hook_name

Files changed (1) hide show

cfg.json +1 -1

cfg.json CHANGED Viewed

@@ -10,7 +10,7 @@
   "dtype": "float32",
   "context_size": 256,
   "model_name": "mistral-7b-instruct",
-  "hook_name": "blocks.16.hook_resid_pre",
   "hook_layer": 16,
   "hook_head_index": null,
   "prepend_bos": false,

   "dtype": "float32",
   "context_size": 256,
   "model_name": "mistral-7b-instruct",
+  "hook_name": "blocks.16.hook_mlp_out",
   "hook_layer": 16,
   "hook_head_index": null,
   "prepend_bos": false,