ChrisMcCormick
/

SubspaceDecoder_mla192-96-192

shared_space_decoder

Model card Files Files and versions

ChrisMcCormick commited on Oct 3, 2025

Commit

b345064

·

verified ·

1 Parent(s): cd2099c

Fixed model type

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -18,7 +18,7 @@
   "kv_shared_dim": 96,
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 1024,
-  "model_type": "shared_subspace_decoder",
   "nope_dims": 32,
   "norm_type": "rmsnorm",
   "num_attention_heads": 12,

   "kv_shared_dim": 96,
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 1024,
+  "model_type": "shared_space_decoder",
   "nope_dims": 32,
   "norm_type": "rmsnorm",
   "num_attention_heads": 12,