TuKoResearch
/

AuriStream200M_100Pred_librilight_200k

AuriStream.AuriStream

Model card Files Files and versions

klemenk commited on Jul 9, 2025

Commit

403b3be

·

verified ·

1 Parent(s): 43f6808

Update config.json

Files changed (1) hide show

config.json +3 -3

config.json CHANGED Viewed

@@ -8,9 +8,9 @@
     "AutoModelForCausalLM": "modeling_auristream.AuriStream"
   },
   "vocab_size": 8192,
-  "n_embd": 768,
-  "n_layer": 12,
-  "n_head": 12,
   "dropout": 0.0,
   "bias": false,
   "use_rope": false,

     "AutoModelForCausalLM": "modeling_auristream.AuriStream"
   },
   "vocab_size": 8192,
+  "n_embd": 1024,
+  "n_layer": 16,
+  "n_head": 16,
   "dropout": 0.0,
   "bias": false,
   "use_rope": false,