TuKoResearch
/

AuriStream7BDeep_40Pred_BigAudioDataset_500k_20251209

AuriStream.AuriStream

Model card Files Files and versions

klemenk commited on Oct 30, 2025

Commit

41ea00f

·

verified ·

1 Parent(s): 150e231

Update config.json

Files changed (1) hide show

config.json +3 -3

config.json CHANGED Viewed

@@ -8,9 +8,9 @@
     "AutoModelForCausalLM": "modeling_auristream.AuriStream"
   },
   "vocab_size": 8192,
-  "n_embd": 1536,
-  "n_layer": 256,
-  "n_head": 24,
   "dropout": 0.0,
   "bias": false,
   "use_rope": true,

     "AutoModelForCausalLM": "modeling_auristream.AuriStream"
   },
   "vocab_size": 8192,
+  "n_head": 32,
+  "n_embd": 2560,
+  "n_layer": 96,
   "dropout": 0.0,
   "bias": false,
   "use_rope": true,