shaurya0
/

deepseek-nextn-random

Model card Files Files and versions

shaurya0 commited on Jan 8

Commit

c2425b9

·

verified ·

1 Parent(s): 54c48e3

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -74,7 +74,7 @@
   "pretraining_tp": 1,
   "problem_type": null,
   "pruned_heads": {},
-  "q_lora_rank": null,
   "qk_nope_head_dim": 128,
   "qk_rope_head_dim": 64,
   "quantization_config": {

   "pretraining_tp": 1,
   "problem_type": null,
   "pruned_heads": {},
+  "q_lora_rank": 1536,
   "qk_nope_head_dim": 128,
   "qk_rope_head_dim": 64,
   "quantization_config": {