qoranet
/

QORA-LLM-3B

Model card Files Files and versions

drdraq commited on Feb 28

Commit

d1b4b0e

·

verified ·

1 Parent(s): 646154c

Update config.json

Files changed (1) hide show

config.json +2 -1

config.json CHANGED Viewed

@@ -17,5 +17,6 @@
   "no_rope_layer_interval": 4,
   "bos_token_id": 128000,
   "eos_token_id": 128012,
-  "hidden_act": "silu"
 }

   "no_rope_layer_interval": 4,
   "bos_token_id": 128000,
   "eos_token_id": 128012,
+  "hidden_act": "silu",
+  "no_rope_layers": []
 }