YGV
/

The_Dirt_V1.1_Merged_4bit

Model card Files Files and versions

YGV commited on 11 days ago

Commit

351925a

·

verified ·

1 Parent(s): 33bf8b8

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -4,7 +4,7 @@
   ],
   "model_type": "qwen2",
   "num_attention_heads": 40,
-  "num_hidden_layers": 40,
   "hidden_size": 5120,
   "intermediate_size": 13696,
   "max_position_embeddings": 32768,

   ],
   "model_type": "qwen2",
   "num_attention_heads": 40,
+  "num_hidden_layers": 39,
   "hidden_size": 5120,
   "intermediate_size": 13696,
   "max_position_embeddings": 32768,