YuanLabAI
/

Yuan3.0-Flash

Model card Files Files and versions

Yuan-lab commited on Apr 7

Commit

0acfc1a

·

verified ·

1 Parent(s): 13af5f3

Update config.json

Files changed (1) hide show

config.json +1 -0

config.json CHANGED Viewed

@@ -82,6 +82,7 @@
         "max_position_embeddings": 131072,
         "model_max_length": 131072,
         "model_type": "yuan",
         "ffn_hidden_size": 8192,
         "moe_config": {
             "moe_num_experts": 32,

         "max_position_embeddings": 131072,
         "model_max_length": 131072,
         "model_type": "yuan",
+        "moe_num_experts": 32,
         "ffn_hidden_size": 8192,
         "moe_config": {
             "moe_num_experts": 32,