Hugging Face's logo

J10Official
/
sparse-moe-Token-Choice

Model card Files
xet
Community
J10Official commited on
Commit
3ad262e
·
verified ·
1 Parent(s): f33f2c5

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ # Retrained MoE Model: Token-Choice
2
+
3
+ ## Model Configuration
4
+ - **Router Type**: token_choice
5
+ - **Load Balancer**: True
6
+ - **GQA Enabled**: False
7
+ - **LoRA Used**: False
8
+