Hugging Face's logo

J10Official
/
sparse-moe-Token-Choice-NoLB

Model card Files
xet
Community
J10Official commited on
Commit
791dd6e
·
verified ·
1 Parent(s): 431544c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ # Retrained MoE Model: Token-Choice-NoLB
2
+
3
+ ## Model Configuration
4
+ - **Router Type**: token_choice
5
+ - **Load Balancer**: False
6
+ - **GQA Enabled**: False
7
+ - **LoRA Used**: False
8
+