ViratGarg
/

sparse-moe-Token-Choice

Model card Files Files and versions

sparse-moe-Token-Choice / README.md

ViratGarg's picture

Upload README.md with huggingface_hub

b191b81 verified 9 months ago

|

History Blame Contribute Delete

167 Bytes

Retrained MoE Model: Token-Choice

Model Configuration

Router Type: token_choice
Load Balancer: True
GQA Enabled: False
LoRA Used: False