README.md

# Retrained MoE Model: Token-Choice

## Model Configuration
- **Router Type**: token_choice
- **Load Balancer**: True
- **GQA Enabled**: False
- **LoRA Used**: False