- 1M3
- 665K36
- Full_competesmoev30
- Full_new_smoe_sigmoidgating
- Full_remoe
- Full_smoe
- Full_smoe_share
- Full_smoe_tcmoe
- Full_xmoe
- hyperrouter
- revise_Full_smoe_perturbed
- revise_Full_smoe_plus_plus
- revise_Full_smoe_sigmoidgating
- revise_Full_smoe_tcmoe
- shared_expert_665k_llava
- shared_experted_norm
- smoe
- smoe_cosinegating
- smoe_perturbed
- smoe_refine_665k_llava
- smoe_refinev2_665k_llava
- smoe_refinev3_665k_llava
- smoe_sigmoidgating
- smoe_sigmoidgating_665k_llava
- smoe_vcr
- xmoe_665k_llava