mncai
/

nf4moe

Mixture of Experts

Model card Files Files and versions

nf4moe / .gitattributes

Commit History

nf4moe writeup: QLoRA for a 743B fused-MoE (NF4 for 3D expert tensors)

3fb00d4
verified

dwmyoung commited on 24 days ago

initial commit

289f954
verified

dwmyoung commited on 24 days ago