nf4moe writeup: QLoRA for a 743B fused-MoE (NF4 for 3D expert tensors)

3fb00d4

verified

dwmyoung commited on 20 days ago