27 days ago
-
fix: declare NextN (MTP) layer 45 as BF16 in quantization ignore lists (#11)

shengliangx +1: lucifer1004 - Declare NextN layer 45 as BF16 in quantization ignore lists (f647c0c8188501ead3d0cd7fbc65621b57a84be5)
Co-authored-by: Gabriel Wu <lucifer1004@users.noreply.huggingface.co>
-
Add SGLang serving instructions (#5)

zhiyucheng +1: sh-25 - Add SGLang serving instructions (cb0525658c313dc9b686fdbaed4d526cb8fe317e)
Co-authored-by: yeh <sh-25@users.noreply.huggingface.co>
-
Update README.md
-
Update README.md
-
Update README.md
-
Create README.md
-
GLM-5.3-Flash-NVFP4 (NVFP4 routed experts + dense MLP, FP8 KV cache)