nvidia

/

GLM-5.3-Flash-NVFP4

like 43

Follow

NVIDIA 68k

Adds SGLang as a supported runtime and documents the high-throughput aggregated TP4 serving command from the GLM-5.3-Flash cookbook.

Validation:

• SGLang 0.0.0.dev1+g008403017 on 4x NVIDIA GB300 GPUs
• High-throughput: full GSM8K test split, 1319/1319 examples, 97.19% accuracy, 0 request errors
• Low-latency adaptive EAGLE: full GSM8K test split, 1319/1319 examples, 96.66% accuracy, 0 request errors

This PR intentionally documents the high-throughput command. Addresses discussion #2.