9.11 GB
laolao77's picture
SGLang: pass --dtype bfloat16 in the launch command
3870482 verified