8.88 GB
laolao77's picture
SGLang: pass --dtype bfloat16 in the launch command
4e526ff verified