lukealonso
/

GLM-4.6-NVFP4

8-bit precision

Model card Files Files and versions

lukealonso commited on Nov 3

Commit

efdc65e

·

verified ·

1 Parent(s): 635d308

Update README.md

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -6,9 +6,7 @@ base_model:
 modelopt NVFP4 quantized GLM-4.6
-Not tested extensively, use at your own risk.
-Tested on 4x RTX Pro 6000 Blackwell via:
 ```
  inference:
     image: vllm/vllm-openai:nightly

 modelopt NVFP4 quantized GLM-4.6
+Tested (but not extensively validated) on 4x RTX Pro 6000 Blackwell via:
 ```
  inference:
     image: vllm/vllm-openai:nightly