amd
/

DeepSeek-R1-MXFP4

8-bit precision

Model card Files Files and versions

linzhao-amd commited on Nov 6, 2025

Commit

7f771af

·

verified ·

1 Parent(s): 340b5ac

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -42,7 +42,7 @@ python3 quantize_quark.py --model_dir $MODEL_DIR \
                           --num_calib_data 128 \
                           --exclude_layers "lm_head" \
                           --skip_evaluation \
-                          --multi_gpu  \
                           --model_export hf_format \
                           --output_dir amd/DeepSeek-R1-MXFP4-Preview
 ```

                           --num_calib_data 128 \
                           --exclude_layers "lm_head" \
                           --skip_evaluation \
+                          --multi_device  \
                           --model_export hf_format \
                           --output_dir amd/DeepSeek-R1-MXFP4-Preview
 ```