Intel
/

Qwen2.5-1.5B-Instruct-int4-inc

Model card Files Files and versions

n1ck-guo commited on Oct 10, 2024

Commit

2ececcb

·

verified ·

1 Parent(s): 50abe4b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -124,7 +124,7 @@ python -m auto_round \
 --iter 1000 \
 --disable_eval \
 --model_dtype "float16" \
---deployment_device 'auto_round' \
 --output_dir "./tmp_autoround"
 ```

 --iter 1000 \
 --disable_eval \
 --model_dtype "float16" \
+--format 'auto_round' \
 --output_dir "./tmp_autoround"
 ```