ig1
/

Qwen2.5-VL-7B-Instruct-NVFP4

Image-Text-to-Text

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

ig1sa commited on Oct 20, 2025

Commit

0973c46

·

verified ·

1 Parent(s): 6c555f8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -67,7 +67,7 @@ cat << EOF > nvfp4.patch
  processor.save_pretrained(SAVE_DIR)
 EOF
 ## Apply the patch
-patch qwen_2_5_vl_gptq.py -i .patch fp4.patch -o qwen_2_5_vl_nvfp4.py
 # Start the quantization
 python3 qwen_2_5_vl_nvfp4.py

  processor.save_pretrained(SAVE_DIR)
 EOF
 ## Apply the patch
+patch qwen_2_5_vl_gptq.py -i nvfp4.patch -o qwen_2_5_vl_nvfp4.py
 # Start the quantization
 python3 qwen_2_5_vl_nvfp4.py