Hugging Face's logo

ig1
/
Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Image-Text-to-Text
Transformers
Safetensors
English
qwen2_5_vl
image-to-text
multimodal
conversational
text-generation-inference
compressed-tensors
Model card Files
xet
Community
hekmon commited on
Commit
ea2371f
·
verified ·
1 Parent(s): 88c691b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -8,4 +8,6 @@ tags:
8
  library_name: transformers
9
  base_model:
10
  - Qwen/Qwen2.5-VL-7B-Instruct
11
- ---
 
 
 
8
  library_name: transformers
9
  base_model:
10
  - Qwen/Qwen2.5-VL-7B-Instruct
11
+ ---
12
+
13
+ [FP8 activation quantization](https://github.com/vllm-project/llm-compressor/tree/main/examples/quantization_w8a8_fp8) performed with [llm-compressor](https://github.com/vllm-project/llm-compressor)