Hugging Face's logo

brandonbeiler
/
InternVL3-8B-FP8-Dynamic

Image-Text-to-Text
Safetensors
English
Chinese
internvl_chat
fp8
quantization
dynamic
vision-language
multimodal
vLLM
llm-compressor
internvl3
conversational
custom_code
compressed-tensors
Model card Files
xet
 Community
InternVL3-8B-FP8-Dynamic
File size: 173 Bytes
b5c3e98
 
 
 
 
 
1
2
3
4
5
6
7
default_stage:
  default_modifiers:
    QuantizationModifier:
      targets: [Linear]
      ignore: ['re:.*lm_head', 're:.*vision.*', 're:mlp1.*']
      scheme: FP8_DYNAMIC