RedHatAI
/

Qwen3-VL-32B-Instruct-FP8-dynamic

Text Generation

compressed-tensors

Model card Files Files and versions

Qwen3-VL-32B-Instruct-FP8-dynamic / recipe.yaml

krishnateja95's picture

Upload folder using huggingface_hub

a78b219 verified 5 months ago

history blame contribute delete

197 Bytes

	default_stage:
	default_modifiers:
	QuantizationModifier:
	targets: [Linear]
	ignore: ['re:.lm_head', 're:visual.', 're:model.visual.', 're:.mlp.gate$']
	scheme: FP8_DYNAMIC