shanjiaz
/

w8a8-quantization-enabled

8-bit precision

compressed-tensors

Model card Files Files and versions

w8a8-quantization-enabled / recipe.yaml

shanjiaz's picture

Upload folder using huggingface_hub

0e3adb6 verified 12 months ago

History Blame Contribute Delete

129 Bytes

	default_stage:
	default_modifiers:
	QuantizationModifier:
	targets: [Linear]
	ignore: [lm_head]
	scheme: W8A8