EXAONE-4.0-1.2B-AWQ / recipe.yaml
MangoLab's picture
Add AWQ-quantized EXAONE-4.0-1.2B
3d9b4c3
raw
history blame contribute delete
144 Bytes
default_stage:
default_modifiers:
QuantizationModifier:
targets: [Linear]
ignore: [embed_tokens, lm_head]
scheme: W4A16