File size: 143 Bytes
15f7b69 | 1 2 3 4 5 6 7 | DEFAULT_stage:
DEFAULT_modifiers:
QuantizationModifier:
ignore: ['re:.*lm_head']
targets: [Linear]
scheme: FP8_DYNAMIC
|
15f7b69 | 1 2 3 4 5 6 7 | DEFAULT_stage:
DEFAULT_modifiers:
QuantizationModifier:
ignore: ['re:.*lm_head']
targets: [Linear]
scheme: FP8_DYNAMIC
|