mattbucci
/

Devstral-24B-AWQ

4-bit precision

Model card Files Files and versions

Devstral-24B-AWQ

15.1 GB

Ctrl+K

Ctrl+K

1 contributor

History: 6 commits

mattbucci's picture

add quantization_config.ignore=['lm_head'] (downstream audit fix)

91382f5 verified 22 days ago

.gitattributes

1.57 kB
Devstral 24B AWQ: GPTQ-calibrated, BOS-fixed chat template, 37 tok/s on RDNA4 about 1 month ago
README.md

1.72 kB
Vision tested and working about 1 month ago
chat_template.jinja

5.32 kB
Devstral 24B AWQ: GPTQ-calibrated, BOS-fixed chat template, 37 tok/s on RDNA4 about 1 month ago
config.json

1.84 kB
add quantization_config.ignore=['lm_head'] (downstream audit fix) 22 days ago
generation_config.json

153 Bytes
Devstral 24B AWQ: GPTQ-calibrated, BOS-fixed chat template, 37 tok/s on RDNA4 about 1 month ago
model-vision.safetensors

878 MB
xet

Devstral 24B AWQ: GPTQ-calibrated, BOS-fixed chat template, 37 tok/s on RDNA4 about 1 month ago
model.safetensors

14.2 GB
xet

Devstral 24B AWQ: GPTQ-calibrated, BOS-fixed chat template, 37 tok/s on RDNA4 about 1 month ago
model.safetensors.index.json

96.4 kB
Devstral 24B AWQ: GPTQ-calibrated, BOS-fixed chat template, 37 tok/s on RDNA4 about 1 month ago
processor_config.json

976 Bytes
Devstral 24B AWQ: GPTQ-calibrated, BOS-fixed chat template, 37 tok/s on RDNA4 about 1 month ago
tokenizer.json

17.1 MB
xet

Devstral 24B AWQ: GPTQ-calibrated, BOS-fixed chat template, 37 tok/s on RDNA4 about 1 month ago
tokenizer_config.json

21.2 kB
Devstral 24B AWQ: GPTQ-calibrated, BOS-fixed chat template, 37 tok/s on RDNA4 about 1 month ago