llmat
/

Mistral-Small-24B-Instruct-2501-NVFP4

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

Mistral-Small-24B-Instruct-2501-NVFP4

15.2 GB

Ctrl+K

Ctrl+K

1 contributor

History: 5 commits

llmat's picture

Update README.md

d2b08cb verified 11 months ago

.gitattributes

271 Bytes
Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
README.md

1.61 kB
Update README.md 11 months ago
chat_template.jinja

1.6 kB
Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
config.json

1.82 kB
Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
generation_config.json

155 Bytes
Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
model-00001-of-00004.safetensors

5 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
model-00002-of-00004.safetensors

4.99 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
model-00003-of-00004.safetensors

3.86 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
model-00004-of-00004.safetensors

1.34 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
model.safetensors.index.json

109 kB
Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
recipe.yaml

130 Bytes
Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
special_tokens_map.json

21.3 kB
Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
tokenizer.json

17.1 MB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago
tokenizer_config.json

198 kB
Add NVFP4 quantized model (llmcompressor oneshot). 11 months ago