llmat
/

Mistral-Small-Instruct-2409-NVFP4

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

Mistral-Small-Instruct-2409-NVFP4

13.1 GB

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

llmat's picture

Update README.md

2c7e516 verified 10 months ago

.gitattributes

220 Bytes
Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
README.md

1.53 kB
Update README.md 10 months ago
chat_template.jinja

3.96 kB
Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
config.json

1.82 kB
Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
generation_config.json

111 Bytes
Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
model-00001-of-00003.safetensors

4.95 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
model-00002-of-00003.safetensors

4.99 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
model-00003-of-00003.safetensors

3.15 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
model.safetensors.index.json

152 kB
Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
recipe.yaml

130 Bytes
Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
special_tokens_map.json

551 Bytes
Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
tokenizer.json

3.67 MB
Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
tokenizer.model

588 kB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago
tokenizer_config.json

137 kB
Add NVFP4 quantized model (llmcompressor oneshot). 10 months ago