llmat
/

Mistral-Small-Instruct-2409-NVFP4

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

Mistral-Small-Instruct-2409-NVFP4

13.1 GB

1 contributor

History: 4 commits

llmat's picture

Update README.md

2c7e516 verified 5 months ago

.gitattributes
220 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
README.md
1.53 kB

Update README.md 5 months ago
chat_template.jinja
3.96 kB

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
config.json
1.82 kB

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
generation_config.json
111 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
model-00001-of-00003.safetensors
4.95 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
model-00002-of-00003.safetensors
4.99 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
model-00003-of-00003.safetensors
3.15 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
model.safetensors.index.json
152 kB

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
recipe.yaml
130 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
special_tokens_map.json
551 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
tokenizer.json
3.67 MB

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
tokenizer.model
588 kB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago
tokenizer_config.json
137 kB

Add NVFP4 quantized model (llmcompressor oneshot). 5 months ago