Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
llmat
/
Mistral-Small-Instruct-2409-NVFP4
like
0
Text Generation
Safetensors
8 languages
mistral
fp4
vllm
conversational
8-bit precision
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
Mistral-Small-Instruct-2409-NVFP4
13.1 GB
Ctrl+K
Ctrl+K
1 contributor
History:
4 commits
llmat
Update README.md
2c7e516
verified
10 months ago
.gitattributes
Safe
220 Bytes
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
README.md
Safe
1.53 kB
Update README.md
10 months ago
chat_template.jinja
Safe
3.96 kB
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
config.json
Safe
1.82 kB
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
generation_config.json
Safe
111 Bytes
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
model-00001-of-00003.safetensors
Safe
4.95 GB
xet
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
model-00002-of-00003.safetensors
Safe
4.99 GB
xet
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
model-00003-of-00003.safetensors
Safe
3.15 GB
xet
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
model.safetensors.index.json
Safe
152 kB
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
recipe.yaml
Safe
130 Bytes
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
special_tokens_map.json
Safe
551 Bytes
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
tokenizer.json
Safe
3.67 MB
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
tokenizer.model
Safe
588 kB
xet
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago
tokenizer_config.json
Safe
137 kB
Add NVFP4 quantized model (llmcompressor oneshot).
10 months ago