Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
josephdowling10
/
Mixtral-8x7B-Instruct-v0.1-NVFP4
like
0
Text Generation
Transformers
Safetensors
mixtral
quantization
nvfp4
fp4
blackwell
tensorrt-llm
modelopt
Mixture of Experts
conversational
text-generation-inference
8-bit precision
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Mixtral-8x7B-Instruct-v0.1-NVFP4
26.7 GB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
josephdowling10
Upload NVFP4 quantized Mixtral 8x7B model
604ecd0
verified
5 months ago
.gitattributes
Safe
1.52 kB
initial commit
5 months ago
README.md
4.13 kB
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
chat_template.jinja
Safe
1.06 kB
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
config.json
2.89 kB
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
generation_config.json
Safe
111 Bytes
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
hf_quant_config.json
1.95 kB
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
model-00001-of-00006.safetensors
5 GB
xet
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
model-00002-of-00006.safetensors
5 GB
xet
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
model-00003-of-00006.safetensors
4.99 GB
xet
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
model-00004-of-00006.safetensors
5 GB
xet
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
model-00005-of-00006.safetensors
5 GB
xet
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
model-00006-of-00006.safetensors
1.67 GB
xet
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
model.safetensors.index.json
362 kB
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
quantization_metadata.json
498 Bytes
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
special_tokens_map.json
Safe
437 Bytes
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
tokenizer.json
Safe
3.51 MB
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago
tokenizer_config.json
Safe
1.03 kB
Upload NVFP4 quantized Mixtral 8x7B model
5 months ago