Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Mixtral-8x7B-v0.1-quantized.w4a16
like
0
Follow
Red Hat AI
1.89k
Safetensors
English
mixtral
Mixture of Experts
w4a16
int4
vllm
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
Mixtral-8x7B-v0.1-quantized.w4a16
24.5 GB
2 contributors
History:
3 commits
nm-research
Add recipe.yaml
4cabe12
verified
12 months ago
.gitattributes
1.52 kB
initial commit
about 1 year ago
README.md
7.48 kB
add model
about 1 year ago
config.json
54.1 kB
add model
about 1 year ago
generation_config.json
111 Bytes
add model
about 1 year ago
model-00001-of-00005.safetensors
4.99 GB
xet
add model
about 1 year ago
model-00002-of-00005.safetensors
4.97 GB
xet
add model
about 1 year ago
model-00003-of-00005.safetensors
5 GB
xet
add model
about 1 year ago
model-00004-of-00005.safetensors
5 GB
xet
add model
about 1 year ago
model-00005-of-00005.safetensors
4.52 GB
xet
add model
about 1 year ago
model.safetensors.index.json
278 kB
add model
about 1 year ago
recipe.yaml
364 Bytes
Add recipe.yaml
12 months ago
special_tokens_map.json
414 Bytes
add model
about 1 year ago
tokenizer.json
3.51 MB
add model
about 1 year ago
tokenizer_config.json
995 Bytes
add model
about 1 year ago
