Hugging Face's logo

Open4bits
/
Mixtral-8x7B-Instruct-v0.1-mlx-4Bit

Safetensors
MLX
vllm
mixtral
4-bit precision
Model card Files
xet
Community
README.md exists but content is empty.
Downloads last month
44
Safetensors
Model size
47B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Open4bits/Mixtral-8x7B-Instruct-v0.1-mlx-4Bit

Base model

mistralai/Mixtral-8x7B-v0.1
Finetuned
mistralai/Mixtral-8x7B-Instruct-v0.1
Quantized
(44)
this model

Collection including Open4bits/Mixtral-8x7B-Instruct-v0.1-mlx-4Bit