Hugging Face's logo

Open4bits
/
Mixtral-8x7B-Instruct-v0.1-mlx-4Bit

Safetensors
MLX
vllm
mixtral
4-bit precision
Model card Files
xet
 Community
How to use from the
Use from the
MLX library
# Download the model from the Hub
pip install huggingface_hub[hf_xet]

huggingface-cli download --local-dir Mixtral-8x7B-Instruct-v0.1-mlx-4Bit Open4bits/Mixtral-8x7B-Instruct-v0.1-mlx-4Bit
README.md exists but content is empty.
Downloads last month
143
Safetensors
Model size
47B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Open4bits/Mixtral-8x7B-Instruct-v0.1-mlx-4Bit

Base model

mistralai/Mixtral-8x7B-v0.1
Finetuned
mistralai/Mixtral-8x7B-Instruct-v0.1
Quantized
(49)
this model

Collection including Open4bits/Mixtral-8x7B-Instruct-v0.1-mlx-4Bit