MLX
Collection
23 items โข Updated โข 1
How to use Open4bits/Mixtral-8x7B-Instruct-v0.1-mlx-4Bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download Open4bits/Mixtral-8x7B-Instruct-v0.1-mlx-4Bit --local-dir Mixtral-8x7B-Instruct-v0.1-mlx-4Bit
4-bit
Base model
mistralai/Mixtral-8x7B-v0.1