Instructions to use splats/Mixtral-8x7B-Instruct-v0.1-mlx-6Bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use splats/Mixtral-8x7B-Instruct-v0.1-mlx-6Bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Mixtral-8x7B-Instruct-v0.1-mlx-6Bit splats/Mixtral-8x7B-Instruct-v0.1-mlx-6Bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Xet hash:
- 32726c94d96b1a5c442963faa3a900decf397fe67b5c530097a9f8b2506c63b6
- Size of remote file:
- 493 kB
- SHA256:
- dadfd56d766715c61d2ef780a525ab43b8e6da4de6865bda3d95fdef5e134055
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.