Instructions to use splats/Mixtral-8x22B-Instruct-v0.1-mlx-6Bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use splats/Mixtral-8x22B-Instruct-v0.1-mlx-6Bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Mixtral-8x22B-Instruct-v0.1-mlx-6Bit splats/Mixtral-8x22B-Instruct-v0.1-mlx-6Bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
Ctrl+K
- 1.52 kB
- 1.19 kB
- 3.96 kB
- 976 Bytes
- 116 Bytes
- 4.96 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 4.82 GB xet
- 5.35 GB xet
- 2.22 GB xet
- 138 kB
- 414 Bytes
- 3.67 MB
- 587 kB xet
- 137 kB