Instructions to use anquachdev/hibiki-1b-mlx-q8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use anquachdev/hibiki-1b-mlx-q8 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir hibiki-1b-mlx-q8 anquachdev/hibiki-1b-mlx-q8
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
| { | |
| "source_lm": "hibiki-mlx-dc2cf5a5@80.safetensors", | |
| "source_lm_sha256": "2d1baa58b2003aef24a034cdec5bc8c6b4c6d14d0d50e530c42708e62e0b30d9", | |
| "quantized_lm": "hibiki-mlx-dc2cf5a5@80.q8.safetensors", | |
| "quantized_lm_sha256": "bf14583f05d046e412fb7c7f2b6e351d29af4911b76cbafd6fc91062e4505147", | |
| "mlx_version": "0.26.5", | |
| "quantization": { | |
| "format": "linear-v1", | |
| "target": "lm-linear", | |
| "bits": 8, | |
| "group_size": 64 | |
| } | |
| } | |