Instructions to use anquachdev/hibiki-1b-mlx-q4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use anquachdev/hibiki-1b-mlx-q4 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir hibiki-1b-mlx-q4 anquachdev/hibiki-1b-mlx-q4
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
| { | |
| "source_lm": "hibiki-mlx-dc2cf5a5@80.safetensors", | |
| "source_lm_sha256": "2d1baa58b2003aef24a034cdec5bc8c6b4c6d14d0d50e530c42708e62e0b30d9", | |
| "quantized_lm": "hibiki-mlx-dc2cf5a5@80.q4.safetensors", | |
| "quantized_lm_sha256": "41795cb599f976c4d7b4cb40e38a255ad8e00e8f127d4d8638a2902b27c4a965", | |
| "mlx_version": "0.26.5", | |
| "quantization": { | |
| "format": "linear-v1", | |
| "target": "lm-linear", | |
| "bits": 4, | |
| "group_size": 32 | |
| } | |
| } | |