Instructions to use anquachdev/hibiki-1b-mlx-q4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use anquachdev/hibiki-1b-mlx-q4 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir hibiki-1b-mlx-q4 anquachdev/hibiki-1b-mlx-q4
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
File size: 440 Bytes
5e64302 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 | {
"source_lm": "hibiki-mlx-dc2cf5a5@80.safetensors",
"source_lm_sha256": "2d1baa58b2003aef24a034cdec5bc8c6b4c6d14d0d50e530c42708e62e0b30d9",
"quantized_lm": "hibiki-mlx-dc2cf5a5@80.q4.safetensors",
"quantized_lm_sha256": "41795cb599f976c4d7b4cb40e38a255ad8e00e8f127d4d8638a2902b27c4a965",
"mlx_version": "0.26.5",
"quantization": {
"format": "linear-v1",
"target": "lm-linear",
"bits": 4,
"group_size": 32
}
}
|