Instructions to use anquachdev/hibiki-1b-mlx-q8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use anquachdev/hibiki-1b-mlx-q8 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir hibiki-1b-mlx-q8 anquachdev/hibiki-1b-mlx-q8
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
File size: 440 Bytes
2ba65cf | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 | {
"source_lm": "hibiki-mlx-dc2cf5a5@80.safetensors",
"source_lm_sha256": "2d1baa58b2003aef24a034cdec5bc8c6b4c6d14d0d50e530c42708e62e0b30d9",
"quantized_lm": "hibiki-mlx-dc2cf5a5@80.q8.safetensors",
"quantized_lm_sha256": "bf14583f05d046e412fb7c7f2b6e351d29af4911b76cbafd6fc91062e4505147",
"mlx_version": "0.26.5",
"quantization": {
"format": "linear-v1",
"target": "lm-linear",
"bits": 8,
"group_size": 64
}
}
|