Instructions to use typealias/llm-compiler-7b-ftd-mlx-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use typealias/llm-compiler-7b-ftd-mlx-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download typealias/llm-compiler-7b-ftd-mlx-8bit --local-dir llm-compiler-7b-ftd-mlx-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload folder using huggingface_hub (#1)
Verified signature- 9856a446eaae4d7e603f4ef31e4b554ac34d92b533a6582f46d6e91a0ef58f72 (76d6c9e09f4667b8af567171e3a69a1f482a95fc) - 53f28281b96e8efcc2e08a8e7d7314854125615172892219ac7f1d6bcd181fad (f79979b990047b1f20936af15ec2af9c86beea4d)07b9dc6 -
initial commit
Verified signature55dc8a7