Instructions to use mlx-community/firefunction-v2-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/firefunction-v2-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/firefunction-v2-4bit --local-dir firefunction-v2-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload folder using huggingface_hub (#1)
Verified signature- 867cde3d8a4e43d7752bf0820278a6952478771b3081f194033d77397bbeffa1 (e2aa1e70e1e9a3eb4d96c6ffdac65f43075b58bc) - 49c7bada5fcb9b10e5600440b1524994b22a6e58a90caee2ca850009e8d89def (356b4d7e8d2f8c3aa54384f159bd03ed8abfbeb5) - 8135d81e97c35272e50ad0e6898fc1eb829341a17c176c98e13d8b3ed019cb98 (4d0b614f07591f9f6687a8b13c17dbe8853eeef0) - 1fd7f121700a28cab50461b5de9da769fc89bf10e6deb8ce2528a7744e2853cb (966da587055f4efab38404c6abd269642160ad89) - c04b70be13bb04c0b494c5234b458b46e24c9f71867a77de655bc85a9f6940b9 (08183fcfdd76ee95ab78b04b0303ef233b07bc3c) - 5b7be22af2153baacac8681ba482562d365ddfacde9fe8e2a2381fd46ca164a2 (e0d084c465599e4027218d1d7ead361aee1d080c) - 86eb4668aa91cb5ff9f82f0df41ceefee6a925dcebe4de09f0dd9290e7f2c1d9 (bd1e998c7b8c6595f3ecf0f295e4ac3911894c50) - 217b5863720470d9b481ea8cd5c870fec711f46588a8f9dd20eb81e2701a10d0 (3c0cef8133adf69207237a695a6d06c24cca3b4f) - f2dcb0787892dbcab0e13cabc822f6e0c38888f9d12c1f149450ffeba10f56fc (308aa233dd67d83ef366899fc916abc5ecf9b1b2)edd3063
-
initial commit
Verified signaturef2eec85