Instructions to use poolside/Laguna-S-2.1-NVFP4-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use poolside/Laguna-S-2.1-NVFP4-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Laguna-S-2.1-NVFP4-mlx poolside/Laguna-S-2.1-NVFP4-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
LM STUDIO mlx version not working
#2
by Dimijazz - opened
I tried to use it with LM Studio, but it's not working. I get an error. When will be fixed?
That's not on the model creator to fix, it's on you or LM Studio.