Instructions to use mlx-community/GLM-4.5V-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/GLM-4.5V-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir GLM-4.5V-8bit mlx-community/GLM-4.5V-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
Model not working in LM studio in apple m3 ultra 512 gb
#1
by Sidbb - opened
This is an LM Studio issue rather than an MLX_LM/MLX-VLM issue. LM Studio hasn’t yet added support for the glm4v_moe model type. Vision models generally take longer to get support than language-only models.
Also, as hehua2008 mentioned, the MLX-VLM commit for glm4v_moe is still in progress. I’d consider available quants as a hack rather than something stable. A little surprised it’s linked to MLX-community already.
