Model not working in LM studio in apple m3 ultra 512 gb
#1
by
Sidbb
- opened
This is an LM Studio issue rather than an MLX_LM/MLX-VLM issue. LM Studio hasn’t yet added support for the glm4v_moe model type. Vision models generally take longer to get support than language-only models.
Also, as hehua2008 mentioned, the MLX-VLM commit for glm4v_moe is still in progress. I’d consider available quants as a hack rather than something stable. A little surprised it’s linked to MLX-community already.
