Thanks. Could you make a new version using Unsloth's new fixed release?
#1
by
deleted
- opened
Have you had issues with the tool calling in this GLM 4.5 base version?
The one you posted is the 4.5 Air which I've run the lm studio community mlx and haven't noticed any issues. (The lm studio version does not have unsloth's template fixes)
Doh, my bad.
No, it was more wondering if a new fixed version would work better than the current 2bit MLXs of GLM 4.5 large.
Unsloth's 2bit GGUFs work well, but the current 2bit MLX versions fall apart.
Chatted with Nightmedia about it and it seems a limitation of MLX - which is apparently not as flexible as GGUF for fine grained mixed quants.
mrtoots
changed discussion status to
closed