Won't load in LM Studio
#2
by DiscoStew - opened
I was able to get https://huggingface.co/mlx-community/DeepSeek-V3.2-4bit working by removing "tokenizer_type": "deepseek_v32" from tokenizer_config.json. I also changed the Jinja template and uploaded it here: https://lmstudio.ai/discostew/deepseek-v3.2 I’ll file a bug with the issue loading it with mlx-lm 0.30.1 https://github.com/lmstudio-ai/lmstudio-bug-tracker/issues/1352