Tool parsing needs correct value in tokenizer_config.json
#3
by diggingAI - opened
Hi, Qwen uses XML tool calls. Thus "tool_parser_type": "json_tools" should be "qwen3_coder".
Huh that is interesting, the mlx conversion "simplified" the tokenizer_config :)
I'll fix them all
Okay, I updated this one, please confirm it is working fine with the updated config :)
It is working for me without all the extra in added_tokens_decoder. Just the change "json_tools" -> "qwen3_coder" did it for me. BTW, mlx-community had the same mistake in their first version and has fixed it by now.
Yeah I added everything like the original model card and added the json_tools that wasn’t there.
From what I understand the mlx embeds the token mapping but missed the tool setup
I updated all other quants. Thank you!