No difference with base model (for me)...
IIt suffers of exactly the same major issue as Qwen3.6 35b, making it impossible to use for development, every time you tell something like "There's a bug on line X, can you fix it?", it does this:
Think: The user says there's a bug on line X, I'll fix it.
Assistant: Okay, I'll fix the issue.
Tool: Fix (correct, it actually fixed the issue).
Think: The user is reporting an issue on line X again, I'll fix it.
Assistant: No problem, I'm fixing that.
Tool: Yet another fix that breaks everything.
Think: The user is reporting an issue.
Assistant: I'll rewrite the entire script.
Tool: Yet another fix that breaks things even more.
...
This can go on for a very long time, until eventually nothing works anymore or it has rewritten the entire script...
I can't understand why, during multi-turn conversations, it seems unable to see that it has already answered, instead of stopping after the tool execution, it starts all over again as if I were repeating the last thing I said...
I've FP8 KVCache and that : {"temperature":0.7,"top_p":0.95,"top_k":20,"min_p":0.0,"presence_penalty":1.5,"repetition_penalty":1.00,"max_tokens":81920}
Only 60k was used
Harness : VSCode Copilot
You should use a custom chat template (https://huggingface.co/froggeric/Qwen-Fixed-Chat-Templates/blob/main/chat_template.jinja) for every Qwen-derived model
I was already using a fixed template but not this one, I've tested this one but it's worse now sometime it says "I forgot to include the filePath in the multi_replace_string_in_file tool call. Let me fix that", "I need to use the correct tool. Let me use the replace_string_in_file tool with the correct parameters." 2 times in a row... And when I ask to fix something he thinks, fix the issue, review the file (it's good) but after he says "I see, there's duplicate lines let me fix it" but there's not duplicate lines, when I ask where he sees that he re-read the file and says "You've right the file is correct now, the issue you mentioned is probably in the CSS" and come back to an other fix I didn't ask because he already fixed the issue...
It's as if there was a big issue in the kv cache, half the informations are forgotten between each turn ...
Resume :
User : There is an issue on the key alignments
Assistant : I see the problem, I fix
Tool : Error
Think : I forgot to include the filePath in the multi_replace_string_in_file tool call. Let me fix that.
Tool : Error
Think : I need to use the correct tool. Let me use the replace_string_in_file tool with the correct parameters.
Tool : Update file
Think : Let me verify the changes by reading the updated HTML file to make sure everything is correct.
Tool : Read file
Think : I see the problem - there are duplicate rows. The rows for 1, 2, 3 are duplicated and the 4, 5, 6 row is missing. Let me check the full file. <--- WRONG THERE'S NO DUPLICATE LINES
Assistant : There're duplicates lines
Tool : Create file
Think : I need to use the replace_string_in_file tool to fix the duplicated rows. Let me read the full file first to see what's there.
Tool : Read file
Think : The HTML looks correct now. Let me check the CSS for the syntax error I fixed.
Tool : Read file
Think : I see the issue now. The HTML file has duplicate rows. Let me check the full HTML and fix it properly. I need to remove the duplicate rows and fix the structure.
Assistant : I see there're duplicate lines, let me fix it
[STOPPED]
User : Where do you see duplicate lines ?
Tool : Read file <-- Why again ???
Think : Looking at the HTML file, I can see the current structure, let me check if there are any duplicate rows....
Assistant : You're right, the HTML file is correct now, the alignment issues that you mentionned is probably bacause of the CSS file, let me check that :
[STOPPED]