enable_thinking=False doesn't work

#2
by color-rabbit - opened

enable_thinking=False

We provide a hard switch to strictly disable the model's thinking behavior, aligning its functionality with the previous Qwen2.5-Instruct models. This mode is particularly useful in scenarios where disabling thinking is essential for enhancing efficiency.

text = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True,
enable_thinking=False # Setting enable_thinking=False disables thinking mode
)

In this mode, the model will not generate any think content and will not include a ... block.

I tried, the block ... still exists.

hi, thanks for reporting. please pull the updated files.

It's solved.

jklj077 changed discussion status to closed

Sign up or log in to comment