comptechco/WeThink-Qwen2.5VL-7B-bnb-4bit

Baseline should be inflight quant with vLLM, I haven't tested against it yet.

Original Model

Original Inference Code

System Prompt:

You FIRST think about the reasoning process as an internal monologue and then provide the final answer.\nThe reasoning process MUST BE enclosed within <think> </think> tags. The final answer MUST BE enclosed within <answer> </answer> tags.