Spaces:

plarnholt
/

excom-ai-demo

Paused

Peter Larnholt commited on Oct 9

Commit

80b0386

1 Parent(s): 55381a2

Remove --enable-auto-tool-choice flag (Qwen has native tool calling)

Files changed (1) hide show

app.py CHANGED Viewed

@@ -26,7 +26,7 @@ VLLM_ARGS = [
     "--max-model-len", "8192",               # fits A10G 24GB
     "--gpu-memory-utilization", "0.90",
     "--trust-remote-code",
-    "--enable-auto-tool-choice",             # Enable automatic tool selection
 ]
 if "AWQ" in MODEL_ID.upper():
     VLLM_ARGS += ["--quantization", "awq_marlin"]  # faster AWQ kernel if available

     "--max-model-len", "8192",               # fits A10G 24GB
     "--gpu-memory-utilization", "0.90",
     "--trust-remote-code",
+    # Qwen 2.5 has native tool calling - no parser override needed
 ]
 if "AWQ" in MODEL_ID.upper():
     VLLM_ARGS += ["--quantization", "awq_marlin"]  # faster AWQ kernel if available