A/B: show reasoning again (remove no_think prefill); raise A/B max_tokens 96->256 so thinking completes 8bfa67a verified SeaWolf-AI commited on 4 days ago
A/B: prefill empty <think></think> to force direct short answers (no reasoning) -> fast races d6e52f6 verified SeaWolf-AI commited on 4 days ago
A/B: apply /no_think so both models answer directly (no <think> block) -> short, fast races f8feff1 verified SeaWolf-AI commited on 4 days ago
add Tab2 live A/B vs Bonsai (sequential: Bonsai first, then POCKET); 2nd llama-server for Bonsai Q1_0; README=BONSAI vs POCKET e77d0bf verified SeaWolf-AI commited on 4 days ago
show live tok/s: backend streams predicted_per_second; UI displays live speed + final tok/s under each reply 4df8486 verified SeaWolf-AI commited on 4 days ago
proxy via native /completion with manual ChatML prompt (bypass embedded template); surface backend errors ea6a70b verified SeaWolf-AI commited on 4 days ago
rebuild backend on upstream llama.cpp master (qwen35moe support) via llama-server; FastAPI proxies; portable CPU build b07a776 verified SeaWolf-AI commited on 4 days ago
fix: portable CPU build (no -march=native/AVX512) -> stop SIGILL exit132; graceful load-error status 2ce7d5d verified SeaWolf-AI commited on 4 days ago