A/B: raise max_tokens 256->512 so POCKET's reasoning + final answer complete (not cut) 336526e Running verified SeaWolf-AI commited on about 16 hours ago
A/B: show reasoning again (remove no_think prefill); raise A/B max_tokens 96->256 so thinking completes 8bfa67a verified SeaWolf-AI commited on about 16 hours ago
A/B: one-sentence example prompts (stable tok/s, still fast) 7bf27a9 verified SeaWolf-AI commited on about 16 hours ago
A/B: prefill empty <think></think> to force direct short answers (no reasoning) -> fast races d6e52f6 verified SeaWolf-AI commited on about 16 hours ago
A/B: apply /no_think so both models answer directly (no <think> block) -> short, fast races f8feff1 verified SeaWolf-AI commited on about 16 hours ago
A/B: shorter-answer example prompts + cap max_tokens 200->96 for snappy races 87a05d4 verified SeaWolf-AI commited on about 17 hours ago
A/B is now the landing tab (swap order); add prism-ml/Bonsai-27B-gguf to models relation bb234a8 verified SeaWolf-AI commited on about 17 hours ago
add Tab2 live A/B vs Bonsai (sequential: Bonsai first, then POCKET); 2nd llama-server for Bonsai Q1_0; README=BONSAI vs POCKET e77d0bf verified SeaWolf-AI commited on about 17 hours ago
show live tok/s: backend streams predicted_per_second; UI displays live speed + final tok/s under each reply 4df8486 verified SeaWolf-AI commited on about 17 hours ago
proxy via native /completion with manual ChatML prompt (bypass embedded template); surface backend errors ea6a70b verified SeaWolf-AI commited on about 18 hours ago
use prebuilt llama.cpp release b10091 (qwen35moe, runtime CPU dispatch) - no compile (no OOM), no -march=native (no SIGILL) 6444aa4 verified SeaWolf-AI commited on about 18 hours ago
fix: cap compile parallelism (-j2) to avoid OOMKilled (exit137) during llama.cpp build 87e88c2 verified SeaWolf-AI commited on about 18 hours ago
rebuild backend on upstream llama.cpp master (qwen35moe support) via llama-server; FastAPI proxies; portable CPU build b07a776 verified SeaWolf-AI commited on about 18 hours ago
fix: portable CPU build (no -march=native/AVX512) -> stop SIGILL exit132; graceful load-error status 2ce7d5d verified SeaWolf-AI commited on about 18 hours ago
fix: portable CPU build (no -march=native/AVX512) -> stop SIGILL exit132; graceful load-error status 5184a79 verified SeaWolf-AI commited on about 18 hours ago
Upload requirements.txt with huggingface_hub 11db75e verified SeaWolf-AI commited on about 19 hours ago