POCKET-35B-CPU / app.py

Commit History

A/B: show reasoning again (remove no_think prefill); raise A/B max_tokens 96->256 so thinking completes
8bfa67a
verified

SeaWolf-AI commited on

A/B: prefill empty <think></think> to force direct short answers (no reasoning) -> fast races
d6e52f6
verified

SeaWolf-AI commited on

A/B: apply /no_think so both models answer directly (no <think> block) -> short, fast races
f8feff1
verified

SeaWolf-AI commited on

add Tab2 live A/B vs Bonsai (sequential: Bonsai first, then POCKET); 2nd llama-server for Bonsai Q1_0; README=BONSAI vs POCKET
e77d0bf
verified

SeaWolf-AI commited on

show live tok/s: backend streams predicted_per_second; UI displays live speed + final tok/s under each reply
4df8486
verified

SeaWolf-AI commited on

proxy via native /completion with manual ChatML prompt (bypass embedded template); surface backend errors
ea6a70b
verified

SeaWolf-AI commited on

rebuild backend on upstream llama.cpp master (qwen35moe support) via llama-server; FastAPI proxies; portable CPU build
b07a776
verified

SeaWolf-AI commited on

fix: portable CPU build (no -march=native/AVX512) -> stop SIGILL exit132; graceful load-error status
2ce7d5d
verified

SeaWolf-AI commited on

Upload app.py with huggingface_hub
e186935
verified

SeaWolf-AI commited on