POCKET-35B-CPU / Dockerfile

Commit History

add Tab2 live A/B vs Bonsai (sequential: Bonsai first, then POCKET); 2nd llama-server for Bonsai Q1_0; README=BONSAI vs POCKET
e77d0bf
verified

SeaWolf-AI commited on

use prebuilt llama.cpp release b10091 (qwen35moe, runtime CPU dispatch) - no compile (no OOM), no -march=native (no SIGILL)
6444aa4
verified

SeaWolf-AI commited on

fix: cap compile parallelism (-j2) to avoid OOMKilled (exit137) during llama.cpp build
87e88c2
verified

SeaWolf-AI commited on

rebuild backend on upstream llama.cpp master (qwen35moe support) via llama-server; FastAPI proxies; portable CPU build
b07a776
verified

SeaWolf-AI commited on

fix: portable CPU build (no -march=native/AVX512) -> stop SIGILL exit132; graceful load-error status
5184a79
verified

SeaWolf-AI commited on

Upload Dockerfile with huggingface_hub
f4eae4e
verified

SeaWolf-AI commited on