Spaces:
Paused
Paused
Commit History
fix(api): run 2 uvicorn workers β a blocking LLM call in an async endpoint was freezing the single event loop (HTTP 000 outages) 9318680 verified
fix(gpu): warm LLM into VRAM at startup + health-check grace period β stops the cold-load restart loop cc2baaf verified
fix(gpu): ollama v0.32.1 .tar.zst (correct URL) + zstd; extract to /usr; GPU CUDA libs baked de23710 verified
feat(gpu): Ollama LLM server (qwen2.5:3b) for GPU inference + on-demand T4 with 15min auto-sleep 39e5349 verified
fix(docker): keep wheel filename so pip accepts it 95a521a verified
perf(llm): install prebuilt AVX2 llama-cpp wheel (no HF-build compile) + Qwen2.5-3B for citations a406137 verified
perf(llm): AVX2/FMA source build of llama-cpp + Qwen2.5-3B (reliable [n] citations) β utilizes the paid CPU's vector units, 3B follows citation instructions 3d0f1e8
MHamdan commited on
fix(slm): thread count from cgroup CPU quota, not host os.cpu_count() β 64 threads on an 8-vCPU container thrashed (slower); now uses the real limit e8c6ada
MHamdan commited on
perf(slm): use all CPU cores (n_threads=cpu_count, n_batch=512) β cuts prefill/TTFT on the paid multi-core tier f20cfdd
MHamdan commited on
fix(web): raise /api proxy timeout to 300s β CPU LLM generation exceeds Next's 30s default on non-streaming endpoints a88ea41
MHamdan commited on
feat(llm): local Qwen2.5-1.5B GGUF via llama-cpp (prebuilt CPU wheel, model baked) β real generative answers on the paid cpu-upgrade tier b4c429e
MHamdan commited on
fix(space): HF_HUB_OFFLINE=1 β baked models must load from cache, never network (prevents relaunch health timeouts) 555a43b
MHamdan commited on
perf(voice): shorter spoken summary (snappier turns) + startup model warmup (no cold-start 5xx) 33e1d6c
MHamdan commited on
feat(voice): NotebookLM-style voice UX 5a0feef
MHamdan commited on