Commit History

sync: bring the Space up to the current GitHub tree
656439d

asdfasdfqrqwer commited on

fix(api): run 2 uvicorn workers β€” a blocking LLM call in an async endpoint was freezing the single event loop (HTTP 000 outages)
9318680
verified

MHamdan commited on

fix(gpu): warm LLM into VRAM at startup + health-check grace period β€” stops the cold-load restart loop
cc2baaf
verified

MHamdan commited on

fix(gpu): ollama v0.32.1 .tar.zst (correct URL) + zstd; extract to /usr; GPU CUDA libs baked
de23710
verified

MHamdan commited on

feat(gpu): Ollama LLM server (qwen2.5:3b) for GPU inference + on-demand T4 with 15min auto-sleep
39e5349
verified

MHamdan commited on

fix(docker): keep wheel filename so pip accepts it
95a521a
verified

MHamdan commited on

perf(llm): install prebuilt AVX2 llama-cpp wheel (no HF-build compile) + Qwen2.5-3B for citations
a406137
verified

MHamdan commited on

perf(llm): AVX2/FMA source build of llama-cpp + Qwen2.5-3B (reliable [n] citations) β€” utilizes the paid CPU's vector units, 3B follows citation instructions
3d0f1e8

MHamdan commited on

fix(slm): thread count from cgroup CPU quota, not host os.cpu_count() β€” 64 threads on an 8-vCPU container thrashed (slower); now uses the real limit
e8c6ada

MHamdan commited on

perf(slm): use all CPU cores (n_threads=cpu_count, n_batch=512) β€” cuts prefill/TTFT on the paid multi-core tier
f20cfdd

MHamdan commited on

fix(web): raise /api proxy timeout to 300s β€” CPU LLM generation exceeds Next's 30s default on non-streaming endpoints
a88ea41

MHamdan commited on

feat(llm): local Qwen2.5-1.5B GGUF via llama-cpp (prebuilt CPU wheel, model baked) β€” real generative answers on the paid cpu-upgrade tier
b4c429e

MHamdan commited on

fix(space): HF_HUB_OFFLINE=1 β€” baked models must load from cache, never network (prevents relaunch health timeouts)
555a43b

MHamdan commited on

perf(voice): shorter spoken summary (snappier turns) + startup model warmup (no cold-start 5xx)
33e1d6c

MHamdan commited on

feat(voice): NotebookLM-style voice UX
5a0feef

MHamdan commited on

feat(voice): speak a short, clean summary (fast TTS); full answer stays on screen
acacd40
verified

MHamdan commited on

feat(voice): ASR small + Kokoro TTS (spoken replies); prebake models
32f283e
verified

MHamdan commited on

fix(voice): install faster-whisper (free, torch-free) + prebake Whisper base; enable ASR
b67cacd
verified

MHamdan commited on

HardwareGate: detect the visitor's real device client-side
4de5f82
verified

MHamdan commited on

ModelFit: clarify server-vs-device on hosted Space + enable wiki
9f1969b
verified

MHamdan commited on

Install .[ingest,llm] so the huggingface LLM provider (openai SDK) loads
f78dd4f
verified

MHamdan commited on

Deploy Auralynq RAG (Llama-3.3-70B via HF Inference Providers)
8c1b9fe
verified

MHamdan commited on

initial commit
4fd8f25
verified

MHamdan commited on