auralynq-rag / Dockerfile

Commit History

fix(gpu): warm LLM into VRAM at startup + health-check grace period β€” stops the cold-load restart loop
cc2baaf
verified

MHamdan commited on

fix(gpu): ollama v0.32.1 .tar.zst (correct URL) + zstd; extract to /usr; GPU CUDA libs baked
de23710
verified

MHamdan commited on

feat(gpu): Ollama LLM server (qwen2.5:3b) for GPU inference + on-demand T4 with 15min auto-sleep
39e5349
verified

MHamdan commited on

fix(docker): keep wheel filename so pip accepts it
95a521a
verified

MHamdan commited on

perf(llm): install prebuilt AVX2 llama-cpp wheel (no HF-build compile) + Qwen2.5-3B for citations
a406137
verified

MHamdan commited on

perf(llm): AVX2/FMA source build of llama-cpp + Qwen2.5-3B (reliable [n] citations) β€” utilizes the paid CPU's vector units, 3B follows citation instructions
3d0f1e8

MHamdan commited on

feat(llm): local Qwen2.5-1.5B GGUF via llama-cpp (prebuilt CPU wheel, model baked) β€” real generative answers on the paid cpu-upgrade tier
b4c429e

MHamdan commited on

fix(space): HF_HUB_OFFLINE=1 β€” baked models must load from cache, never network (prevents relaunch health timeouts)
555a43b

MHamdan commited on

feat(voice): NotebookLM-style voice UX
5a0feef

MHamdan commited on

feat(voice): ASR small + Kokoro TTS (spoken replies); prebake models
32f283e
verified

MHamdan commited on

fix(voice): install faster-whisper (free, torch-free) + prebake Whisper base; enable ASR
b67cacd
verified

MHamdan commited on

Install .[ingest,llm] so the huggingface LLM provider (openai SDK) loads
f78dd4f
verified

MHamdan commited on

Deploy Auralynq RAG (Llama-3.3-70B via HF Inference Providers)
8c1b9fe
verified

MHamdan commited on