fix: route conversational queries early in stream_answer to bypass RAG retrieval and ensure correct greeting/identity responses 907e24b risu1012 commited on Jul 11
feat: enhance conversational query prompts and fallback handlers to support Risu Solutions / BAMS curriculum identity f192346 risu1012 commited on Jul 11
fix: copy all .so dynamic libraries to /usr/local/bin to resolve llama-server backend scanning path 0d71f46 risu1012 commited on Jul 11
fix: copy all .so dynamic libraries from llama.cpp tarball to /usr/local/lib and run ldconfig c1df392 risu1012 commited on Jul 11
debug: run llama-server logging to file, do not block uvicorn, expose server log in debug endpoint 7d8c0ea risu1012 commited on Jul 11
fix: extract pre-built ChromaDB index zip on startup to bypass slow CPU indexing c299925 risu1012 commited on Jul 11
fix: install libgomp1 in Dockerfile to satisfy llama-server OpenMP shared library dependency 81436f8 risu1012 commited on Jul 11
fix: deploy native llama-server sidecar from pre-built tarball (supports n_parallel, fixes fallback mode) 4e2ce7c risu1012 commited on Jul 11
tune: raise context budget 700->1400 tokens + max_tokens 1200->1800 for 600-800 word answers ddb755d risu1012 commited on Jul 11
fix: remove sidecar llama-server - revert to direct uvicorn startup (was working in 10/10 test) c92e042 risu1012 commited on Jul 11
fix: use python -m llama_cpp.server with --n_parallel 3 (no binary download needed, pip install already covers it) 5339570 risu1012 commited on Jul 11
fix: download pre-built llama-server binary instead of compiling from source - reduces build time from 20min to under 2min c78ca43 risu1012 commited on Jul 11
feat: complete BAMS syllabus database ingestion & local LLM config b82ddfa risu1012 commited on Jul 11
feat: complete BAMS syllabus database ingestion & local LLM config 0081036 risu1012 commited on Jul 11