perf: Downgrade model to 1.5B for faster CPU inference 9e9ace3 Running quoctrong commited on 20 days ago
perf: Optimize Latency (Remove query translation, async cache, tune LLM threads, limit tokens) 9d3288b quoctrong commited on 20 days ago
feat: Phase 4 Upgrade - RAG Architecture Stability (mMARCO, pdfplumber, true recursive chunk, 3B LLM) 7a67d93 quoctrong commited on 20 days ago
feat: Implement Phase 3 - Optimize inference engine with llama.cpp 03f3ef0 quoctrong commited on 21 days ago
feat: production-hardening, upload validation, admin auth, threadpool, logging & HF dataset repo integration 0d6af6d quoctrong commited on 21 days ago
Expand LLM context window max length to 6500 tokens (~5000 words) 59cac60 quoctrong commited on 21 days ago
Use native Transformers GGUF loader to fix C++ compile delay in Docker build 8db2a53 quoctrong commited on 21 days ago
Upgrade Local LLM to GGUF (llama.cpp) format for 5x-7x faster CPU inference 9087f4e quoctrong commited on 21 days ago