Fix: lazy model load, GGUF integrity check, re-download corrupt files 9a8d0cd vykanand commited on Jul 3
Fix: replace llama_cpp.server with custom FastAPI server (no mlock, no health check loop) a7f7a81 vykanand commited on Jul 3
Fix: --api_key (underscore) not --api-key (dash) for llama_cpp.server fdd6703 vykanand commited on Jul 2
Fix: always set api-key (default: not-set) so health check auth works 130da7d vykanand commited on Jul 2
Fix: correct CLI flags for llama_cpp.server 0.3.32 (use_mlock, no cont_batching) d5e1d77 vykanand commited on Jul 2
Pre-built CPU wheel: pip install in 30s instead of 10min source compile af3cfcb vykanand commited on Jul 2
Pin all deps: python:3.10-slim-bookworm, exact pip versions in requirements.txt ebd79f8 vykanand commited on Jul 2
Switch from vLLM to llama-cpp-python (CPU, free HF tier, GGUF Q3_K_M) 90385c2 vykanand commited on Jul 2
Production vLLM deploy: SHA-pinned Docker, pre-flight checks, ai.js client, usage guide 76fdc26 vykanand commited on Jul 2