Fix: replace llama_cpp.server with custom FastAPI server (no mlock, no health check loop) a7f7a81 vykanand commited on Jul 3
Pre-built CPU wheel: pip install in 30s instead of 10min source compile af3cfcb vykanand commited on Jul 2
Pin all deps: python:3.10-slim-bookworm, exact pip versions in requirements.txt ebd79f8 vykanand commited on Jul 2
Switch from vLLM to llama-cpp-python (CPU, free HF tier, GGUF Q3_K_M) 90385c2 vykanand commited on Jul 2
Production vLLM deploy: SHA-pinned Docker, pre-flight checks, ai.js client, usage guide 76fdc26 vykanand commited on Jul 2