qwen2.5api / Dockerfile

Commit History

Fix: replace llama_cpp.server with custom FastAPI server (no mlock, no health check loop)
a7f7a81

vykanand commited on

Fix: install git (required by HF Spaces build system)
dc7c627

vykanand commited on

Pre-built CPU wheel: pip install in 30s instead of 10min source compile
af3cfcb

vykanand commited on

CPU perf: OpenBLAS build, auto-threads, mlock, batched inference
6d7a7ac

vykanand commited on

Pin all deps: python:3.10-slim-bookworm, exact pip versions in requirements.txt
ebd79f8

vykanand commited on

Fix: add build-essential cmake for llama-cpp-python source build
c6c37a2

vykanand commited on

Switch from vLLM to llama-cpp-python (CPU, free HF tier, GGUF Q3_K_M)
90385c2

vykanand commited on

Pin to v0.7.3 tag (immutable, cacheable on HF)
d3ca23c

vykanand commited on

Switch to latest tag for faster HF cache hit
f3d57ef

vykanand commited on

Production vLLM deploy: SHA-pinned Docker, pre-flight checks, ai.js client, usage guide
76fdc26

vykanand commited on

Create Dockerfile
be6d600
verified

vykanand commited on