ornith / requirements.txt
devarshia5's picture
Upload 7 files
ed7c75c verified
Raw
History Blame Contribute Delete
659 Bytes
# Bumped 0.3.2 -> 0.3.32 (Jun 2026) and still built FROM SOURCE (Dockerfile
# --no-binary):
# * Qwen3.5 uses the `qwen35` architecture, which needs llama.cpp >= b9616.
# The old 0.3.2 pin can't load it ("unknown architecture 'qwen35'").
# * 0.3.32 vendors a recent llama.cpp (past the old CPU "set_rows" decode
# crash) and works on Debian glibc when compiled here.
# If a future wheel regresses, pin the last-known-good 0.3.x that loads qwen35.
llama-cpp-python==0.3.32
# Lightweight CPU embeddings via ONNX (no PyTorch -> small image, fast).
fastembed
faiss-cpu
# API + serving
fastapi
uvicorn[standard]
python-multipart
huggingface_hub
numpy