byteastra / Dockerfile

Commit History

fix: copy all .so dynamic libraries to /usr/local/bin to resolve llama-server backend scanning path
0d71f46

risu1012 commited on

fix: copy all .so dynamic libraries from llama.cpp tarball to /usr/local/lib and run ldconfig
c1df392

risu1012 commited on

fix: install libgomp1 in Dockerfile to satisfy llama-server OpenMP shared library dependency
81436f8

risu1012 commited on

fix: deploy native llama-server sidecar from pre-built tarball (supports n_parallel, fixes fallback mode)
4e2ce7c

risu1012 commited on

fix: use python -m llama_cpp.server with --n_parallel 3 (no binary download needed, pip install already covers it)
5339570

risu1012 commited on

fix: download pre-built llama-server binary instead of compiling from source - reduces build time from 20min to under 2min
c78ca43

risu1012 commited on

feat: complete BAMS syllabus database ingestion & local LLM config
b82ddfa

risu1012 commited on

feat: optimize deployment payload using zipped database index
9fca47f

risu1012 commited on