inference / Dockerfile

Commit History

update custom llama cpp support
5c0d1a4

0xarchit commited on

some experimental
57426fb

0xarchit commited on

Add LangSearch web search tool for small model knowledge augmentation
c459436

0xarchit commited on

Copy llama.cpp shared libraries into runtime image
18a5c35

0xarchit commited on

Speed up build (ccache) and fix /data permissions: create appuser and run downloader/server as appuser
c5437e1

0xarchit commited on

Use Python venv in runtime to avoid PEP 668 pip install error
3d3f603

0xarchit commited on

Fix llama.cpp math compiler flags
85f2f8b

0xarchit commited on

Fix llama.cpp Debian slim build deps
63aa2ad

0xarchit commited on

Add optimized llama.cpp CPU inference backend
8ebf335

0xarchit commited on