Commit History

Support CONTEXT_LENGTH env var (default 4096) for ctx-size
30426eb

0xarchit commited on

Use Python venv in runtime to avoid PEP 668 pip install error
3d3f603

0xarchit commited on

Fix llama.cpp math compiler flags
85f2f8b

0xarchit commited on

Fix llama.cpp Debian slim build deps
63aa2ad

0xarchit commited on

Add optimized llama.cpp CPU inference backend
8ebf335

0xarchit commited on

initial commit
957406c
verified

zrxarchit commited on