trst / Dockerfile

Commit History

Serve pepekberbulu Q4_K_M GGUF live via llama-server (fast CPU inference)
39c322b
verified

ffkbblu commited on

Use prebuilt llama.cpp binary (b9670) instead of compiling (fix OOM)
75d6f7a
verified

ffkbblu commited on

Deploy VibeThinker-3B -> GGUF Q4_K_M conversion+upload job
6f65232
verified

ffkbblu commited on