agent-inference / __pycache__

Commit History

v2.0: single-instance CPU proxy, native OpenAI tools+streaming, flash-attn+q4_0 KV, all-cores
e24791f
verified

Leon4gr45 commited on