AGI / cpp /llm_manager.cpp

Commit History

Refactor the C++ LLM manager into modular components, moves Python modules under python/, and keeps the current control-plane behavior intact. The C++ server now has clearer separation for config, model lifecycle, runtime services, request parsing, HTTP helpers, and server routing, while Docker build/runtime paths were updated to compile multiple C++ files and load Python code from the new package folder
332826f

Dmitry Beresnev commited on

add auth, token policy, queue scheduler, and cancel flow, etc
d9ce859

Dmitry Beresnev commited on

add new endpoint to cancel all processing prompts
8ef326a

Dmitry Beresnev commited on

fix encoding
d211568

Dmitry Beresnev commited on

fix proxied response in llm manager
53e9f39

Dmitry Beresnev commited on

fix routing in llm manager
a4ee76d

Dmitry Beresnev commited on

add cpp server
fc0860f

Dmitry Beresnev commited on