Spaces:
Running
Running
Dmitry Beresnev
Refactor the C++ LLM manager into modular components, moves Python modules under python/, and keeps the current control-plane behavior intact. The C++ server now has clearer separation for config, model lifecycle, runtime services, request parsing, HTTP helpers, and server routing, while Docker build/runtime paths were updated to compile multiple C++ files and load Python code from the new package folder
332826f | std::string now_utc_iso(); | |
| void log_line(const std::string &line); | |
| std::string truncate_body(const std::string &body, size_t max_len = 2000); | |
| std::optional<std::string> extract_cancel_request_id(const std::string &path); | |
| std::pair<int, std::string> forward_chat(const WorkerInfo &worker, const std::string &body); | |
| ProxiedGetResult forward_get_to_worker(const WorkerInfo &worker, const std::string &target); | |