AGI / cpp /http_helpers.h
Dmitry Beresnev
Refactor the C++ LLM manager into modular components, moves Python modules under python/, and keeps the current control-plane behavior intact. The C++ server now has clearer separation for config, model lifecycle, runtime services, request parsing, HTTP helpers, and server routing, while Docker build/runtime paths were updated to compile multiple C++ files and load Python code from the new package folder
332826f
raw
history blame contribute delete
511 Bytes
#pragma once
#include <optional>
#include <string>
#include <utility>
#include "llm_manager_types.h"
std::string now_utc_iso();
void log_line(const std::string &line);
std::string truncate_body(const std::string &body, size_t max_len = 2000);
std::optional<std::string> extract_cancel_request_id(const std::string &path);
std::pair<int, std::string> forward_chat(const WorkerInfo &worker, const std::string &body);
ProxiedGetResult forward_get_to_worker(const WorkerInfo &worker, const std::string &target);