Commit History
perf(cache): Optimize cleanup for agentic workloads 51130e0
feat(cache): Add auto cleanup at 90% capacity + fix config 155743e
feat(perf): Add 4 performance features - token cache, compression, dedup, stream cache e0c724f
feat(cache): Add response caching layer with LRU memory backend 96b735b
test: align signature cache tests with cache behavior 35f1d4e
sowar1987 Warp commited on
test: update signature cache tests bbfc169
sowar1987 Warp commited on
refactor(cache, translator): refine signature caching logic and tests, replace session-based logic with model group handling 2ca7e4b unverified
refactor(cache, translator): remove session ID from signature caching and clean up logic 1455b87 unverified
refactor(cache): simplify signature caching by removing sessionID parameter 222e7bd unverified
fix(translator): update `HasValidSignature` to require `modelName` parameter for improved validation 79304ba unverified
feat(cache): handle gemini family in signature cache with fallback validator logic 4e313ee unverified
fix(translator): enhance signature cache clearing logic and update test cases with model name 098db74
hkfires commited on
chore(translator): update cache functions to include model name parameter in tests 79cf785 unverified
feat(translator): unify model group references by introducing `GetModelGroup` helper function 9f5fa5a unverified
feat(translator): improve signature handling by associating with model name in cache functions dd14cf1 unverified
refactor(cache): remove max entries logic and extend signature TTL to 3 hours 3a61f25 unverified
fix(server): resolve memory leaks causing OOM in k8s deployment 120635e
hemanta212 Amp commited on
refactor: Improve cache eviction ordering and clean up session ID usage 44dfd4f
이대희 commited on
feat(cache): add signature cache for Claude thinking blocks a21a8cd
이대희 commited on