Cache What Lasts: Token Retention for Memory-Bounded KV Cache in LLMs
Paper
•
2512.03324
•
Published
TrimKV
A set of models that can run with bounded memory
-
-
ngocbh/TrimKV-Qwen3-4B-Math
Updated • 54 -
ngocbh/TrimKV-Qwen3-1.7B-Math
Updated • 43 -
ngocbh/TrimKV-Qwen3-4B-Instruct-2507
Updated • 30 -
ngocbh/TrimKV-Phi-3-mini-128k-instruct
Updated • 28 -
ngocbh/TrimKV-Qwen3-8B-Math
Updated • 30 -
ngocbh/TrimKV-Qwen3-14B-Math
Updated • 26 -
ngocbh/TrimKV-DeepSeek-R1-Distill-Llama-8B
Updated • 19