metadata
license: apache-2.0
library_name: pytorch
tags:
- kv-cache
- kv-cache-compression
- fastkvzip
tangram-gate
FastKVzip gate weights collected for the Tangram project.
Each gate is a small per-layer module trained to score KV importance for gated KV
eviction. Load them with the load_gate utility from the FastKVzip codebase; the
layout follows the convention {model_name_lowercased}/{tag}.pt.
Trained gates
| Model | File |
|---|---|
| openai/gpt-oss-20b | gpt-oss-20b/q8_dim16_sink16.pt |
| meta-llama/Llama-3.1-8B-Instruct | llama3.1-8b-instruct/q4_dim16_sink16.pt |
| meta-llama/Llama-3.1-8B-Instruct (earlier run) | llama3.1-8b-instruct/q4_dim16_sink16_v0.pt |
| Qwen/Qwen3-14B | qwen3-14b/q5_dim16_sink16.pt |
| Qwen/Qwen3-8B | qwen3-8b/q4_dim16_sink16.pt |
| Qwen/Qwen3-4B-Instruct-2507 | qwen3-4b-instruct-2507/q4_dim16_sink16.pt |
| Qwen/Qwen2.5-7B-Instruct-1M | qwen2.5-7b-instruct-1m/q7_dim16_sink16.pt |
| google/gemma-3-12b-it | gemma-3-12b-it/q2_dim16_sink16.pt |
Attribution
FastKVzip — "Fast KVzip: Efficient and Accurate LLM Inference with Gated KV Eviction", Jang-Hyun Kim, Dongyoon Han, Sangdoo Yun (NAVER AI Lab). Original gate weights: https://huggingface.co/Jang-Hyun/Fast-KVzip