NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit Vector Quantization of KV Cache
Paper • 2505.18231 • Published • 3
Gil Jae Song
j-song
AI & ML interests
None yet
Recent Activity
submitted a paper about 7 hours ago
PN-Mix: Pair-Norm Guided Mixed-Precision Key Cache Quantization for Efficient Long-Output LLM Inference authored a paper about 24 hours ago
PN-Mix: Pair-Norm Guided Mixed-Precision Key Cache Quantization for Efficient Long-Output LLM Inference upvoted a paper about 1 year ago
NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit
Vector Quantization of KV CacheOrganizations
upvoted 2
papers about 1 year ago
upvoted 5
papers over 1 year ago
MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention
Paper • 2407.02490 • Published • 26
Reasoning Models Can Be Effective Without Thinking
Paper • 2504.09858 • Published • 11
Dialogue Without Limits: Constant-Sized KV Caches for Extended Responses in LLMs
Paper • 2503.00979 • Published • 1
TokenSkip: Controllable Chain-of-Thought Compression in LLMs
Paper • 2502.12067 • Published • 4
Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation
Paper • 2503.22675 • Published • 36