Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus Paper • 2608.12149 • Published 14 days ago • 30
Taylor-Calibrate: Principled Initialization for Hybrid Linear Attention Distillation Paper • 2606.16429 • Published Jun 15 • 5
OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization Paper • 2605.17757 • Published May 18 • 66
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models Paper • 2406.05223 • Published Jun 7, 2024 • 4
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design Paper • 2401.14112 • Published Jan 25, 2024 • 20