SageAttention2 Technical Report: Accurate 4 Bit Attention for Plug-and-play Inference Acceleration
Paper • 2411.10958 • Published • 57
efficient ml
-
-
SpargeAttn: Accurate Sparse Attention Accelerating Any Model Inference
Paper • 2502.18137 • Published • 60 -
SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Training
Paper • 2505.11594 • Published • 75 -
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
Paper • 2410.02367 • Published • 50 -
SageAttention2++: A More Efficient Implementation of SageAttention2
Paper • 2505.21136 • Published • 45 -
jt-zhang/SageAttention2_plus
Updated • 26 -
jt-zhang/SageAttention3
Updated • 54 -
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention
Paper • 2509.24006 • Published • 119 -
TurboDiffusion: Accelerating Video Diffusion Models by 100-200 Times
Paper • 2512.16093 • Published • 97 -
SLA2: Sparse-Linear Attention with Learnable Routing and QAT
Paper • 2602.12675 • Published • 58 -
SpargeAttention2: Trainable Sparse Attention via Hybrid Top-k+Top-p Masking and Distillation Fine-Tuning
Paper • 2602.13515 • Published • 44 -
KernelBench-X: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels
Paper • 2605.04956 • Published • 1