Why Diffusion Language Models Struggle with Truly Parallel (Non-Autoregressive) Decoding? Paper • 2602.23225 • Published Feb 26 • 1
One LR Doesn't Fit All: Heavy-Tail Guided Layerwise Learning Rates for LLMs Paper • 2605.22297 • Published May 27 • 1
AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization Paper • 2606.04980 • Published Jun 3 • 2
Learning from the Self-future: On-policy Self-distillation for dLLMs Paper • 2606.18195 • Published 25 days ago • 76
Learning from the Self-future: On-policy Self-distillation for dLLMs Paper • 2606.18195 • Published 25 days ago • 76
The Path Not Taken: RLVR Provably Learns Off the Principals Paper • 2511.08567 • Published Nov 11, 2025 • 37
The Art of Scaling Reinforcement Learning Compute for LLMs Paper • 2510.13786 • Published Oct 15, 2025 • 34
Diffusion Language Models Know the Answer Before Decoding Paper • 2508.19982 • Published Aug 27, 2025 • 27
LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning Paper • 2506.00772 • Published Jun 1, 2025 • 2
LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning Paper • 2506.00772 • Published Jun 1, 2025 • 2 • 2
OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning Paper • 2405.18380 • Published May 28, 2024 • 1
FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping Paper • 2404.03865 • Published Apr 5, 2024
Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding Paper • 2403.04797 • Published Mar 5, 2024 • 1
The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training Paper • 2202.02643 • Published Feb 5, 2022 • 1
Sparse Training via Boosting Pruning Plasticity with Neuroregeneration Paper • 2106.10404 • Published Jun 19, 2021 • 1
The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter Paper • 2306.03805 • Published Jun 6, 2023 • 1
Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs Paper • 2310.08915 • Published Oct 13, 2023
AdaMerging: Adaptive Model Merging for Multi-Task Learning Paper • 2310.02575 • Published Oct 4, 2023 • 1
Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers Paper • 2303.01610 • Published Mar 2, 2023