-
Language Modeling Is Compression
Paper • 2309.10668 • Published • 84 -
SlimPajama-DC: Understanding Data Combinations for LLM Training
Paper • 2309.10818 • Published • 11 -
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference Using Sorted Fine-Tuning (SoFT)
Paper • 2309.08968 • Published • 24 -
Contrastive Decoding Improves Reasoning in Large Language Models
Paper • 2309.09117 • Published • 40
Lei Wang
demolei
AI & ML interests
LLMs
Recent Activity
upvoted a paper 2 days ago
MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Data upvoted a collection 2 days ago
MiroThinker-1.7 upvoted a paper 6 days ago
On-Policy Self-Distillation for Reasoning Compression