On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
Paper • 2306.13649 • Published • 37
Võ Hữu Trí Dũng
vohuutridung
AI & ML interests
None yet
Recent Activity
updated a dataset 25 days ago
vohuutridung/locomo published a dataset 25 days ago
vohuutridung/locomo updated a model 29 days ago
vohuutridung/FastVLM_cls_r32_bs16_bg1.0_cmrd1.0Organizations
None yet
upvoted a paper about 1 month ago
upvoted a collection about 2 months ago
upvoted an article about 2 months ago
Article
Vision Language Models (Better, faster, stronger)
- +3
merve, sergiopaniego, ariG23498, pcuenq, andito
• • 614 upvoted an article 3 months ago
Article
DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior Reinforcement Learning Knowledge
NormalUhr
• • 297 upvoted an article 4 months ago
Article
Everything You Need to Know about Knowledge Distillation
Kseniase
• • 86 upvoted an article 5 months ago
Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
AviSoori1x
• • 124 upvoted 2
articles 7 months ago
Article
Mixture of Experts Explained
- +4
osanseviero, lewtun, philschmid, smangrul, ybelkada, pcuenq
• • 1.16k Article
🤗 PEFT welcomes new merging methods
smangrul, sayakpaul
• • 31