Post
4,458
TRL now supports MOPD (Multi-Teacher On-Policy Distillation) natively❗️
Many frontier open models use it. labs train one RL expert per domain and then distill them all into one model
Blog with what it is, who uses it and an experiment you can run on HF Jobs with one command
https://huggingface.co/blog/sergiopaniego/mopd-trl
Many frontier open models use it. labs train one RL expert per domain and then distill them all into one model
Blog with what it is, who uses it and an experiment you can run on HF Jobs with one command
https://huggingface.co/blog/sergiopaniego/mopd-trl