view post Post 7420 Frontier models use distillation as a step of their post-training pipelines. In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL! See translation 3 replies · 👍 14 14 🔥 6 6 ❤️ 3 3 + Reply
yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2 Text Generation • 12B • Updated 11 days ago • 58.2k • 66
yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF Text Generation • 12B • Updated 22 days ago • 437k • 1.14k
yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF Text Generation • 12B • Updated 22 days ago • 720k • 2.68k