Running Featured 77 Distilling 100B+ Models 40x Faster with TRL π 77 TRL distillation for 100B+ teachers, 40x faster
Running on CPU Upgrade 232 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens π 232 Explore synthetic data experiments on a virtual bookshelf
Running on CPU Upgrade Featured 3.15k The Smol Training Playbook π 3.15k The secrets to building world-class LLMs
Running Featured 74 QED-Nano: Teaching a Tiny Model to Prove Hard Theorems π 74 Who needs 1T parameters? Olympiad proofs with a 4B model
Running 3.83k The Ultra-Scale Playbook π 3.83k The ultimate guide to training LLM on large GPU Clusters
Running Featured 1.05k Can You Run It? LLM version π 1.05k Calculate GPU needs for running LLMs on your hardware
Running on CPU Upgrade Agents 22 Accelerate Examples π 22 Generate code samples for model training and configuration