Running on CPU Upgrade 800 The Ultimate MoE Training Handbook 🧩 800 A hands-on guide to training Mixture-of-Experts models
Running Featured 1.47k FineWeb: decanting the web for the finest text data at scale 🍷 1.47k Explore the FineWeb dataset and its creation process
view article Article Beyond LoRA: Can you beat the most popular fine-tuning technique? +2 BenjaminB, sayakpaul, hubnemo, kashif • Jun 18 • 110
Running 7 Token-In, Token-Out Done Right 🧩 7 Explore an interactive simulation while reading the article
Running Featured 100 Distilling 100B+ Models 40x Faster with TRL 📝 100 TRL distillation for 100B+ teachers, 40x faster
Running on CPU Upgrade 295 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens 📝 295 Explore synthetic data experiments on a bookshelf visualization
Running 5 The Missing Manual: vLLM on NVIDIA Blackwell GB10 🔧 5 Run local LLMs on NVIDIA Blackwell GPUs