Running on CPU Upgrade Featured 3.15k The Smol Training Playbook 📚 3.15k The secrets to building world-class LLMs
The Ultimate Collection of Code Classifiers Collection 🔥 15 classifiers, 124M parameters, one per programming language— for assessing the educational value of GitHub code • 15 items • Updated May 5, 2025 • 15
Essential-Web v1.0: 24T tokens of organized web data Paper • 2506.14111 • Published Jun 17, 2025 • 46
CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training Paper • 2504.13161 • Published Apr 17, 2025 • 98
Running 3.83k The Ultra-Scale Playbook 🌌 3.83k The ultimate guide to training LLM on large GPU Clusters
Running 92 Scaling FineWeb to 1000+ languages: Step 1: finding signal in 100s of evaluation tasks 📝 92 Evaluate multilingual models using FineTasks