Running Featured 66 QED-Nano: Teaching a Tiny Model to Prove Hard Theorems 📝 66 Who needs 1T parameters? Olympiad proofs with a 4B model
Running 79 Maintain the unmaintainable 📚 79 Explore the complex relationships between 400+ machine learning models
Running 90 Scaling FineWeb to 1000+ languages: Step 1: finding signal in 100s of evaluation tasks 📝 90 Evaluate multilingual models using FineTasks
Running on CPU Upgrade 177 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens 📝 177 Explore synthetic data experiments in a bookshelf view
Running on CPU Upgrade 13.9k Open LLM Leaderboard 🏆 13.9k Track, rank and evaluate open LLMs and chatbots
Running on CPU Upgrade Featured 3.05k The Smol Training Playbook 📚 3.05k The secrets to building world-class LLMs
Running 3.74k The Ultra-Scale Playbook 🌌 3.74k The ultimate guide to training LLM on large GPU Clusters
Running Featured 1.31k FineWeb: decanting the web for the finest text data at scale 🍷 1.31k Generate a curated web‑text dataset for LLM training