view article Article Welcome Muse Spark Open: open-weight frontier multimodal mixture-of-experts model from Meta +6 pcuenq, merve, burtenshaw, guarin, qgallouedec, alvarobartt, Serveurperso, Jundot • 27 days ago • 75
view article Article Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler +3 ariG23498, sayakpaul, sergiopaniego, ror, pcuenq • May 29 • 189
view article Article Unlocking asynchronicity in continuous batching +1 ror, pcuenq, ariG23498 • May 14 • 71
view article Article Continuous batching from first principles +1 ror, ArthurZ, mcpotato • Nov 25, 2025 • 462
view article Article Ultra-Long Sequence Parallelism: Ulysses + Ring-Attention Technical Principles and Implementation exploding-gradients • Sep 16, 2025 • 23
Running on CPU Upgrade Featured 3.38k The Smol Training Playbook 📚 3.38k The secrets to building world-class LLMs