TAOT: Topology-Aware Optimal Transport for Dynamic Expert Replica Placement in MoE Training Paper • 2608.03676 • Published 9 days ago • 2
view article Article Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler +3 ariG23498, sayakpaul, sergiopaniego, ror, pcuenq • May 29 • 158
Running 3.98k The Ultra-Scale Playbook 🌌 3.98k The ultimate guide to training LLM on large GPU Clusters