The Ultra-Scale Playbook
🌌
3.99k
The ultimate guide to training LLM on large GPU Clusters
Julian Scharf
Julianx2005
·
AI & ML interests
None yet
Recent Activity
liked a Space 2 days ago
nanotron/ultrascale-playbook upvoted an article 20 days ago
Continuous batching from first principles commentedon an article 3 months ago
1.5: Decode — Computational Deep DiveOrganizations
None yet
liked a
Space 2 days ago
upvoted an article 20 days ago
Article
Continuous batching from first principles
- +1
ror, ArthurZ, mcpotato
• • 438 commented on 1.5: Decode — Computational Deep Dive 3 months ago
Absolute Masterpiece! Thank you so much
upvoted 2
articles 3 months ago
Article
1.5: Decode — Computational Deep Dive
atharv6f
• • 3 Article
1.4: Prefill — Computational Deep Dive
atharv6f
• • 4