Estimate model memory usage and see detailed plots
The ultimate guide to training LLM on large GPU Clusters