GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper • 2403.03507 • Published • 191
Yaroslav Bulatov
yaroslavvb
·
AI & ML interests
large-scale training, optimization, automatic differentiation
Organizations
None yet
upvoted a paper over 2 years ago