Pretraining A Large Language Model using Distributed GPUs: A Memory-Efficient Decentralized Paradigm
Paper
• 2602.11543 • Published
• 5 •
4
Jinrui Zhang
zjr2000
AI & ML interests
None yet
Recent Activity
updated
a model 3 days ago
zjr2000/SPES-9B updated
a model 3 days ago
zjr2000/SPES-7B updated
a model 3 days ago
zjr2000/SPES-2B Organizations
None yet
commented a paper 21 days ago