Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
AviSoori1x
• • 122
Amit Kumar
amitkumariitm
·
AI & ML interests
None yet
Recent Activity
liked a Space about 2 months ago
nanotron/ultrascale-playbook upvoted an article about 2 months ago
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch liked a dataset 3 months ago
roneneldan/TinyStoriesOrganizations
None yet
upvoted an article about 2 months ago