Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
•
111
Avinash Sooriyarachchi
AviSoori1x
AI & ML interests
I work at Mistral AI
Recent Activity
liked
a model
7 days ago
microsoft/TRELLIS.2-4B
liked
a model
12 days ago
nvidia/NitroGen
liked
a model
about 2 months ago
answerdotai/ModernBERT-large
Organizations
upvoted
an
article
3 months ago
upvoted
an
article
6 months ago
Article
SmolLM3: smol, multilingual, long-context reasoner
- +21
•
740
upvoted
4
articles
7 months ago
Article
Learn the Hugging Face Kernel Hub in 5 Minutes
- +5
•
151
Article
KV Cache from scratch in nanoVLM
- +3
•
107
Article
No GPU left behind: Unlocking Efficiency with Co-located vLLM in TRL
- +4
•
96
Article
🐯 Liger GRPO meets TRL
-
- +4
•
52
upvoted
a
paper
almost 2 years ago