Article
Mixture of Experts (MoEs) in Transformers
- +5
ariG23498, pcuenq, merve, IlyasMoutawwakil, ArthurZ, sergiopaniego, Molbap
• • 159Chau Quang Anh
quanganh
·
AI & ML interests
NLP, relation extraction
Recent Activity
liked a model about 1 month ago
g-group-ai-lab/gwen-tts-0.6B liked a model about 2 months ago
g-group-ai-lab/gipformer-65M-rnnt upvoted an article about 2 months ago
Mixture of Experts (MoEs) in TransformersOrganizations
None yet
upvoted an article about 2 months ago
upvoted an article 8 months ago
Article
Nemotron-Personas-Japan: Synthesized Data for Sovereign AI
nvidia
• • 27 upvoted 3
articles 9 months ago
Article
NVIDIA Releases 3 Million Sample Dataset for OCR, Visual Question Answering, and Captioning Tasks
nvidia
• • 76 Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
AviSoori1x
• • 121 Article
DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior Reinforcement Learning Knowledge
NormalUhr
• • 292