UMoE: Unifying Attention and FFN with Shared Experts
Paper
•
2505.07260
•
Published
•
9
Debopam Dey
pritamdeb68
AI & ML interests
AI , NLP and Data Science
Organizations
None yet
upvoted
a
paper
4 months ago
upvoted
an
article
9 months ago
Article
The NLP Course is becoming the LLM Course
- +8
•
103
upvoted
an
article
11 months ago
Article
How to train a new language model from scratch using Transformers and Tokenizers
•
56