UMoE: Unifying Attention and FFN with Shared Experts
Paper • 2505.07260 • Published • 10
Debopam Dey
pritamdeb68
AI & ML interests
AI , NLP and Data Science
Recent Activity
liked a dataset 6 days ago
wikimedia/wikipedia updated a dataset 8 days ago
pritamdeb68/hybrid_hq_tokenized published a dataset 8 days ago
pritamdeb68/hybrid_hq_tokenizedOrganizations
None yet
upvoted a paper 11 months ago
upvoted an article about 1 year ago
Article
The NLP Course is becoming the LLM Course
- +8
burtenshaw, reach-vb, lewtun, fdaudens, pcuenq, tomaarsen, coyotte508, mishig, sergiopaniego, julien-c
• • 107 upvoted an article over 1 year ago
Article
How to train a new language model from scratch using Transformers and Tokenizers
julien-c
• • 62