UMoE: Unifying Attention and FFN with Shared Experts
Paper • 2505.07260 • Published • 9
Debopam Dey
pritamdeb68
AI & ML interests
AI , NLP and Data Science
Recent Activity
updated a dataset 19 days ago
pritamdeb68/mlm-bert-cased-chunked-512 published a dataset 19 days ago
pritamdeb68/mlm-bert-cased-chunked-512 updated a dataset 19 days ago
pritamdeb68/MLM-PretrainingOrganizations
None yet
upvoted a paper 9 months ago
upvoted an article about 1 year ago
Article
The NLP Course is becoming the LLM Course
- +8
burtenshaw, reach-vb, lewtun, fdaudens, pcuenq, tomaarsen, coyotte508, mishig, sergiopaniego, julien-c
• • 106 upvoted an article over 1 year ago
Article
How to train a new language model from scratch using Transformers and Tokenizers
julien-c
• • 61