Article
Ulysses Sequence Parallelism: Training with Million-Token Contexts
kashif, stas
• • 28Thomas Betton
tbetton
AI & ML interests
None yet
Organizations
upvoted an article 2 months ago
upvoted 2
articles 4 months ago
Article
Mixture of Experts Explained
- +4
osanseviero, lewtun, philschmid, smangrul, ybelkada, pcuenq
• • 1.13k Article
DualPipe Explained: A Comprehensive Guide to DualPipe That Anyone Can Understand—Even Without a Distributed Training Background
NormalUhr
• • 19 upvoted an article 5 months ago
Article
Improving Prompt Consistency with Structured Generations
- +1
willkurt, remi, clefourrier
• • 68 upvoted an article 10 months ago
Article
No GPU left behind: Unlocking Efficiency with Co-located vLLM in TRL
- +4
toslali-ibm, mirinflim, qgallouedec, esnible, rganti, mudhakar
• • 101 upvoted an article 11 months ago
Article
Training and Finetuning Sparse Embedding Models with Sentence Transformers
tomaarsen, arthurbresnu
• • 138 upvoted a paper about 1 year ago
upvoted 3
articles over 1 year ago
Article
From Zero to Reasoning Hero: How DeepSeek-R1 Leverages Reinforcement Learning to Master Complex Reasoning
NormalUhr
• • 17 Article
4D masks support in Transformers
poedator
• • 31 Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
sirluk
• • 71 upvoted a paper over 1 year ago