Article
Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL
- +2
aminediroHF, qgallouedec, kashif, sergiopaniego
• • 53 Amine Dirhoussi
aminediroHF
AI & ML interests
None yet
Recent Activity
updated a Space 5 days ago
aminediroHF/scalerl-sanity-r1d-1.5b-static-8571ed published a Space 5 days ago
aminediroHF/scalerl-sanity-r1d-1.5b-static-8571ed updated a bucket 5 days ago
aminediroHF/scalerl-sanity-r1d-1.5b-static-8571ed-bucketOrganizations
published an article 17 days ago
published an article 4 months ago
Article
Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL
- +6
aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, lvwerra, sergiopaniego
• • 50 published an article 7 months ago
Article
Keep the Tokens Flowing: Lessons from 16 Open-Source RL Libraries
- +7
aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, nouamanetazi, lvwerra, sergiopaniego
• • 189