sian cao

sonald's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted 2 articles about 1 month ago

view article

Article

Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL

• 
• 
• +6

aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, lvwerra, sergiopaniego

•

May 27

• 42

view article

Article

Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler

• 
• 
• +3

ariG23498, sayakpaul, sergiopaniego, ror, pcuenq

•

May 29

• 132

upvoted an article 4 months ago

view article

Article

Keep the Tokens Flowing: Lessons from 16 Open-Source RL Libraries

• 
• 
• +7

aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, nouamanetazi, lvwerra, sergiopaniego

•

Mar 10

• 167

upvoted an article 5 months ago

view article

Article

SmolVLM Grows Smaller – Introducing the 256M & 500M Models!

• 
• 
• +1

andito, mfarre, merve

•

Jan 23, 2025

• 192

liked a Space 5 months ago

Running

601

Scaling test-time compute

📈

601

Boost LLM answers with flexible test‑time search strategies

upvoted a paper 6 months ago

GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimization

Paper • 2601.05242 • Published Jan 8 • 234

upvoted 3 articles 6 months ago

view article

Article

Deriving the DPO Loss from First Principles

• 

garg-aayush

•

Dec 30, 2025

• 8

view article

Article

Deriving the PPO Loss from First Principles

• 

garg-aayush

•

Dec 25, 2025

• 45

view article

Article

From GRPO to DAPO and GSPO: What, Why, and How

• 

NormalUhr

•

Aug 9, 2025

• 128

liked a Space 6 months ago

Running

3.92k

The Ultra-Scale Playbook

🌌

3.92k

The ultimate guide to training LLM on large GPU Clusters

upvoted 3 articles 6 months ago

view article

Article

Efficient MultiModal Data Pipeline

• 
• 
• +3

ariG23498, lusxvr, andito, sergiopaniego, pcuenq

•

Jul 8, 2025

• 72

view article

Article

KV Cache from scratch in nanoVLM

• 
• 
• +3

ariG23498, kashif, lusxvr, andito, pcuenq

•

Jun 4, 2025

• 120

view article

Article

Tricks from OpenAI gpt-oss YOU 🫵 can use with transformers

• 
• 
• +5

ariG23498, sergiopaniego, reach-vb, pcuenq, ArthurZ, SaylorTwift, cyrilvallez

•

Sep 11, 2025

• 188

upvoted an article 7 months ago

view article

Article

Efficient LLM Pretraining: Packed Sequences and Masked Attention

• 

sirluk

•

Oct 7, 2024

• 71

liked a Space 7 months ago

Running on CPU Upgrade

Featured

3.23k

The Smol Training Playbook

📚

3.23k

The secrets to building world-class LLMs

upvoted 2 articles 7 months ago

view article

Article

Nemotron 3 Nano \- A new Standard for Efficient, Open, and Intelligent Agentic Models

• 

nvidia

•

Dec 15, 2025

• 113

view article

Article

Putting RL back in RLHF

• 
• 

vwxyzjn, ArashAhmadian

•

Jun 12, 2024

• 112

upvoted a paper 7 months ago

From Code Foundation Models to Agents and Applications: A Practical Guide to Code Intelligence

Paper • 2511.18538 • Published Nov 23, 2025 • 306

liked a dataset 7 months ago

PleIAs/SYNTH

Viewer • Updated May 6 • 68M • 5.91k • 270

upvoted an article 8 months ago

view article

Article

Why Did MiniMax M2 End Up as a Full Attention Model?

• 

MiniMax-AI

•

Oct 30, 2025

• 80