🔄 In a Training Loop
aayush garg
garg-aayush
AI & ML interests
None yet
Organizations
Training-LLMs
- Running on CPU UpgradeFeatured3.37k
The Smol Training Playbook
📚3.37kThe secrets to building world-class LLMs
- Running4.13k
The Ultra-Scale Playbook
🌌4.13kThe ultimate guide to training LLM on large GPU Clusters
- RunningFeatured1.47k
FineWeb: decanting the web for the finest text data at scale
🍷1.47kExplore the FineWeb dataset and its creation process
- Running236
FineVision: Open Data is All You Need
📝236A new open-source dataset for training VLMs
RLHF Papers
-
Proximal Policy Optimization Algorithms
Paper • 1707.06347 • Published • 12 -
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 73 -
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Paper • 2402.03300 • Published • 152 -
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
Paper • 2501.12948 • Published • 458
Llama papers and reports
List of papers and reports related to llama models
LLM Tech Reports
RLHF Papers
-
Proximal Policy Optimization Algorithms
Paper • 1707.06347 • Published • 12 -
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 73 -
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Paper • 2402.03300 • Published • 152 -
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
Paper • 2501.12948 • Published • 458
Training-LLMs
- Running on CPU UpgradeFeatured3.37k
The Smol Training Playbook
📚3.37kThe secrets to building world-class LLMs
- Running4.13k
The Ultra-Scale Playbook
🌌4.13kThe ultimate guide to training LLM on large GPU Clusters
- RunningFeatured1.47k
FineWeb: decanting the web for the finest text data at scale
🍷1.47kExplore the FineWeb dataset and its creation process
- Running236
FineVision: Open Data is All You Need
📝236A new open-source dataset for training VLMs
Llama papers and reports
List of papers and reports related to llama models