Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
ihbkaiser
/
trl-mcsd
like
0
arxiv:
2402.03300
arxiv:
2305.18290
arxiv:
2407.21783
Model card
Files
Files and versions
xet
Community
main
trl-mcsd
/
examples
/
scripts
320 kB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
ihbkaiser
Implement MCSD for experimental SDPO
1fa3c6c
verified
23 days ago
nemo_gym
Implement MCSD for experimental SDPO
23 days ago
openenv
Implement MCSD for experimental SDPO
23 days ago
ppo
Implement MCSD for experimental SDPO
23 days ago
async_grpo.py
Safe
2.3 kB
Implement MCSD for experimental SDPO
23 days ago
bco.py
Safe
5.85 kB
Implement MCSD for experimental SDPO
23 days ago
cpo.py
Safe
3.49 kB
Implement MCSD for experimental SDPO
23 days ago
dpo.py
Safe
917 Bytes
Implement MCSD for experimental SDPO
23 days ago
dpo_vlm.py
Safe
4.28 kB
Implement MCSD for experimental SDPO
23 days ago
gkd.py
Safe
5.05 kB
Implement MCSD for experimental SDPO
23 days ago
grpo_2048.py
Safe
5.2 kB
Implement MCSD for experimental SDPO
23 days ago
grpo_agent.py
Safe
10.3 kB
Implement MCSD for experimental SDPO
23 days ago
grpo_vlm.py
Safe
5.23 kB
Implement MCSD for experimental SDPO
23 days ago
gspo.py
Safe
4.42 kB
Implement MCSD for experimental SDPO
23 days ago
gspo_vlm.py
Safe
4.85 kB
Implement MCSD for experimental SDPO
23 days ago
kto.py
Safe
3.59 kB
Implement MCSD for experimental SDPO
23 days ago
mpo_vlm.py
Safe
4.26 kB
Implement MCSD for experimental SDPO
23 days ago
nash_md.py
Safe
5.1 kB
Implement MCSD for experimental SDPO
23 days ago
online_dpo.py
Safe
5.37 kB
Implement MCSD for experimental SDPO
23 days ago
online_dpo_vlm.py
Safe
7.71 kB
Implement MCSD for experimental SDPO
23 days ago
orpo.py
Safe
3.57 kB
Implement MCSD for experimental SDPO
23 days ago
prm.py
Safe
4.44 kB
Implement MCSD for experimental SDPO
23 days ago
reward_modeling.py
Safe
4.42 kB
Implement MCSD for experimental SDPO
23 days ago
rloo.py
Safe
3.44 kB
Implement MCSD for experimental SDPO
23 days ago
rloo_vlm.py
Safe
5.23 kB
Implement MCSD for experimental SDPO
23 days ago
sdpo_rar_science.py
Safe
23.5 kB
Implement MCSD for experimental SDPO
23 days ago
sft.py
Safe
917 Bytes
Implement MCSD for experimental SDPO
23 days ago
sft_gemma3.py
Safe
1.98 kB
Implement MCSD for experimental SDPO
23 days ago
sft_gpt_oss.py
Safe
3.19 kB
Implement MCSD for experimental SDPO
23 days ago
sft_nemotron_3.py
Safe
4.09 kB
Implement MCSD for experimental SDPO
23 days ago
sft_tiny_aya_tool_calling.py
Safe
5.31 kB
Implement MCSD for experimental SDPO
23 days ago
sft_video_llm.py
Safe
8.2 kB
Implement MCSD for experimental SDPO
23 days ago
sft_vlm.py
Safe
3.92 kB
Implement MCSD for experimental SDPO
23 days ago
sft_vlm_gemma3.py
Safe
6.69 kB
Implement MCSD for experimental SDPO
23 days ago
tiny_aya_chat_template.jinja
Safe
5.66 kB
Implement MCSD for experimental SDPO
23 days ago
xpo.py
Safe
4.5 kB
Implement MCSD for experimental SDPO
23 days ago