trl-mcsd / trl /experimental

1.48 MB

Ctrl+K

1 contributor

History: 1 commit

ihbkaiser

Implement MCSD for experimental SDPO

1fa3c6c verified about 1 month ago

async_grpo
Implement MCSD for experimental SDPO about 1 month ago
bco
Implement MCSD for experimental SDPO about 1 month ago
bema_for_ref_model
Implement MCSD for experimental SDPO about 1 month ago
cpo
Implement MCSD for experimental SDPO about 1 month ago
distillation
Implement MCSD for experimental SDPO about 1 month ago
dppo
Implement MCSD for experimental SDPO about 1 month ago
gfpo
Implement MCSD for experimental SDPO about 1 month ago
gkd
Implement MCSD for experimental SDPO about 1 month ago
gold
Implement MCSD for experimental SDPO about 1 month ago
grpo_with_replay_buffer
Implement MCSD for experimental SDPO about 1 month ago
gspo_token
Implement MCSD for experimental SDPO about 1 month ago
kto
Implement MCSD for experimental SDPO about 1 month ago
minillm
Implement MCSD for experimental SDPO about 1 month ago
nash_md
Implement MCSD for experimental SDPO about 1 month ago
online_dpo
Implement MCSD for experimental SDPO about 1 month ago
openenv
Implement MCSD for experimental SDPO about 1 month ago
orpo
Implement MCSD for experimental SDPO about 1 month ago
papo
Implement MCSD for experimental SDPO about 1 month ago
ppo
Implement MCSD for experimental SDPO about 1 month ago
prm
Implement MCSD for experimental SDPO about 1 month ago
sdft
Implement MCSD for experimental SDPO about 1 month ago
sdpo
Implement MCSD for experimental SDPO about 1 month ago
self_distillation
Implement MCSD for experimental SDPO about 1 month ago
ssd
Implement MCSD for experimental SDPO about 1 month ago
tpo
Implement MCSD for experimental SDPO about 1 month ago
xpo
Implement MCSD for experimental SDPO about 1 month ago
__init__.py

1.35 kB
Implement MCSD for experimental SDPO about 1 month ago
merge_model_callback.py

14.2 kB
Implement MCSD for experimental SDPO about 1 month ago
utils.py

29.7 kB
Implement MCSD for experimental SDPO about 1 month ago