trl-mcsd / docs /source /merge_model_callback.md
ihbkaiser's picture
Implement MCSD for experimental SDPO
1fa3c6c verified

MergeModelCallback

[[autodoc]] experimental.merge_model_callback.MergeModelCallback