ComPO

This repo contains all the models for paper -

ComPO: Preference Alignment via Comparison Oracles

https://arxiv.org/abs/2505.05465

Please cite

@inproceedings{
Chen-2025-compo,
title={ComPO: Preference Alignment via Comparison Oracles},
author={Peter Chen and Xi Chen and Wotao Yin and Tianyi Lin},
booktitle={The Thirty-ninth Annual Conference on Neural Information Processing Systems},
year={2025},
url={https://openreview.net/forum?id=0lNwIIHWhZ}
}