How to use trl-lib/qwen1.5-1.8b-dpo-cli with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("trl-lib/qwen1.5-1.8b-dpo-cli", dtype="auto")
