How to use August4293/mistral_self_alignment_DPO with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("August4293/mistral_self_alignment_DPO", dtype="auto")
