How to use Lzhang49/Assignment4-DPO-lora with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Lzhang49/Assignment4-DPO-lora", dtype="auto")
