How to use tzwilliam0/Safe_dpo_harmless with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("tzwilliam0/Safe_dpo_harmless", device_map="auto")
