Haleshot
/

Mathmate-7B-DELLA-ORPO

preference-learning

Model card Files Files and versions

Haleshot commited on Sep 29, 2024

Commit

81533a4

·

verified ·

1 Parent(s): 80cab8f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ license: apache-2.0
 # Mathmate-7B-DELLA-ORPO
-Mathmate-7B-DELLA-ORPO is a finetuned version of [Haleshot/Mathmate-7B-DELLA](https://huggingface.co/Haleshot/Mathmate-7B-DELLA) using the ORPO (Offline Ranked Preference Optimization) technique. This model has been specifically tuned to improve its performance on mathematical reasoning tasks based on human preferences.
 ## Model Details

 # Mathmate-7B-DELLA-ORPO
+Mathmate-7B-DELLA-ORPO is a finetuned version of [Haleshot/Mathmate-7B-DELLA](https://huggingface.co/Haleshot/Mathmate-7B-DELLA) using the ORPO (Odds Ratio Preference Optimization) technique. This model has been specifically tuned to improve its performance on mathematical reasoning tasks based on human preferences.
 ## Model Details