Hugging Face's logo

ComparisonPO
/
Mistral-Base-7B-DPO_clean

Safetensors
mistral
Model card Files
xet
 Community
PeterLauLukCh commited on
Commit
893361c
·
verified ·
1 Parent(s): dd27b34

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -6,4 +6,4 @@ base_model:
6
  - alignment-handbook/zephyr-7b-sft-full
7
  ---
8
 
9
- DPO model for Mistral-Base under trl/ultradeedback_binarized finetuning.
 
6
  - alignment-handbook/zephyr-7b-sft-full
7
  ---
8
 
9
+ DPO model excluding the noisy preference pairs for Mistral-Base under trl/ultradeedback_binarized finetuning.