berkeley-nest/Nectar
Viewer • Updated • 183k • 2.64k • 307
LM Preference datas
-
-
mlabonne/chatml_dpo_pairs
Viewer • Updated • 12.9k • 75 • 55 -
HuggingFaceH4/ultrachat_200k
Viewer • Updated • 515k • 86.2k • 1.18k -
Intel/orca_dpo_pairs
Viewer • Updated • 12.9k • 2.01k • 335 -
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 19.1k • 173 -
argilla/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 658 • 88 -
PKU-Alignment/PKU-SafeRLHF
Viewer • Updated • 164k • 13.2k • 205 -
lvwerra/stack-exchange-paired
Updated • 1.87k • 153 -
Anthropic/hh-rlhf
Viewer • Updated • 169k • 35.2k • 2.46k -
jondurbin/truthy-dpo-v0.1
Viewer • Updated • 1.02k • 597 • 142 -
neovalle/H4rmony
Viewer • Updated • 2.02k • 170 • 17 -
peiyi9979/Math-Shepherd
Viewer • Updated • 445k • 2.22k • 106 -
nvidia/HelpSteer
Viewer • Updated • 37.1k • 3.49k • 261 -
argilla/dpo-mix-7k
Viewer • Updated • 7.5k • 997 • 183 -
microsoft/ms_marco
Viewer • Updated • 1.11M • 18.2k • 261 -
openbmb/UltraInteract_sft
Viewer • Updated • 289k • 1.22k • 131 -
allenai/olmo-2-0325-32b-preference-mix
Updated • 97 • 15 -
PrimeIntellect/SYNTHETIC-2-Base-Answer-Critique
Viewer • Updated • 50k • 21 • 2