berkeley-nest/Nectar
Viewer • Updated • 183k • 2.52k • 307
LM Preference datas
-
-
mlabonne/chatml_dpo_pairs
Viewer • Updated • 12.9k • 72 • 55 -
HuggingFaceH4/ultrachat_200k
Viewer • Updated • 515k • 88.2k • 1.18k -
Intel/orca_dpo_pairs
Viewer • Updated • 12.9k • 2k • 335 -
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 20k • 173 -
argilla/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 650 • 88 -
PKU-Alignment/PKU-SafeRLHF
Viewer • Updated • 164k • 13.1k • 204 -
lvwerra/stack-exchange-paired
Updated • 1.87k • 153 -
Anthropic/hh-rlhf
Viewer • Updated • 169k • 35k • 2.46k -
jondurbin/truthy-dpo-v0.1
Viewer • Updated • 1.02k • 577 • 142 -
neovalle/H4rmony
Viewer • Updated • 2.02k • 137 • 17 -
peiyi9979/Math-Shepherd
Viewer • Updated • 445k • 2.24k • 106 -
nvidia/HelpSteer
Viewer • Updated • 37.1k • 3.53k • 261 -
argilla/dpo-mix-7k
Viewer • Updated • 7.5k • 1.02k • 183 -
microsoft/ms_marco
Viewer • Updated • 1.11M • 22.5k • 260 -
openbmb/UltraInteract_sft
Viewer • Updated • 289k • 1.12k • 131 -
allenai/olmo-2-0325-32b-preference-mix
Updated • 98 • 15 -
PrimeIntellect/SYNTHETIC-2-Base-Answer-Critique
Viewer • Updated • 50k • 19 • 2