berkeley-nest/Nectar
Viewer • Updated • 183k • 1.28k • 295
LM Preference datas
-
-
mlabonne/chatml_dpo_pairs
Viewer • Updated • 12.9k • 77 • 55 -
HuggingFaceH4/ultrachat_200k
Viewer • Updated • 515k • 57.7k • 739 -
Intel/orca_dpo_pairs
Viewer • Updated • 12.9k • 2.11k • 323 -
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 12.3k • 162 -
argilla/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 2.39k • 86 -
PKU-Alignment/PKU-SafeRLHF
Viewer • Updated • 164k • 12.3k • 191 -
lvwerra/stack-exchange-paired
Viewer • Updated • 31.3M • 1.07k • 150 -
Anthropic/hh-rlhf
Viewer • Updated • 169k • 28.7k • 1.81k -
jondurbin/truthy-dpo-v0.1
Viewer • Updated • 1.02k • 328 • 140 -
neovalle/H4rmony
Viewer • Updated • 2.02k • 40 • 15 -
peiyi9979/Math-Shepherd
Viewer • Updated • 445k • 666 • 105 -
nvidia/HelpSteer
Viewer • Updated • 37.1k • 1.66k • 250 -
argilla/dpo-mix-7k
Viewer • Updated • 7.5k • 1.12k • 175 -
microsoft/ms_marco
Viewer • Updated • 1.11M • 26.6k • 244 -
openbmb/UltraInteract_sft
Viewer • Updated • 289k • 2.05k • 127 -
allenai/olmo-2-0325-32b-preference-mix
Updated • 46 • 15 -
PrimeIntellect/SYNTHETIC-2-Base-Answer-Critique
Viewer • Updated • 50k • 15 • 2