ComparisonPO
/

Llama-3.2-3B-Instruct-DPO

Update README.md

0767176 verified about 1 month ago

111 Bytes

license: mit
datasets:
  - trl-lib/ultrafeedback_binarized
base_model:
  - meta-llama/Llama-3.2-3B-Instruct