jointpreferences
/

mistral_7b_sft_helpful

Text Generation

text-generation-inference

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Paper: Comparing Bad Apples to Good Oranges: Aligning Large Language Models via Joint Preference Optimization

Link: https://arxiv.org/abs/2404.00530

Github: https://github.com/Hritikbansal/dove

Downloads last month: 6

Safetensors

Model size

7B params

Tensor type

BF16

·

Paper for jointpreferences/mistral_7b_sft_helpful

Comparing Bad Apples to Good Oranges: Aligning Large Language Models via Joint Preference Optimization

Paper • 2404.00530 • Published Mar 31, 2024