RTO-RL
/

Llama3-8B-DPO

Model card Files Files and versions

Base model: OpenRLHF/Llama-3-8b-sft-mixture

Preference dataset: HuggingFaceH4/ultrafeedback_binarized

Downloads last month: 15

Safetensors

Model size

8B params

Tensor type

BF16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for RTO-RL/Llama3-8B-DPO

Base model

OpenRLHF/Llama-3-8b-sft-mixture

Finetuned

(11)

this model

Dataset used to train RTO-RL/Llama3-8B-DPO