RTO-RL
/

Llama3-8B-RTO_RPP

Model card Files Files and versions

Base Model: OpenRLHF/Llama-3-8b-sft-mixture

DPO model: RTO-RL/Llama3-8B-DPO

Reward model: RTO-RL/Llama3.2-1B-RewardModel

Prompt dataset: weqweasdas/ultra_train

Downloads last month: -

Safetensors

Model size

8B params

Tensor type

BF16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for RTO-RL/Llama3-8B-RTO_RPP

Base model

OpenRLHF/Llama-3-8b-sft-mixture

Finetuned

(11)

this model

Quantizations

Dataset used to train RTO-RL/Llama3-8B-RTO_RPP