mmmanuel
/

DPO_ONSFT_HALF_DATA_3

Text Generation

text-generation-inference

Model card Files Files and versions

Uploaded model

Developed by: mmmanuel
License: apache-2.0
Finetuned from model : mmmanuel/SFT_nochat_FULL_DATA

This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: 1

Safetensors

Model size

0.6B params

Tensor type

BF16

·

Model tree for mmmanuel/DPO_ONSFT_HALF_DATA_3

Base model

mmmanuel/SFT_nochat_FULL_DATA

Finetuned

(4)

this model