Hugging Face's logo

Nada2022
/
dpo-qwen-cot-merged

Text Generation
Transformers
Safetensors
English
dpo
unsloth
qwen
alignment
conversational
Model card Files
xet
 Community

dpo-qwen-cot-merged

This repository contains DPO fine-tuning artifacts.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Nada2022/dpo-qwen-cot-merged

Base model

Qwen/Qwen3-4B-Instruct-2507
Finetuned
(1652)
this model

Dataset used to train Nada2022/dpo-qwen-cot-merged