Models

1,472

Full-text search

Active filters: alignment

nyannto/dpo-qwen-cot-merged12

Text Generation • 4B • Updated Feb 21 • 2 •

mandalgo/dpo-qwen-cot-merged2

Text Generation • 4B • Updated Feb 20 • 1

Hi-Satoh/adv_sft5_dpo2_merged

Text Generation • 4B • Updated Feb 20 • 5

Hi-Satoh/adv_sft5_dpo3_merged

Text Generation • 4B • Updated Feb 20 • 2 •

kuniakky/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 20 • 5

keijiban3/dpo-qwen-cot-merged

Text Generation • 0.5B • Updated Feb 20 • 5 •

Hi-Satoh/adv_sft3_dpo_merged

Text Generation • 4B • Updated Feb 20 • 4

arata1/dpo-qwen-cot-merged-0211-b03

Text Generation • 4B • Updated Feb 20 • 2

SKOTK/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 27 • 4 •

m-fujita/structured-output-lora

Text Generation • 4B • Updated Feb 23 • 5

nyannto/dpo-qwen-cot-merged13

Text Generation • 4B • Updated Feb 21 • 3 •

Atsumi1/dpo-qwen-cot-merged-v5

Text Generation • 4B • Updated Feb 21 • 1

taka104/qwen3-4b-dpo-qwen-cot-merged

Text Generation • 4B • Updated Mar 2 • 4 •

shotalab/Qwen3-4B-Instruct-SFT-03-Merged-DPO-01

Text Generation • 4B • Updated Feb 21 • 3 •

q-hisa/dpo-qwen-cot-merged-v5

Text Generation • 4B • Updated Feb 22 • 4 •

q-hisa/dpo-qwen-cot-lora-v5

Text Generation • Updated Feb 21 • 1

takami2022/dpo-qwen3-4b-structured-v2_SFT_SystemPrompt

Text Generation • 4B • Updated Feb 21 • 1

takami2022/dpo-qwen3-4b-structured-v3_SFT_SystemPrompt

Text Generation • 4B • Updated Feb 21 • 3

sfutenma/dpo-qwen3_4b-cot-merged_v260221-210728

Text Generation • 4B • Updated Feb 21 • 2

nyannto/dpo-qwen-cot-merged15

Text Generation • 4B • Updated Feb 21 • 2

sfutenma/dpo-qwen3_4b-cot-merged_v260221-223020

Text Generation • 4B • Updated Feb 21 • 1

arata1/dpo-qwen-cot-e2-b05-1024

Text Generation • 4B • Updated Feb 21 • 1 •

kedumerikugame/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 23 • 2 •

shotalab/Qwen3-4B-Instruct-SFT-03-Merged-DPO-02

Text Generation • 4B • Updated Feb 21 • 2

biokrhr/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 21 • 5

gimlet09/dpo-qwen-cot-merged-v5

Text Generation • Updated Feb 21

Taichi11/sft_v7_dpo_v1_merged

Text Generation • 4B • Updated Feb 21 • 2

Orifusa/dpo-qwen-cot-merged_study11.5.1ya-cot

Text Generation • 4B • Updated Feb 22 • 1

makotonlo/LLM2026_DPO_SFT19_v8

Text Generation • Updated Feb 22

Orifusa/dpo-qwen-cot-merged_study11.5.3ya

Text Generation • 4B • Updated Feb 22 • 5