Models

1,472

Full-text search

Active filters: alignment

Hi-Satoh/adv_sft3J_dpo_merged

Text Generation • 4B • Updated Feb 22 • 3 •

Taichi11/sft_v7_dpo_v2_merged

Text Generation • 4B • Updated Feb 27 • 3 •

WassyO/qwen3-4b-instruct-dpo-from-sft-4096_u-10bei_v5

Text Generation • Updated Feb 22 • 1

Orifusa/dpo-qwen-cot-merged_study11.5.4ya

Text Generation • 4B • Updated Feb 22 • 2

shinich001/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 22 • 3 •

ogwata/exp19-enhanced-dpo

Text Generation • 4B • Updated Feb 22 • 1

q-hisa/dpo-qwen-cot-merged-v6

Text Generation • 4B • Updated Feb 22 • 10

q-hisa/dpo-qwen-cot-lora-v6

Text Generation • Updated Feb 22 • 2

Orifusa/dpo-qwen-cot-merged_study11.5.5ya

Text Generation • 4B • Updated Feb 22 • 1

Orifusa/dpo-qwen-cot-merged_study11.5.6ya

Text Generation • 4B • Updated Feb 22 • 2

makotonlo/LLM2026_DPO_SFT19_v9

Text Generation • Updated Feb 22

shinich001/qwen3-4b-seq2k-dpo-merged

Text Generation • 4B • Updated Feb 22 • 9

WassyO/qwen3-4b-instruct-dpo-from-sft-4096_u-10bei_9datasets

Text Generation • Updated Feb 22 • 1

nikeda/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 22 • 1

sonodd/qwen3-4b-structeval-dpo-v1-base

Text Generation • 4B • Updated Feb 22 • 4

nagayoshi3/dpo-qwen-cot-merged_test1

Text Generation • 4B • Updated Feb 22 • 3

edynmarch/frostyshat

Text Generation • Updated Mar 22 • 1

sen0808/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 23 • 2

Hi-Satoh/adv_sft3J2_dpo_merged

Text Generation • 4B • Updated Feb 23 • 1

makotonlo/LLM2026_DPO_SFT19_v10

Text Generation • Updated Feb 23

takerufukushima/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 23 • 2

sak3E/qwen2.5-1.5b-dpo-truthful

q-hisa/dpo-qwen-cot-merged-v7

Text Generation • 4B • Updated Feb 23 • 11

q-hisa/dpo-qwen-cot-lora-v7

Text Generation • Updated Feb 23 • 4

masachika/qwen3-4b-dpo-cot-merged

Text Generation • 4B • Updated Feb 24 • 5 •

OguraHiroyuki/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 23 • 5 •

makotonlo/LLM2026_DPO_SFT19_v11

Text Generation • Updated Feb 23

makotonlo/LLM2026_DPO_SFT19_v12

Text Generation • Updated Feb 23

OguraHiroyuki/dpo-qwen-cot-mergedv2

Text Generation • 4B • Updated Feb 23 • 2

unfdn/qwen3-lora

Text Generation • 4B • Updated Mar 2 • 4