Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,245

Full-text search

Active filters: alignment

Rina1001/dpo-qwen-cot-merged

Text Generation • 4B • Updated 30 days ago • 16

Hi-Satoh/sft-base4-dpo-e2-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 1

reiwa7/dpo-qwen-cot-merged-s200

Text Generation • 4B • Updated Feb 7 • 1

atsuo321/dpo1-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 1

maru-miya/qwen3-4b-dpo-qwen-cot-merged_v1

Text Generation • 4B • Updated Feb 7

ksk740/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 1

takatuki56/dpo-qwen-cot-merged-V3_v16

Text Generation • 4B • Updated Feb 7 • 1

Chiaki111/qwen3-4b-structured-dpo-merged9-v1

Text Generation • 4B • Updated Feb 7 • 1

sallm/dpo_3-qwen-cot-merged

Text Generation • 4B • Updated about 1 month ago • 1

FujiwaraAyumu/dpo-qwen-cot-merged

Text Generation • Updated Feb 7 • 2

hifill/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 1

Termaln/qwen3-4b-structeval-sft-dpo-v9.1

Text Generation • Updated Feb 7

deepkawamura/qwen3-4b-sft-data1-1-dpo

Text Generation • 4B • Updated Feb 8 • 1

TaHiTaHiTa/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 1

makotonlo/LLM2026_DPO_finalv3

Text Generation • 4B • Updated Feb 7 • 1

maru-miya/dpo-qwen-cot-merged_v27

Text Generation • 4B • Updated Feb 7 • 1

ikedabent/dpo-qwen-cot-merged-v1

Text Generation • Updated Feb 7

reiwa7/dpo-qwen-cot-merged-s250

Text Generation • 4B • Updated Feb 7 • 15

TakaTaka3/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 8 • 1

takatuki56/dpo-qwen-cot-merged-v17

Text Generation • 4B • Updated Feb 7 • 1

kochan13/qwen3-4b-dpo-qwen-cot-merged-26020701

Text Generation • 4B • Updated Feb 7 • 1

takami2022/dpo-qwen-cot-merged_0207ver0

Text Generation • 4B • Updated Feb 7 • 1

odoriko-yoru/qwen3-4b-sft-plus-dpo

Text Generation • 4B • Updated Feb 7 • 2

nisiwaki/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 3

sallm/dpo_4-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 5

HiromasaR04/dpo-qwen-cot-merged3

Text Generation • 4B • Updated Feb 7 • 2

ikedabent/dpo-qwen-cot-merged-v2

Text Generation • Updated Feb 7

kasumi-nakano/dpo-qwen-cot-merged-v2

Text Generation • 4B • Updated Feb 7 • 3

nisiwaki/dpo-qwen-cot-merged_01

Text Generation • 4B • Updated Feb 8 • 1

elenasuzuki/qwen3-4b-structevalt-dpo-run17

Text Generation • 4B • Updated Feb 7 • 1