Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,535

Base only

Active filters: alignment

pgsyttch/dpo-qwen-cot-merged-1

Text Generation • 4B • Updated Feb 7 • 5

Aimitmk/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 2

koguma-ai/sft-dpo-qwen-cot-merged0207

Text Generation • 4B • Updated Feb 7 • 15 •

fieldvalley-llm2025/llm2025_main_merged_dpo

Text Generation • 4B • Updated Feb 7 • 2

hirosawady/qwen2.5-structured-output-dpo-merged

Text Generation • 4B • Updated Feb 7 • 3

sasa5555/sft-dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 1

makotonlo/LLM2026_DPO_finalv2

Text Generation • 4B • Updated Feb 7 • 2

takenoko888/Qwen3-4B-DPO-Merged

Text Generation • 4B • Updated Feb 7 • 2

rkumagai/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 8 • 16 •

fieldvalley-llm2025/llm2025_main_merged_dpo02

Text Generation • 4B • Updated Feb 7 • 2

takatuki56/dpo-qwen-cot-merged-V2_v14

Text Generation • 4B • Updated Feb 7 • 3

poko75/dpo-qwen-cot-merged2

Text Generation • Updated Feb 7

hawaii222/dpo202602071734

Text Generation • 4B • Updated Feb 7 • 3

legoskier/sft-dpo-qwen-078-plus

Text Generation • Updated Feb 7

fieldvalley-llm2025/llm2025_main_merged_dpo03

4B • Updated Feb 8 • 6

hawaii222/dpo202602071752

Text Generation • 4B • Updated Feb 7 • 2

Kumeichi/dpo-rev.0.1-qwen-cot-merged-with-qwen3-4b-SFT-rev.0.8

Text Generation • 4B • Updated Feb 7 • 4

hawaii222/dpo202602071804

Text Generation • 4B • Updated Feb 7 • 2

hawaii222/dpo202602071902

Text Generation • 4B • Updated Feb 7 • 2

jmJapan/jm23d

Text Generation • 4B • Updated Feb 7 • 2

curio184/qwen3-4b-struct-exp14

Text Generation • 4B • Updated Feb 7 • 3

hikahika/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 18 •

sweetsilversong/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 2

Termaln/qwen3-4b-structeval-sft-dpo-v9

Text Generation • Updated Feb 7

Rakushaking/Qwen4b-SFT-d9-merged-after-dpo-d2

Text Generation • 4B • Updated Feb 8 • 19 •

moroqq/dpo-qwen-cot-merged

Text Generation • Updated Feb 7

Rina1001/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 14 • 23 •

Hi-Satoh/sft-base4-dpo-e2-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 16 •

reiwa7/dpo-qwen-cot-merged-s200

Text Generation • 4B • Updated Feb 7 • 2

atsuo321/dpo1-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 2