Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,529

Base only

Active filters: alignment

Chiaki111/qwen3-4b-structured-dpo-merged9-v1

Text Generation • 4B • Updated Feb 7 • 3

sallm/dpo_3-qwen-cot-merged

Text Generation • 4B • Updated Feb 13 • 3

FujiwaraAyumu/dpo-qwen-cot-merged

Text Generation • Updated Feb 7 • 2

hifill/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 17 •

Termaln/qwen3-4b-structeval-sft-dpo-v9.1

Text Generation • Updated Feb 7

deepkawamura/qwen3-4b-sft-data1-1-dpo

Text Generation • 4B • Updated Feb 8 • 2

TaHiTaHiTa/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 15 •

makotonlo/LLM2026_DPO_finalv3

Text Generation • 4B • Updated Feb 7 • 2

maru-miya/dpo-qwen-cot-merged_v27

Text Generation • 4B • Updated Feb 7 • 2

ikedabent/dpo-qwen-cot-merged-v1

Text Generation • Updated Feb 7

reiwa7/dpo-qwen-cot-merged-s250

Text Generation • 4B • Updated Feb 7 • 18 •

TakaTaka3/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 8 • 2

takatuki56/dpo-qwen-cot-merged-v17

Text Generation • 4B • Updated Feb 7 • 3

kochan13/qwen3-4b-dpo-qwen-cot-merged-26020701

Text Generation • 4B • Updated Feb 7 • 3

takami2022/dpo-qwen-cot-merged_0207ver0

Text Generation • 4B • Updated Feb 7 • 4

odoriko-yoru/qwen3-4b-sft-plus-dpo

Text Generation • 4B • Updated Feb 7 • 3

nisiwaki/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 3

sallm/dpo_4-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 3

HiromasaR04/dpo-qwen-cot-merged3

Text Generation • 4B • Updated Feb 7 • 5

ikedabent/dpo-qwen-cot-merged-v2

Text Generation • Updated Feb 7

kasumi-nakano/dpo-qwen-cot-merged-v2

Text Generation • 4B • Updated Feb 7 • 3

nisiwaki/dpo-qwen-cot-merged_01

Text Generation • 4B • Updated Feb 8 • 16 •

elenasuzuki/qwen3-4b-structevalt-dpo-run17

Text Generation • 4B • Updated Feb 7 • 3

uskma7151/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 2

nakano0takashi/dpo-qwen-cot-lora-0208-C1

Text Generation • Updated Feb 7

SasanoHideo/qwen3-4b-dpo-qwen-cot-merged-rev.01

Text Generation • 4B • Updated Feb 8 • 18 •

nakano0takashi/dpo-qwen-cot-merged-0208-C2

Text Generation • 4B • Updated Feb 8 • 2

choco800/dpo-qwen-cot-merged-v1

Text Generation • 4B • Updated Feb 8 • 2

nakano0takashi/dpo-qwen-cot-lora-0208-C2

Text Generation • Updated Feb 8

TATSUKI003/dpo-qwen-cot-merged_0208

Text Generation • 4B • Updated Feb 8 • 2