Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,529

Base only

Active filters: alignment

kasumi-nakano/dpo-qwen-cot-merged-base

Text Generation • 4B • Updated Feb 5 • 2

yyymmmddd/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 2

hkawaguc/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 2

Norimasa/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 3

7-mitch/qwen3-4b-dpo-qwen-cot-merged-aigis

Text Generation • 4B • Updated Feb 5 • 6

tmdoi/lora-structeval-sft-0205-merged-v2

Text Generation • Updated Feb 5

nakano0takashi/dpo-qwen-cot-merged-1

Text Generation • 4B • Updated Feb 5 • 2

KazumaTsuboi/dpo-qwen-cot-merged_v10

Text Generation • 4B • Updated Feb 5 • 16 •

jmJapan/jm11

Text Generation • 4B • Updated Feb 5 • 3

KotaroT1/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 14 •

qtam/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 3

yuk1chan/qwen3-4b-sft-v5-dpo-beta0.1

Text Generation • 4B • Updated Feb 5 • 2

hirosawady/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 6

kawakawa0778/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 2

mradermacher/utokyo-llm-advance-main-dpo-GGUF

4B • Updated Feb 5 • 162

oberon1999/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 25 • 15 •

OkamotoJP/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 11 • 21 •

sallm/dpo_0-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 2

matsunya/dpo_qwen_cot_merged_v2

Text Generation • 4B • Updated Feb 5 • 4

matsunya/dpo_qwen_cot_merged

Text Generation • 4B • Updated Feb 7 • 20 •

amu870/test-v2.1-grpo

Text Generation • 4B • Updated Feb 6 • 4

morisue/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 2

KazumaTsuboi/dpo-qwen-cot-merged_260206_my_best_baseline

Text Generation • 4B • Updated Feb 5 • 4

kasumi-nakano/dpo-qwen-cot-merged-v1

Text Generation • 4B • Updated Feb 5 • 3

yuji-hashimoto225/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 5 • 2

yamanara/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 7 • 15 •

Mbian/llm-sft-dpo-lora

Text Generation • Updated Feb 5

SusumuDou/dpo-qwen-cot-merged_3

Text Generation • Updated Feb 6 • 2

takeofuture/shibatake-DPO_2602052303

Text Generation • Updated Feb 5

TakaYamamoto/dpo-qwen-cot-merged_biya

Text Generation • 4B • Updated Feb 8 • 9