Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,245

Full-text search

Active filters: alignment

mohtani777/Qwen3_4B_SFT_DPOv1_agent_v0LR1E6

Text Generation • 4B • Updated 15 days ago • 37

Hi-Satoh/adv_MoE_OL_dpo_merged

Text Generation • 4B • Updated 15 days ago • 47

tatsuji1962/dpo-qwen-cot-merged24

Text Generation • 4B • Updated 15 days ago • 36

sfutenma/dpo-qwen3_4b-cot-merged_v260227-193900

Text Generation • 4B • Updated 15 days ago • 34

sfutenma/dpo-qwen3_4b-cot-merged_v260227-195434

Text Generation • 4B • Updated 15 days ago • 36

sfutenma/dpo-qwen3_4b-cot-merged_v260227-201817

Text Generation • 4B • Updated 15 days ago • 36

OguraHiroyuki/dpo-qwen-cot-mergedv6

Text Generation • 4B • Updated 15 days ago • 31

smzyuki/dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 78

sonodd/qwen3-4b-structeval-dpo-v6c

Text Generation • 4B • Updated 15 days ago • 16

OguraHiroyuki/dpo-qwen-cot-mergedv7

Text Generation • 4B • Updated 15 days ago • 27

achiepatricia/han-ethical-alignment-monitoring-model-v1

Updated 15 days ago

hiro7ka/dpo-qwen-cot-merged

Text Generation • 4B • Updated 14 days ago • 71

Asmith52/dpo-qwen-cot-merged

Text Generation • 4B • Updated 15 days ago • 26

tomofusa/exp026-mlp-dpo-ipo-merged

Text Generation • 4B • Updated 15 days ago • 23

mohtani777/Qwen3_4B_SFT_DPO_agent_v0_2

Text Generation • 4B • Updated 15 days ago • 48

sonodd/qwen3-4b-structeval-dpo-v7-beta005

Text Generation • 4B • Updated 15 days ago • 10

takanaka/dpo-qwen-cot-merged

Text Generation • 4B • Updated 15 days ago • 41

nyannto/dpo-qwen-cot-merged24

Text Generation • 4B • Updated 15 days ago • 37

tomofusa/exp026b-mlp-dpo-ipo-merged

Text Generation • 4B • Updated 15 days ago • 47

Hi-Satoh/adv_sft_dpo_w_merged

Text Generation • 4B • Updated 15 days ago • 57

sampeichan/qwen3-4b-dpo-qwen-cot-merged_20260228

Text Generation • 4B • Updated 14 days ago • 47

satoyutaka/llm2025_main_v12_075_dpo_merged

4B • Updated 14 days ago • 33

sonodd/qwen3-4b-structeval-dpo-v2-restored

Text Generation • 4B • Updated 14 days ago • 13

YiyingXie/gemma-3-270m-it-dpo

Updated 3 days ago

nyannto/dpo-qwen-cot-merged25

Text Generation • 4B • Updated 14 days ago • 42

tomofusa/exp027-downproj-dpo-ipo-merged

Text Generation • 4B • Updated 14 days ago • 38

Momoka1010/qwen3-4b-dpo-v0.04

Text Generation • 4B • Updated 14 days ago • 39

ottys/dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 148

nyannto/dpo-qwen-cot-merged26

Text Generation • 4B • Updated 14 days ago • 43

hiro7ka/dpo-qwen-cot-merged-ver2

Text Generation • 4B • Updated 14 days ago • 36