Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,245

Full-text search

Active filters: alignment

tomofusa/exp033-dpo-wd005-merged

Text Generation • 4B • Updated 13 days ago • 49

tomofusa/exp031-dpo-toml-custom-merged

Text Generation • 4B • Updated 13 days ago • 41

mohtani777/Qwen3_4B_SFTV5_DPOv3_agent_v0_LR5E7

Text Generation • 4B • Updated 13 days ago • 47

Hi-Satoh/adv_sft_dpo_final_10_merged

Text Generation • 4B • Updated 13 days ago • 51

HuiyuWang/dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 85

mohtani777/Qwen3_4B_SFT_DPOv1_DPOv3_agent_v0

Text Generation • 4B • Updated 13 days ago • 59

satoyutaka/LLM2026_main_v13_dpo

4B • Updated 13 days ago • 44

Mayukemono/dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 44

Hi-Satoh/adv_sft_dpo_final_11_merged

Text Generation • 4B • Updated 13 days ago • 60

sfutenma/dpo-qwen3_4b-cot-merged_v260301-142208

Text Generation • 4B • Updated 13 days ago • 45

SomasE/dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 77

bam2app/dpo-qwen-cot-merged_v1

Text Generation • 4B • Updated 13 days ago • 72

Hi-Satoh/adv_sft_dpo_final_12_merged

Text Generation • 4B • Updated 13 days ago • 51

mohtani777/Qwen3_4B_SFTV5_DPOv3_agent_v0_LR1E6

Text Generation • 4B • Updated 13 days ago • 75

MzAsh/qwen3-4b-struct-dpo-v1

Text Generation • Updated 13 days ago

Yurori/qwen3-4b-dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 93

sfutenma/dpo-qwen3_4b-cot-merged_v260301-151110

Text Generation • 4B • Updated 12 days ago • 73

follmon10/qwen3-4b-dpo-qwen-cot-merged_v1

Text Generation • 4B • Updated 13 days ago • 83

Hi-Satoh/adv_sft_dpo_final_13_merged

Text Generation • 4B • Updated 13 days ago • 85

Hi-Satoh/adv_sft_dpo_final_14_merged

Text Generation • 4B • Updated 13 days ago • 52

sfutenma/dpo-qwen3_4b-cot-merged_v260301-161127

Text Generation • 4B • Updated 12 days ago • 46

YangZhou24/RealGRPO

Text-to-Image • Updated 12 days ago • 7

hiro7ka/dpo-qwen-cot-merged-ver3c

Text Generation • 4B • Updated 13 days ago • 48

tomofusa/exp034-toml-upsample-dpo-merged

Text Generation • 4B • Updated 13 days ago • 60

riririyako/dpo-qwen-cot-merged-v1

Text Generation • 4B • Updated 13 days ago • 43

tomofusa/exp036-blend-i-dpo-merged

Text Generation • 4B • Updated 13 days ago • 43

FruitsLover/dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 44

Sumiokashi/dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 32

Sumiokashi/qwen3-4b-structured-3k-mix-sft_lora-dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 141

yukiakari/dpo-qwen-cot-merged

Text Generation • 4B • Updated 13 days ago • 97