Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,530

Base only

Active filters: alignment

nyannto/dpo-qwen-cot-merged24

Text Generation • 4B • Updated Feb 28 • 3

tomofusa/exp026b-mlp-dpo-ipo-merged

Text Generation • 4B • Updated Feb 28 • 3

Hi-Satoh/adv_sft_dpo_w_merged

Text Generation • 4B • Updated Feb 28 • 19 •

sampeichan/qwen3-4b-dpo-qwen-cot-merged_20260228

Text Generation • 4B • Updated Feb 28 • 3

satoyutaka/llm2025_main_v12_075_dpo_merged

4B • Updated Feb 28 • 1

sonodd/qwen3-4b-structeval-dpo-v2-restored

Text Generation • 4B • Updated Feb 28 • 3

YiyingXie/gemma-3-270m-it-dpo

Updated Mar 11 • 1

nyannto/dpo-qwen-cot-merged25

Text Generation • 4B • Updated Feb 28 • 4

tomofusa/exp027-downproj-dpo-ipo-merged

Text Generation • 4B • Updated Feb 28 • 3

Momoka1010/qwen3-4b-dpo-v0.04

Text Generation • 4B • Updated Feb 28 • 3

ottys/dpo-qwen-cot-merged

Text Generation • 4B • Updated Mar 1 • 16 •

nyannto/dpo-qwen-cot-merged26

Text Generation • 4B • Updated Feb 28 • 3

hiro7ka/dpo-qwen-cot-merged-ver2

Text Generation • 4B • Updated Feb 28 • 3

sho-nakamura/dpo-qwen-cot-merged

Text Generation • 4B • Updated Mar 1 • 19 •

Hi-Satoh/adv_sft_dpo_final_1_merged

Text Generation • 4B • Updated Feb 28 • 23 •

ogaharu/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 28 • 3

KSIMNB/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 28 • 17 •

Hi-Satoh/adv_sft_dpo_final_2_merged

Text Generation • 4B • Updated Feb 28 • 17 •

kuma-no-yapooh3/your-lora-repo-dpo

Text Generation • 4B • Updated Feb 28 • 2

tomofusa/exp028b-downproj-dpo-lr1e6-ep2-merged

Text Generation • 4B • Updated Feb 28 • 3

motobrew/qwen-dpo-v3

Text Generation • 4B • Updated Mar 2 • 20 •

Hi-Satoh/adv_sft_dpo_final_3_merged

Text Generation • 4B • Updated Feb 28 • 19 •

hiro7ka/dpo-qwen-cot-merged-ver3

Text Generation • 4B • Updated Feb 28 • 17 •

tomofusa/exp028-downproj-dpo-ep3-merged

Text Generation • 4B • Updated Feb 28 • 2

mohtani777/Qwen3_4B_SFT_DPOv3_agent_v0_LR1E7

Text Generation • 4B • Updated Feb 28 • 17 •

tmaoshima/dpo-qwen-cot-merged

Text Generation • 4B • Updated Mar 1 • 19 •

mohtani777/Qwen3_4B_SFT_DPOv3_agent_v0_LR5E7

Text Generation • 4B • Updated Feb 28 • 17 •

Hi-Satoh/adv_sft_dpo_final_4_merged

Text Generation • 4B • Updated Feb 28 • 22 •

mohtani777/Qwen3_4B_SFT_DPOv3_agent_v0_LR1E6

Text Generation • 4B • Updated Feb 28 • 3

motobrew/qwen-dpo-v11

Text Generation • 4B • Updated Mar 3 • 2