Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,245

Full-text search

Active filters: alignment

Taigerer/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 11 • 2

kenzrx/dpo-ori-qwen-cot-merged

Text Generation • 4B • Updated 30 days ago • 3

achiepatricia/han-preference-alignment-engine-v1

sallm/dpo_qm_qwen-cot-merged

Text Generation • 4B • Updated Feb 11 • 2

choco800/dpo-qwen-cot-merged-v3

Text Generation • 4B • Updated Feb 11 • 2

TitleOS/RLAIF_Patriot_Experiment_LoRA

Updated Feb 11 • 5

poko75/dpo-qwen-cot-merged20260211_3

Text Generation • 4B • Updated Feb 12 • 2

KeigoK/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 12 • 2

tussiiiii/qwen3-4b-structured-output-lora-continued-v5-daichira-ver2-dpo-ver2

Text Generation • Updated Feb 12

nyannto/dpo-qwen-cot-merged2

Text Generation • 4B • Updated Feb 12

nyannto/dpo-qwen-cot-merged4

Text Generation • 4B • Updated Feb 12 • 2

SKano/dpo-qwen-cot-merged

Text Generation • 4B • Updated Feb 12 • 2

nyannto/dpo-qwen-cot-merged5

Text Generation • 4B • Updated Feb 12 • 2

kazu1215/qwen-dpo-2026212

Text Generation • 4B • Updated Feb 12 • 4

nyannto/dpo-qwen-cot-merged6

Text Generation • 4B • Updated about 1 month ago • 3

jinkami07/dpo-qwen3-4b-r16-lr3e7-beta005-ep2-merged

Text Generation • 4B • Updated 28 days ago • 20

yuhsuke777/dpo-qwen-cot-merged

Text Generation • 4B • Updated 30 days ago • 2

TitleOS/RLAIF_Patriot_Experiment_F16-GGUF

38.4M • Updated about 1 month ago • 6

TitleOS/RLAIF_Patriot_Experiment_Q8_0-GGUF

38.4M • Updated about 1 month ago • 5

AlignmentResearch/gemma3-27b-it-colluder

Updated about 1 month ago

lthn/LEK-Gemma3-27B

Text Generation • 28B • Updated 24 days ago • 129

Hi-Satoh/sft-base4-dpo-base5-qwen-cot-merged

Text Generation • 4B • Updated about 1 month ago • 2

lthn/LEK-GPT-OSS-20B

Text Generation • 21B • Updated 24 days ago • 177

lthn/LEK-Gemma3-1B-layered

Text Generation • 0.2B • Updated 24 days ago • 75

lthn/LEK-Gemma3-1B-layered-v2

Text Generation • 0.2B • Updated 24 days ago • 68 • 1

manu02/gemma-3-1b-it-4bit-lora-dpo-aligned

Text Generation • 1.0B • Updated 30 days ago • 44

tussiiiii/qwen3-4b-structured-output-lora-continued-v5-daichira-ver2-dpo-ver3

Text Generation • 4B • Updated 28 days ago • 9

y-tani/dpo-qwen-cot-merged

Text Generation • 4B • Updated 29 days ago • 47

HIllaryMori/mmqwen_exp05

Text Generation • 4B • Updated 29 days ago • 13

xyncz/dpo-qwen-cot-merged

Text Generation • 4B • Updated about 1 month ago • 2