Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

preference-optimization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

211

Base only

Active filters: preference-optimization

sarimahsan101/Qwen2.5-0.5B-DPO-detox

0.5B • Updated Jul 25 • 14

Manav112/llama-3.2-3b-fantasy-startsit-dpo

Updated Aug 5 • 12

XujuntaoFighting/GC-DPO-diagnostic-ckpts

Text-to-Image • Updated Aug 12

jackf857/Llama-3.2-1B-Instruct-DPO-HH

Text Generation • 1B • Updated Aug 7 • 95

iPwnds/finanalyst-qwen1.5b-final

Text Generation • Updated Aug 9

prajwal55/slm-125m-dpo

Text Generation • 0.1B • Updated Aug 9 • 75

prajwal55/slm-125m-ppo

Text Generation • 0.1B • Updated Aug 9 • 87 • 1

birgermoell/oellm-9b-256k-simpo

Text Generation • 9B • Updated Aug 12 • 97 • 1

ewin-reg/minicpm5-1b-calibrated-anti-hallucination-sycophancy

Text Generation • 1B • Updated Aug 15 • 204

ewin-reg/minicpm5-1b-calibrated-anti-hallucination-sycophancy-GGUF

Text Generation • 1B • Updated Aug 15 • 259 • 2

Sizhe-Chen/Qwen3.6-27B-Instruct-SecPO

Image-Text-to-Text • 27B • Updated Aug 14 • 210 • 2

davidnichols-ops/claude-yolo-vibes-v4-dpo

Text Generation • 8B • Updated Aug 17 • 79

SanatanSinghVishen/sift-1b-dpo

Text Generation • Updated Aug 18 • 12

SanatanSinghVishen/sift-1b-gguf

Text Generation • 2B • Updated Aug 18 • 19 • 1

kenpeter123/small-1b-dpo

Text Generation • 1B • Updated Aug 20 • 120

MMMMoK9922/MetaRoboBench-Flow-DPO

Robotics • Updated Aug 21

aimagelab/CounterVid-Qwen2.5-VL-3B-LoRA

Image-Text-to-Text • 4B • Updated Aug 26 • 15

aimagelab/CounterVid-Qwen2.5-VL-7B-LoRA

Image-Text-to-Text • 8B • Updated Aug 26 • 32

aimagelab/CounterVid-InternVL3-9B-LoRA

Image-Text-to-Text • 9B • Updated Aug 26 • 43

YichengWangCA/R1-Distill-Qwen-14B-AIME-DPO-LoRA

Text Generation • Updated 7 days ago • 65

RantiRepo/gpt2-DPO-LoRA

Text Generation • 0.1B • Updated Aug 28 • 186

RantiRepo/Llama3.2-1B-DPO-LoRA

Text Generation • 1B • Updated Aug 28 • 101

camilablank/sycophancy-dpo-paper-checkpoints

promotion/Qwen3-8B-HTMNPO-instruction-following

8B • Updated Aug 30 • 7

promotion/Llama-3.1-8B-Utilitarian-baseline

8B • Updated Aug 30 • 8

promotion/Llama-3.1-8B-AbsoluteMaxmin-baseline

Text Generation • 8B • Updated 29 days ago • 337

promotion/Llama-3.1-8B-SurplusMaxmin-baseline

Text Generation • 8B • Updated 29 days ago • 341

promotion/Llama-3.1-8B-MOPO-baseline

8B • Updated Aug 30 • 10

austin-k-wang/DiffusionLAIR-SD1.5

Text-to-Image • 0.9B • Updated Aug 31 • 12 • 1

austin-k-wang/DiffusionLAIR-SDXL

Text-to-Image • 3B • Updated Aug 31 • 1