Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12,531

Base only

Active filters: dpo

syntropy-ai/Soren-1-Small

Text Generation • 2B • Updated 2 days ago • 1.12k • 21

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated Apr 9 • 184

mlabonne/NeuralHermes-2.5-Mistral-7B

Text Generation • 7B • Updated Apr 8, 2024 • 78 • • 154

RISys-Lab/RedSage-Qwen3-8B-DPO

Text Generation • 8B • Updated Feb 9 • 1.18k • • 7

mradermacher/RedSage-Qwen3-8B-DPO-GGUF

Text Generation • 8B • Updated Jan 30 • 380 • 4

trentmkelly/gpt-4o-distil-Llama-3.3-70B-Instruct

Text Generation • Updated Feb 2 • 9 • 3

mradermacher/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy-GGUF

8B • Updated Feb 19 • 608 • 7

YiyingXie/gemma-3-270m-it-dpo

Updated Mar 11 • 1

danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF

Text Generation • 9B • Updated Apr 1 • 1.26k • 17

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated 19 days ago • 941 • • 30

XiangJinYu/Qwen3.5-9B-Humanize-DPO-Round2

Text Generation • Updated 19 days ago • 117 • 1

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated

Image-Text-to-Text • 123B • Updated 9 days ago • 770 • 7

mradermacher/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-i1-GGUF

125B • Updated 11 days ago • 6.09k • 3

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4

Image-Text-to-Text • 74B • Updated 9 days ago • 1.25k • 3

MRockatansky/Gemma-4-31B-storymaxxed2-GGUF

Text Generation • 31B • Updated 3 days ago • 2.97k • 1

EvanOLeary/laguna-xs2-dense-k8-cuda-dpo

Text Generation • 3B • Updated 3 days ago • 42 • 1

yakz1/gemma-4-e4b-question-algerienne-dpo-analyse-qualitative-608-2ep-GGUF

Image-Text-to-Text • 7B • Updated 2 days ago • 71 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 16 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 23 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 5

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 19 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 11 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 25 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 68 • • 124

ContextualAI/archangel_sft_pythia1-4b

Text Generation • 1B • Updated Jan 11, 2024 • 5

ContextualAI/archangel_sft_pythia2-8b

Text Generation • 3B • Updated Jan 11, 2024 • 140 • 2

ContextualAI/archangel_sft_pythia6-9b

Text Generation • 7B • Updated Jan 11, 2024 • 6

ContextualAI/archangel_sft_pythia12-0b

Text Generation • 12B • Updated Jan 11, 2024 • 9