Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

544

Full-text search

Active filters: DPO

Zoyd/NousResearch_Hermes-2-Theta-Llama-3-8B-6_0bpw_exl2

Text Generation • Updated May 26, 2024

Zoyd/NousResearch_Hermes-2-Theta-Llama-3-8B-6_5bpw_exl2

Text Generation • Updated May 26, 2024 • 1

Zoyd/NousResearch_Hermes-2-Theta-Llama-3-8B-8_0bpw_exl2

Text Generation • Updated May 26, 2024 • 1

grimjim/llama-3-aaditya-OpenBioLLM-8B

Text Generation • 8B • Updated May 29, 2024 • 8

Johnyquest7/Llama3-OpenBioLLM-8B-Q4_K_M-GGUF

8B • Updated May 31, 2024 • 4

Writer/Palmyra-Med-70B-32K

Text Generation • Updated Sep 1, 2025 • 111 • 121

NikolayKozloff/DiscoLM_German_7b_v1-Q8_0-GGUF

7B • Updated Jun 4, 2024 • 1 • 1

sealad886/Llama3-OpenBioLLM-8B

Text Generation • 8B • Updated Jun 20, 2024 • 1

sealad886/Llama3-OpenBioLLM-70B

Text Generation • 71B • Updated Jun 21, 2024 • 2

vicky4s4s/mistral-2-7B

Text Generation • 7B • Updated Jun 6, 2024 • 5

SungJoo/llama2-7b-sft-dpo-detox

Updated Jun 7, 2024

mradermacher/Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF

47B • Updated Mar 31, 2025 • 210 • 2

mradermacher/Nous-Hermes-2-Mixtral-8x7B-DPO-i1-GGUF

47B • Updated Aug 2, 2024 • 322 • 5

mradermacher/Yi-34Bx2-MoE-60B-DPO-GGUF

61B • Updated Jun 29, 2024 • 60

mradermacher/Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B-GGUF

61B • Updated Jun 15, 2024 • 44

mradermacher/Yi-34Bx2-MoE-60B-DPO-i1-GGUF

61B • Updated Aug 2, 2024 • 82

mlx-community/Hermes-2-Theta-Llama-3-8B-4bit

Text Generation • 1B • Updated Jun 14, 2024 • 3 • 1

cypienai/cymist-2-v02-DPO-main

Text Generation • 7B • Updated Jun 14, 2024 • 3 • 3

mlx-community/Hermes-2-Theta-Llama-3-8B-8bit

Text Generation • 2B • Updated Jun 14, 2024 • 2 • 1

mradermacher/Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B-i1-GGUF

61B • Updated Aug 2, 2024 • 3.33k

vicky4s4s/Hermes-2-Pro-Mistral-7B

Text Generation • 7B • Updated Jun 18, 2024

yichaodu/DiffusionDPO-alignment-claude3-opus

Text-to-Image • Updated Jul 9, 2024 • 12

yichaodu/DiffusionDPO-alignment-gemini-1.5

Text-to-Image • Updated Jul 9, 2024 • 22 • 1

yichaodu/DiffusionDPO-alignment-gpt-4o

Text-to-Image • Updated Jul 9, 2024 • 22

yichaodu/DiffusionDPO-alignment-gpt-4v

Text-to-Image • Updated Jul 9, 2024 • 6

yichaodu/DiffusionDPO-alignment-hps-2.1

Text-to-Image • Updated Jul 9, 2024 • 15

yichaodu/DiffusionDPO-alignment-internvl-1.5

Text-to-Image • Updated Jul 9, 2024 • 26

yichaodu/DiffusionDPO-safety-claude3-opus

Text-to-Image • Updated Jul 9, 2024 • 6

yichaodu/DiffusionDPO-safety-gemini-1.5

Text-to-Image • Updated Jul 9, 2024 • 8

yichaodu/DiffusionDPO-safety-gpt-4o

Text-to-Image • Updated Jul 9, 2024 • 10