Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

1,287

Base only

Active filters: orpo

mradermacher/Qwen3.5-27B-WebNovel-Writer-zh-i1-GGUF

27B • Updated Mar 25 • 2.04k • 4

yothinS/Llama-3.2-3B-ORPO-Advertisement

Text Generation • 3B • Updated about 3 hours ago • 2

wcn123/Qwen3.5-27B-WebNovel-Writer-zh

Text Generation • 27B • Updated Mar 22 • 231 • 17

nbeerbower/Gemma4-Gutenberg-31B

Image-Text-to-Text • 31B • Updated Jun 16 • 147 • 26

yothinS/Qwen3-4B-ORPO-Advertisement

Text Generation • 4B • Updated 1 day ago • 53 • 1

yothinS/Qwen3-4B-ORPO-Advertisement-GGUF

Text Generation • 4B • Updated 1 day ago • 1.39k • 1

yothinS/Llama-3.2-3B-ORPO-Advertisement-GGUF

Text Generation • 3B • Updated about 2 hours ago • 1

alvarobartt/Mistral-7B-v0.1-ORPO

Text Generation • 7B • Updated Mar 23, 2024 • 47 • 14

alvarobartt/Mistral-7B-v0.1-ORPO-PEFT

Text Generation • Updated Mar 23, 2024 • 14 • 1

anakin87/gemma-2b-orpo

Text Generation • 3B • Updated Jun 29, 2025 • 56 • 27

alvarobartt/mistral-orpo-mix

Text Generation • 7B • Updated Mar 24, 2024 • 40 • 1

bartowski/Mistral-7B-v0.1-ORPO-exl2

Text Generation • Updated Mar 24, 2024 • 6

bartowski/Mistral-7B-v0.1-ORPO-GGUF

Text Generation • 7B • Updated Mar 24, 2024 • 706 • 1

alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt

Text Generation • 7B • Updated Mar 26, 2024 • 17

alvarobartt/mistral-orpo-mix-b0.05-l1024-pl512-lr5e-7-cosine

Text Generation • 7B • Updated Mar 26, 2024 • 15

alvarobartt/mistral-7b-orpo-alignment-handbook

Text Generation • 7B • Updated Mar 27, 2024 • 28 • 1

alvarobartt/mistral-7b-orpo-airoboros-pref-10k

Text Generation • 7B • Updated Mar 28, 2024 • 19

mradermacher/mistral-7b-orpo-capybara-reproduction-GGUF

7B • Updated May 6, 2024 • 2.96k

anakin87/gemma-2b-orpo-GGUF

3B • Updated Apr 9, 2024 • 14 • 7

HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1

Text Generation • 141B • Updated Apr 18, 2024 • 238 • 270

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • 141B • Updated Apr 12, 2024 • 1.54k • 29

mlx-community/zephyr-orpo-141b-A35b-v0.1-4bit

141B • Updated Apr 12, 2024 • 37 • 3

wandb/zephyr-orpo-7b-v0.2

Text Generation • 7B • Updated Apr 21, 2024 • 24 • 4

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw2.25

Text Generation • Updated Apr 12, 2024 • 11 • 1

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw2.5

Text Generation • Updated Apr 12, 2024 • 13

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3

Text Generation • Updated Apr 12, 2024 • 15

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3.5

Text Generation • Updated Apr 12, 2024 • 11

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3.7

Text Generation • Updated Apr 12, 2024 • 18

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw4

Text Generation • Updated Apr 12, 2024 • 15

mlx-community/zephyr-orpo-141b-A35b-v0.1-8bit

141B • Updated Apr 16, 2024 • 32