Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

preference-modeling

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

20

Base only

Active filters: preference-modeling

Tandogan/MNLP_M2_dpo_model

0.6B • Updated May 27, 2025 • 8

rameyjm7/llm-preference-unlearning

Updated Dec 1, 2025 • 1

ariefansclub/humanoid-preference-personalization-classifier-v1

Text Classification • Updated Feb 21 • 6

OldKingMeister/llama-3-8b-lmsys-arena-final

Updated Mar 5 • 5

OldKingMeister/llama-3-8b-instruct-lmsys-arena-final

Updated Mar 5 • 16

OldKingMeister/gemma-2b-lmsys-arena-final

Updated Mar 5 • 11

Himanshu167/AI-Response-Comparer-v1.5

Text Classification • 0.4B • Updated May 9 • 10

Himanshu167/AI-Response-Comparer-v1.6

Text Classification • 0.4B • Updated May 9 • 6

mario-rc/multi-domain-rm-fsfairx-gemma-2-9b-it

Text Classification • 9B • Updated Sep 16 • 15

mario-rc/multi-domain-rm-fsfairx-llama-3-8b-it

Text Classification • 8B • Updated Sep 16 • 21

mario-rc/multi-domain-rm-mistral-7b-it

Text Classification • 7B • Updated Sep 16 • 28

mario-rc/multi-domain-rm-qwen-3-nemotron-8b-it

Text Classification • 8B • Updated Sep 16 • 10 • 1

mario-rc/multi-domain-rm-skywork-llama-3.1-8b-it

Text Classification • 8B • Updated Sep 16 • 35

mario-rc/multi-domain-rm-skywork-qwen-3-8b-it

Text Classification • 8B • Updated Sep 16 • 22

yavuz-ai/qwen2.5-1.5b-rm-ultrafeedback

Text Classification • 2B • Updated Jun 19 • 2.45k

abhishekai/slm-125m-legal-rm

Text Classification • 0.1B • Updated Aug 15 • 5

abhishekai/slm-500m-legal-rm

Text Classification • 0.5B • Updated Aug 15 • 8

abhishekai/gemma-2-2b-legal-rm

Text Classification • 3B • Updated Aug 15 • 11

Teburile/DRM

Text Classification • Updated Sep 29 • 6

dheepakkaran/arenajudge-qwen2.5-1.5b-lora-onnx-w4

Text Classification • Updated 26 days ago