Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

preference-modeling

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15

Base only

Active filters: preference-modeling

Tandogan/MNLP_M2_dpo_model

0.6B • Updated May 27, 2025 • 14

rameyjm7/llm-preference-unlearning

Updated Dec 1, 2025 • 1

ariefansclub/humanoid-preference-personalization-classifier-v1

Text Classification • Updated Feb 21 • 1

OldKingMeister/llama-3-8b-lmsys-arena-final

OldKingMeister/llama-3-8b-instruct-lmsys-arena-final

OldKingMeister/gemma-2b-lmsys-arena-final

Updated Mar 5 • 2

Himanshu167/AI-Response-Comparer-v1.5

Text Classification • 0.4B • Updated May 9 • 4

Himanshu167/AI-Response-Comparer-v1.6

Text Classification • 0.4B • Updated May 9 • 4

mario-rc/multi-domain-rm-fsfairx-gemma-2-9b-it

Text Classification • 9B • Updated Jun 9 • 8

mario-rc/multi-domain-rm-fsfairx-llama-3-8b-it

Text Classification • 8B • Updated Jun 9 • 4

mario-rc/multi-domain-rm-mistral-7b-it

Text Classification • 7B • Updated Jun 9 • 4

mario-rc/multi-domain-rm-qwen-3-nemotron-8b-it

Text Classification • 8B • Updated Jun 9 • 13

mario-rc/multi-domain-rm-skywork-llama-3.1-8b-it

Text Classification • 8B • Updated Jun 9 • 9

mario-rc/multi-domain-rm-skywork-qwen-3-8b-it

Text Classification • 8B • Updated Jun 9 • 4

yavuz-ai/qwen2.5-1.5b-rm-ultrafeedback

Text Classification • 2B • Updated 26 days ago • 38