Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Edit Models filters

Apps
llama.cpp
LM Studio
Jan
Draw Things
DiffusionBee
Jellybox
JoyFusion
LocalAI
vLLM
Ollama
TGI
MLX LM
Docker Model Runner
Lemonade
Inference Providers
Groq
Novita
Nebius AI
Cerebras
SambaNova
Nscale
fal
Hyperbolic
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
WaveSpeed
Misc
preference-optimization
Inference Endpoints
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Mixture of Experts
Carbon Emissions

Models

10
Full-text search
Active filters: preference-optimization

HaiZhiYan/CheX-Phi35V

Visual Question Answering • Updated 18 days ago • 2

ecoxial2007/CheX-Phi4MM-GRPO

Image-Text-to-Text • 6B • Updated 1 day ago • 32 • 1

tokutsu/japanese-answer-13b-8bit

Updated Apr 21 • 5

tahamajs/llama-3.2-3b-orpo-lora64-4bit-instruct

Updated Apr 3 • 3

Likhith003/dpo-pairrm-lora-adapter

Text Generation • 1B • Updated Apr 19 • 11

Likhith003/dpo-llmjudge-lora-adapter

Text Generation • 1B • Updated Apr 19 • 10

jasperyeoh2/mistral-dpo-peft

Updated Apr 25 • 8

loganlin777/mistral-7b-dpo-adapter

Updated Apr 27

gandhiraketla277/finance-llama-3.1-8b-dpo-trained

Text Generation • Updated Aug 24 • 2

vidavox/Qwen3-SKK-32B-DPO

Text Generation • Updated 15 days ago
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs