Hugging Face
Search models, datasets, users...
Ctrl K
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Model Tree
Base
Adapters
Finetunes
Quantizations
Merges
Apps
llama.cpp
Llama
LM Studio
Jan
Draw Things
DiffusionBee
JoyFusion
vLLM
Ollama
MLX LM
Docker Model Runner
Lemonade
SGLang
Unsloth Desktop
Pi
Hermes Agent
Atomic Chat
OpenClaw
Inference Providers
Select all
DeepInfra
Baseten
Cerebras
Featherless AI
Fireworks
fal
Cohere
Together AI
CoreWeave
DigitalOcean
WaveSpeed
Parasail
Nebius
Prime Intellect
Scaleway
Liquid AI
Mistral
Replicate
Reka
HF Inference API
One-click Deployment
Inference Endpoints
Microsoft Foundry
Amazon SageMaker AI
Misc
Reset Misc
rpo
Mixture of Experts
decision-model
Merge
4-bit precision
8-bit precision
custom_code
Eval Results
Carbon Emissions
Apply filters
Models
24
Base only
Inference Available
Inference
Edit filters
Sort: Trending
Active filters:
rpo
Clear all
sambal/k2-v2-think-dpo-checkpoint-200
Text Generation
•
33B
•
Updated
Sep 2
•
10
sambal/k2-horizon-7b-lndpo-rpo-full-checkpoint-200
Text Generation
•
9B
•
Updated
Sep 28
•
40
sambal/k2-horizon-7b-lndpo-rpo-full-checkpoint-300
Text Generation
•
9B
•
Updated
Sep 28
•
30
sambal/k2-horizon-7b-lndpo-rpo-lora-checkpoint-300
Text Generation
•
9B
•
Updated
Sep 28
•
22
k050506koch/GPT3-dev-125m-0610-instruct
Text Generation
•
0.1B
•
Updated
Oct 15
•
26
RakhatM/qwen3-1.7b-kazakh-text-to-sql-dpo
Text Generation
•
2B
•
Updated
Oct 20
•
27
ewin-reg/MiniCPM-V-4.7-1B-Agentic-FwS
Image-Text-to-Text
•
2B
•
Updated
26 days ago
•
197
•
2
bcckfdn/cevher2-test-16-decay-it-dpo
2B
•
Updated
21 days ago
•
43
EiadEssam/smollm2-1.7b-gsm8k-v2-dpo
Text Generation
•
2B
•
Updated
17 days ago
•
83
sambal/k2-horizon-3.7b-lndpo-rpo-full-checkpoint-300
Text Generation
•
5B
•
Updated
17 days ago
•
51
sambal/k2-horizon-3.7b-lndpo-rpo-full-checkpoint-400
Text Generation
•
5B
•
Updated
17 days ago
•
62
wentywenty/robopoly-action-rpo-wave
Robotics
•
Updated
11 days ago
wentywenty/robopoly-action-rpo-default
Robotics
•
Updated
11 days ago
wentywenty/robopoly-action-rpo-amp
Robotics
•
Updated
11 days ago
wentywenty/robopoly-action-rpo-interrupt
Robotics
•
Updated
11 days ago
wentywenty/robopoly-action-rpo-parkour
Robotics
•
Updated
11 days ago
wentywenty/robopoly-action-rpo-getup
Robotics
•
Updated
11 days ago
wentywenty/robopoly-action-rpo-dance0
Robotics
•
Updated
11 days ago
wentywenty/robopoly-action-rpo-dance1
Robotics
•
Updated
11 days ago
davidan03/openwebrl-4b-selectionadm-rpo-2ep
4B
•
Updated
12 days ago
•
46
BonTapHoa/LifeMate-Qwen3.5-4B-Adapters
Text Generation
•
Updated
3 days ago
Plans11/MiniCPM-V-4.7-1B-Agentic-FwS
Image-Text-to-Text
•
2B
•
Updated
2 days ago
•
30
davidan03/openwebrl-4b-iterpool-schedule
Updated
1 day ago
mradermacher/MiniCPM-V-4.7-1B-Agentic-FwS-GGUF
Reinforcement Learning
•
1B
•
Updated
1 day ago
•
724