promotion/UW1-NBPO-PW
Text Generation • 8B • Updated • 709
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
211
Active filters: preference-optimization
promotion/UW1-FixedRefNash-PW
Text Generation • 8B • Updated • 723
promotion/UW1-DPO-soft
Text Generation • 8B • Updated • 729
promotion/UW1-INPO-soft
Text Generation • 8B • Updated • 729
promotion/UW1-SPPO
Text Generation • 8B • Updated • 793
promotion/UW1-PROSPER
Text Generation • 8B • Updated • 392
rat-lab/mh-ec2-ttomd-K2-van
Updated
rat-lab/mh-ec2-ttomd-K2-jk
Updated
rat-lab/mh-ec2-ttomd-K2-delta
Updated
rat-lab/mh-ec2-ttomd-K4-van
Updated • 1
rat-lab/mh-ec2-ttomd-K4-jk
Updated
rat-lab/mh-ec2-ttomd-K4-delta
Updated
rat-lab/mh-ec2-ttomd-K8-van
Updated
rat-lab/mh-ec2-ttomd-K8-jk
Updated
rat-lab/mh-ec2-ttomd-K8-delta
Updated
vinmlops/dpo-v1
Text Generation • 2B • Updated • 24
rat-lab/mh-fresh-K2-van
Updated
rat-lab/mh-fresh-K2-jk
Updated
rat-lab/mh-fresh-K2-delta
Updated
rat-lab/mh-fresh-K6-van
Updated
rat-lab/mh-fresh-K6-jk
Updated
rat-lab/mh-fresh-K6-delta
Updated
wesjos/Mimo-Qwen3.5-9B-Cold
Text Generation • 9B • Updated • 405
wesjos/Mimo-Qwen3.5-9B-Cold-GGUF
Text Generation • 9B • Updated • 154
MercanAI/Mercan-0.8B-Preference-Plus-Q4
Text Generation • Updated
nagbhaskar55/slm125mlive-qa-RLAIF
Text Generation • 0.1B • Updated • 128
nagbhaskar55/slm-500m-qa-RLAIF
Text Generation • 0.5B • Updated • 125
nagbhaskar55/slm125mlive-qa-DPO
Text Generation • 0.1B • Updated • 128
nagbhaskar55/slm-500m-qa-DPO
Text Generation • 0.5B • Updated • 124
nagbhaskar55/gemma-2-2b-qa-DPO
Text Generation • 3B • Updated • 126