Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

preference-optimization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

211

Base only

Active filters: preference-optimization

promotion/Llama-3.1-8B-FixedReferenceNBPO

Text Generation • 8B • Updated 29 days ago • 309

promotion/Llama-3.1-8B-TLDR-MaxMinRLHF-baseline

Text Generation • 8B • Updated 28 days ago • 585

promotion/Llama-3.1-8B-TLDR-RewardedSoups-baseline

Text Generation • 8B • Updated 29 days ago • 343

promotion/Llama-3.1-8B-TLDR-Panacea-baseline

Text Generation • 8B • Updated 29 days ago • 347

promotion/Llama-3.1-8B-TLDR-NBPO-finitepool

Text Generation • 8B • Updated 29 days ago • 344

promotion/Llama-3.1-8B-TLDR-Utilitarian-baseline

Text Generation • 8B • Updated 29 days ago • 303

promotion/Llama-3.1-8B-TLDR-AbsoluteMaxMin-baseline

Text Generation • 8B • Updated 29 days ago • 290

promotion/Llama-3.1-8B-TLDR-SurplusMaxMin-baseline

Text Generation • 8B • Updated 29 days ago • 287

promotion/Llama-3.1-8B-SafeRLHF-MaxMinRLHF-baseline

Text Generation • 8B • Updated 29 days ago • 298

promotion/Llama-3.1-8B-SafeRLHF-RewardedSoups-baseline

Text Generation • 8B • Updated 29 days ago • 344

promotion/Llama-3.1-8B-SafeRLHF-NBPO-finitepool

Text Generation • 8B • Updated 29 days ago • 374

promotion/Llama-3.1-8B-SafeRLHF-Utilitarian-baseline

Text Generation • 8B • Updated 29 days ago • 378

promotion/Llama-3.1-8B-SafeRLHF-AbsoluteMaxMin-baseline

Text Generation • 8B • Updated 29 days ago • 351

promotion/Llama-3.1-8B-SafeRLHF-SurplusMaxMin-baseline

Text Generation • 8B • Updated 29 days ago • 361

promotion/Llama-3.1-8B-NBPO-UltraFeedback-clean

Text Generation • 8B • Updated 27 days ago • 293

promotion/Llama-3.1-8B-NBPO-UltraFeedback-eta0.05

Text Generation • 8B • Updated 27 days ago • 292

promotion/Llama-3.1-8B-TLDR-NBPO-eta0.05

Text Generation • 8B • Updated 27 days ago • 285

promotion/Llama-3.1-8B-SafeRLHF-NBPO-eta0.1

Text Generation • 8B • Updated 27 days ago • 287

promotion/Qwen3-8B-MaxMinRLHF-baseline

Text Generation • 8B • Updated 27 days ago • 271

promotion/Qwen3-8B-RewardedSoups-baseline

Text Generation • 8B • Updated 27 days ago • 287

promotion/Qwen3-8B-Panacea-baseline

Text Generation • 8B • Updated 27 days ago • 292

promotion/Llama-3.1-8B-SafeRLHF-NBPO-stage2

Text Generation • 8B • Updated 27 days ago • 351

promotion/Llama-3.1-8B-NBPO-UltraFeedback-600updates

Text Generation • 8B • Updated 27 days ago • 370

promotion/Llama-3.1-8B-TLDR-NBPO-600updates

Text Generation • 8B • Updated 27 days ago • 350

promotion/Llama-3.1-8B-SafeRLHF-NBPO-600updates

Text Generation • 8B • Updated 27 days ago • 377

promotion/nbpo-policy-diagnostics

Updated 25 days ago

arjhinety/OpenGrad-Qwen3.5-2B-M1-DPO

Updated 21 days ago

promotion/NBPO-Qwen2.5-7B-WildChecklists-2ep

Text Generation • 8B • Updated 18 days ago • 450

promotion/PROSPER-Qwen2.5-7B-WildChecklists-2ep

Text Generation • 8B • Updated 18 days ago • 449

promotion/FixedRefNash-Qwen2.5-7B-WildChecklists-2ep

Text Generation • 8B • Updated 18 days ago • 451