Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
llama.cpp
LM Studio
Jan
Draw Things
DiffusionBee
JoyFusion
vLLM
Ollama
MLX LM
Docker Model Runner
Lemonade
SGLang
Unsloth Studio
Pi
Hermes Agent
Inference Providers
Select all
Groq
Novita
Cerebras
SambaNova
Nscale
fal
Hyperbolic
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
DeepInfra
WaveSpeed
Misc
Reset Misc
alignment
Inference Endpoints
text-generation-inference
Eval Results (legacy)
text-embeddings-inference
4-bit precision
custom_code
Merge
8-bit precision
Mixture of Experts
Carbon Emissions
Eval Results
Apply filters
Models
1,472
Full-text search
Inference Available
Edit filters
Sort: Trending
Active filters:
alignment
Clear all
OguraHiroyuki/dpo-qwen-cot-mergedv7
Text Generation
•
4B
•
Updated
Feb 27
•
21
achiepatricia/han-ethical-alignment-monitoring-model-v1
Updated
Feb 27
hiro7ka/dpo-qwen-cot-merged
Text Generation
•
4B
•
Updated
Feb 28
•
8
•
Asmith52/dpo-qwen-cot-merged
Text Generation
•
4B
•
Updated
Feb 27
•
7
tomofusa/exp026-mlp-dpo-ipo-merged
Text Generation
•
4B
•
Updated
Feb 27
•
7
mohtani777/Qwen3_4B_SFT_DPO_agent_v0_2
Text Generation
•
4B
•
Updated
Feb 28
•
3
sonodd/qwen3-4b-structeval-dpo-v7-beta005
Text Generation
•
4B
•
Updated
Feb 28
•
4
takanaka/dpo-qwen-cot-merged
Text Generation
•
4B
•
Updated
Feb 28
•
5
nyannto/dpo-qwen-cot-merged24
Text Generation
•
4B
•
Updated
Feb 28
•
7
tomofusa/exp026b-mlp-dpo-ipo-merged
Text Generation
•
4B
•
Updated
Feb 28
•
9
Hi-Satoh/adv_sft_dpo_w_merged
Text Generation
•
4B
•
Updated
Feb 28
•
5
•
sampeichan/qwen3-4b-dpo-qwen-cot-merged_20260228
Text Generation
•
4B
•
Updated
Feb 28
•
5
satoyutaka/llm2025_main_v12_075_dpo_merged
4B
•
Updated
Feb 28
sonodd/qwen3-4b-structeval-dpo-v2-restored
Text Generation
•
4B
•
Updated
Feb 28
•
1
YiyingXie/gemma-3-270m-it-dpo
Updated
Mar 11
nyannto/dpo-qwen-cot-merged25
Text Generation
•
4B
•
Updated
Feb 28
•
5
tomofusa/exp027-downproj-dpo-ipo-merged
Text Generation
•
4B
•
Updated
Feb 28
•
6
Momoka1010/qwen3-4b-dpo-v0.04
Text Generation
•
4B
•
Updated
Feb 28
•
19
ottys/dpo-qwen-cot-merged
Text Generation
•
4B
•
Updated
Mar 1
•
8
•
nyannto/dpo-qwen-cot-merged26
Text Generation
•
4B
•
Updated
Feb 28
•
6
hiro7ka/dpo-qwen-cot-merged-ver2
Text Generation
•
4B
•
Updated
Feb 28
•
9
sho-nakamura/dpo-qwen-cot-merged
Text Generation
•
4B
•
Updated
Mar 1
•
9
•
Hi-Satoh/adv_sft_dpo_final_1_merged
Text Generation
•
4B
•
Updated
Feb 28
•
9
•
ogaharu/dpo-qwen-cot-merged
Text Generation
•
4B
•
Updated
Feb 28
•
5
KSIMNB/dpo-qwen-cot-merged
Text Generation
•
4B
•
Updated
Feb 28
•
13
•
Hi-Satoh/adv_sft_dpo_final_2_merged
Text Generation
•
4B
•
Updated
Feb 28
•
7
•
kuma-no-yapooh3/your-lora-repo-dpo
Text Generation
•
4B
•
Updated
Feb 28
•
3
tomofusa/exp028b-downproj-dpo-lr1e6-ep2-merged
Text Generation
•
4B
•
Updated
Feb 28
•
7
motobrew/qwen-dpo-v3
Text Generation
•
4B
•
Updated
Mar 2
•
6
•
Hi-Satoh/adv_sft_dpo_final_3_merged
Text Generation
•
4B
•
Updated
Feb 28
•
6
•
Previous
1
...
35
36
37
38
39
...
50
Next