Nmoro/dpo-qwen-cot-merged
Text Generation • 4B • Updated
• 86
Edit Models filters
Apps
Inference Providers
Active filters: alignment
lthn/LEM-Gemma3-4B-GGUF
Text Generation • 4B • Updated
• 1.16k
lthn/LEM-Gemma3-1B-GGUF
Text Generation • 1B • Updated
• 569
misocat22/dpo-qwen-cot-merged
Text Generation • 4B • Updated
• 24
seibergwitten/dpo-qwen-cot-merged.ver3
Text Generation • 4B • Updated
• 26
Nomushin/dpo-qwen-cot-merged
Text Generation • 4B • Updated
• 98
Tkawamura/test-lora-repo
Text Generation • 4B • Updated
• 29
weights-and-wires/Llama-3.2-3B-Polite-ORPO
Updated
Naoto-TAJIMA/dpo-qwen-cot-merged
Text Generation • 4B • Updated
• 73
tomofusa/exp017-dpo-ipo-merged
Text Generation • 4B • Updated
• 33
ShimadaMasatsugu/dpo-qwen-cot-merged
Text Generation • 4B • Updated
• 143
tomofusa/exp018-dpo-merged
Text Generation • 4B • Updated
• 17
mohtani777/Qwen3_4B_SFT_DPO_agent_v0
Text Generation • 4B • Updated
• 89
ogwata/exp21-sft-dpo-lr7e7-beta02
Text Generation • 4B • Updated
• 36
ogwata/exp22-sft-dpo-lr8e7-beta02
Text Generation • 4B • Updated
• 18
ogwata/exp23-sft-dpo-lr7e7-beta03
Text Generation • 4B • Updated
• 27
tomofusa/exp019-dpo-ipo-lr1e6-merged
Text Generation • 4B • Updated
• 22
NibiruTwin/dpo-qwen-cot-merged
Text Generation • 4B • Updated
• 30
YasKoga/dpo-qwen-cot-merged_v0
Text Generation • 4B • Updated
• 37
satoyutaka/llm2025_main_v11_surgical_dpo
Updated
satoyutaka/llm2025_main_v11_surgical_dpo_merged
4B • Updated
• 12
mradermacher/LEM-Gemma3-1B-GGUF
1B • Updated
• 532
tomofusa/exp020-simpo-merged
Text Generation • 4B • Updated
• 36
synonym/dpo-qwen-cot-merged
Text Generation • 4B • Updated
• 21
satoyutaka/llm2025_main_v11_no_v10_merged
4B • Updated
• 7
kennaka1112/dpo-qwen-cot-merged
Text Generation • 4B • Updated
• 57
ita2no/qwen3-4b-structeval-sft-dpo-merged
Text Generation • 4B • Updated
• 34
ikeda1976/dpo-qwen-cot-merged-rev.001
Text Generation • 4B • Updated
• 34
Hi-Satoh/adv_MoE_sft3_dpo_merged
Text Generation • 4B • Updated
• 201
mradermacher/LEM-Gemma3-1B-i1-GGUF
1B • Updated
• 1.84k