Inference Providers
Active filters: dpo
syntropy-ai/Soren-1-Small
Text Generation
• 2B • Updated • 1.12k
• 21
F16/z-image-turbo-flow-dpo
Feature Extraction
• Updated • 184
mlabonne/NeuralHermes-2.5-Mistral-7B
Text Generation
• 7B • Updated • 78
• • 154
RISys-Lab/RedSage-Qwen3-8B-DPO
Text Generation
• 8B • Updated • 1.18k
• • 7
mradermacher/RedSage-Qwen3-8B-DPO-GGUF
Text Generation
• 8B • Updated • 380
• 4
trentmkelly/gpt-4o-distil-Llama-3.3-70B-Instruct
Text Generation
• Updated • 9
• 3
mradermacher/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy-GGUF
8B • Updated • 608
• 7
YiyingXie/gemma-3-270m-it-dpo
danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF
Text Generation
• 9B • Updated • 1.26k
• 17
sweepai/sweep-next-edit-v2-7B
Text Generation
• 8B • Updated • 941
• • 30
XiangJinYu/Qwen3.5-9B-Humanize-DPO-Round2
Text Generation
• Updated • 117
• 1
OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated
Image-Text-to-Text
• 123B • Updated • 770
• 7
mradermacher/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-i1-GGUF
125B • Updated • 6.09k
• 3
OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4
Image-Text-to-Text
• 74B • Updated • 1.25k
• 3
MRockatansky/Gemma-4-31B-storymaxxed2-GGUF
Text Generation
• 31B • Updated • 2.97k
• 1
EvanOLeary/laguna-xs2-dense-k8-cuda-dpo
Text Generation
• 3B • Updated • 42
• 1
yakz1/gemma-4-e4b-question-algerienne-dpo-analyse-qualitative-608-2ep-GGUF
Image-Text-to-Text
• 7B • Updated • 71
• 1
lyogavin/Anima33B-DPO-Belle-1k
Text Generation
• Updated • 1
lyogavin/Anima33B-DPO-Belle-1k-merged
Text Generation
• Updated • 16
• 12
daekeun-ml/Llama-2-ko-DPO-13B
Text Generation
• 13B • Updated • 23
• 19
lewtun/zephyr-7b-dpo-full
Text Generation
• 7B • Updated • 5
alignment-handbook/zephyr-7b-dpo-full
Text Generation
• 7B • Updated • 19
• 3
alignment-handbook/zephyr-7b-dpo-qlora
Updated • 11
• 9
Text Generation
• Updated • 25
• 7
argilla/notus-7b-v1-lora-adapter
Text Generation
• Updated • 3
Text Generation
• 7B • Updated • 68
• • 124
ContextualAI/archangel_sft_pythia1-4b
Text Generation
• 1B • Updated • 5
ContextualAI/archangel_sft_pythia2-8b
Text Generation
• 3B • Updated • 140
• 2
ContextualAI/archangel_sft_pythia6-9b
Text Generation
• 7B • Updated • 6
ContextualAI/archangel_sft_pythia12-0b
Text Generation
• 12B • Updated • 9