Wenboz/llama3-wpo-lora
Updated • 6
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
5,008
Active filters: alignment-handbook
DUAL-GPO/zephyr-7b-dpo-0k-15k-0.001-i1
Updated • 3
terry69/llama3_feedback
Text Generation • 8B • Updated • 9
terry69/gemma_preference
Updated • 9
hansh/hansken_human_hql_v3
Updated • 5
terry69/feedback_gemma_dirty
Text Generation • 9B • Updated • 7
terry69/llama3_preference
Updated • 3
terry69/qwen_preference
Updated • 5
QuantFactory/MagpieLM-8B-Chat-v0.1-GGUF
8B • Updated • 93 • 1
QuantFactory/MagpieLM-4B-Chat-v0.1-GGUF
5B • Updated • 531 • 2
terry69/preference_p0.1_seed42_level2_syntaxmixbatch16
Text Generation • 7B • Updated • 6
Dynosaur/llama3-8b-math-sft-full-command-r
Text Generation • 8B • Updated • 5
DUAL-GPO/zephyr-7b-ipo-0k-15k-i1
Updated • 5
tanliboy/lambda-qwen2.5-14b-dpo-test
Text Generation • 15B • Updated • 23 • • 10
Katayoon/VPO-Pess-SELM-Zephyr-7B-iter-1
7B • Updated • 7
terry69/preference_p0.1_seed42_level2_syntaxdirtybatch16
Text Generation • 7B • Updated • 5
Katayoon/VPO-Pess-SELM-Zephyr-7B-iter-2
7B • Updated • 7
terry69/downstream_mistral
Updated • 7
nlee-208/uf-qwen2-7IT-sft_bon
8B • Updated • 3
terry69/qwen_feedback
Text Generation • 8B • Updated • 8
terry69/preference_p0.1_seed42_level2_syntaxcleanbatch16
Text Generation • 7B • Updated • 4
silviasapora/gemma-7b-borpo-low-quality
Text Generation • 9B • Updated • 6
tanliboy/lambda-llama-3-8b-dpo-test-orca
Text Generation • 8B • Updated • 8
terry69/feedback_p0.2_seed42_level2_raredirtybatch16
Text Generation • 7B • Updated • 5
terry69/qwen_0.5_downstream
Updated • 3
terry69/qwen_4_downstream
Updated • 3
terry69/feedback_p0.05_seed42_level2_raredirtybatch16
Text Generation • 7B • Updated • 6
terry69/qwen_7_downstream
Updated • 3
silviasapora/gemma-7b-borpo
Text Generation • 9B • Updated • 6
terry69/feedback_p0.02_seed42_level2_raredirtybatch16
Text Generation • 7B • Updated • 7