W-61/mistral-7b-base-margin-dpo-hh-helpful-4xh200-batch-64
Text Generation • 7B • Updated • 7
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
3,163
Active filters: transformers, alignment-handbook
W-61/mistral-7b-base-sft-hh-helpful-4xh200-batch-64
Text Generation • 7B • Updated • 7
jackf857/llama-3-8b-base-r-dpo-ultrafeedback-4xh200
Text Generation • 8B • Updated • 11
jackf857/qwen3-8b-base-epsilon-dpo-hh-harmless-4xh200-batch-64
Text Generation • 8B • Updated • 8
jackf857/qwen3-8b-base-beta-dpo-hh-harmless-4xh200-batch-64
Text Generation • 8B • Updated • 6
jackf857/qwen3-8b-base-beta-dpo-hh-helpful-4xh200-batch-64
Text Generation • 8B • Updated • 7
jackf857/qwen3-8b-base-sft-hh-harmless-4xh200-batch-64
Text Generation • 8B • Updated • 10
jackf857/qwen3-8b-base-sft-ultrachat-4xh200-batch-128
Text Generation • 8B • Updated • 22
jackf857/llama-3-8b-base-new-dpo-harmless-4xh200-s_star1.0
Text Generation • 8B • Updated • 12
W-61/llama-3-8b-base-new-dpo-hh-harmless-s_star0.4-4xh200-batch-64-20260421-204233
Text Generation • 8B • Updated • 7
W-61/llama-3-8b-base-new-dpo-hh-harmless-s_star0.6-4xh200-batch-64-20260421-213851
Text Generation • 8B • Updated • 10
jackf857/llama-3-8b-base-new-dpo-hh-helpful-s_star0.4-4xh200-batch-64-20260421-214335-rerun
Text Generation • 8B • Updated • 11
W-61/llama-3-8b-base-new-dpo-hh-harmless-s_star0.85-4xh200-batch-64-20260421-213851
Text Generation • 8B • Updated • 10
jackf857/llama-3-8b-base-new-dpo-hh-helpful-s_star0.6-4xh200-batch-64-20260421-214335-rerun
Text Generation • 8B • Updated • 12
W-61/llama-3-8b-base-new-dpo-hh-harmless-s_star1.0-4xh200-batch-64-20260421-213851
Text Generation • 8B • Updated • 9
jackf857/llama-3-8b-base-new-dpo-hh-helpful-s_star0.85-4xh200-batch-64-20260421-233802
Text Generation • 8B • Updated • 10
jackf857/llama-3-8b-base-new-dpo-hh-helpful-s_star1.0-4xh200-batch-64-20260421-233802
Text Generation • 8B • Updated • 7
jackf857/llama-3-8b-base-margin-dpo-hh-harmless-beta0.01
Text Generation • 8B • Updated • 11
W-61/llama-3-8b-base-new-dpo-hh-harmless-s_star0.6-4xh200-batch-64-20260422-051621
Text Generation • 8B • Updated • 6
W-61/llama-3-8b-base-new-dpo-hh-harmless-s_star1.0-4xh200-batch-64-20260422-051621
Text Generation • 8B • Updated • 14
jackf857/qwen3-8b-base-epsilon-dpo-ultrafeedback-4xh200-batch-128
Text Generation • 8B • Updated • 8
jackf857/qwen3-8b-base-sft-hh-helpful-8xh200-20260414-192602-232981
Text Generation • 8B • Updated • 6
W-61/qwen3-8b-base-cpo-ultrafeedback-4xh200-batch-128-20260422-131855
Text Generation • 8B • Updated • 8
W-61/qwen3-8b-base-epsilon-dpo-ultrafeedback-4xh200-batch-128-20260422-131855
Text Generation • 8B • Updated • 7
W-61/qwen3-8b-base-ipo-ultrafeedback-4xh200-batch-128-20260422-131855
Text Generation • 8B • Updated • 8
W-61/qwen3-8b-base-slic-hf-ultrafeedback-4xh200-batch-128-20260422-131855
Text Generation • 8B • Updated • 7
W-61/qwen3-8b-base-r-dpo-ultrafeedback-4xh200-batch-128-20260422-131855
Text Generation • 8B • Updated • 6
jackf857/llama-3-8b-base-new-dpo-harmless-s_star0.4-q_t0.4
Text Generation • 8B • Updated • 16 • 1
jackf857/llama-3-8b-base-new-dpo-harmless-s_star0.6-q_t0.4
Text Generation • 8B • Updated • 16
W-61/llama3-8b-base-new-method-q_t-0.4-s_star0.6
Text Generation • 8B • Updated • 17