Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
ComparisonPO
/
gemma-3-4b-it-DPO
like
0
Follow
ComPO
5
Safetensors
HuggingFaceH4/ultrafeedback_binarized
gemma3
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
README.md exists but content is empty.
Downloads last month
6
Safetensors
Model size
5B params
Tensor type
F32
·
Chat template
Files info
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for
ComparisonPO/gemma-3-4b-it-DPO
Base model
google/gemma-3-4b-pt
Finetuned
google/gemma-3-4b-it
Finetuned
(
706
)
this model
Finetunes
1 model
Dataset used to train
ComparisonPO/gemma-3-4b-it-DPO
HuggingFaceH4/ultrafeedback_binarized
Viewer
•
Updated
Oct 16, 2024
•
187k
•
11.8k
•
341