Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
underactuated
/
mistral_dpo_iter1
like
0
Transformers
Safetensors
Generated from Trainer
trl
dpo
arxiv:
2305.18290
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
mistral_dpo_iter1
/
reference
168 MB
1 contributor
History:
33 commits
underactuated
End of training
47825b7
verified
11 months ago
adapter_config.json
Safe
799 Bytes
End of training
11 months ago
adapter_model.safetensors
168 MB
xet
End of training
11 months ago