Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
sciarrilli
/
Llama-3.2-3B-DPO
like
0
Transformers
Safetensors
trl-lib/ultrafeedback_binarized
Generated from Trainer
trl
dpo
arxiv:
2305.18290
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Llama-3.2-3B-DPO
54 MB
1 contributor
History:
5 commits
sciarrilli
End of training
5cbfce9
verified
11 months ago
.gitattributes
1.57 kB
Model save
11 months ago
README.md
2.79 kB
End of training
11 months ago
adapter_config.json
729 Bytes
Model save
11 months ago
adapter_model.safetensors
36.7 MB
xet
Model save
11 months ago
all_results.json
546 Bytes
Model save
11 months ago
eval_results.json
546 Bytes
Model save
11 months ago
special_tokens_map.json
325 Bytes
Model save
11 months ago
tokenizer.json
17.2 MB
xet
Model save
11 months ago
tokenizer_config.json
54.6 kB
Model save
11 months ago
training_args.bin
6.26 kB
xet
Model save
11 months ago