knight7561
/

SmolLM2-FT-DPO-python-code

Text Generation

Generated from Trainer

python-code-DPO

text-generation-inference

Model card Files Files and versions

knight7561 commited on Jan 20

Commit

d0d1317

·

verified ·

1 Parent(s): b128398

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ licence: license
 # Model Card for SmolLM2-FT-DPO-python-code
 This model is a fine-tuned version of [knight7561/SmolLM2_python_coder](https://huggingface.co/knight7561/SmolLM2_python_coder).
-It has been trained using [TRL](https://github.com/huggingface/trl).
 ## Quick start

 # Model Card for SmolLM2-FT-DPO-python-code
 This model is a fine-tuned version of [knight7561/SmolLM2_python_coder](https://huggingface.co/knight7561/SmolLM2_python_coder).
+It has been trained using [TRL](https://github.com/huggingface/trl) by DPO method.
 ## Quick start