Model save

README.md

@@ -27,19 +27,17 @@ print(output["generated_text"])
 
 ## Training procedure
 
- 
-
 
 
 This model was trained with SFT.
 
 ### Framework versions
 
-- TRL: 1.3.0
-- Transformers: 5.8.0
-- Pytorch: 2.10.0+cu128
+- TRL: 0.12.0
+- Transformers: 4.46.0
+- Pytorch: 2.8.0+cu128
 - Datasets: 4.8.5
-- Tokenizers: 0.22.2
+- Tokenizers: 0.20.3
 
 ## Citations
 
@@ -48,11 +46,12 @@ This model was trained with SFT.
 Cite TRL as:
     
 ```bibtex
-@software{vonwerra2020trl,
-  title   = {{TRL: Transformers Reinforcement Learning}},
-  author  = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin},
-  license = {Apache-2.0},
-  url     = {https://github.com/huggingface/trl},
-  year    = {2020}
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
 }
 ```

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:aeebe368eb77dd59cf57cb7a1b09ab7881a8f38ef8de181557db15cf97d42441
+oid sha256:d826c1300a005d0aa9d67d33ff875a1009deb22d9d081ec0014ccc545f55a316
 size 167832240