Training in progress, step 100

README.md

@@ -4,8 +4,8 @@ library_name: transformers
 model_name: nmt_21
 tags:
 - generated_from_trainer
-- grpo
 - trl
+- grpo
 licence: license
 ---
 
@@ -27,18 +27,19 @@ print(output["generated_text"])
 
 ## Training procedure
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/oleg-dats/nmt/runs/u8jyz3l9) 
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/oleg-dats/nmt/runs/r4z1m3br) 
+
 
 
 This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
 
 ### Framework versions
 
-- TRL: 0.23.1
-- Transformers: 4.57.0
-- Pytorch: 2.5.1+cu124
-- Datasets: 4.1.1
-- Tokenizers: 0.22.1
+- TRL: 0.29.1
+- Transformers: 4.57.6
+- Pytorch: 2.10.0+cu128
+- Datasets: 4.8.4
+- Tokenizers: 0.22.2
 
 ## Citations
 
@@ -57,12 +58,11 @@ Cite GRPO as:
 Cite TRL as:
     
 ```bibtex
-@misc{vonwerra2022trl,
-	title        = {{TRL: Transformer Reinforcement Learning}},
-	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
-	year         = 2020,
-	journal      = {GitHub repository},
-	publisher    = {GitHub},
-	howpublished = {\url{https://github.com/huggingface/trl}}
+@software{vonwerra2020trl,
+  title   = {{TRL: Transformers Reinforcement Learning}},
+  author  = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin},
+  license = {Apache-2.0},
+  url     = {https://github.com/huggingface/trl},
+  year    = {2020}
 }
 ```

completions/completions_00010.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c94406b4033a224b896b54a88daeadb4d51ff3fd8538146b24935e4cdf26e83
+size 16296

completions/completions_00020.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1a92a0d31f2e5be440ae4bd6a2abe3b0cab8c43e1fb7b3bbdb07055708d9866d
+size 15929

completions/completions_00030.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:69d7bfe232a57f2e9d64e52eb313cb907a6eecc61cd5a16adb3255fee942b931
+size 16088

completions/completions_00040.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1ca2d298bcc80d7d3e3acaa5d41d23e3ede2b6c955f4d27fc03d1f952c161faa
+size 16383

completions/completions_00050.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:66f203d3cc9aafc3db8ce708b587523e602954bfbb0d60e1e8974b3befad90bb
+size 14331

completions/completions_00060.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7eb4dafc5bb7a9bb98ee69162c12a4a8377191b91f34c6010c6d8753ee79f897
+size 19493

completions/completions_00070.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1824f09be293273cba458cec6cb1862f8d7258ae2c0dbb684f6c76a0fd910b7f
+size 14666

completions/completions_00080.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e9b7a4a78e05e2c28a16c2930cf3243afb39205967bea3a36fb1d15fa12330d0
+size 15611

completions/completions_00090.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e2273f00a15e24c092558810fefff14ae229b9b90ca7828512d737106f82f26b
+size 20001

completions/completions_00100.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0acceeae6c3654cf26744296d2286b73460e8e412b54fb5437648d8fbfd6343c
+size 14074

config.json

@@ -57,7 +57,7 @@
   "rope_theta": 1000000,
   "sliding_window": 512,
   "sliding_window_pattern": 6,
-  "transformers_version": "4.57.0",
+  "transformers_version": "4.57.6",
   "use_bidirectional_attention": false,
   "use_cache": true,
   "vocab_size": 262144

generation_config.json

@@ -10,5 +10,5 @@
   "pad_token_id": 0,
   "top_k": 64,
   "top_p": 0.95,
-  "transformers_version": "4.57.0"
+  "transformers_version": "4.57.6"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:eb44cbbaf0283330a474573c0f2959dbb9c1f1d6022861bc66ebb1ff981c86f2
+oid sha256:f266337336d50b66dfa4844f8f70af9fba4396b8efaae4af9aa3664813955910
 size 1999811208

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:76fe024da92bce1c7bf8cff9ee12ca373a3a8667017dab3d942229b1baad9d63
-size 6776
+oid sha256:85c6f4dba97a6e2be03c223e4313b5f7ad1106fd9250b078cc26adf1f84d228e
+size 7697