Add qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50

.gitattributes

@@ -100,3 +100,5 @@ qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-again-b16g16-ng16-lr1e
 qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-again-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-again-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-again-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-750/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/README.md

@@ -0,0 +1,66 @@
+---
+library_name: transformers
+model_name: qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50
+tags:
+- generated_from_trainer
+- trl
+- grpo
+licence: license
+---
+
+# Model Card for qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50
+
+This model is a fine-tuned version of [None](https://huggingface.co/None).
+It has been trained using [TRL](https://github.com/huggingface/trl).
+
+## Quick start
+
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="None", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
+
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://cohere.wandb.io/cohere/nathans-internship/runs/r8on84dl) 
+
+
+
+This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
+
+### Framework versions
+
+- TRL: 1.3.0
+- Transformers: 4.57.6
+- Pytorch: 2.10.0+cu128
+- Datasets: 4.8.5
+- Tokenizers: 0.22.2
+
+## Citations
+
+Cite GRPO as:
+
+```bibtex
+@article{shao2024deepseekmath,
+    title        = {{DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models}},
+    author       = {Zhihong Shao and Peiyi Wang and Qihao Zhu and Runxin Xu and Junxiao Song and Mingchuan Zhang and Y. K. Li and Y. Wu and Daya Guo},
+    year         = 2024,
+    eprint       = {arXiv:2402.03300},
+}
+```
+
+Cite TRL as:
+    
+```bibtex
+@software{vonwerra2020trl,
+  title   = {{TRL: Transformers Reinforcement Learning}},
+  author  = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin},
+  license = {Apache-2.0},
+  url     = {https://github.com/huggingface/trl},
+  year    = {2020}
+}
+```

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/README.md

@@ -0,0 +1,209 @@
+---
+base_model: /root/repos/verl/new_models/qwen/qwen2.5-coder-7B-v4-if-grpo-oci-v3-balanced-b16g16-ng16-lr1e-05-v3_delta_prefill-cwup-w50-c2i0.25_checkpoint-8000
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:/root/repos/verl/new_models/qwen/qwen2.5-coder-7B-v4-if-grpo-oci-v3-balanced-b16g16-ng16-lr1e-05-v3_delta_prefill-cwup-w50-c2i0.25_checkpoint-8000
+- grpo
+- lora
+- transformers
+- trl
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.0

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/adapter_config.json

@@ -0,0 +1,41 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "/root/repos/verl/new_models/qwen/qwen2.5-coder-7B-v4-if-grpo-oci-v3-balanced-b16g16-ng16-lr1e-05-v3_delta_prefill-cwup-w50-c2i0.25_checkpoint-8000",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.0",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:029ac0e7c308e5bd00aca638d50174b8b0e7af246f97ba5a6f12b176d692d12b
+size 20200056

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/added_tokens.json

@@ -0,0 +1,24 @@
+{
+  "</tool_call>": 151658,
+  "<tool_call>": 151657,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/chat_template.jinja

@@ -0,0 +1,54 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- messages[0]['content'] }}
+    {%- else %}
+        {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}
+    {%- endif %}
+    {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
+    {%- else %}
+        {{- '<|im_start|>system\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- for message in messages %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
+        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {{- '<|im_start|>' + message.role }}
+        {%- if message.content %}
+            {{- '\n' + message.content }}
+        {%- endif %}
+        {%- for tool_call in message.tool_calls %}
+            {%- if tool_call.function is defined %}
+                {%- set tool_call = tool_call.function %}
+            {%- endif %}
+            {{- '\n<tool_call>\n{"name": "' }}
+            {{- tool_call.name }}
+            {{- '", "arguments": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- '}\n</tool_call>' }}
+        {%- endfor %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- message.content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+{%- endif %}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9331e975f21713ba3d196c81c9af159b510b59714f5ad3429896d0bad1d4138c
+size 40466443

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/ref/adapter_config.json

@@ -0,0 +1,41 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "/root/repos/verl/new_models/qwen/qwen2.5-coder-7B-v4-if-grpo-oci-v3-balanced-b16g16-ng16-lr1e-05-v3_delta_prefill-cwup-w50-c2i0.25_checkpoint-8000",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.0",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/ref/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7d21034b0f45adb8b3be7720adeaceaac5ce9c42de12051eb8741681327e42b
+size 10107504

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/rng_state_0.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d47fe0671cac215cabe98cda677f577136a5b9be7b7f02e4e2f7f22bceeb4f5
+size 14917

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/rng_state_1.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dbd4cde96c667e4cdec8728c7c68ef6c69a81a3301ef38175280f28b02c759a6
+size 14917

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:80fb2baa02f95c75469ca566800e788a181fa1521604acd533f8bc5306e8cc60
+size 1465

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/special_tokens_map.json

@@ -0,0 +1,31 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
+size 11421896

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/tokenizer_config.json

@@ -0,0 +1,207 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151646": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151647": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151648": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151649": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151650": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151651": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151652": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151653": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151654": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151655": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151656": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151657": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151658": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151659": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151660": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151661": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151662": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151663": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151664": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "model_max_length": 32768,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/trainer_state.json

@@ -0,0 +1,1429 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.046125461254612546,
+  "eval_steps": 50,
+  "global_step": 250,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 612.0,
+      "completions/max_terminated_length": 612.0,
+      "completions/mean_length": 102.953125,
+      "completions/mean_terminated_length": 102.953125,
+      "completions/min_length": 18.0,
+      "completions/min_terminated_length": 18.0,
+      "entropy": 0.11227604653686285,
+      "epoch": 0.00018450184501845018,
+      "frac_reward_zero_std": 0.5,
+      "grad_norm": 0.010054216720163822,
+      "kl": 0.0,
+      "learning_rate": 0.0,
+      "loss": -0.0286,
+      "num_tokens": 256984.0,
+      "reward": 10.642986297607422,
+      "reward/apply_success_pct_given_tool": 39.15441131591797,
+      "reward/component/B_useful_patch_mean": 1.0,
+      "reward/component/R_base_mean": 3.854543685913086,
+      "reward/component/R_delta_mean": 1.1333333253860474,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 7.646730899810791,
+      "reward/mean": 10.642986297607422,
+      "reward/solved_pct": 61.9140625,
+      "reward/tool_delta_harmful_pct": 11.948529243469238,
+      "reward/tool_delta_improved_pct": 9.865196228027344,
+      "reward/tool_delta_no_change_pct": 17.340686798095703,
+      "reward/tool_use_pct": 12.6953125,
+      "reward_std": 9.424612998962402,
+      "rewards/_reward_fn/mean": 10.642986297607422,
+      "rewards/_reward_fn/std": 9.424612998962402,
+      "sampling/importance_sampling_ratio/max": 1.4697821140289307,
+      "sampling/importance_sampling_ratio/mean": 0.7766783833503723,
+      "sampling/importance_sampling_ratio/min": 9.449524077353999e-05,
+      "sampling/sampling_logp_difference/max": 0.5408859252929688,
+      "sampling/sampling_logp_difference/mean": 0.008102428168058395,
+      "step": 1,
+      "step_time": 62.72553479205817
+    },
+    {
+      "clip_ratio/high_max": 0.00013250717125225088,
+      "clip_ratio/high_mean": 7.141433686936378e-05,
+      "clip_ratio/low_mean": 6.0496135726377055e-05,
+      "clip_ratio/low_min": 3.153698748469146e-06,
+      "clip_ratio/region_mean": 0.00013191047289890575,
+      "completions/clipped_ratio": 0.0008680555555555555,
+      "completions/max_length": 656.0,
+      "completions/max_terminated_length": 634.5555555555555,
+      "completions/mean_length": 114.1171875,
+      "completions/mean_terminated_length": 113.43473646375868,
+      "completions/min_length": 24.444444444444443,
+      "completions/min_terminated_length": 24.444444444444443,
+      "entropy": 0.08754533208492729,
+      "epoch": 0.0018450184501845018,
+      "frac_reward_zero_std": 0.4826388888888889,
+      "grad_norm": 0.018110981211066246,
+      "kl": 0.000106440086382362,
+      "learning_rate": 1.8000000000000001e-06,
+      "loss": -0.0214,
+      "num_tokens": 2668068.0,
+      "reward": 11.322579595777723,
+      "reward/apply_success_pct_given_tool": 40.277425342135956,
+      "reward/component/B_useful_patch_mean": 0.7777777777777778,
+      "reward/component/R_base_mean": 4.08864426612854,
+      "reward/component/R_delta_mean": 1.4181481384568744,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.102313465542263,
+      "reward/mean": 11.322579701741537,
+      "reward/solved_pct": 64.21440972222223,
+      "reward/tool_delta_harmful_pct": 6.1654157638549805,
+      "reward/tool_delta_improved_pct": 6.181375662485759,
+      "reward/tool_delta_no_change_pct": 27.930633756849502,
+      "reward/tool_use_pct": 8.463541666666666,
+      "reward_std": 9.043424818250868,
+      "rewards/_reward_fn/mean": 11.322579595777723,
+      "rewards/_reward_fn/std": 9.043424818250868,
+      "sampling/importance_sampling_ratio/max": 1.3842155403561063,
+      "sampling/importance_sampling_ratio/mean": 0.7840358548694186,
+      "sampling/importance_sampling_ratio/min": 0.0007227754847715712,
+      "sampling/sampling_logp_difference/max": 0.48987701535224915,
+      "sampling/sampling_logp_difference/mean": 0.006036102616538604,
+      "step": 10,
+      "step_time": 57.73900603544381
+    },
+    {
+      "clip_ratio/high_max": 0.00020941412731190212,
+      "clip_ratio/high_mean": 0.00011060444558097515,
+      "clip_ratio/low_mean": 9.367811999254627e-05,
+      "clip_ratio/low_min": 8.865247400535736e-06,
+      "clip_ratio/region_mean": 0.00020428256520972355,
+      "completions/clipped_ratio": 0.0001953125,
+      "completions/max_length": 700.8,
+      "completions/max_terminated_length": 671.0,
+      "completions/mean_length": 126.7869140625,
+      "completions/mean_terminated_length": 126.63587036132813,
+      "completions/min_length": 23.0,
+      "completions/min_terminated_length": 23.0,
+      "entropy": 0.09221122779417783,
+      "epoch": 0.0036900369003690036,
+      "frac_reward_zero_std": 0.4125,
+      "grad_norm": 0.010808057151734829,
+      "kl": 0.00012384328492771602,
+      "learning_rate": 3.8000000000000005e-06,
+      "loss": -0.0397,
+      "num_tokens": 5443553.0,
+      "reward": 11.128899478912354,
+      "reward/apply_success_pct_given_tool": 42.7192304611206,
+      "reward/component/B_useful_patch_mean": 0.9,
+      "reward/component/R_base_mean": 4.054660654067993,
+      "reward/component/R_delta_mean": 1.28033337444067,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.000829219818115,
+      "reward/mean": 11.128899478912354,
+      "reward/solved_pct": 63.359375,
+      "reward/tool_delta_harmful_pct": 10.0396644115448,
+      "reward/tool_delta_improved_pct": 6.464357364177704,
+      "reward/tool_delta_no_change_pct": 26.21520757675171,
+      "reward/tool_use_pct": 12.9296875,
+      "reward_std": 8.94474925994873,
+      "rewards/_reward_fn/mean": 11.128899478912354,
+      "rewards/_reward_fn/std": 8.944749212265014,
+      "sampling/importance_sampling_ratio/max": 1.3496280074119569,
+      "sampling/importance_sampling_ratio/mean": 0.7529563784599305,
+      "sampling/importance_sampling_ratio/min": 0.0014435469798172562,
+      "sampling/sampling_logp_difference/max": 0.664992380142212,
+      "sampling/sampling_logp_difference/mean": 0.0063636247534304856,
+      "step": 20,
+      "step_time": 56.78309687618166
+    },
+    {
+      "clip_ratio/high_max": 0.00022074645885368228,
+      "clip_ratio/high_mean": 0.00011651029903987364,
+      "clip_ratio/low_mean": 8.244218242907664e-05,
+      "clip_ratio/low_min": 1.5037662888062186e-05,
+      "clip_ratio/region_mean": 0.00019895248146895028,
+      "completions/clipped_ratio": 0.00078125,
+      "completions/max_length": 699.9,
+      "completions/max_terminated_length": 612.6,
+      "completions/mean_length": 121.9220703125,
+      "completions/mean_terminated_length": 121.31291961669922,
+      "completions/min_length": 22.9,
+      "completions/min_terminated_length": 22.9,
+      "entropy": 0.07924611248308792,
+      "epoch": 0.005535055350553505,
+      "frac_reward_zero_std": 0.45,
+      "grad_norm": 0.011765395291149616,
+      "kl": 0.00010895145899212367,
+      "learning_rate": 5.8e-06,
+      "loss": -0.0253,
+      "num_tokens": 8157474.0,
+      "reward": 11.121116256713867,
+      "reward/apply_success_pct_given_tool": 32.547439861297605,
+      "reward/component/B_useful_patch_mean": 0.6,
+      "reward/component/R_base_mean": 4.05430657863617,
+      "reward/component/R_delta_mean": 0.8600000023841858,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 7.9943928718566895,
+      "reward/mean": 11.12111587524414,
+      "reward/solved_pct": 63.515625,
+      "reward/tool_delta_harmful_pct": 7.7472827434539795,
+      "reward/tool_delta_improved_pct": 2.337369590997696,
+      "reward/tool_delta_no_change_pct": 22.462788105010986,
+      "reward/tool_use_pct": 9.86328125,
+      "reward_std": 9.05692253112793,
+      "rewards/_reward_fn/mean": 11.121116256713867,
+      "rewards/_reward_fn/std": 9.056922721862794,
+      "sampling/importance_sampling_ratio/max": 1.3287093043327332,
+      "sampling/importance_sampling_ratio/mean": 0.7821361303329468,
+      "sampling/importance_sampling_ratio/min": 0.0011665741945307672,
+      "sampling/sampling_logp_difference/max": 0.4735832214355469,
+      "sampling/sampling_logp_difference/mean": 0.005574250826612115,
+      "step": 30,
+      "step_time": 59.089014053158465
+    },
+    {
+      "clip_ratio/high_max": 0.0001796558122805436,
+      "clip_ratio/high_mean": 8.98279061402718e-05,
+      "clip_ratio/low_mean": 7.419242147079785e-05,
+      "clip_ratio/low_min": 4.145851926296018e-06,
+      "clip_ratio/region_mean": 0.0001640203283386654,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 564.5,
+      "completions/max_terminated_length": 564.5,
+      "completions/mean_length": 112.9021484375,
+      "completions/mean_terminated_length": 112.9021484375,
+      "completions/min_length": 24.7,
+      "completions/min_terminated_length": 24.7,
+      "entropy": 0.07879362337989733,
+      "epoch": 0.007380073800738007,
+      "frac_reward_zero_std": 0.44375,
+      "grad_norm": 0.01239884551614523,
+      "kl": 0.00010962535723137989,
+      "learning_rate": 7.800000000000002e-06,
+      "loss": -0.0221,
+      "num_tokens": 10796509.0,
+      "reward": 10.69527292251587,
+      "reward/apply_success_pct_given_tool": 35.73933849334717,
+      "reward/component/B_useful_patch_mean": 0.9,
+      "reward/component/R_base_mean": 3.893808650970459,
+      "reward/component/R_delta_mean": 1.3311111092567445,
+      "reward/component/R_edit_efficiency_mean": -0.1,
+      "reward/component/R_task_mean": 7.710135555267334,
+      "reward/mean": 10.695272731781007,
+      "reward/solved_pct": 61.81640625,
+      "reward/tool_delta_harmful_pct": 10.994668459892273,
+      "reward/tool_delta_improved_pct": 6.371493637561798,
+      "reward/tool_delta_no_change_pct": 18.373176670074464,
+      "reward/tool_use_pct": 8.203125,
+      "reward_std": 9.33149585723877,
+      "rewards/_reward_fn/mean": 10.69527292251587,
+      "rewards/_reward_fn/std": 9.331495571136475,
+      "sampling/importance_sampling_ratio/max": 1.3650810599327088,
+      "sampling/importance_sampling_ratio/mean": 0.7958621084690094,
+      "sampling/importance_sampling_ratio/min": 0.0013212997151129003,
+      "sampling/sampling_logp_difference/max": 0.5991839647293091,
+      "sampling/sampling_logp_difference/mean": 0.005501575535163283,
+      "step": 40,
+      "step_time": 52.02689078059048
+    },
+    {
+      "clip_ratio/high_max": 0.00020076451273780548,
+      "clip_ratio/high_mean": 0.00010775959435704863,
+      "clip_ratio/low_mean": 0.00010884243338296073,
+      "clip_ratio/low_min": 1.1718718815245665e-05,
+      "clip_ratio/region_mean": 0.00021660202746716096,
+      "completions/clipped_ratio": 0.001953125,
+      "completions/max_length": 755.4,
+      "completions/max_terminated_length": 584.3,
+      "completions/mean_length": 117.16640625,
+      "completions/mean_terminated_length": 115.65559234619141,
+      "completions/min_length": 23.6,
+      "completions/min_terminated_length": 23.6,
+      "entropy": 0.08462144425138832,
+      "epoch": 0.00922509225092251,
+      "frac_reward_zero_std": 0.4625,
+      "grad_norm": 0.013000819832086563,
+      "kl": 0.00012004886223166977,
+      "learning_rate": 9.800000000000001e-06,
+      "loss": -0.0316,
+      "num_tokens": 13466961.0,
+      "reward": 11.578496837615967,
+      "reward/apply_success_pct_given_tool": 40.786439990997316,
+      "reward/component/B_useful_patch_mean": 0.6,
+      "reward/component/R_base_mean": 4.155265665054321,
+      "reward/component/R_delta_mean": 0.7516666680574418,
+      "reward/component/R_edit_efficiency_mean": -0.1,
+      "reward/component/R_task_mean": 8.233069944381715,
+      "reward/mean": 11.578496837615967,
+      "reward/solved_pct": 65.7421875,
+      "reward/tool_delta_harmful_pct": 7.683244073390961,
+      "reward/tool_delta_improved_pct": 5.539320123195648,
+      "reward/tool_delta_no_change_pct": 27.563875102996825,
+      "reward/tool_use_pct": 9.296875,
+      "reward_std": 8.900829362869263,
+      "rewards/_reward_fn/mean": 11.578496837615967,
+      "rewards/_reward_fn/std": 8.900829362869263,
+      "sampling/importance_sampling_ratio/max": 1.440872812271118,
+      "sampling/importance_sampling_ratio/mean": 0.7858114182949066,
+      "sampling/importance_sampling_ratio/min": 0.0002555308292187419,
+      "sampling/sampling_logp_difference/max": 0.4947912931442261,
+      "sampling/sampling_logp_difference/mean": 0.005852115945890546,
+      "step": 50,
+      "step_time": 60.40062542343512
+    },
+    {
+      "epoch": 0.00922509225092251,
+      "eval_clip_ratio/high_max": 0.0,
+      "eval_clip_ratio/high_mean": 0.0,
+      "eval_clip_ratio/low_mean": 0.0,
+      "eval_clip_ratio/low_min": 0.0,
+      "eval_clip_ratio/region_mean": 0.0,
+      "eval_completions/clipped_ratio": 0.00078125,
+      "eval_completions/max_length": 265.84,
+      "eval_completions/max_terminated_length": 255.945,
+      "eval_completions/mean_length": 118.59703125,
+      "eval_completions/mean_terminated_length": 118.07820259094238,
+      "eval_completions/min_length": 60.285,
+      "eval_completions/min_terminated_length": 60.285,
+      "eval_entropy": 0.07036545467097312,
+      "eval_frac_reward_zero_std": 0.4775,
+      "eval_kl": 0.00010057142535855767,
+      "eval_loss": -0.03294865041971207,
+      "eval_num_tokens": 13466961.0,
+      "eval_reward": 11.409455852396786,
+      "eval_reward/apply_success_pct_given_tool": 12.643465411663055,
+      "eval_reward/component/B_useful_patch_mean": 0.04,
+      "eval_reward/component/R_base_mean": 4.126733306539245,
+      "eval_reward/component/R_delta_mean": 0.0509999992698431,
+      "eval_reward/component/R_edit_efficiency_mean": 0.0,
+      "eval_reward/component/R_task_mean": 8.160563106853514,
+      "eval_reward/mean": 11.409455855712295,
+      "eval_reward/solved_pct": 65.390625,
+      "eval_reward/tool_delta_harmful_pct": 2.0899090361595154,
+      "eval_reward/tool_delta_improved_pct": 0.8065323495864868,
+      "eval_reward/tool_delta_no_change_pct": 9.747024046182633,
+      "eval_reward/tool_use_pct": 9.5,
+      "eval_reward_std": 5.882306991592049,
+      "eval_rewards/_reward_fn/mean": 11.409455852396786,
+      "eval_rewards/_reward_fn/std": 5.882306908024475,
+      "eval_runtime": 615.3816,
+      "eval_samples_per_second": 0.65,
+      "eval_sampling/importance_sampling_ratio/max": 1.0856791752576829,
+      "eval_sampling/importance_sampling_ratio/mean": 0.7841130894422531,
+      "eval_sampling/importance_sampling_ratio/min": 0.3254345842811409,
+      "eval_sampling/sampling_logp_difference/max": 0.27181925531476736,
+      "eval_sampling/sampling_logp_difference/mean": 0.0048258733169495825,
+      "eval_steps_per_second": 0.021,
+      "step": 50
+    },
+    {
+      "clip_ratio/high_max": 0.0002481533569152816,
+      "clip_ratio/high_mean": 0.0001357153002572886,
+      "clip_ratio/low_mean": 6.72920243232511e-05,
+      "clip_ratio/low_min": 3.1742001738166437e-06,
+      "clip_ratio/region_mean": 0.0002030073243076913,
+      "completions/clipped_ratio": 0.0009765625,
+      "completions/max_length": 726.7,
+      "completions/max_terminated_length": 661.3,
+      "completions/mean_length": 116.0552734375,
+      "completions/mean_terminated_length": 115.29556350708008,
+      "completions/min_length": 25.0,
+      "completions/min_terminated_length": 25.0,
+      "entropy": 0.07858798278030008,
+      "epoch": 0.01107011070110701,
+      "frac_reward_zero_std": 0.475,
+      "grad_norm": 0.012529355473816395,
+      "kl": 0.00011560996458683803,
+      "learning_rate": 1e-05,
+      "loss": -0.0281,
+      "num_tokens": 16149916.0,
+      "reward": 11.666673183441162,
+      "reward/apply_success_pct_given_tool": 38.022731971740725,
+      "reward/component/B_useful_patch_mean": 0.7,
+      "reward/component/R_base_mean": 4.206229972839355,
+      "reward/component/R_delta_mean": 1.0000000029802323,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.300269651412965,
+      "reward/mean": 11.666673183441162,
+      "reward/solved_pct": 66.23046875,
+      "reward/tool_delta_harmful_pct": 9.776944541931153,
+      "reward/tool_delta_improved_pct": 3.3581446170806886,
+      "reward/tool_delta_no_change_pct": 24.887642097473144,
+      "reward/tool_use_pct": 7.98828125,
+      "reward_std": 8.839952564239502,
+      "rewards/_reward_fn/mean": 11.666673183441162,
+      "rewards/_reward_fn/std": 8.83995246887207,
+      "sampling/importance_sampling_ratio/max": 1.3765479445457458,
+      "sampling/importance_sampling_ratio/mean": 0.7910651564598083,
+      "sampling/importance_sampling_ratio/min": 0.0010555364307947457,
+      "sampling/sampling_logp_difference/max": 0.5279581904411316,
+      "sampling/sampling_logp_difference/mean": 0.005506994714960456,
+      "step": 60,
+      "step_time": 67.67197508178651
+    },
+    {
+      "clip_ratio/high_max": 0.00018577974879008252,
+      "clip_ratio/high_mean": 9.749099899636349e-05,
+      "clip_ratio/low_mean": 9.731422178447247e-05,
+      "clip_ratio/low_min": 8.26452724140836e-06,
+      "clip_ratio/region_mean": 0.00019480522050798754,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 579.9,
+      "completions/max_terminated_length": 579.9,
+      "completions/mean_length": 119.1916015625,
+      "completions/mean_terminated_length": 119.1916015625,
+      "completions/min_length": 23.3,
+      "completions/min_terminated_length": 23.3,
+      "entropy": 0.09272894472815096,
+      "epoch": 0.012915129151291513,
+      "frac_reward_zero_std": 0.44375,
+      "grad_norm": 0.009795981459319592,
+      "kl": 0.00013398837836575694,
+      "learning_rate": 1e-05,
+      "loss": -0.0202,
+      "num_tokens": 18850289.0,
+      "reward": 10.25573959350586,
+      "reward/apply_success_pct_given_tool": 40.30005702972412,
+      "reward/component/B_useful_patch_mean": 0.9,
+      "reward/component/R_base_mean": 3.7825167655944822,
+      "reward/component/R_delta_mean": 1.1193333476781846,
+      "reward/component/R_edit_efficiency_mean": -0.1,
+      "reward/component/R_task_mean": 7.447878503799439,
+      "reward/mean": 10.25573959350586,
+      "reward/solved_pct": 59.0234375,
+      "reward/tool_delta_harmful_pct": 8.679320538043976,
+      "reward/tool_delta_improved_pct": 4.474356389045715,
+      "reward/tool_delta_no_change_pct": 27.14637985229492,
+      "reward/tool_use_pct": 10.5078125,
+      "reward_std": 9.278578996658325,
+      "rewards/_reward_fn/mean": 10.25573959350586,
+      "rewards/_reward_fn/std": 9.278579187393188,
+      "sampling/importance_sampling_ratio/max": 1.4373008370399476,
+      "sampling/importance_sampling_ratio/mean": 0.7684895515441894,
+      "sampling/importance_sampling_ratio/min": 0.0011953131252470327,
+      "sampling/sampling_logp_difference/max": 0.5093779623508453,
+      "sampling/sampling_logp_difference/mean": 0.006458018720149994,
+      "step": 70,
+      "step_time": 51.85711044240743
+    },
+    {
+      "clip_ratio/high_max": 0.00024410690730292117,
+      "clip_ratio/high_mean": 0.00012948667726959685,
+      "clip_ratio/low_mean": 7.332587510973098e-05,
+      "clip_ratio/low_min": 5.841274469275959e-06,
+      "clip_ratio/region_mean": 0.00020281255265217624,
+      "completions/clipped_ratio": 0.0005859375,
+      "completions/max_length": 705.8,
+      "completions/max_terminated_length": 660.7,
+      "completions/mean_length": 115.147265625,
+      "completions/mean_terminated_length": 114.68915100097657,
+      "completions/min_length": 22.8,
+      "completions/min_terminated_length": 22.8,
+      "entropy": 0.08896196065470577,
+      "epoch": 0.014760147601476014,
+      "frac_reward_zero_std": 0.453125,
+      "grad_norm": 0.009337497875094414,
+      "kl": 0.00014589336133212781,
+      "learning_rate": 1e-05,
+      "loss": -0.0199,
+      "num_tokens": 21515715.0,
+      "reward": 10.72714443206787,
+      "reward/apply_success_pct_given_tool": 46.43294773101807,
+      "reward/component/B_useful_patch_mean": 0.8,
+      "reward/component/R_base_mean": 3.91385395526886,
+      "reward/component/R_delta_mean": 1.5883333504199981,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 7.7319825172424315,
+      "reward/mean": 10.72714443206787,
+      "reward/solved_pct": 61.8359375,
+      "reward/tool_delta_harmful_pct": 9.649351394176483,
+      "reward/tool_delta_improved_pct": 4.212373733520508,
+      "reward/tool_delta_no_change_pct": 32.5712215423584,
+      "reward/tool_use_pct": 10.09765625,
+      "reward_std": 9.319528675079345,
+      "rewards/_reward_fn/mean": 10.72714443206787,
+      "rewards/_reward_fn/std": 9.319528484344483,
+      "sampling/importance_sampling_ratio/max": 1.3298519134521485,
+      "sampling/importance_sampling_ratio/mean": 0.7757445633411407,
+      "sampling/importance_sampling_ratio/min": 0.0018173916711646144,
+      "sampling/sampling_logp_difference/max": 0.49689871072769165,
+      "sampling/sampling_logp_difference/mean": 0.006198259256780148,
+      "step": 80,
+      "step_time": 57.544437632802875
+    },
+    {
+      "clip_ratio/high_max": 0.00020591175070876487,
+      "clip_ratio/high_mean": 0.00011082563896707143,
+      "clip_ratio/low_mean": 8.234651595557807e-05,
+      "clip_ratio/low_min": 6.970476897549816e-06,
+      "clip_ratio/region_mean": 0.00019317215501359896,
+      "completions/clipped_ratio": 0.000390625,
+      "completions/max_length": 617.1,
+      "completions/max_terminated_length": 598.1,
+      "completions/mean_length": 112.6185546875,
+      "completions/mean_terminated_length": 112.31851119995117,
+      "completions/min_length": 24.1,
+      "completions/min_terminated_length": 24.1,
+      "entropy": 0.08620329624973237,
+      "epoch": 0.016605166051660517,
+      "frac_reward_zero_std": 0.4375,
+      "grad_norm": 0.01593380980193615,
+      "kl": 0.0001864940004907112,
+      "learning_rate": 1e-05,
+      "loss": -0.0247,
+      "num_tokens": 24161938.0,
+      "reward": 11.733750343322754,
+      "reward/apply_success_pct_given_tool": 48.641702270507814,
+      "reward/component/B_useful_patch_mean": 0.9,
+      "reward/component/R_base_mean": 4.17463870048523,
+      "reward/component/R_delta_mean": 1.089179477095604,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.314301919937133,
+      "reward/mean": 11.733750438690185,
+      "reward/solved_pct": 66.25,
+      "reward/tool_delta_harmful_pct": 9.958201438188553,
+      "reward/tool_delta_improved_pct": 8.610025310516358,
+      "reward/tool_delta_no_change_pct": 30.07347583770752,
+      "reward/tool_use_pct": 9.19921875,
+      "reward_std": 8.876571702957154,
+      "rewards/_reward_fn/mean": 11.733750343322754,
+      "rewards/_reward_fn/std": 8.876571607589721,
+      "sampling/importance_sampling_ratio/max": 1.368099308013916,
+      "sampling/importance_sampling_ratio/mean": 0.7861773669719696,
+      "sampling/importance_sampling_ratio/min": 0.0014549959842877769,
+      "sampling/sampling_logp_difference/max": 0.5029132544994355,
+      "sampling/sampling_logp_difference/mean": 0.0060428502969443795,
+      "step": 90,
+      "step_time": 56.012300855200735
+    },
+    {
+      "clip_ratio/high_max": 0.0002031281239396776,
+      "clip_ratio/high_mean": 0.00011036569849238731,
+      "clip_ratio/low_mean": 9.161969583146857e-05,
+      "clip_ratio/low_min": 1.9580200387281364e-06,
+      "clip_ratio/region_mean": 0.00020198539432385586,
+      "completions/clipped_ratio": 0.000390625,
+      "completions/max_length": 663.1,
+      "completions/max_terminated_length": 611.6,
+      "completions/mean_length": 123.2865234375,
+      "completions/mean_terminated_length": 122.99078369140625,
+      "completions/min_length": 27.8,
+      "completions/min_terminated_length": 27.8,
+      "entropy": 0.0858211137354374,
+      "epoch": 0.01845018450184502,
+      "frac_reward_zero_std": 0.440625,
+      "grad_norm": 0.010971284471452236,
+      "kl": 0.00028123334063820946,
+      "learning_rate": 1e-05,
+      "loss": -0.0263,
+      "num_tokens": 26876877.0,
+      "reward": 11.037343597412109,
+      "reward/apply_success_pct_given_tool": 36.99973030090332,
+      "reward/component/B_useful_patch_mean": 0.5,
+      "reward/component/R_base_mean": 4.011923432350159,
+      "reward/component/R_delta_mean": 1.0566666737198829,
+      "reward/component/R_edit_efficiency_mean": -0.1,
+      "reward/component/R_task_mean": 7.932715511322021,
+      "reward/mean": 11.03734369277954,
+      "reward/solved_pct": 63.61328125,
+      "reward/tool_delta_harmful_pct": 8.265407180786132,
+      "reward/tool_delta_improved_pct": 4.122124898433685,
+      "reward/tool_delta_no_change_pct": 24.612197399139404,
+      "reward/tool_use_pct": 9.08203125,
+      "reward_std": 9.237083053588867,
+      "rewards/_reward_fn/mean": 11.037343597412109,
+      "rewards/_reward_fn/std": 9.237082958221436,
+      "sampling/importance_sampling_ratio/max": 1.566675055027008,
+      "sampling/importance_sampling_ratio/mean": 0.7753388285636902,
+      "sampling/importance_sampling_ratio/min": 0.0001489254657819572,
+      "sampling/sampling_logp_difference/max": 0.6491730093955994,
+      "sampling/sampling_logp_difference/mean": 0.005994408950209617,
+      "step": 100,
+      "step_time": 54.749787248950454
+    },
+    {
+      "epoch": 0.01845018450184502,
+      "eval_clip_ratio/high_max": 0.0,
+      "eval_clip_ratio/high_mean": 0.0,
+      "eval_clip_ratio/low_mean": 0.0,
+      "eval_clip_ratio/low_min": 0.0,
+      "eval_clip_ratio/region_mean": 0.0,
+      "eval_completions/clipped_ratio": 0.00015625,
+      "eval_completions/max_length": 244.925,
+      "eval_completions/max_terminated_length": 243.735,
+      "eval_completions/mean_length": 115.74953125,
+      "eval_completions/mean_terminated_length": 115.64001007080078,
+      "eval_completions/min_length": 60.445,
+      "eval_completions/min_terminated_length": 60.445,
+      "eval_entropy": 0.06678198812762276,
+      "eval_frac_reward_zero_std": 0.4875,
+      "eval_kl": 0.0003430500092323285,
+      "eval_loss": -0.034811168909072876,
+      "eval_num_tokens": 26876877.0,
+      "eval_reward": 11.454193704538048,
+      "eval_reward/apply_success_pct_given_tool": 13.772176401615143,
+      "eval_reward/component/B_useful_patch_mean": 0.05,
+      "eval_reward/component/R_base_mean": 4.135028258753009,
+      "eval_reward/component/R_delta_mean": 0.06649999968707561,
+      "eval_reward/component/R_edit_efficiency_mean": 0.0,
+      "eval_reward/component/R_task_mean": 8.18144760252908,
+      "eval_reward/mean": 11.454193700700998,
+      "eval_reward/solved_pct": 65.484375,
+      "eval_reward/tool_delta_harmful_pct": 2.786755928993225,
+      "eval_reward/tool_delta_improved_pct": 0.99548992395401,
+      "eval_reward/tool_delta_no_change_pct": 9.989930498600007,
+      "eval_reward/tool_use_pct": 8.078125,
+      "eval_reward_std": 5.941274922974408,
+      "eval_rewards/_reward_fn/mean": 11.454193704538048,
+      "eval_rewards/_reward_fn/std": 5.941274832850322,
+      "eval_runtime": 557.4367,
+      "eval_samples_per_second": 0.718,
+      "eval_sampling/importance_sampling_ratio/max": 1.1029843735694884,
+      "eval_sampling/importance_sampling_ratio/mean": 0.8005477206408977,
+      "eval_sampling/importance_sampling_ratio/min": 0.3540622854890876,
+      "eval_sampling/sampling_logp_difference/max": 0.2792318390309811,
+      "eval_sampling/sampling_logp_difference/mean": 0.004614601342073001,
+      "eval_steps_per_second": 0.023,
+      "step": 100
+    },
+    {
+      "clip_ratio/high_max": 0.00023523846502939704,
+      "clip_ratio/high_mean": 0.0001321048825957405,
+      "clip_ratio/low_mean": 6.88946256559575e-05,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.00020099950797884957,
+      "completions/clipped_ratio": 0.000390625,
+      "completions/max_length": 654.6,
+      "completions/max_terminated_length": 608.7,
+      "completions/mean_length": 120.687890625,
+      "completions/mean_terminated_length": 120.38757553100587,
+      "completions/min_length": 26.3,
+      "completions/min_terminated_length": 26.3,
+      "entropy": 0.08716824075672776,
+      "epoch": 0.02029520295202952,
+      "frac_reward_zero_std": 0.453125,
+      "grad_norm": 0.011396385729312897,
+      "kl": 0.00028926514478371245,
+      "learning_rate": 1e-05,
+      "loss": -0.0255,
+      "num_tokens": 29572143.0,
+      "reward": 11.120241069793702,
+      "reward/apply_success_pct_given_tool": 47.939691162109376,
+      "reward/component/B_useful_patch_mean": 0.7,
+      "reward/component/R_base_mean": 4.04483642578125,
+      "reward/component/R_delta_mean": 0.8166666850447655,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 7.958938789367676,
+      "reward/mean": 11.120241260528564,
+      "reward/solved_pct": 62.8125,
+      "reward/tool_delta_harmful_pct": 11.53702998161316,
+      "reward/tool_delta_improved_pct": 8.895909416675568,
+      "reward/tool_delta_no_change_pct": 27.506751155853273,
+      "reward/tool_use_pct": 8.33984375,
+      "reward_std": 9.081052017211913,
+      "rewards/_reward_fn/mean": 11.120241069793702,
+      "rewards/_reward_fn/std": 9.081052017211913,
+      "sampling/importance_sampling_ratio/max": 1.3894711971282958,
+      "sampling/importance_sampling_ratio/mean": 0.7753439664840698,
+      "sampling/importance_sampling_ratio/min": 0.0008019323565122249,
+      "sampling/sampling_logp_difference/max": 0.6378564476966858,
+      "sampling/sampling_logp_difference/mean": 0.0060680612921714784,
+      "step": 110,
+      "step_time": 56.7801183517091
+    },
+    {
+      "clip_ratio/high_max": 0.00021326073820091552,
+      "clip_ratio/high_mean": 0.00011761065406972193,
+      "clip_ratio/low_mean": 6.656577006651787e-05,
+      "clip_ratio/low_min": 4.290019205654971e-06,
+      "clip_ratio/region_mean": 0.00018417642431813874,
+      "completions/clipped_ratio": 0.0001953125,
+      "completions/max_length": 599.0,
+      "completions/max_terminated_length": 576.7,
+      "completions/mean_length": 121.9642578125,
+      "completions/mean_terminated_length": 121.81817169189453,
+      "completions/min_length": 25.7,
+      "completions/min_terminated_length": 25.7,
+      "entropy": 0.07917747963219882,
+      "epoch": 0.02214022140221402,
+      "frac_reward_zero_std": 0.496875,
+      "grad_norm": 0.00803076196461916,
+      "kl": 0.00035773927493210067,
+      "learning_rate": 1e-05,
+      "loss": -0.0266,
+      "num_tokens": 32320504.0,
+      "reward": 11.586969375610352,
+      "reward/apply_success_pct_given_tool": 43.3990385055542,
+      "reward/component/B_useful_patch_mean": 1.2,
+      "reward/component/R_base_mean": 4.165695548057556,
+      "reward/component/R_delta_mean": 1.552000030875206,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.244828796386718,
+      "reward/mean": 11.586969375610352,
+      "reward/solved_pct": 65.80078125,
+      "reward/tool_delta_harmful_pct": 8.076656818389893,
+      "reward/tool_delta_improved_pct": 5.610287690162659,
+      "reward/tool_delta_no_change_pct": 29.712094497680663,
+      "reward/tool_use_pct": 9.47265625,
+      "reward_std": 8.988118171691895,
+      "rewards/_reward_fn/mean": 11.586969375610352,
+      "rewards/_reward_fn/std": 8.988118362426757,
+      "sampling/importance_sampling_ratio/max": 1.3942416548728942,
+      "sampling/importance_sampling_ratio/mean": 0.7956717908382416,
+      "sampling/importance_sampling_ratio/min": 0.0015128496593661111,
+      "sampling/sampling_logp_difference/max": 0.5542707771062851,
+      "sampling/sampling_logp_difference/mean": 0.005592703726142645,
+      "step": 120,
+      "step_time": 56.20834960984066
+    },
+    {
+      "clip_ratio/high_max": 0.00019207513632863994,
+      "clip_ratio/high_mean": 0.00010209105357716908,
+      "clip_ratio/low_mean": 9.948437282218947e-05,
+      "clip_ratio/low_min": 7.267745058925357e-06,
+      "clip_ratio/region_mean": 0.00020157542667220696,
+      "completions/clipped_ratio": 0.000390625,
+      "completions/max_length": 687.4,
+      "completions/max_terminated_length": 652.9,
+      "completions/mean_length": 121.323046875,
+      "completions/mean_terminated_length": 121.01700592041016,
+      "completions/min_length": 21.8,
+      "completions/min_terminated_length": 21.8,
+      "entropy": 0.08384264635387809,
+      "epoch": 0.023985239852398525,
+      "frac_reward_zero_std": 0.4625,
+      "grad_norm": 0.016780834645032883,
+      "kl": 0.0004704319350366859,
+      "learning_rate": 1e-05,
+      "loss": -0.0303,
+      "num_tokens": 35046366.0,
+      "reward": 11.526555728912353,
+      "reward/apply_success_pct_given_tool": 42.76843700408936,
+      "reward/component/B_useful_patch_mean": 0.6,
+      "reward/component/R_base_mean": 4.168564319610596,
+      "reward/component/R_delta_mean": 0.9766666844487191,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.221009063720704,
+      "reward/mean": 11.526555633544922,
+      "reward/solved_pct": 64.7265625,
+      "reward/tool_delta_harmful_pct": 8.421176433563232,
+      "reward/tool_delta_improved_pct": 7.104018497467041,
+      "reward/tool_delta_no_change_pct": 27.243241596221925,
+      "reward/tool_use_pct": 9.43359375,
+      "reward_std": 8.872696018218994,
+      "rewards/_reward_fn/mean": 11.526555728912353,
+      "rewards/_reward_fn/std": 8.872695875167846,
+      "sampling/importance_sampling_ratio/max": 1.534518873691559,
+      "sampling/importance_sampling_ratio/mean": 0.7859900534152985,
+      "sampling/importance_sampling_ratio/min": 0.0007695142622040407,
+      "sampling/sampling_logp_difference/max": 0.6891680240631104,
+      "sampling/sampling_logp_difference/mean": 0.005972785875201225,
+      "step": 130,
+      "step_time": 56.667882435116915
+    },
+    {
+      "clip_ratio/high_max": 0.00022012189729139208,
+      "clip_ratio/high_mean": 0.00011268080552326865,
+      "clip_ratio/low_mean": 8.676975730850244e-05,
+      "clip_ratio/low_min": 1.6135696387209465e-05,
+      "clip_ratio/region_mean": 0.00019945056219512481,
+      "completions/clipped_ratio": 0.0009765625,
+      "completions/max_length": 678.0,
+      "completions/max_terminated_length": 617.6,
+      "completions/mean_length": 112.497265625,
+      "completions/mean_terminated_length": 111.73680419921875,
+      "completions/min_length": 24.2,
+      "completions/min_terminated_length": 24.2,
+      "entropy": 0.07168035440845415,
+      "epoch": 0.025830258302583026,
+      "frac_reward_zero_std": 0.45625,
+      "grad_norm": 0.02058902382850647,
+      "kl": 0.0008614284733084787,
+      "learning_rate": 1e-05,
+      "loss": -0.0374,
+      "num_tokens": 37696336.0,
+      "reward": 11.63793478012085,
+      "reward/apply_success_pct_given_tool": 42.29119720458984,
+      "reward/component/B_useful_patch_mean": 0.5,
+      "reward/component/R_base_mean": 4.21570851802826,
+      "reward/component/R_delta_mean": 0.6335714295506477,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.284550380706786,
+      "reward/mean": 11.637934684753418,
+      "reward/solved_pct": 65.46875,
+      "reward/tool_delta_harmful_pct": 14.78165340423584,
+      "reward/tool_delta_improved_pct": 4.225364005565643,
+      "reward/tool_delta_no_change_pct": 23.2841796875,
+      "reward/tool_use_pct": 6.71875,
+      "reward_std": 8.855925226211548,
+      "rewards/_reward_fn/mean": 11.63793478012085,
+      "rewards/_reward_fn/std": 8.855925035476684,
+      "sampling/importance_sampling_ratio/max": 1.5301782131195067,
+      "sampling/importance_sampling_ratio/mean": 0.8201212525367737,
+      "sampling/importance_sampling_ratio/min": 0.000672118240407471,
+      "sampling/sampling_logp_difference/max": 0.8904636859893799,
+      "sampling/sampling_logp_difference/mean": 0.005340459197759629,
+      "step": 140,
+      "step_time": 58.69500599168241
+    },
+    {
+      "clip_ratio/high_max": 0.0001595634892510134,
+      "clip_ratio/high_mean": 8.563768415115192e-05,
+      "clip_ratio/low_mean": 8.162629674188793e-05,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.00016726398116588824,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 508.9,
+      "completions/max_terminated_length": 508.9,
+      "completions/mean_length": 105.769140625,
+      "completions/mean_terminated_length": 105.769140625,
+      "completions/min_length": 25.8,
+      "completions/min_terminated_length": 25.8,
+      "entropy": 0.07320830426178873,
+      "epoch": 0.027675276752767528,
+      "frac_reward_zero_std": 0.515625,
+      "grad_norm": 0.025410808622837067,
+      "kl": 0.0009136529503848579,
+      "learning_rate": 1e-05,
+      "loss": -0.0294,
+      "num_tokens": 40361090.0,
+      "reward": 12.012639999389648,
+      "reward/apply_success_pct_given_tool": 46.143860530853274,
+      "reward/component/B_useful_patch_mean": 0.8,
+      "reward/component/R_base_mean": 4.2996844291687015,
+      "reward/component/R_delta_mean": 1.1290000081062317,
+      "reward/component/R_edit_efficiency_mean": -0.1,
+      "reward/component/R_task_mean": 8.505676460266113,
+      "reward/mean": 12.012640190124511,
+      "reward/solved_pct": 66.93359375,
+      "reward/tool_delta_harmful_pct": 12.139100015163422,
+      "reward/tool_delta_improved_pct": 9.940935206413268,
+      "reward/tool_delta_no_change_pct": 24.063825607299805,
+      "reward/tool_use_pct": 7.20703125,
+      "reward_std": 8.645849561691284,
+      "rewards/_reward_fn/mean": 12.012639999389648,
+      "rewards/_reward_fn/std": 8.645849418640136,
+      "sampling/importance_sampling_ratio/max": 1.5811097145080566,
+      "sampling/importance_sampling_ratio/mean": 0.8203917384147644,
+      "sampling/importance_sampling_ratio/min": 0.0010853145504256644,
+      "sampling/sampling_logp_difference/max": 0.8135462403297424,
+      "sampling/sampling_logp_difference/mean": 0.005324356863275171,
+      "step": 150,
+      "step_time": 49.08764977613464
+    },
+    {
+      "epoch": 0.027675276752767528,
+      "eval_clip_ratio/high_max": 0.0,
+      "eval_clip_ratio/high_mean": 0.0,
+      "eval_clip_ratio/low_mean": 0.0,
+      "eval_clip_ratio/low_min": 0.0,
+      "eval_clip_ratio/region_mean": 0.0,
+      "eval_completions/clipped_ratio": 0.00015625,
+      "eval_completions/max_length": 229.845,
+      "eval_completions/max_terminated_length": 227.12,
+      "eval_completions/mean_length": 111.9309375,
+      "eval_completions/mean_terminated_length": 111.80254535675049,
+      "eval_completions/min_length": 59.225,
+      "eval_completions/min_terminated_length": 59.225,
+      "eval_entropy": 0.06121339231962338,
+      "eval_frac_reward_zero_std": 0.5025,
+      "eval_kl": 0.0009744446298040544,
+      "eval_loss": -0.0286413487046957,
+      "eval_num_tokens": 40361090.0,
+      "eval_reward": 11.526437724977733,
+      "eval_reward/apply_success_pct_given_tool": 12.345153760910033,
+      "eval_reward/component/B_useful_patch_mean": 0.04,
+      "eval_reward/component/R_base_mean": 4.1519422115804625,
+      "eval_reward/component/R_delta_mean": 0.0723999997228384,
+      "eval_reward/component/R_edit_efficiency_mean": 0.0,
+      "eval_reward/component/R_task_mean": 8.210490764100104,
+      "eval_reward/mean": 11.526437741219997,
+      "eval_reward/solved_pct": 65.609375,
+      "eval_reward/tool_delta_harmful_pct": 2.6600784635543824,
+      "eval_reward/tool_delta_improved_pct": 1.2824494934082031,
+      "eval_reward/tool_delta_no_change_pct": 8.40262582063675,
+      "eval_reward/tool_use_pct": 6.390625,
+      "eval_reward_std": 5.901023456919939,
+      "eval_rewards/_reward_fn/mean": 11.526437724977733,
+      "eval_rewards/_reward_fn/std": 5.9010233445558695,
+      "eval_runtime": 541.1166,
+      "eval_samples_per_second": 0.739,
+      "eval_sampling/importance_sampling_ratio/max": 1.1830519792437553,
+      "eval_sampling/importance_sampling_ratio/mean": 0.8282190448045731,
+      "eval_sampling/importance_sampling_ratio/min": 0.3655103847636241,
+      "eval_sampling/sampling_logp_difference/max": 0.3254329504072666,
+      "eval_sampling/sampling_logp_difference/mean": 0.004453213424712885,
+      "eval_steps_per_second": 0.024,
+      "step": 150
+    },
+    {
+      "clip_ratio/high_max": 0.00019504252850310877,
+      "clip_ratio/high_mean": 0.00010473545944478246,
+      "clip_ratio/low_mean": 7.363339937001001e-05,
+      "clip_ratio/low_min": 6.939762170077302e-06,
+      "clip_ratio/region_mean": 0.00017836885926953984,
+      "completions/clipped_ratio": 0.0001953125,
+      "completions/max_length": 572.4,
+      "completions/max_terminated_length": 550.7,
+      "completions/mean_length": 109.8677734375,
+      "completions/mean_terminated_length": 109.7158187866211,
+      "completions/min_length": 21.5,
+      "completions/min_terminated_length": 21.5,
+      "entropy": 0.07699971334077418,
+      "epoch": 0.02952029520295203,
+      "frac_reward_zero_std": 0.440625,
+      "grad_norm": 0.014981130138039589,
+      "kl": 0.001021515233151149,
+      "learning_rate": 1e-05,
+      "loss": -0.0319,
+      "num_tokens": 43003437.0,
+      "reward": 11.008538341522216,
+      "reward/apply_success_pct_given_tool": 43.24302921295166,
+      "reward/component/B_useful_patch_mean": 1.0,
+      "reward/component/R_base_mean": 3.992829775810242,
+      "reward/component/R_delta_mean": 1.2896666526794434,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 7.912523317337036,
+      "reward/mean": 11.008538150787354,
+      "reward/solved_pct": 61.66015625,
+      "reward/tool_delta_harmful_pct": 8.137261247634887,
+      "reward/tool_delta_improved_pct": 9.572439241409302,
+      "reward/tool_delta_no_change_pct": 25.53332886695862,
+      "reward/tool_use_pct": 7.8515625,
+      "reward_std": 9.070524883270263,
+      "rewards/_reward_fn/mean": 11.008538341522216,
+      "rewards/_reward_fn/std": 9.0705246925354,
+      "sampling/importance_sampling_ratio/max": 1.7989765405654907,
+      "sampling/importance_sampling_ratio/mean": 0.8165328025817871,
+      "sampling/importance_sampling_ratio/min": 0.0012922484581849858,
+      "sampling/sampling_logp_difference/max": 0.8317235291004181,
+      "sampling/sampling_logp_difference/mean": 0.0057515331078320745,
+      "step": 160,
+      "step_time": 51.5585632561706
+    },
+    {
+      "clip_ratio/high_max": 0.00020795641394215635,
+      "clip_ratio/high_mean": 0.00011857282406708691,
+      "clip_ratio/low_mean": 9.31897122427472e-05,
+      "clip_ratio/low_min": 4.505516517383512e-06,
+      "clip_ratio/region_mean": 0.00021176253649173303,
+      "completions/clipped_ratio": 0.0005859375,
+      "completions/max_length": 589.6,
+      "completions/max_terminated_length": 519.1,
+      "completions/mean_length": 111.4337890625,
+      "completions/mean_terminated_length": 110.98353729248046,
+      "completions/min_length": 23.5,
+      "completions/min_terminated_length": 23.5,
+      "entropy": 0.07038887067465112,
+      "epoch": 0.03136531365313653,
+      "frac_reward_zero_std": 0.503125,
+      "grad_norm": 0.03459205850958824,
+      "kl": 0.0013147015451977495,
+      "learning_rate": 1e-05,
+      "loss": -0.031,
+      "num_tokens": 45662826.0,
+      "reward": 11.957479476928711,
+      "reward/apply_success_pct_given_tool": 40.27231578826904,
+      "reward/component/B_useful_patch_mean": 0.4,
+      "reward/component/R_base_mean": 4.2803816318511965,
+      "reward/component/R_delta_mean": 0.6600000023841858,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.456700897216797,
+      "reward/mean": 11.957479572296142,
+      "reward/solved_pct": 67.3046875,
+      "reward/tool_delta_harmful_pct": 6.862850999832153,
+      "reward/tool_delta_improved_pct": 3.4656668186187742,
+      "reward/tool_delta_no_change_pct": 29.94379816055298,
+      "reward/tool_use_pct": 7.05078125,
+      "reward_std": 8.697943353652954,
+      "rewards/_reward_fn/mean": 11.957479476928711,
+      "rewards/_reward_fn/std": 8.697943353652954,
+      "sampling/importance_sampling_ratio/max": 1.6393386483192445,
+      "sampling/importance_sampling_ratio/mean": 0.8219207346439361,
+      "sampling/importance_sampling_ratio/min": 0.0027227112514083274,
+      "sampling/sampling_logp_difference/max": 0.9732717037200928,
+      "sampling/sampling_logp_difference/mean": 0.00528430100530386,
+      "step": 170,
+      "step_time": 52.491502999234946
+    },
+    {
+      "clip_ratio/high_max": 0.00018475634506103232,
+      "clip_ratio/high_mean": 0.00010646040796018497,
+      "clip_ratio/low_mean": 7.646325020687073e-05,
+      "clip_ratio/low_min": 3.865048711304553e-06,
+      "clip_ratio/region_mean": 0.00018292365803063149,
+      "completions/clipped_ratio": 0.0005859375,
+      "completions/max_length": 649.2,
+      "completions/max_terminated_length": 627.5,
+      "completions/mean_length": 113.2130859375,
+      "completions/mean_terminated_length": 112.75348434448242,
+      "completions/min_length": 24.9,
+      "completions/min_terminated_length": 24.9,
+      "entropy": 0.07052409281022846,
+      "epoch": 0.033210332103321034,
+      "frac_reward_zero_std": 0.484375,
+      "grad_norm": 0.021335577592253685,
+      "kl": 0.0014991436068157783,
+      "learning_rate": 1e-05,
+      "loss": -0.0212,
+      "num_tokens": 48327309.0,
+      "reward": 11.075523376464844,
+      "reward/apply_success_pct_given_tool": 41.31239624023438,
+      "reward/component/B_useful_patch_mean": 0.6,
+      "reward/component/R_base_mean": 4.019260406494141,
+      "reward/component/R_delta_mean": 0.7633333534002305,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 7.9447962760925295,
+      "reward/mean": 11.075523281097412,
+      "reward/solved_pct": 63.10546875,
+      "reward/tool_delta_harmful_pct": 9.619399118423463,
+      "reward/tool_delta_improved_pct": 5.880249238014221,
+      "reward/tool_delta_no_change_pct": 25.8127480506897,
+      "reward/tool_use_pct": 6.5234375,
+      "reward_std": 9.209563732147217,
+      "rewards/_reward_fn/mean": 11.075523376464844,
+      "rewards/_reward_fn/std": 9.209563636779786,
+      "sampling/importance_sampling_ratio/max": 1.7227159500122071,
+      "sampling/importance_sampling_ratio/mean": 0.820741868019104,
+      "sampling/importance_sampling_ratio/min": 0.0015581478479361976,
+      "sampling/sampling_logp_difference/max": 0.9154388189315796,
+      "sampling/sampling_logp_difference/mean": 0.005375081417150795,
+      "step": 180,
+      "step_time": 55.131990532763304
+    },
+    {
+      "clip_ratio/high_max": 0.00014927587453712478,
+      "clip_ratio/high_mean": 8.11735389106616e-05,
+      "clip_ratio/low_mean": 7.789550127199619e-05,
+      "clip_ratio/low_min": 5.365745710150804e-06,
+      "clip_ratio/region_mean": 0.00015906903963696094,
+      "completions/clipped_ratio": 0.000390625,
+      "completions/max_length": 568.1,
+      "completions/max_terminated_length": 515.1,
+      "completions/mean_length": 108.5109375,
+      "completions/mean_terminated_length": 108.21175689697266,
+      "completions/min_length": 20.9,
+      "completions/min_terminated_length": 20.9,
+      "entropy": 0.05555519321933389,
+      "epoch": 0.03505535055350553,
+      "frac_reward_zero_std": 0.54375,
+      "grad_norm": 0.018722575157880783,
+      "kl": 0.0014766790654903161,
+      "learning_rate": 1e-05,
+      "loss": -0.0227,
+      "num_tokens": 50942453.0,
+      "reward": 11.70543394088745,
+      "reward/apply_success_pct_given_tool": 42.16090841293335,
+      "reward/component/B_useful_patch_mean": 0.4,
+      "reward/component/R_base_mean": 4.194123148918152,
+      "reward/component/R_delta_mean": 0.7700000047683716,
+      "reward/component/R_edit_efficiency_mean": -0.2,
+      "reward/component/R_task_mean": 8.296390533447266,
+      "reward/mean": 11.70543384552002,
+      "reward/solved_pct": 66.34765625,
+      "reward/tool_delta_harmful_pct": 8.087179279327392,
+      "reward/tool_delta_improved_pct": 10.075396704673768,
+      "reward/tool_delta_no_change_pct": 23.998331832885743,
+      "reward/tool_use_pct": 4.12109375,
+      "reward_std": 9.02739782333374,
+      "rewards/_reward_fn/mean": 11.70543394088745,
+      "rewards/_reward_fn/std": 9.027397727966308,
+      "sampling/importance_sampling_ratio/max": 1.6138852000236512,
+      "sampling/importance_sampling_ratio/mean": 0.8452004075050354,
+      "sampling/importance_sampling_ratio/min": 0.0027836032990308014,
+      "sampling/sampling_logp_difference/max": 0.8636963725090027,
+      "sampling/sampling_logp_difference/mean": 0.004302366101182997,
+      "step": 190,
+      "step_time": 52.65988230202347
+    },
+    {
+      "clip_ratio/high_max": 0.0002104033022078511,
+      "clip_ratio/high_mean": 0.00011298979793537001,
+      "clip_ratio/low_mean": 8.75066780281486e-05,
+      "clip_ratio/low_min": 8.804377648630179e-06,
+      "clip_ratio/region_mean": 0.00020049647614541754,
+      "completions/clipped_ratio": 0.001953125,
+      "completions/max_length": 721.4,
+      "completions/max_terminated_length": 663.5,
+      "completions/mean_length": 114.5673828125,
+      "completions/mean_terminated_length": 113.04182739257813,
+      "completions/min_length": 24.4,
+      "completions/min_terminated_length": 24.4,
+      "entropy": 0.07257845954736694,
+      "epoch": 0.03690036900369004,
+      "frac_reward_zero_std": 0.503125,
+      "grad_norm": 0.023543676361441612,
+      "kl": 0.002098342059980496,
+      "learning_rate": 1e-05,
+      "loss": -0.0141,
+      "num_tokens": 53644702.0,
+      "reward": 11.880938911437989,
+      "reward/apply_success_pct_given_tool": 52.08720760345459,
+      "reward/component/B_useful_patch_mean": 0.4,
+      "reward/component/R_base_mean": 4.231159090995789,
+      "reward/component/R_delta_mean": 0.6350000038743019,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.393022394180297,
+      "reward/mean": 11.880938625335693,
+      "reward/solved_pct": 67.51953125,
+      "reward/tool_delta_harmful_pct": 5.835481071472168,
+      "reward/tool_delta_improved_pct": 4.453013300895691,
+      "reward/tool_delta_no_change_pct": 41.79871368408203,
+      "reward/tool_use_pct": 6.66015625,
+      "reward_std": 8.851639747619629,
+      "rewards/_reward_fn/mean": 11.880938911437989,
+      "rewards/_reward_fn/std": 8.851639652252198,
+      "sampling/importance_sampling_ratio/max": 1.56670902967453,
+      "sampling/importance_sampling_ratio/mean": 0.8197263419628144,
+      "sampling/importance_sampling_ratio/min": 0.0006614162295591087,
+      "sampling/sampling_logp_difference/max": 1.0728787243366242,
+      "sampling/sampling_logp_difference/mean": 0.005478994129225612,
+      "step": 200,
+      "step_time": 57.64046573247761
+    },
+    {
+      "epoch": 0.03690036900369004,
+      "eval_clip_ratio/high_max": 0.0,
+      "eval_clip_ratio/high_mean": 0.0,
+      "eval_clip_ratio/low_mean": 0.0,
+      "eval_clip_ratio/low_min": 0.0,
+      "eval_clip_ratio/region_mean": 0.0,
+      "eval_completions/clipped_ratio": 0.00015625,
+      "eval_completions/max_length": 229.835,
+      "eval_completions/max_terminated_length": 228.82,
+      "eval_completions/mean_length": 111.8209375,
+      "eval_completions/mean_terminated_length": 111.72316024780274,
+      "eval_completions/min_length": 59.07,
+      "eval_completions/min_terminated_length": 59.07,
+      "eval_entropy": 0.057692300159251315,
+      "eval_frac_reward_zero_std": 0.5225,
+      "eval_kl": 0.0019594344102222294,
+      "eval_loss": -0.03086557611823082,
+      "eval_num_tokens": 53644702.0,
+      "eval_reward": 11.690192336738109,
+      "eval_reward/apply_success_pct_given_tool": 9.688758413791657,
+      "eval_reward/component/B_useful_patch_mean": 0.03,
+      "eval_reward/component/R_base_mean": 4.21092854518909,
+      "eval_reward/component/R_delta_mean": 0.02899999938905239,
+      "eval_reward/component/R_edit_efficiency_mean": 0.0,
+      "eval_reward/component/R_task_mean": 8.310298587996513,
+      "eval_reward/mean": 11.690192318111658,
+      "eval_reward/solved_pct": 66.59375,
+      "eval_reward/tool_delta_harmful_pct": 3.0588969922065736,
+      "eval_reward/tool_delta_improved_pct": 0.9593253779411316,
+      "eval_reward/tool_delta_no_change_pct": 5.670536049604416,
+      "eval_reward/tool_use_pct": 6.171875,
+      "eval_reward_std": 5.947616479415447,
+      "eval_rewards/_reward_fn/mean": 11.690192336738109,
+      "eval_rewards/_reward_fn/std": 5.947616354944184,
+      "eval_runtime": 538.2558,
+      "eval_samples_per_second": 0.743,
+      "eval_sampling/importance_sampling_ratio/max": 1.1541682589054107,
+      "eval_sampling/importance_sampling_ratio/mean": 0.8326147775352001,
+      "eval_sampling/importance_sampling_ratio/min": 0.40857273394678484,
+      "eval_sampling/sampling_logp_difference/max": 0.34644374340772627,
+      "eval_sampling/sampling_logp_difference/mean": 0.004358195329550654,
+      "eval_steps_per_second": 0.024,
+      "step": 200
+    },
+    {
+      "clip_ratio/high_max": 0.0001560147211421281,
+      "clip_ratio/high_mean": 8.427029715676326e-05,
+      "clip_ratio/low_mean": 8.059253814280964e-05,
+      "clip_ratio/low_min": 7.472297147614881e-06,
+      "clip_ratio/region_mean": 0.00016486283520862345,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 505.2,
+      "completions/max_terminated_length": 505.2,
+      "completions/mean_length": 107.6642578125,
+      "completions/mean_terminated_length": 107.6642578125,
+      "completions/min_length": 23.2,
+      "completions/min_terminated_length": 23.2,
+      "entropy": 0.06096881704870612,
+      "epoch": 0.03874538745387454,
+      "frac_reward_zero_std": 0.484375,
+      "grad_norm": 0.024006105959415436,
+      "kl": 0.0018058499641483649,
+      "learning_rate": 1e-05,
+      "loss": -0.0301,
+      "num_tokens": 56276951.0,
+      "reward": 11.14963731765747,
+      "reward/apply_success_pct_given_tool": 42.84285945892334,
+      "reward/component/B_useful_patch_mean": 0.3,
+      "reward/component/R_base_mean": 4.040538740158081,
+      "reward/component/R_delta_mean": 0.6600000008940696,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 7.985949182510376,
+      "reward/mean": 11.14963731765747,
+      "reward/solved_pct": 63.73046875,
+      "reward/tool_delta_harmful_pct": 16.939499807357787,
+      "reward/tool_delta_improved_pct": 5.831529426574707,
+      "reward/tool_delta_no_change_pct": 20.07182922363281,
+      "reward/tool_use_pct": 4.53125,
+      "reward_std": 9.190572929382324,
+      "rewards/_reward_fn/mean": 11.14963731765747,
+      "rewards/_reward_fn/std": 9.190572547912598,
+      "sampling/importance_sampling_ratio/max": 1.7111823201179504,
+      "sampling/importance_sampling_ratio/mean": 0.8461174428462982,
+      "sampling/importance_sampling_ratio/min": 0.0018867200880777091,
+      "sampling/sampling_logp_difference/max": 0.8022410094738006,
+      "sampling/sampling_logp_difference/mean": 0.00464123715646565,
+      "step": 210,
+      "step_time": 49.276526562217626
+    },
+    {
+      "clip_ratio/high_max": 0.00022996926909399918,
+      "clip_ratio/high_mean": 0.00012168214716439252,
+      "clip_ratio/low_mean": 9.770368860699819e-05,
+      "clip_ratio/low_min": 7.0426111051347105e-06,
+      "clip_ratio/region_mean": 0.00021938583558949175,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 546.6,
+      "completions/max_terminated_length": 546.6,
+      "completions/mean_length": 99.3310546875,
+      "completions/mean_terminated_length": 99.3310546875,
+      "completions/min_length": 24.8,
+      "completions/min_terminated_length": 24.8,
+      "entropy": 0.07305318422149867,
+      "epoch": 0.04059040590405904,
+      "frac_reward_zero_std": 0.509375,
+      "grad_norm": 0.022132640704512596,
+      "kl": 0.002066104738696595,
+      "learning_rate": 1e-05,
+      "loss": -0.0208,
+      "num_tokens": 58847430.0,
+      "reward": 11.046182250976562,
+      "reward/apply_success_pct_given_tool": 52.32607021331787,
+      "reward/component/B_useful_patch_mean": 0.7,
+      "reward/component/R_base_mean": 4.023368000984192,
+      "reward/component/R_delta_mean": 0.8166666686534881,
+      "reward/component/R_edit_efficiency_mean": -0.1,
+      "reward/component/R_task_mean": 7.92728009223938,
+      "reward/mean": 11.046182250976562,
+      "reward/solved_pct": 61.89453125,
+      "reward/tool_delta_harmful_pct": 8.144870352745055,
+      "reward/tool_delta_improved_pct": 3.825251376628876,
+      "reward/tool_delta_no_change_pct": 40.3559476852417,
+      "reward/tool_use_pct": 5.60546875,
+      "reward_std": 9.07750096321106,
+      "rewards/_reward_fn/mean": 11.046182250976562,
+      "rewards/_reward_fn/std": 9.077500820159912,
+      "sampling/importance_sampling_ratio/max": 1.7171172380447388,
+      "sampling/importance_sampling_ratio/mean": 0.8341441929340363,
+      "sampling/importance_sampling_ratio/min": 0.0025481905471679057,
+      "sampling/sampling_logp_difference/max": 0.8644452691078186,
+      "sampling/sampling_logp_difference/mean": 0.005526903737336397,
+      "step": 220,
+      "step_time": 49.76215039938688
+    },
+    {
+      "clip_ratio/high_max": 0.00015373438600363443,
+      "clip_ratio/high_mean": 7.974182799443951e-05,
+      "clip_ratio/low_mean": 8.08408312877873e-05,
+      "clip_ratio/low_min": 1.4344109149533325e-05,
+      "clip_ratio/region_mean": 0.00016058265891842892,
+      "completions/clipped_ratio": 0.0005859375,
+      "completions/max_length": 719.3,
+      "completions/max_terminated_length": 656.9,
+      "completions/mean_length": 110.6224609375,
+      "completions/mean_terminated_length": 110.15891571044922,
+      "completions/min_length": 22.0,
+      "completions/min_terminated_length": 22.0,
+      "entropy": 0.06194095227401704,
+      "epoch": 0.042435424354243544,
+      "frac_reward_zero_std": 0.5125,
+      "grad_norm": 0.03635764122009277,
+      "kl": 0.0017908313566294964,
+      "learning_rate": 1e-05,
+      "loss": -0.0173,
+      "num_tokens": 61452873.0,
+      "reward": 11.396505451202392,
+      "reward/apply_success_pct_given_tool": 48.05235195159912,
+      "reward/component/B_useful_patch_mean": 0.6,
+      "reward/component/R_base_mean": 4.099998259544373,
+      "reward/component/R_delta_mean": 1.0340000301599503,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.131569862365723,
+      "reward/mean": 11.396505546569824,
+      "reward/solved_pct": 64.16015625,
+      "reward/tool_delta_harmful_pct": 8.532223534584045,
+      "reward/tool_delta_improved_pct": 7.841976892948151,
+      "reward/tool_delta_no_change_pct": 31.678151226043703,
+      "reward/tool_use_pct": 5.234375,
+      "reward_std": 9.06121072769165,
+      "rewards/_reward_fn/mean": 11.396505451202392,
+      "rewards/_reward_fn/std": 9.061210632324219,
+      "sampling/importance_sampling_ratio/max": 1.757542860507965,
+      "sampling/importance_sampling_ratio/mean": 0.8362370252609252,
+      "sampling/importance_sampling_ratio/min": 0.004150766115344595,
+      "sampling/sampling_logp_difference/max": 0.8529959380626678,
+      "sampling/sampling_logp_difference/mean": 0.004772624466568232,
+      "step": 230,
+      "step_time": 54.79260343192145
+    },
+    {
+      "clip_ratio/high_max": 0.0001848411729952204,
+      "clip_ratio/high_mean": 9.821855101108668e-05,
+      "clip_ratio/low_mean": 7.920353873487329e-05,
+      "clip_ratio/low_min": 1.1846675261040217e-05,
+      "clip_ratio/region_mean": 0.00017742209065545466,
+      "completions/clipped_ratio": 0.000390625,
+      "completions/max_length": 604.2,
+      "completions/max_terminated_length": 598.9,
+      "completions/mean_length": 109.0744140625,
+      "completions/mean_terminated_length": 108.7636116027832,
+      "completions/min_length": 22.9,
+      "completions/min_terminated_length": 22.9,
+      "entropy": 0.07005312427645549,
+      "epoch": 0.04428044280442804,
+      "frac_reward_zero_std": 0.53125,
+      "grad_norm": 0.025080060586333275,
+      "kl": 0.0018074575922582881,
+      "learning_rate": 1e-05,
+      "loss": -0.0135,
+      "num_tokens": 64078694.0,
+      "reward": 11.59510326385498,
+      "reward/apply_success_pct_given_tool": 58.44213447570801,
+      "reward/component/B_useful_patch_mean": 0.8,
+      "reward/component/R_base_mean": 4.134954142570495,
+      "reward/component/R_delta_mean": 0.9627380892634392,
+      "reward/component/R_edit_efficiency_mean": -0.1,
+      "reward/component/R_task_mean": 8.22653169631958,
+      "reward/mean": 11.595103359222412,
+      "reward/solved_pct": 66.15234375,
+      "reward/tool_delta_harmful_pct": 10.053972673416137,
+      "reward/tool_delta_improved_pct": 9.108486747741699,
+      "reward/tool_delta_no_change_pct": 39.27967548370361,
+      "reward/tool_use_pct": 5.52734375,
+      "reward_std": 9.00002498626709,
+      "rewards/_reward_fn/mean": 11.59510326385498,
+      "rewards/_reward_fn/std": 9.000024795532227,
+      "sampling/importance_sampling_ratio/max": 1.718640649318695,
+      "sampling/importance_sampling_ratio/mean": 0.831313943862915,
+      "sampling/importance_sampling_ratio/min": 0.0018951008485146303,
+      "sampling/sampling_logp_difference/max": 0.7132040381431579,
+      "sampling/sampling_logp_difference/mean": 0.005271387100219726,
+      "step": 240,
+      "step_time": 52.92341566616669
+    },
+    {
+      "clip_ratio/high_max": 0.00013830441457685083,
+      "clip_ratio/high_mean": 7.543054434790974e-05,
+      "clip_ratio/low_mean": 5.836110567543073e-05,
+      "clip_ratio/low_min": 3.481894236756489e-06,
+      "clip_ratio/region_mean": 0.00013379165002334049,
+      "completions/clipped_ratio": 0.0001953125,
+      "completions/max_length": 559.1,
+      "completions/max_terminated_length": 549.7,
+      "completions/mean_length": 104.812109375,
+      "completions/mean_terminated_length": 104.66366424560547,
+      "completions/min_length": 23.5,
+      "completions/min_terminated_length": 23.5,
+      "entropy": 0.06662628618068993,
+      "epoch": 0.046125461254612546,
+      "frac_reward_zero_std": 0.54375,
+      "grad_norm": 0.03168033808469772,
+      "kl": 0.002189036015624879,
+      "learning_rate": 1e-05,
+      "loss": -0.0148,
+      "num_tokens": 66668132.0,
+      "reward": 11.9512770652771,
+      "reward/apply_success_pct_given_tool": 44.01959457397461,
+      "reward/component/B_useful_patch_mean": 1.0,
+      "reward/component/R_base_mean": 4.248904061317444,
+      "reward/component/R_delta_mean": 1.2606666892766953,
+      "reward/component/R_edit_efficiency_mean": 0.0,
+      "reward/component/R_task_mean": 8.449918842315673,
+      "reward/mean": 11.951276969909667,
+      "reward/solved_pct": 67.75390625,
+      "reward/tool_delta_harmful_pct": 6.142129611968994,
+      "reward/tool_delta_improved_pct": 9.692818069458008,
+      "reward/tool_delta_no_change_pct": 28.18464775085449,
+      "reward/tool_use_pct": 5.41015625,
+      "reward_std": 8.890695285797118,
+      "rewards/_reward_fn/mean": 11.9512770652771,
+      "rewards/_reward_fn/std": 8.890695285797118,
+      "sampling/importance_sampling_ratio/max": 1.827085053920746,
+      "sampling/importance_sampling_ratio/mean": 0.8389009296894073,
+      "sampling/importance_sampling_ratio/min": 0.0007055281144857872,
+      "sampling/sampling_logp_difference/max": 1.0331299543380736,
+      "sampling/sampling_logp_difference/mean": 0.005113462917506695,
+      "step": 250,
+      "step_time": 50.672314977180214
+    },
+    {
+      "epoch": 0.046125461254612546,
+      "eval_clip_ratio/high_max": 0.0,
+      "eval_clip_ratio/high_mean": 0.0,
+      "eval_clip_ratio/low_mean": 0.0,
+      "eval_clip_ratio/low_min": 0.0,
+      "eval_clip_ratio/region_mean": 0.0,
+      "eval_completions/clipped_ratio": 0.00015625,
+      "eval_completions/max_length": 236.395,
+      "eval_completions/max_terminated_length": 234.39,
+      "eval_completions/mean_length": 113.03015625,
+      "eval_completions/mean_terminated_length": 112.95279739379883,
+      "eval_completions/min_length": 59.84,
+      "eval_completions/min_terminated_length": 59.84,
+      "eval_entropy": 0.058541165199130774,
+      "eval_frac_reward_zero_std": 0.5175,
+      "eval_kl": 0.0028583471066156107,
+      "eval_loss": -0.03485310077667236,
+      "eval_num_tokens": 66668132.0,
+      "eval_reward": 11.8223366856575,
+      "eval_reward/apply_success_pct_given_tool": 12.58699038028717,
+      "eval_reward/component/B_useful_patch_mean": 0.04,
+      "eval_reward/component/R_base_mean": 4.239605409097858,
+      "eval_reward/component/R_delta_mean": 0.04199999988079071,
+      "eval_reward/component/R_edit_efficiency_mean": 0.0,
+      "eval_reward/component/R_task_mean": 8.387197254616767,
+      "eval_reward/mean": 11.822336682081222,
+      "eval_reward/solved_pct": 67.21875,
+      "eval_reward/tool_delta_harmful_pct": 2.2710497617721557,
+      "eval_reward/tool_delta_improved_pct": 1.1624188208580017,
+      "eval_reward/tool_delta_no_change_pct": 9.153521778583526,
+      "eval_reward/tool_use_pct": 6.046875,
+      "eval_reward_std": 5.92577289994806,
+      "eval_rewards/_reward_fn/mean": 11.8223366856575,
+      "eval_rewards/_reward_fn/std": 5.925772826587782,
+      "eval_runtime": 550.0044,
+      "eval_samples_per_second": 0.727,
+      "eval_sampling/importance_sampling_ratio/max": 1.1637728112936019,
+      "eval_sampling/importance_sampling_ratio/mean": 0.827920114994049,
+      "eval_sampling/importance_sampling_ratio/min": 0.37507851646523704,
+      "eval_sampling/sampling_logp_difference/max": 0.3501102040708065,
+      "eval_sampling/sampling_logp_difference/mean": 0.00442439226215356,
+      "eval_steps_per_second": 0.024,
+      "step": 250
+    }
+  ],
+  "logging_steps": 10,
+  "max_steps": 8000,
+  "num_input_tokens_seen": 66668132,
+  "num_train_epochs": 2,
+  "save_steps": 250,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 0.0,
+  "train_batch_size": 16,
+  "trial_name": null,
+  "trial_params": null
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-250/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1000c8de73962e2e55eeff75046153193ed891c1f7c4610f38740686f0a6ddb5
+size 8209

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/README.md

@@ -0,0 +1,209 @@
+---
+base_model: /root/repos/verl/new_models/qwen/qwen2.5-coder-7B-v4-if-grpo-oci-v3-balanced-b16g16-ng16-lr1e-05-v3_delta_prefill-cwup-w50-c2i0.25_checkpoint-8000
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:/root/repos/verl/new_models/qwen/qwen2.5-coder-7B-v4-if-grpo-oci-v3-balanced-b16g16-ng16-lr1e-05-v3_delta_prefill-cwup-w50-c2i0.25_checkpoint-8000
+- grpo
+- lora
+- transformers
+- trl
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.0

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/adapter_config.json

@@ -0,0 +1,41 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "/root/repos/verl/new_models/qwen/qwen2.5-coder-7B-v4-if-grpo-oci-v3-balanced-b16g16-ng16-lr1e-05-v3_delta_prefill-cwup-w50-c2i0.25_checkpoint-8000",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.0",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3417f1ff3fd433fcf59512059420f42f3e57f4e8f511664a17a6ad4f8265200a
+size 20200056

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/added_tokens.json

@@ -0,0 +1,24 @@
+{
+  "</tool_call>": 151658,
+  "<tool_call>": 151657,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/chat_template.jinja

@@ -0,0 +1,54 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- messages[0]['content'] }}
+    {%- else %}
+        {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}
+    {%- endif %}
+    {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
+    {%- else %}
+        {{- '<|im_start|>system\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- for message in messages %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
+        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {{- '<|im_start|>' + message.role }}
+        {%- if message.content %}
+            {{- '\n' + message.content }}
+        {%- endif %}
+        {%- for tool_call in message.tool_calls %}
+            {%- if tool_call.function is defined %}
+                {%- set tool_call = tool_call.function %}
+            {%- endif %}
+            {{- '\n<tool_call>\n{"name": "' }}
+            {{- tool_call.name }}
+            {{- '", "arguments": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- '}\n</tool_call>' }}
+        {%- endfor %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- message.content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+{%- endif %}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:82fc0d31662ce659620299258897b9cfce56118c6ff650a8a9debab55706cc61
+size 40466443

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/ref/adapter_config.json

@@ -0,0 +1,41 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "/root/repos/verl/new_models/qwen/qwen2.5-coder-7B-v4-if-grpo-oci-v3-balanced-b16g16-ng16-lr1e-05-v3_delta_prefill-cwup-w50-c2i0.25_checkpoint-8000",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.0",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/ref/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7d21034b0f45adb8b3be7720adeaceaac5ce9c42de12051eb8741681327e42b
+size 10107504

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/rng_state_0.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2b808e9dd317a2dd7b913fe418af7fe14e26f0bf4c2a80dfe5e46d8295c29a0a
+size 14917

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/rng_state_1.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:14001204806a122b8b4276a919952ed7e4f6d5711ba3b17430d8944f8fa4ed77
+size 14917

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6a9f2521d172b38a790f51c15c85ec5cda2cee75109e107696b808a0f5823c40
+size 1465

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/special_tokens_map.json

@@ -0,0 +1,31 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
+size 11421896

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/tokenizer_config.json

@@ -0,0 +1,207 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151646": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151647": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151648": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151649": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151650": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151651": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151652": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151653": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151654": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151655": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151656": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151657": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151658": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151659": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151660": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151661": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151662": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151663": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151664": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "model_max_length": 32768,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/checkpoint-500/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1000c8de73962e2e55eeff75046153193ed891c1f7c4610f38740686f0a6ddb5
+size 8209

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00001.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6fab45304f30202d8edde41c5f553cf45473630a1177beb5f7bff4c5233c3a59
+size 63661

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00010.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d79bce98ab6b658e20e779360277630f41f46627d926fb87ef71cad0ff58c34d
+size 60889

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00020.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f8e2cbad1262cfed5e053a216b25aa211c0e0bac2fd42d885487d4f770d3a595
+size 67546

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00030.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6290fd41be39f76c32b2397ecf1c6845065c5d6fb769075b633bde74142eb13e
+size 64531

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00040.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bde19cfbf23ee21fb7b2f3657a1e8b64378476ccbe5a9b5d091f127eddba5c87
+size 44354

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00050.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79f52a24d27fe128fa91cee5f253ee6223198f5350465683268d38ed1376dfb9
+size 62389

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00060.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c5edc7d89af17358b4d647e065409a1bf3c86c6226b67e4d9699d602402d052c
+size 57605

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00070.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:39c6d67542385576ff388769df043f492e206c631ff131bf603de545269df06d
+size 73723

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00080.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aaf60d62c49ddd4d2f4ef18b44b9fecc337fb22877fb1a672469ea4ab52aa4ba
+size 71840

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00090.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e925ad156e6865c6c6dc38573508a81d908de0297983ce64376120b5268ffea
+size 76907

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00100.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f282efdad58909881909d8e1cec27700fde50190ec73a0f1b05f12bbc1f91ca
+size 59919

qwen2.5-coder-7B-v4-if-grpo-codegen-from-oci8000-balanced-b16g16-ng16-lr1e-05-codegen_tool-cwup-w50/completions/completions_00110.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:053456565c63128fefc3abc34cdc352709bd2ec099953b6069dd642ac979e079
+size 73265