Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+TextUI-Cap-7B/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+TextUI-Func-7B/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+TextUI-Trans-7B/tokenizer.json filter=lfs diff=lfs merge=lfs -text

TextUI-Cap-7B/README.md

@@ -0,0 +1,202 @@
+---
+base_model: /root/autodl-fs/Qwen2.5-7B-Instruct
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.15.1

TextUI-Cap-7B/adapter_config.json

@@ -0,0 +1,39 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "/root/autodl-fs/Qwen2.5-7B-Instruct",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "v_proj",
+    "q_proj",
+    "up_proj",
+    "gate_proj",
+    "down_proj",
+    "k_proj",
+    "o_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_rslora": false
+}

TextUI-Cap-7B/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e1ffe3e8171c896b957a27c4245fa27db8abdb734239414307fb8f345d49211
+size 161533192

TextUI-Cap-7B/added_tokens.json

@@ -0,0 +1,24 @@
+{
+  "</tool_call>": 151658,
+  "<tool_call>": 151657,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}

TextUI-Cap-7B/special_tokens_map.json

@@ -0,0 +1,31 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

TextUI-Cap-7B/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
+size 11421896

TextUI-Cap-7B/tokenizer_config.json

@@ -0,0 +1,209 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151646": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151647": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151648": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151649": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151650": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151651": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151652": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151653": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151654": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151655": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151656": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151657": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151658": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151659": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151660": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151661": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151662": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151663": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151664": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "chat_template": "{%- if tools %}\n    {{- '<|im_start|>system\\n' }}\n    {%- if messages[0]['role'] == 'system' %}\n        {{- messages[0]['content'] }}\n    {%- else %}\n        {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}\n    {%- endif %}\n    {{- \"\\n\\n# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n    {%- for tool in tools %}\n        {{- \"\\n\" }}\n        {{- tool | tojson }}\n    {%- endfor %}\n    {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n    {%- if messages[0]['role'] == 'system' %}\n        {{- '<|im_start|>system\\n' + messages[0]['content'] + '<|im_end|>\\n' }}\n    {%- else %}\n        {{- '<|im_start|>system\\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\\n' }}\n    {%- endif %}\n{%- endif %}\n{%- for message in messages %}\n    {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) or (message.role == \"assistant\" and not message.tool_calls) %}\n        {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n    {%- elif message.role == \"assistant\" %}\n        {{- '<|im_start|>' + message.role }}\n        {%- if message.content %}\n            {{- '\\n' + message.content }}\n        {%- endif %}\n        {%- for tool_call in message.tool_calls %}\n            {%- if tool_call.function is defined %}\n                {%- set tool_call = tool_call.function %}\n            {%- endif %}\n            {{- '\\n<tool_call>\\n{\"name\": \"' }}\n            {{- tool_call.name }}\n            {{- '\", \"arguments\": ' }}\n            {{- tool_call.arguments | tojson }}\n            {{- '}\\n</tool_call>' }}\n        {%- endfor %}\n        {{- '<|im_end|>\\n' }}\n    {%- elif message.role == \"tool\" %}\n        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != \"tool\") %}\n            {{- '<|im_start|>user' }}\n        {%- endif %}\n        {{- '\\n<tool_response>\\n' }}\n        {{- message.content }}\n        {{- '\\n</tool_response>' }}\n        {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n            {{- '<|im_end|>\\n' }}\n        {%- endif %}\n    {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n    {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "padding_side": "right",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

TextUI-Cap-7B/trainer_log.jsonl

@@ -0,0 +1,110 @@
+{"current_steps": 1, "total_steps": 100, "loss": 1.9336, "lr": 0.0, "epoch": 0.03524229074889868, "percentage": 1.0, "elapsed_time": "0:00:15", "remaining_time": "0:25:05"}
+{"current_steps": 2, "total_steps": 100, "loss": 2.048, "lr": 1e-05, "epoch": 0.07048458149779736, "percentage": 2.0, "elapsed_time": "0:00:33", "remaining_time": "0:27:38"}
+{"current_steps": 3, "total_steps": 100, "loss": 1.9311, "lr": 2e-05, "epoch": 0.10572687224669604, "percentage": 3.0, "elapsed_time": "0:00:56", "remaining_time": "0:30:26"}
+{"current_steps": 4, "total_steps": 100, "loss": 1.9814, "lr": 3e-05, "epoch": 0.14096916299559473, "percentage": 4.0, "elapsed_time": "0:01:16", "remaining_time": "0:30:33"}
+{"current_steps": 5, "total_steps": 100, "loss": 1.9955, "lr": 4e-05, "epoch": 0.1762114537444934, "percentage": 5.0, "elapsed_time": "0:01:32", "remaining_time": "0:29:14"}
+{"current_steps": 6, "total_steps": 100, "loss": 1.874, "lr": 5e-05, "epoch": 0.21145374449339208, "percentage": 6.0, "elapsed_time": "0:01:48", "remaining_time": "0:28:18"}
+{"current_steps": 7, "total_steps": 100, "loss": 1.7726, "lr": 6e-05, "epoch": 0.24669603524229075, "percentage": 7.0, "elapsed_time": "0:02:09", "remaining_time": "0:28:44"}
+{"current_steps": 8, "total_steps": 100, "loss": 1.6056, "lr": 7e-05, "epoch": 0.28193832599118945, "percentage": 8.0, "elapsed_time": "0:02:26", "remaining_time": "0:28:04"}
+{"current_steps": 9, "total_steps": 100, "loss": 1.4883, "lr": 8e-05, "epoch": 0.31718061674008813, "percentage": 9.0, "elapsed_time": "0:02:44", "remaining_time": "0:27:45"}
+{"current_steps": 10, "total_steps": 100, "loss": 1.3543, "lr": 9e-05, "epoch": 0.3524229074889868, "percentage": 10.0, "elapsed_time": "0:03:07", "remaining_time": "0:28:07"}
+{"current_steps": 10, "total_steps": 100, "eval_loss": 1.2461069822311401, "epoch": 0.3524229074889868, "percentage": 10.0, "elapsed_time": "0:03:32", "remaining_time": "0:31:55"}
+{"current_steps": 11, "total_steps": 100, "loss": 1.253, "lr": 0.0001, "epoch": 0.3876651982378855, "percentage": 11.0, "elapsed_time": "0:03:48", "remaining_time": "0:30:49"}
+{"current_steps": 12, "total_steps": 100, "loss": 1.1504, "lr": 0.00011000000000000002, "epoch": 0.42290748898678415, "percentage": 12.0, "elapsed_time": "0:04:05", "remaining_time": "0:29:58"}
+{"current_steps": 13, "total_steps": 100, "loss": 1.1904, "lr": 0.00012, "epoch": 0.4581497797356828, "percentage": 13.0, "elapsed_time": "0:04:23", "remaining_time": "0:29:25"}
+{"current_steps": 14, "total_steps": 100, "loss": 1.065, "lr": 0.00013000000000000002, "epoch": 0.4933920704845815, "percentage": 14.0, "elapsed_time": "0:04:40", "remaining_time": "0:28:42"}
+{"current_steps": 15, "total_steps": 100, "loss": 1.0323, "lr": 0.00014, "epoch": 0.5286343612334802, "percentage": 15.0, "elapsed_time": "0:05:01", "remaining_time": "0:28:26"}
+{"current_steps": 16, "total_steps": 100, "loss": 0.967, "lr": 0.00015000000000000001, "epoch": 0.5638766519823789, "percentage": 16.0, "elapsed_time": "0:05:16", "remaining_time": "0:27:43"}
+{"current_steps": 17, "total_steps": 100, "loss": 0.9886, "lr": 0.00016, "epoch": 0.5991189427312775, "percentage": 17.0, "elapsed_time": "0:05:34", "remaining_time": "0:27:12"}
+{"current_steps": 18, "total_steps": 100, "loss": 0.9052, "lr": 0.00017, "epoch": 0.6343612334801763, "percentage": 18.0, "elapsed_time": "0:05:51", "remaining_time": "0:26:39"}
+{"current_steps": 19, "total_steps": 100, "loss": 0.8916, "lr": 0.00018, "epoch": 0.6696035242290749, "percentage": 19.0, "elapsed_time": "0:06:12", "remaining_time": "0:26:26"}
+{"current_steps": 20, "total_steps": 100, "loss": 0.8508, "lr": 0.00019, "epoch": 0.7048458149779736, "percentage": 20.0, "elapsed_time": "0:06:29", "remaining_time": "0:25:57"}
+{"current_steps": 20, "total_steps": 100, "eval_loss": 0.8256819844245911, "epoch": 0.7048458149779736, "percentage": 20.0, "elapsed_time": "0:06:54", "remaining_time": "0:27:39"}
+{"current_steps": 21, "total_steps": 100, "loss": 0.837, "lr": 0.0002, "epoch": 0.7400881057268722, "percentage": 21.0, "elapsed_time": "0:07:10", "remaining_time": "0:27:00"}
+{"current_steps": 22, "total_steps": 100, "loss": 0.8872, "lr": 0.0001999229036240723, "epoch": 0.775330396475771, "percentage": 22.0, "elapsed_time": "0:07:30", "remaining_time": "0:26:35"}
+{"current_steps": 23, "total_steps": 100, "loss": 0.8076, "lr": 0.0001996917333733128, "epoch": 0.8105726872246696, "percentage": 23.0, "elapsed_time": "0:07:47", "remaining_time": "0:26:04"}
+{"current_steps": 24, "total_steps": 100, "loss": 0.8181, "lr": 0.00019930684569549264, "epoch": 0.8458149779735683, "percentage": 24.0, "elapsed_time": "0:08:02", "remaining_time": "0:25:28"}
+{"current_steps": 25, "total_steps": 100, "loss": 0.8081, "lr": 0.00019876883405951377, "epoch": 0.8810572687224669, "percentage": 25.0, "elapsed_time": "0:08:20", "remaining_time": "0:25:01"}
+{"current_steps": 26, "total_steps": 100, "loss": 0.7206, "lr": 0.00019807852804032305, "epoch": 0.9162995594713657, "percentage": 26.0, "elapsed_time": "0:08:34", "remaining_time": "0:24:23"}
+{"current_steps": 27, "total_steps": 100, "loss": 0.7821, "lr": 0.00019723699203976766, "epoch": 0.9515418502202643, "percentage": 27.0, "elapsed_time": "0:08:52", "remaining_time": "0:23:58"}
+{"current_steps": 28, "total_steps": 100, "loss": 0.7356, "lr": 0.00019624552364536473, "epoch": 0.986784140969163, "percentage": 28.0, "elapsed_time": "0:09:10", "remaining_time": "0:23:34"}
+{"current_steps": 29, "total_steps": 100, "loss": 0.7774, "lr": 0.00019510565162951537, "epoch": 1.0, "percentage": 29.0, "elapsed_time": "0:09:20", "remaining_time": "0:22:53"}
+{"current_steps": 30, "total_steps": 100, "loss": 0.7069, "lr": 0.00019381913359224842, "epoch": 1.0352422907488987, "percentage": 30.0, "elapsed_time": "0:09:35", "remaining_time": "0:22:22"}
+{"current_steps": 30, "total_steps": 100, "eval_loss": 0.6948859691619873, "epoch": 1.0352422907488987, "percentage": 30.0, "elapsed_time": "0:10:00", "remaining_time": "0:23:21"}
+{"current_steps": 31, "total_steps": 100, "loss": 0.7228, "lr": 0.0001923879532511287, "epoch": 1.0704845814977975, "percentage": 31.0, "elapsed_time": "0:10:19", "remaining_time": "0:22:58"}
+{"current_steps": 32, "total_steps": 100, "loss": 0.6692, "lr": 0.00019081431738250814, "epoch": 1.105726872246696, "percentage": 32.0, "elapsed_time": "0:10:36", "remaining_time": "0:22:33"}
+{"current_steps": 33, "total_steps": 100, "loss": 0.6742, "lr": 0.0001891006524188368, "epoch": 1.1409691629955947, "percentage": 33.0, "elapsed_time": "0:10:52", "remaining_time": "0:22:05"}
+{"current_steps": 34, "total_steps": 100, "loss": 0.7012, "lr": 0.00018724960070727972, "epoch": 1.1762114537444934, "percentage": 34.0, "elapsed_time": "0:11:07", "remaining_time": "0:21:36"}
+{"current_steps": 35, "total_steps": 100, "loss": 0.6594, "lr": 0.00018526401643540922, "epoch": 1.2114537444933922, "percentage": 35.0, "elapsed_time": "0:11:25", "remaining_time": "0:21:13"}
+{"current_steps": 36, "total_steps": 100, "loss": 0.6723, "lr": 0.00018314696123025454, "epoch": 1.2466960352422907, "percentage": 36.0, "elapsed_time": "0:11:41", "remaining_time": "0:20:46"}
+{"current_steps": 37, "total_steps": 100, "loss": 0.6514, "lr": 0.00018090169943749476, "epoch": 1.2819383259911894, "percentage": 37.0, "elapsed_time": "0:11:57", "remaining_time": "0:20:21"}
+{"current_steps": 38, "total_steps": 100, "loss": 0.6585, "lr": 0.00017853169308807448, "epoch": 1.3171806167400881, "percentage": 38.0, "elapsed_time": "0:12:21", "remaining_time": "0:20:09"}
+{"current_steps": 39, "total_steps": 100, "loss": 0.6339, "lr": 0.0001760405965600031, "epoch": 1.3524229074889869, "percentage": 39.0, "elapsed_time": "0:12:37", "remaining_time": "0:19:44"}
+{"current_steps": 40, "total_steps": 100, "loss": 0.655, "lr": 0.00017343225094356855, "epoch": 1.3876651982378854, "percentage": 40.0, "elapsed_time": "0:12:52", "remaining_time": "0:19:18"}
+{"current_steps": 40, "total_steps": 100, "eval_loss": 0.6199031472206116, "epoch": 1.3876651982378854, "percentage": 40.0, "elapsed_time": "0:13:17", "remaining_time": "0:19:56"}
+{"current_steps": 41, "total_steps": 100, "loss": 0.6334, "lr": 0.00017071067811865476, "epoch": 1.422907488986784, "percentage": 41.0, "elapsed_time": "0:13:37", "remaining_time": "0:19:35"}
+{"current_steps": 42, "total_steps": 100, "loss": 0.644, "lr": 0.0001678800745532942, "epoch": 1.4581497797356828, "percentage": 42.0, "elapsed_time": "0:13:52", "remaining_time": "0:19:09"}
+{"current_steps": 43, "total_steps": 100, "loss": 0.5925, "lr": 0.00016494480483301836, "epoch": 1.4933920704845816, "percentage": 43.0, "elapsed_time": "0:14:05", "remaining_time": "0:18:41"}
+{"current_steps": 44, "total_steps": 100, "loss": 0.6486, "lr": 0.00016190939493098344, "epoch": 1.5286343612334803, "percentage": 44.0, "elapsed_time": "0:14:22", "remaining_time": "0:18:17"}
+{"current_steps": 45, "total_steps": 100, "loss": 0.6039, "lr": 0.00015877852522924732, "epoch": 1.5638766519823788, "percentage": 45.0, "elapsed_time": "0:14:38", "remaining_time": "0:17:53"}
+{"current_steps": 46, "total_steps": 100, "loss": 0.6244, "lr": 0.00015555702330196023, "epoch": 1.5991189427312775, "percentage": 46.0, "elapsed_time": "0:15:02", "remaining_time": "0:17:39"}
+{"current_steps": 47, "total_steps": 100, "loss": 0.5672, "lr": 0.0001522498564715949, "epoch": 1.6343612334801763, "percentage": 47.0, "elapsed_time": "0:15:18", "remaining_time": "0:17:15"}
+{"current_steps": 48, "total_steps": 100, "loss": 0.6356, "lr": 0.00014886212414969553, "epoch": 1.6696035242290748, "percentage": 48.0, "elapsed_time": "0:15:36", "remaining_time": "0:16:54"}
+{"current_steps": 49, "total_steps": 100, "loss": 0.6105, "lr": 0.00014539904997395468, "epoch": 1.7048458149779737, "percentage": 49.0, "elapsed_time": "0:15:56", "remaining_time": "0:16:35"}
+{"current_steps": 50, "total_steps": 100, "loss": 0.6023, "lr": 0.0001418659737537428, "epoch": 1.7400881057268722, "percentage": 50.0, "elapsed_time": "0:16:18", "remaining_time": "0:16:18"}
+{"current_steps": 50, "total_steps": 100, "eval_loss": 0.5753047466278076, "epoch": 1.7400881057268722, "percentage": 50.0, "elapsed_time": "0:16:43", "remaining_time": "0:16:43"}
+{"current_steps": 51, "total_steps": 100, "loss": 0.6216, "lr": 0.000138268343236509, "epoch": 1.775330396475771, "percentage": 51.0, "elapsed_time": "0:17:03", "remaining_time": "0:16:23"}
+{"current_steps": 52, "total_steps": 100, "loss": 0.6124, "lr": 0.0001346117057077493, "epoch": 1.8105726872246697, "percentage": 52.0, "elapsed_time": "0:17:19", "remaining_time": "0:15:59"}
+{"current_steps": 53, "total_steps": 100, "loss": 0.5445, "lr": 0.00013090169943749476, "epoch": 1.8458149779735682, "percentage": 53.0, "elapsed_time": "0:17:39", "remaining_time": "0:15:39"}
+{"current_steps": 54, "total_steps": 100, "loss": 0.5508, "lr": 0.00012714404498650743, "epoch": 1.881057268722467, "percentage": 54.0, "elapsed_time": "0:17:55", "remaining_time": "0:15:16"}
+{"current_steps": 55, "total_steps": 100, "loss": 0.5522, "lr": 0.00012334453638559057, "epoch": 1.9162995594713657, "percentage": 55.0, "elapsed_time": "0:18:13", "remaining_time": "0:14:54"}
+{"current_steps": 56, "total_steps": 100, "loss": 0.5569, "lr": 0.00011950903220161285, "epoch": 1.9515418502202642, "percentage": 56.0, "elapsed_time": "0:18:29", "remaining_time": "0:14:31"}
+{"current_steps": 57, "total_steps": 100, "loss": 0.5307, "lr": 0.0001156434465040231, "epoch": 1.9867841409691631, "percentage": 57.0, "elapsed_time": "0:18:51", "remaining_time": "0:14:13"}
+{"current_steps": 58, "total_steps": 100, "loss": 0.6131, "lr": 0.00011175373974578378, "epoch": 2.0, "percentage": 58.0, "elapsed_time": "0:18:58", "remaining_time": "0:13:44"}
+{"current_steps": 59, "total_steps": 100, "loss": 0.4965, "lr": 0.0001078459095727845, "epoch": 2.0352422907488985, "percentage": 59.0, "elapsed_time": "0:19:14", "remaining_time": "0:13:22"}
+{"current_steps": 60, "total_steps": 100, "loss": 0.5086, "lr": 0.00010392598157590688, "epoch": 2.0704845814977975, "percentage": 60.0, "elapsed_time": "0:19:31", "remaining_time": "0:13:00"}
+{"current_steps": 60, "total_steps": 100, "eval_loss": 0.5449034571647644, "epoch": 2.0704845814977975, "percentage": 60.0, "elapsed_time": "0:19:56", "remaining_time": "0:13:17"}
+{"current_steps": 61, "total_steps": 100, "loss": 0.5208, "lr": 0.0001, "epoch": 2.105726872246696, "percentage": 61.0, "elapsed_time": "0:20:13", "remaining_time": "0:12:55"}
+{"current_steps": 62, "total_steps": 100, "loss": 0.5298, "lr": 9.607401842409317e-05, "epoch": 2.140969162995595, "percentage": 62.0, "elapsed_time": "0:20:33", "remaining_time": "0:12:36"}
+{"current_steps": 63, "total_steps": 100, "loss": 0.5025, "lr": 9.215409042721552e-05, "epoch": 2.1762114537444934, "percentage": 63.0, "elapsed_time": "0:20:53", "remaining_time": "0:12:16"}
+{"current_steps": 64, "total_steps": 100, "loss": 0.4856, "lr": 8.824626025421626e-05, "epoch": 2.211453744493392, "percentage": 64.0, "elapsed_time": "0:21:08", "remaining_time": "0:11:53"}
+{"current_steps": 65, "total_steps": 100, "loss": 0.5118, "lr": 8.435655349597689e-05, "epoch": 2.246696035242291, "percentage": 65.0, "elapsed_time": "0:21:26", "remaining_time": "0:11:32"}
+{"current_steps": 66, "total_steps": 100, "loss": 0.5256, "lr": 8.049096779838719e-05, "epoch": 2.2819383259911894, "percentage": 66.0, "elapsed_time": "0:21:42", "remaining_time": "0:11:10"}
+{"current_steps": 67, "total_steps": 100, "loss": 0.5396, "lr": 7.66554636144095e-05, "epoch": 2.317180616740088, "percentage": 67.0, "elapsed_time": "0:22:03", "remaining_time": "0:10:52"}
+{"current_steps": 68, "total_steps": 100, "loss": 0.5633, "lr": 7.285595501349258e-05, "epoch": 2.352422907488987, "percentage": 68.0, "elapsed_time": "0:22:27", "remaining_time": "0:10:34"}
+{"current_steps": 69, "total_steps": 100, "loss": 0.5233, "lr": 6.909830056250527e-05, "epoch": 2.3876651982378854, "percentage": 69.0, "elapsed_time": "0:22:41", "remaining_time": "0:10:11"}
+{"current_steps": 70, "total_steps": 100, "loss": 0.5638, "lr": 6.538829429225069e-05, "epoch": 2.4229074889867843, "percentage": 70.0, "elapsed_time": "0:22:58", "remaining_time": "0:09:50"}
+{"current_steps": 70, "total_steps": 100, "eval_loss": 0.5274443030357361, "epoch": 2.4229074889867843, "percentage": 70.0, "elapsed_time": "0:23:23", "remaining_time": "0:10:01"}
+{"current_steps": 71, "total_steps": 100, "loss": 0.5003, "lr": 6.173165676349103e-05, "epoch": 2.458149779735683, "percentage": 71.0, "elapsed_time": "0:23:41", "remaining_time": "0:09:40"}
+{"current_steps": 72, "total_steps": 100, "loss": 0.4974, "lr": 5.8134026246257225e-05, "epoch": 2.4933920704845813, "percentage": 72.0, "elapsed_time": "0:23:56", "remaining_time": "0:09:18"}
+{"current_steps": 73, "total_steps": 100, "loss": 0.5325, "lr": 5.4600950026045326e-05, "epoch": 2.5286343612334803, "percentage": 73.0, "elapsed_time": "0:24:17", "remaining_time": "0:08:59"}
+{"current_steps": 74, "total_steps": 100, "loss": 0.4323, "lr": 5.113787585030454e-05, "epoch": 2.563876651982379, "percentage": 74.0, "elapsed_time": "0:24:36", "remaining_time": "0:08:38"}
+{"current_steps": 75, "total_steps": 100, "loss": 0.4905, "lr": 4.7750143528405126e-05, "epoch": 2.5991189427312777, "percentage": 75.0, "elapsed_time": "0:24:52", "remaining_time": "0:08:17"}
+{"current_steps": 76, "total_steps": 100, "loss": 0.4649, "lr": 4.444297669803981e-05, "epoch": 2.6343612334801763, "percentage": 76.0, "elapsed_time": "0:25:08", "remaining_time": "0:07:56"}
+{"current_steps": 77, "total_steps": 100, "loss": 0.5379, "lr": 4.12214747707527e-05, "epoch": 2.6696035242290748, "percentage": 77.0, "elapsed_time": "0:25:29", "remaining_time": "0:07:36"}
+{"current_steps": 78, "total_steps": 100, "loss": 0.4885, "lr": 3.8090605069016595e-05, "epoch": 2.7048458149779737, "percentage": 78.0, "elapsed_time": "0:25:49", "remaining_time": "0:07:16"}
+{"current_steps": 79, "total_steps": 100, "loss": 0.4923, "lr": 3.5055195166981645e-05, "epoch": 2.7400881057268722, "percentage": 79.0, "elapsed_time": "0:26:09", "remaining_time": "0:06:57"}
+{"current_steps": 80, "total_steps": 100, "loss": 0.4747, "lr": 3.211992544670582e-05, "epoch": 2.7753303964757707, "percentage": 80.0, "elapsed_time": "0:26:27", "remaining_time": "0:06:36"}
+{"current_steps": 80, "total_steps": 100, "eval_loss": 0.5167238712310791, "epoch": 2.7753303964757707, "percentage": 80.0, "elapsed_time": "0:26:52", "remaining_time": "0:06:43"}
+{"current_steps": 81, "total_steps": 100, "loss": 0.4887, "lr": 2.9289321881345254e-05, "epoch": 2.8105726872246697, "percentage": 81.0, "elapsed_time": "0:27:11", "remaining_time": "0:06:22"}
+{"current_steps": 82, "total_steps": 100, "loss": 0.4812, "lr": 2.6567749056431467e-05, "epoch": 2.845814977973568, "percentage": 82.0, "elapsed_time": "0:27:32", "remaining_time": "0:06:02"}
+{"current_steps": 83, "total_steps": 100, "loss": 0.4947, "lr": 2.3959403439996907e-05, "epoch": 2.8810572687224667, "percentage": 83.0, "elapsed_time": "0:27:49", "remaining_time": "0:05:41"}
+{"current_steps": 84, "total_steps": 100, "loss": 0.5061, "lr": 2.146830691192553e-05, "epoch": 2.9162995594713657, "percentage": 84.0, "elapsed_time": "0:28:08", "remaining_time": "0:05:21"}
+{"current_steps": 85, "total_steps": 100, "loss": 0.4976, "lr": 1.9098300562505266e-05, "epoch": 2.951541850220264, "percentage": 85.0, "elapsed_time": "0:28:24", "remaining_time": "0:05:00"}
+{"current_steps": 86, "total_steps": 100, "loss": 0.459, "lr": 1.6853038769745467e-05, "epoch": 2.986784140969163, "percentage": 86.0, "elapsed_time": "0:28:43", "remaining_time": "0:04:40"}
+{"current_steps": 87, "total_steps": 100, "loss": 0.4275, "lr": 1.4735983564590783e-05, "epoch": 3.0, "percentage": 87.0, "elapsed_time": "0:28:50", "remaining_time": "0:04:18"}
+{"current_steps": 88, "total_steps": 100, "loss": 0.4549, "lr": 1.2750399292720283e-05, "epoch": 3.0352422907488985, "percentage": 88.0, "elapsed_time": "0:29:10", "remaining_time": "0:03:58"}
+{"current_steps": 89, "total_steps": 100, "loss": 0.4918, "lr": 1.0899347581163221e-05, "epoch": 3.0704845814977975, "percentage": 89.0, "elapsed_time": "0:29:29", "remaining_time": "0:03:38"}
+{"current_steps": 90, "total_steps": 100, "loss": 0.458, "lr": 9.185682617491863e-06, "epoch": 3.105726872246696, "percentage": 90.0, "elapsed_time": "0:29:54", "remaining_time": "0:03:19"}
+{"current_steps": 90, "total_steps": 100, "eval_loss": 0.5118579268455505, "epoch": 3.105726872246696, "percentage": 90.0, "elapsed_time": "0:30:19", "remaining_time": "0:03:22"}
+{"current_steps": 91, "total_steps": 100, "loss": 0.4861, "lr": 7.612046748871327e-06, "epoch": 3.140969162995595, "percentage": 91.0, "elapsed_time": "0:30:40", "remaining_time": "0:03:02"}
+{"current_steps": 92, "total_steps": 100, "loss": 0.4881, "lr": 6.180866407751595e-06, "epoch": 3.1762114537444934, "percentage": 92.0, "elapsed_time": "0:30:58", "remaining_time": "0:02:41"}
+{"current_steps": 93, "total_steps": 100, "loss": 0.4524, "lr": 4.8943483704846475e-06, "epoch": 3.211453744493392, "percentage": 93.0, "elapsed_time": "0:31:14", "remaining_time": "0:02:21"}
+{"current_steps": 94, "total_steps": 100, "loss": 0.4678, "lr": 3.7544763546352834e-06, "epoch": 3.246696035242291, "percentage": 94.0, "elapsed_time": "0:31:31", "remaining_time": "0:02:00"}
+{"current_steps": 95, "total_steps": 100, "loss": 0.5017, "lr": 2.7630079602323442e-06, "epoch": 3.2819383259911894, "percentage": 95.0, "elapsed_time": "0:31:47", "remaining_time": "0:01:40"}
+{"current_steps": 96, "total_steps": 100, "loss": 0.4615, "lr": 1.921471959676957e-06, "epoch": 3.317180616740088, "percentage": 96.0, "elapsed_time": "0:32:02", "remaining_time": "0:01:20"}
+{"current_steps": 97, "total_steps": 100, "loss": 0.4972, "lr": 1.231165940486234e-06, "epoch": 3.352422907488987, "percentage": 97.0, "elapsed_time": "0:32:20", "remaining_time": "0:01:00"}
+{"current_steps": 98, "total_steps": 100, "loss": 0.4188, "lr": 6.931543045073708e-07, "epoch": 3.3876651982378854, "percentage": 98.0, "elapsed_time": "0:32:37", "remaining_time": "0:00:39"}
+{"current_steps": 99, "total_steps": 100, "loss": 0.4577, "lr": 3.0826662668720364e-07, "epoch": 3.4229074889867843, "percentage": 99.0, "elapsed_time": "0:32:54", "remaining_time": "0:00:19"}
+{"current_steps": 100, "total_steps": 100, "loss": 0.4505, "lr": 7.709637592770991e-08, "epoch": 3.458149779735683, "percentage": 100.0, "elapsed_time": "0:33:15", "remaining_time": "0:00:00"}
+{"current_steps": 100, "total_steps": 100, "eval_loss": 0.5112941265106201, "epoch": 3.458149779735683, "percentage": 100.0, "elapsed_time": "0:33:41", "remaining_time": "0:00:00"}

TextUI-Cap-7B/trainer_state.json

@@ -0,0 +1,814 @@
+{
+  "best_global_step": 100,
+  "best_metric": 0.5112941265106201,
+  "best_model_checkpoint": "/root/autodl-tmp/model/lora-textui/stage0_caption-v2/checkpoint-100",
+  "epoch": 3.458149779735683,
+  "eval_steps": 10,
+  "global_step": 100,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.03524229074889868,
+      "grad_norm": 1.2463780641555786,
+      "learning_rate": 0.0,
+      "loss": 1.9336,
+      "step": 1
+    },
+    {
+      "epoch": 0.07048458149779736,
+      "grad_norm": 1.3275448083877563,
+      "learning_rate": 1e-05,
+      "loss": 2.048,
+      "step": 2
+    },
+    {
+      "epoch": 0.10572687224669604,
+      "grad_norm": 1.2619495391845703,
+      "learning_rate": 2e-05,
+      "loss": 1.9311,
+      "step": 3
+    },
+    {
+      "epoch": 0.14096916299559473,
+      "grad_norm": 1.2719473838806152,
+      "learning_rate": 3e-05,
+      "loss": 1.9814,
+      "step": 4
+    },
+    {
+      "epoch": 0.1762114537444934,
+      "grad_norm": 1.3939034938812256,
+      "learning_rate": 4e-05,
+      "loss": 1.9955,
+      "step": 5
+    },
+    {
+      "epoch": 0.21145374449339208,
+      "grad_norm": 1.3475849628448486,
+      "learning_rate": 5e-05,
+      "loss": 1.874,
+      "step": 6
+    },
+    {
+      "epoch": 0.24669603524229075,
+      "grad_norm": 1.2599456310272217,
+      "learning_rate": 6e-05,
+      "loss": 1.7726,
+      "step": 7
+    },
+    {
+      "epoch": 0.28193832599118945,
+      "grad_norm": 1.1231255531311035,
+      "learning_rate": 7e-05,
+      "loss": 1.6056,
+      "step": 8
+    },
+    {
+      "epoch": 0.31718061674008813,
+      "grad_norm": 0.926201581954956,
+      "learning_rate": 8e-05,
+      "loss": 1.4883,
+      "step": 9
+    },
+    {
+      "epoch": 0.3524229074889868,
+      "grad_norm": 0.8478774428367615,
+      "learning_rate": 9e-05,
+      "loss": 1.3543,
+      "step": 10
+    },
+    {
+      "epoch": 0.3524229074889868,
+      "eval_loss": 1.2461069822311401,
+      "eval_runtime": 25.3282,
+      "eval_samples_per_second": 7.975,
+      "eval_steps_per_second": 0.513,
+      "step": 10
+    },
+    {
+      "epoch": 0.3876651982378855,
+      "grad_norm": 0.8932197093963623,
+      "learning_rate": 0.0001,
+      "loss": 1.253,
+      "step": 11
+    },
+    {
+      "epoch": 0.42290748898678415,
+      "grad_norm": 0.9408664703369141,
+      "learning_rate": 0.00011000000000000002,
+      "loss": 1.1504,
+      "step": 12
+    },
+    {
+      "epoch": 0.4581497797356828,
+      "grad_norm": 0.7685560584068298,
+      "learning_rate": 0.00012,
+      "loss": 1.1904,
+      "step": 13
+    },
+    {
+      "epoch": 0.4933920704845815,
+      "grad_norm": 1.0110777616500854,
+      "learning_rate": 0.00013000000000000002,
+      "loss": 1.065,
+      "step": 14
+    },
+    {
+      "epoch": 0.5286343612334802,
+      "grad_norm": 1.0698988437652588,
+      "learning_rate": 0.00014,
+      "loss": 1.0323,
+      "step": 15
+    },
+    {
+      "epoch": 0.5638766519823789,
+      "grad_norm": 0.9592034220695496,
+      "learning_rate": 0.00015000000000000001,
+      "loss": 0.967,
+      "step": 16
+    },
+    {
+      "epoch": 0.5991189427312775,
+      "grad_norm": 0.515692412853241,
+      "learning_rate": 0.00016,
+      "loss": 0.9886,
+      "step": 17
+    },
+    {
+      "epoch": 0.6343612334801763,
+      "grad_norm": 0.4879838824272156,
+      "learning_rate": 0.00017,
+      "loss": 0.9052,
+      "step": 18
+    },
+    {
+      "epoch": 0.6696035242290749,
+      "grad_norm": 0.5619950294494629,
+      "learning_rate": 0.00018,
+      "loss": 0.8916,
+      "step": 19
+    },
+    {
+      "epoch": 0.7048458149779736,
+      "grad_norm": 0.5306786298751831,
+      "learning_rate": 0.00019,
+      "loss": 0.8508,
+      "step": 20
+    },
+    {
+      "epoch": 0.7048458149779736,
+      "eval_loss": 0.8256819844245911,
+      "eval_runtime": 25.3172,
+      "eval_samples_per_second": 7.979,
+      "eval_steps_per_second": 0.513,
+      "step": 20
+    },
+    {
+      "epoch": 0.7400881057268722,
+      "grad_norm": 0.45645713806152344,
+      "learning_rate": 0.0002,
+      "loss": 0.837,
+      "step": 21
+    },
+    {
+      "epoch": 0.775330396475771,
+      "grad_norm": 0.3715068995952606,
+      "learning_rate": 0.0001999229036240723,
+      "loss": 0.8872,
+      "step": 22
+    },
+    {
+      "epoch": 0.8105726872246696,
+      "grad_norm": 0.3798660337924957,
+      "learning_rate": 0.0001996917333733128,
+      "loss": 0.8076,
+      "step": 23
+    },
+    {
+      "epoch": 0.8458149779735683,
+      "grad_norm": 0.4133865237236023,
+      "learning_rate": 0.00019930684569549264,
+      "loss": 0.8181,
+      "step": 24
+    },
+    {
+      "epoch": 0.8810572687224669,
+      "grad_norm": 0.3884609043598175,
+      "learning_rate": 0.00019876883405951377,
+      "loss": 0.8081,
+      "step": 25
+    },
+    {
+      "epoch": 0.9162995594713657,
+      "grad_norm": 0.3344547748565674,
+      "learning_rate": 0.00019807852804032305,
+      "loss": 0.7206,
+      "step": 26
+    },
+    {
+      "epoch": 0.9515418502202643,
+      "grad_norm": 0.2715914845466614,
+      "learning_rate": 0.00019723699203976766,
+      "loss": 0.7821,
+      "step": 27
+    },
+    {
+      "epoch": 0.986784140969163,
+      "grad_norm": 0.3191257417201996,
+      "learning_rate": 0.00019624552364536473,
+      "loss": 0.7356,
+      "step": 28
+    },
+    {
+      "epoch": 1.0,
+      "grad_norm": 0.43808606266975403,
+      "learning_rate": 0.00019510565162951537,
+      "loss": 0.7774,
+      "step": 29
+    },
+    {
+      "epoch": 1.0352422907488987,
+      "grad_norm": 0.32706010341644287,
+      "learning_rate": 0.00019381913359224842,
+      "loss": 0.7069,
+      "step": 30
+    },
+    {
+      "epoch": 1.0352422907488987,
+      "eval_loss": 0.6948859691619873,
+      "eval_runtime": 25.3163,
+      "eval_samples_per_second": 7.979,
+      "eval_steps_per_second": 0.514,
+      "step": 30
+    },
+    {
+      "epoch": 1.0704845814977975,
+      "grad_norm": 0.2936725616455078,
+      "learning_rate": 0.0001923879532511287,
+      "loss": 0.7228,
+      "step": 31
+    },
+    {
+      "epoch": 1.105726872246696,
+      "grad_norm": 0.3039261996746063,
+      "learning_rate": 0.00019081431738250814,
+      "loss": 0.6692,
+      "step": 32
+    },
+    {
+      "epoch": 1.1409691629955947,
+      "grad_norm": 0.29901978373527527,
+      "learning_rate": 0.0001891006524188368,
+      "loss": 0.6742,
+      "step": 33
+    },
+    {
+      "epoch": 1.1762114537444934,
+      "grad_norm": 0.32121536135673523,
+      "learning_rate": 0.00018724960070727972,
+      "loss": 0.7012,
+      "step": 34
+    },
+    {
+      "epoch": 1.2114537444933922,
+      "grad_norm": 0.3143290579319,
+      "learning_rate": 0.00018526401643540922,
+      "loss": 0.6594,
+      "step": 35
+    },
+    {
+      "epoch": 1.2466960352422907,
+      "grad_norm": 0.3040238320827484,
+      "learning_rate": 0.00018314696123025454,
+      "loss": 0.6723,
+      "step": 36
+    },
+    {
+      "epoch": 1.2819383259911894,
+      "grad_norm": 0.2974918782711029,
+      "learning_rate": 0.00018090169943749476,
+      "loss": 0.6514,
+      "step": 37
+    },
+    {
+      "epoch": 1.3171806167400881,
+      "grad_norm": 0.2963806390762329,
+      "learning_rate": 0.00017853169308807448,
+      "loss": 0.6585,
+      "step": 38
+    },
+    {
+      "epoch": 1.3524229074889869,
+      "grad_norm": 0.2951265871524811,
+      "learning_rate": 0.0001760405965600031,
+      "loss": 0.6339,
+      "step": 39
+    },
+    {
+      "epoch": 1.3876651982378854,
+      "grad_norm": 0.3203594386577606,
+      "learning_rate": 0.00017343225094356855,
+      "loss": 0.655,
+      "step": 40
+    },
+    {
+      "epoch": 1.3876651982378854,
+      "eval_loss": 0.6199031472206116,
+      "eval_runtime": 25.3133,
+      "eval_samples_per_second": 7.98,
+      "eval_steps_per_second": 0.514,
+      "step": 40
+    },
+    {
+      "epoch": 1.422907488986784,
+      "grad_norm": 0.29003453254699707,
+      "learning_rate": 0.00017071067811865476,
+      "loss": 0.6334,
+      "step": 41
+    },
+    {
+      "epoch": 1.4581497797356828,
+      "grad_norm": 0.29403063654899597,
+      "learning_rate": 0.0001678800745532942,
+      "loss": 0.644,
+      "step": 42
+    },
+    {
+      "epoch": 1.4933920704845816,
+      "grad_norm": 0.30763620138168335,
+      "learning_rate": 0.00016494480483301836,
+      "loss": 0.5925,
+      "step": 43
+    },
+    {
+      "epoch": 1.5286343612334803,
+      "grad_norm": 0.3372487425804138,
+      "learning_rate": 0.00016190939493098344,
+      "loss": 0.6486,
+      "step": 44
+    },
+    {
+      "epoch": 1.5638766519823788,
+      "grad_norm": 0.2898256480693817,
+      "learning_rate": 0.00015877852522924732,
+      "loss": 0.6039,
+      "step": 45
+    },
+    {
+      "epoch": 1.5991189427312775,
+      "grad_norm": 0.2907792627811432,
+      "learning_rate": 0.00015555702330196023,
+      "loss": 0.6244,
+      "step": 46
+    },
+    {
+      "epoch": 1.6343612334801763,
+      "grad_norm": 0.3023645579814911,
+      "learning_rate": 0.0001522498564715949,
+      "loss": 0.5672,
+      "step": 47
+    },
+    {
+      "epoch": 1.6696035242290748,
+      "grad_norm": 0.3130245804786682,
+      "learning_rate": 0.00014886212414969553,
+      "loss": 0.6356,
+      "step": 48
+    },
+    {
+      "epoch": 1.7048458149779737,
+      "grad_norm": 0.3192823529243469,
+      "learning_rate": 0.00014539904997395468,
+      "loss": 0.6105,
+      "step": 49
+    },
+    {
+      "epoch": 1.7400881057268722,
+      "grad_norm": 0.3187403082847595,
+      "learning_rate": 0.0001418659737537428,
+      "loss": 0.6023,
+      "step": 50
+    },
+    {
+      "epoch": 1.7400881057268722,
+      "eval_loss": 0.5753047466278076,
+      "eval_runtime": 25.3636,
+      "eval_samples_per_second": 7.964,
+      "eval_steps_per_second": 0.513,
+      "step": 50
+    },
+    {
+      "epoch": 1.775330396475771,
+      "grad_norm": 0.3186057507991791,
+      "learning_rate": 0.000138268343236509,
+      "loss": 0.6216,
+      "step": 51
+    },
+    {
+      "epoch": 1.8105726872246697,
+      "grad_norm": 0.3059786856174469,
+      "learning_rate": 0.0001346117057077493,
+      "loss": 0.6124,
+      "step": 52
+    },
+    {
+      "epoch": 1.8458149779735682,
+      "grad_norm": 0.2928261160850525,
+      "learning_rate": 0.00013090169943749476,
+      "loss": 0.5445,
+      "step": 53
+    },
+    {
+      "epoch": 1.881057268722467,
+      "grad_norm": 0.2955411374568939,
+      "learning_rate": 0.00012714404498650743,
+      "loss": 0.5508,
+      "step": 54
+    },
+    {
+      "epoch": 1.9162995594713657,
+      "grad_norm": 0.30531296133995056,
+      "learning_rate": 0.00012334453638559057,
+      "loss": 0.5522,
+      "step": 55
+    },
+    {
+      "epoch": 1.9515418502202642,
+      "grad_norm": 0.3257448375225067,
+      "learning_rate": 0.00011950903220161285,
+      "loss": 0.5569,
+      "step": 56
+    },
+    {
+      "epoch": 1.9867841409691631,
+      "grad_norm": 0.29654088616371155,
+      "learning_rate": 0.0001156434465040231,
+      "loss": 0.5307,
+      "step": 57
+    },
+    {
+      "epoch": 2.0,
+      "grad_norm": 0.46664145588874817,
+      "learning_rate": 0.00011175373974578378,
+      "loss": 0.6131,
+      "step": 58
+    },
+    {
+      "epoch": 2.0352422907488985,
+      "grad_norm": 0.3071623742580414,
+      "learning_rate": 0.0001078459095727845,
+      "loss": 0.4965,
+      "step": 59
+    },
+    {
+      "epoch": 2.0704845814977975,
+      "grad_norm": 0.3435165286064148,
+      "learning_rate": 0.00010392598157590688,
+      "loss": 0.5086,
+      "step": 60
+    },
+    {
+      "epoch": 2.0704845814977975,
+      "eval_loss": 0.5449034571647644,
+      "eval_runtime": 25.365,
+      "eval_samples_per_second": 7.964,
+      "eval_steps_per_second": 0.513,
+      "step": 60
+    },
+    {
+      "epoch": 2.105726872246696,
+      "grad_norm": 0.3053547739982605,
+      "learning_rate": 0.0001,
+      "loss": 0.5208,
+      "step": 61
+    },
+    {
+      "epoch": 2.140969162995595,
+      "grad_norm": 0.3197723627090454,
+      "learning_rate": 9.607401842409317e-05,
+      "loss": 0.5298,
+      "step": 62
+    },
+    {
+      "epoch": 2.1762114537444934,
+      "grad_norm": 0.31069523096084595,
+      "learning_rate": 9.215409042721552e-05,
+      "loss": 0.5025,
+      "step": 63
+    },
+    {
+      "epoch": 2.211453744493392,
+      "grad_norm": 0.3025587797164917,
+      "learning_rate": 8.824626025421626e-05,
+      "loss": 0.4856,
+      "step": 64
+    },
+    {
+      "epoch": 2.246696035242291,
+      "grad_norm": 0.32704848051071167,
+      "learning_rate": 8.435655349597689e-05,
+      "loss": 0.5118,
+      "step": 65
+    },
+    {
+      "epoch": 2.2819383259911894,
+      "grad_norm": 0.3421045243740082,
+      "learning_rate": 8.049096779838719e-05,
+      "loss": 0.5256,
+      "step": 66
+    },
+    {
+      "epoch": 2.317180616740088,
+      "grad_norm": 0.3493560552597046,
+      "learning_rate": 7.66554636144095e-05,
+      "loss": 0.5396,
+      "step": 67
+    },
+    {
+      "epoch": 2.352422907488987,
+      "grad_norm": 0.34267452359199524,
+      "learning_rate": 7.285595501349258e-05,
+      "loss": 0.5633,
+      "step": 68
+    },
+    {
+      "epoch": 2.3876651982378854,
+      "grad_norm": 0.34627947211265564,
+      "learning_rate": 6.909830056250527e-05,
+      "loss": 0.5233,
+      "step": 69
+    },
+    {
+      "epoch": 2.4229074889867843,
+      "grad_norm": 0.3640250265598297,
+      "learning_rate": 6.538829429225069e-05,
+      "loss": 0.5638,
+      "step": 70
+    },
+    {
+      "epoch": 2.4229074889867843,
+      "eval_loss": 0.5274443030357361,
+      "eval_runtime": 25.3671,
+      "eval_samples_per_second": 7.963,
+      "eval_steps_per_second": 0.512,
+      "step": 70
+    },
+    {
+      "epoch": 2.458149779735683,
+      "grad_norm": 0.3336215913295746,
+      "learning_rate": 6.173165676349103e-05,
+      "loss": 0.5003,
+      "step": 71
+    },
+    {
+      "epoch": 2.4933920704845813,
+      "grad_norm": 0.3200637102127075,
+      "learning_rate": 5.8134026246257225e-05,
+      "loss": 0.4974,
+      "step": 72
+    },
+    {
+      "epoch": 2.5286343612334803,
+      "grad_norm": 0.3232054114341736,
+      "learning_rate": 5.4600950026045326e-05,
+      "loss": 0.5325,
+      "step": 73
+    },
+    {
+      "epoch": 2.563876651982379,
+      "grad_norm": 0.327750027179718,
+      "learning_rate": 5.113787585030454e-05,
+      "loss": 0.4323,
+      "step": 74
+    },
+    {
+      "epoch": 2.5991189427312777,
+      "grad_norm": 0.325334757566452,
+      "learning_rate": 4.7750143528405126e-05,
+      "loss": 0.4905,
+      "step": 75
+    },
+    {
+      "epoch": 2.6343612334801763,
+      "grad_norm": 0.3405950665473938,
+      "learning_rate": 4.444297669803981e-05,
+      "loss": 0.4649,
+      "step": 76
+    },
+    {
+      "epoch": 2.6696035242290748,
+      "grad_norm": 0.35329973697662354,
+      "learning_rate": 4.12214747707527e-05,
+      "loss": 0.5379,
+      "step": 77
+    },
+    {
+      "epoch": 2.7048458149779737,
+      "grad_norm": 0.34212884306907654,
+      "learning_rate": 3.8090605069016595e-05,
+      "loss": 0.4885,
+      "step": 78
+    },
+    {
+      "epoch": 2.7400881057268722,
+      "grad_norm": 0.33281591534614563,
+      "learning_rate": 3.5055195166981645e-05,
+      "loss": 0.4923,
+      "step": 79
+    },
+    {
+      "epoch": 2.7753303964757707,
+      "grad_norm": 0.32896408438682556,
+      "learning_rate": 3.211992544670582e-05,
+      "loss": 0.4747,
+      "step": 80
+    },
+    {
+      "epoch": 2.7753303964757707,
+      "eval_loss": 0.5167238712310791,
+      "eval_runtime": 25.36,
+      "eval_samples_per_second": 7.965,
+      "eval_steps_per_second": 0.513,
+      "step": 80
+    },
+    {
+      "epoch": 2.8105726872246697,
+      "grad_norm": 0.34730497002601624,
+      "learning_rate": 2.9289321881345254e-05,
+      "loss": 0.4887,
+      "step": 81
+    },
+    {
+      "epoch": 2.845814977973568,
+      "grad_norm": 0.35023897886276245,
+      "learning_rate": 2.6567749056431467e-05,
+      "loss": 0.4812,
+      "step": 82
+    },
+    {
+      "epoch": 2.8810572687224667,
+      "grad_norm": 0.34714555740356445,
+      "learning_rate": 2.3959403439996907e-05,
+      "loss": 0.4947,
+      "step": 83
+    },
+    {
+      "epoch": 2.9162995594713657,
+      "grad_norm": 0.3485592007637024,
+      "learning_rate": 2.146830691192553e-05,
+      "loss": 0.5061,
+      "step": 84
+    },
+    {
+      "epoch": 2.951541850220264,
+      "grad_norm": 0.36132875084877014,
+      "learning_rate": 1.9098300562505266e-05,
+      "loss": 0.4976,
+      "step": 85
+    },
+    {
+      "epoch": 2.986784140969163,
+      "grad_norm": 0.3450870215892792,
+      "learning_rate": 1.6853038769745467e-05,
+      "loss": 0.459,
+      "step": 86
+    },
+    {
+      "epoch": 3.0,
+      "grad_norm": 0.5119443535804749,
+      "learning_rate": 1.4735983564590783e-05,
+      "loss": 0.4275,
+      "step": 87
+    },
+    {
+      "epoch": 3.0352422907488985,
+      "grad_norm": 0.325406551361084,
+      "learning_rate": 1.2750399292720283e-05,
+      "loss": 0.4549,
+      "step": 88
+    },
+    {
+      "epoch": 3.0704845814977975,
+      "grad_norm": 0.33169472217559814,
+      "learning_rate": 1.0899347581163221e-05,
+      "loss": 0.4918,
+      "step": 89
+    },
+    {
+      "epoch": 3.105726872246696,
+      "grad_norm": 0.3156157433986664,
+      "learning_rate": 9.185682617491863e-06,
+      "loss": 0.458,
+      "step": 90
+    },
+    {
+      "epoch": 3.105726872246696,
+      "eval_loss": 0.5118579268455505,
+      "eval_runtime": 25.3571,
+      "eval_samples_per_second": 7.966,
+      "eval_steps_per_second": 0.513,
+      "step": 90
+    },
+    {
+      "epoch": 3.140969162995595,
+      "grad_norm": 0.34081166982650757,
+      "learning_rate": 7.612046748871327e-06,
+      "loss": 0.4861,
+      "step": 91
+    },
+    {
+      "epoch": 3.1762114537444934,
+      "grad_norm": 0.32250353693962097,
+      "learning_rate": 6.180866407751595e-06,
+      "loss": 0.4881,
+      "step": 92
+    },
+    {
+      "epoch": 3.211453744493392,
+      "grad_norm": 0.3292059600353241,
+      "learning_rate": 4.8943483704846475e-06,
+      "loss": 0.4524,
+      "step": 93
+    },
+    {
+      "epoch": 3.246696035242291,
+      "grad_norm": 0.3330952525138855,
+      "learning_rate": 3.7544763546352834e-06,
+      "loss": 0.4678,
+      "step": 94
+    },
+    {
+      "epoch": 3.2819383259911894,
+      "grad_norm": 0.3274575173854828,
+      "learning_rate": 2.7630079602323442e-06,
+      "loss": 0.5017,
+      "step": 95
+    },
+    {
+      "epoch": 3.317180616740088,
+      "grad_norm": 0.3240121006965637,
+      "learning_rate": 1.921471959676957e-06,
+      "loss": 0.4615,
+      "step": 96
+    },
+    {
+      "epoch": 3.352422907488987,
+      "grad_norm": 0.34071552753448486,
+      "learning_rate": 1.231165940486234e-06,
+      "loss": 0.4972,
+      "step": 97
+    },
+    {
+      "epoch": 3.3876651982378854,
+      "grad_norm": 0.3293885588645935,
+      "learning_rate": 6.931543045073708e-07,
+      "loss": 0.4188,
+      "step": 98
+    },
+    {
+      "epoch": 3.4229074889867843,
+      "grad_norm": 0.32528501749038696,
+      "learning_rate": 3.0826662668720364e-07,
+      "loss": 0.4577,
+      "step": 99
+    },
+    {
+      "epoch": 3.458149779735683,
+      "grad_norm": 0.35076647996902466,
+      "learning_rate": 7.709637592770991e-08,
+      "loss": 0.4505,
+      "step": 100
+    },
+    {
+      "epoch": 3.458149779735683,
+      "eval_loss": 0.5112941265106201,
+      "eval_runtime": 25.3907,
+      "eval_samples_per_second": 7.956,
+      "eval_steps_per_second": 0.512,
+      "step": 100
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 100,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 4,
+  "save_steps": 30,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 5.237513300119388e+17,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

TextUI-Cap-7B/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6fe86ede0ce9f34f10d4d866c3a42dabb60082d4c755df6bd02e30daa6c7e608
+size 6161

TextUI-Func-7B/README.md

@@ -0,0 +1,76 @@
+---
+library_name: peft
+license: other
+base_model: /root/autodl-fs/Qwen2.5-7B-Instruct
+tags:
+- llama-factory
+- lora
+- generated_from_trainer
+model-index:
+- name: stage1_cap_func
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# stage1_cap_func
+
+This model is a fine-tuned version of [/root/autodl-fs/Qwen2.5-7B-Instruct](https://huggingface.co//root/autodl-fs/Qwen2.5-7B-Instruct) on the textui-caption2k and the textui-function6k datasets.
+It achieves the following results on the evaluation set:
+- Loss: 0.4610
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0001
+- train_batch_size: 3
+- eval_batch_size: 4
+- seed: 42
+- distributed_type: multi-GPU
+- num_devices: 4
+- gradient_accumulation_steps: 8
+- total_train_batch_size: 96
+- total_eval_batch_size: 16
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: cosine
+- lr_scheduler_warmup_steps: 25
+- training_steps: 250
+
+### Training results
+
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 0.6383        | 0.2436 | 25   | 0.6979          |
+| 0.5722        | 0.4872 | 50   | 0.6059          |
+| 0.5268        | 0.7308 | 75   | 0.5485          |
+| 0.492         | 0.9744 | 100  | 0.5159          |
+| 0.4719        | 1.2241 | 125  | 0.4990          |
+| 0.4031        | 1.4677 | 150  | 0.4809          |
+| 0.3825        | 1.7113 | 175  | 0.4702          |
+| 0.3944        | 1.9549 | 200  | 0.4625          |
+| 0.3411        | 2.2046 | 225  | 0.4616          |
+| 0.3588        | 2.4482 | 250  | 0.4610          |
+
+
+### Framework versions
+
+- PEFT 0.15.1
+- Transformers 4.51.3
+- Pytorch 2.7.0+cu126
+- Datasets 3.5.0
+- Tokenizers 0.21.1

TextUI-Func-7B/adapter_config.json

@@ -0,0 +1,39 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "/root/autodl-fs/Qwen2.5-7B-Instruct",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "v_proj",
+    "down_proj",
+    "o_proj",
+    "k_proj",
+    "gate_proj",
+    "q_proj",
+    "up_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_rslora": false
+}

TextUI-Func-7B/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dffb0a3a2b49157c0b836102e436dc96d8935ee000246e14c2cf22a5fe213fe4
+size 161533192

TextUI-Func-7B/added_tokens.json

@@ -0,0 +1,24 @@
+{
+  "</tool_call>": 151658,
+  "<tool_call>": 151657,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}

TextUI-Func-7B/all_results.json

@@ -0,0 +1,12 @@
+{
+    "epoch": 2.4482338611449452,
+    "eval_loss": 0.4610269367694855,
+    "eval_runtime": 116.0895,
+    "eval_samples_per_second": 7.382,
+    "eval_steps_per_second": 0.465,
+    "total_flos": 2.3792355349217935e+18,
+    "train_loss": 0.49713707935810086,
+    "train_runtime": 9531.3935,
+    "train_samples_per_second": 2.518,
+    "train_steps_per_second": 0.026
+}

TextUI-Func-7B/eval_results.json

@@ -0,0 +1,7 @@
+{
+    "epoch": 2.4482338611449452,
+    "eval_loss": 0.4610269367694855,
+    "eval_runtime": 116.0895,
+    "eval_samples_per_second": 7.382,
+    "eval_steps_per_second": 0.465
+}

TextUI-Func-7B/runs/events.out.tfevents.1749786583.autodl-container-40b74f9912-ad7efc16.23496.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2ddb596420cd303025a950e744047483d55dd5a7cbf49dc516de41b638596a51
+size 60772

TextUI-Func-7B/runs/events.out.tfevents.1749796231.autodl-container-40b74f9912-ad7efc16.23496.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0b704a2975b9e6417dac74a3b8f4c2c7f43d1219b8d090c8ae51bebbe9d2fb6
+size 359

TextUI-Func-7B/special_tokens_map.json

@@ -0,0 +1,31 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

TextUI-Func-7B/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
+size 11421896

TextUI-Func-7B/tokenizer_config.json

@@ -0,0 +1,209 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151646": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151647": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151648": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151649": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151650": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151651": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151652": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151653": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151654": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151655": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151656": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151657": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151658": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151659": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151660": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151661": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151662": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151663": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151664": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "chat_template": "{%- if tools %}\n    {{- '<|im_start|>system\\n' }}\n    {%- if messages[0]['role'] == 'system' %}\n        {{- messages[0]['content'] }}\n    {%- else %}\n        {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}\n    {%- endif %}\n    {{- \"\\n\\n# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n    {%- for tool in tools %}\n        {{- \"\\n\" }}\n        {{- tool | tojson }}\n    {%- endfor %}\n    {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n    {%- if messages[0]['role'] == 'system' %}\n        {{- '<|im_start|>system\\n' + messages[0]['content'] + '<|im_end|>\\n' }}\n    {%- else %}\n        {{- '<|im_start|>system\\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\\n' }}\n    {%- endif %}\n{%- endif %}\n{%- for message in messages %}\n    {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) or (message.role == \"assistant\" and not message.tool_calls) %}\n        {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n    {%- elif message.role == \"assistant\" %}\n        {{- '<|im_start|>' + message.role }}\n        {%- if message.content %}\n            {{- '\\n' + message.content }}\n        {%- endif %}\n        {%- for tool_call in message.tool_calls %}\n            {%- if tool_call.function is defined %}\n                {%- set tool_call = tool_call.function %}\n            {%- endif %}\n            {{- '\\n<tool_call>\\n{\"name\": \"' }}\n            {{- tool_call.name }}\n            {{- '\", \"arguments\": ' }}\n            {{- tool_call.arguments | tojson }}\n            {{- '}\\n</tool_call>' }}\n        {%- endfor %}\n        {{- '<|im_end|>\\n' }}\n    {%- elif message.role == \"tool\" %}\n        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != \"tool\") %}\n            {{- '<|im_start|>user' }}\n        {%- endif %}\n        {{- '\\n<tool_response>\\n' }}\n        {{- message.content }}\n        {{- '\\n</tool_response>' }}\n        {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n            {{- '<|im_end|>\\n' }}\n        {%- endif %}\n    {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n    {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "padding_side": "right",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

TextUI-Func-7B/train_results.json

@@ -0,0 +1,8 @@
+{
+    "epoch": 2.4482338611449452,
+    "total_flos": 2.3792355349217935e+18,
+    "train_loss": 0.49713707935810086,
+    "train_runtime": 9531.3935,
+    "train_samples_per_second": 2.518,
+    "train_steps_per_second": 0.026
+}

TextUI-Func-7B/trainer_log.jsonl

@@ -0,0 +1,261 @@
+{"current_steps": 1, "total_steps": 250, "loss": 0.9971, "lr": 0.0, "epoch": 0.0097442143727162, "percentage": 0.4, "elapsed_time": "0:00:43", "remaining_time": "3:01:51"}
+{"current_steps": 2, "total_steps": 250, "loss": 0.8357, "lr": 4.000000000000001e-06, "epoch": 0.0194884287454324, "percentage": 0.8, "elapsed_time": "0:01:15", "remaining_time": "2:35:36"}
+{"current_steps": 3, "total_steps": 250, "loss": 1.0968, "lr": 8.000000000000001e-06, "epoch": 0.029232643118148598, "percentage": 1.2, "elapsed_time": "0:01:54", "remaining_time": "2:36:38"}
+{"current_steps": 4, "total_steps": 250, "loss": 0.9436, "lr": 1.2e-05, "epoch": 0.0389768574908648, "percentage": 1.6, "elapsed_time": "0:02:19", "remaining_time": "2:22:57"}
+{"current_steps": 5, "total_steps": 250, "loss": 0.8405, "lr": 1.6000000000000003e-05, "epoch": 0.048721071863580996, "percentage": 2.0, "elapsed_time": "0:02:51", "remaining_time": "2:19:45"}
+{"current_steps": 6, "total_steps": 250, "loss": 0.8719, "lr": 2e-05, "epoch": 0.058465286236297195, "percentage": 2.4, "elapsed_time": "0:03:26", "remaining_time": "2:19:55"}
+{"current_steps": 7, "total_steps": 250, "loss": 0.7487, "lr": 2.4e-05, "epoch": 0.0682095006090134, "percentage": 2.8, "elapsed_time": "0:04:00", "remaining_time": "2:19:08"}
+{"current_steps": 8, "total_steps": 250, "loss": 0.8104, "lr": 2.8000000000000003e-05, "epoch": 0.0779537149817296, "percentage": 3.2, "elapsed_time": "0:04:33", "remaining_time": "2:17:50"}
+{"current_steps": 9, "total_steps": 250, "loss": 0.7356, "lr": 3.2000000000000005e-05, "epoch": 0.0876979293544458, "percentage": 3.6, "elapsed_time": "0:05:02", "remaining_time": "2:14:54"}
+{"current_steps": 10, "total_steps": 250, "loss": 0.7642, "lr": 3.6e-05, "epoch": 0.09744214372716199, "percentage": 4.0, "elapsed_time": "0:05:31", "remaining_time": "2:12:41"}
+{"current_steps": 11, "total_steps": 250, "loss": 0.734, "lr": 4e-05, "epoch": 0.1071863580998782, "percentage": 4.4, "elapsed_time": "0:06:08", "remaining_time": "2:13:36"}
+{"current_steps": 12, "total_steps": 250, "loss": 0.7155, "lr": 4.4000000000000006e-05, "epoch": 0.11693057247259439, "percentage": 4.8, "elapsed_time": "0:06:50", "remaining_time": "2:15:45"}
+{"current_steps": 13, "total_steps": 250, "loss": 0.7207, "lr": 4.8e-05, "epoch": 0.12667478684531058, "percentage": 5.2, "elapsed_time": "0:07:23", "remaining_time": "2:14:54"}
+{"current_steps": 14, "total_steps": 250, "loss": 0.7882, "lr": 5.2000000000000004e-05, "epoch": 0.1364190012180268, "percentage": 5.6, "elapsed_time": "0:07:53", "remaining_time": "2:13:09"}
+{"current_steps": 15, "total_steps": 250, "loss": 0.7188, "lr": 5.6000000000000006e-05, "epoch": 0.146163215590743, "percentage": 6.0, "elapsed_time": "0:08:28", "remaining_time": "2:12:53"}
+{"current_steps": 16, "total_steps": 250, "loss": 0.7002, "lr": 6e-05, "epoch": 0.1559074299634592, "percentage": 6.4, "elapsed_time": "0:09:00", "remaining_time": "2:11:48"}
+{"current_steps": 17, "total_steps": 250, "loss": 0.7174, "lr": 6.400000000000001e-05, "epoch": 0.1656516443361754, "percentage": 6.8, "elapsed_time": "0:09:37", "remaining_time": "2:11:49"}
+{"current_steps": 18, "total_steps": 250, "loss": 0.7085, "lr": 6.800000000000001e-05, "epoch": 0.1753958587088916, "percentage": 7.2, "elapsed_time": "0:10:09", "remaining_time": "2:10:50"}
+{"current_steps": 19, "total_steps": 250, "loss": 0.788, "lr": 7.2e-05, "epoch": 0.1851400730816078, "percentage": 7.6, "elapsed_time": "0:10:46", "remaining_time": "2:11:00"}
+{"current_steps": 20, "total_steps": 250, "loss": 0.6491, "lr": 7.6e-05, "epoch": 0.19488428745432398, "percentage": 8.0, "elapsed_time": "0:11:22", "remaining_time": "2:10:44"}
+{"current_steps": 21, "total_steps": 250, "loss": 0.6749, "lr": 8e-05, "epoch": 0.2046285018270402, "percentage": 8.4, "elapsed_time": "0:11:52", "remaining_time": "2:09:26"}
+{"current_steps": 22, "total_steps": 250, "loss": 0.6431, "lr": 8.4e-05, "epoch": 0.2143727161997564, "percentage": 8.8, "elapsed_time": "0:12:30", "remaining_time": "2:09:40"}
+{"current_steps": 23, "total_steps": 250, "loss": 0.6089, "lr": 8.800000000000001e-05, "epoch": 0.2241169305724726, "percentage": 9.2, "elapsed_time": "0:12:59", "remaining_time": "2:08:12"}
+{"current_steps": 24, "total_steps": 250, "loss": 0.605, "lr": 9.200000000000001e-05, "epoch": 0.23386114494518878, "percentage": 9.6, "elapsed_time": "0:13:34", "remaining_time": "2:07:46"}
+{"current_steps": 25, "total_steps": 250, "loss": 0.6383, "lr": 9.6e-05, "epoch": 0.243605359317905, "percentage": 10.0, "elapsed_time": "0:14:05", "remaining_time": "2:06:49"}
+{"current_steps": 25, "total_steps": 250, "eval_loss": 0.6978875398635864, "epoch": 0.243605359317905, "percentage": 10.0, "elapsed_time": "0:16:01", "remaining_time": "2:24:16"}
+{"current_steps": 26, "total_steps": 250, "loss": 0.6573, "lr": 0.0001, "epoch": 0.25334957369062117, "percentage": 10.4, "elapsed_time": "0:16:32", "remaining_time": "2:22:32"}
+{"current_steps": 27, "total_steps": 250, "loss": 0.6503, "lr": 9.999512620046522e-05, "epoch": 0.2630937880633374, "percentage": 10.8, "elapsed_time": "0:17:07", "remaining_time": "2:21:26"}
+{"current_steps": 28, "total_steps": 250, "loss": 0.6056, "lr": 9.998050575201771e-05, "epoch": 0.2728380024360536, "percentage": 11.2, "elapsed_time": "0:17:50", "remaining_time": "2:21:26"}
+{"current_steps": 29, "total_steps": 250, "loss": 0.6291, "lr": 9.995614150494293e-05, "epoch": 0.28258221680876977, "percentage": 11.6, "elapsed_time": "0:18:40", "remaining_time": "2:22:20"}
+{"current_steps": 30, "total_steps": 250, "loss": 0.5929, "lr": 9.992203820909906e-05, "epoch": 0.292326431181486, "percentage": 12.0, "elapsed_time": "0:19:13", "remaining_time": "2:21:02"}
+{"current_steps": 31, "total_steps": 250, "loss": 0.6166, "lr": 9.987820251299122e-05, "epoch": 0.3020706455542022, "percentage": 12.4, "elapsed_time": "0:19:46", "remaining_time": "2:19:39"}
+{"current_steps": 32, "total_steps": 250, "loss": 0.631, "lr": 9.982464296247522e-05, "epoch": 0.3118148599269184, "percentage": 12.8, "elapsed_time": "0:20:18", "remaining_time": "2:18:21"}
+{"current_steps": 33, "total_steps": 250, "loss": 0.6309, "lr": 9.976136999909156e-05, "epoch": 0.3215590742996346, "percentage": 13.2, "elapsed_time": "0:20:51", "remaining_time": "2:17:10"}
+{"current_steps": 34, "total_steps": 250, "loss": 0.6514, "lr": 9.968839595802982e-05, "epoch": 0.3313032886723508, "percentage": 13.6, "elapsed_time": "0:21:27", "remaining_time": "2:16:19"}
+{"current_steps": 35, "total_steps": 250, "loss": 0.5839, "lr": 9.96057350657239e-05, "epoch": 0.341047503045067, "percentage": 14.0, "elapsed_time": "0:21:56", "remaining_time": "2:14:48"}
+{"current_steps": 36, "total_steps": 250, "loss": 0.5927, "lr": 9.951340343707852e-05, "epoch": 0.3507917174177832, "percentage": 14.4, "elapsed_time": "0:22:24", "remaining_time": "2:13:10"}
+{"current_steps": 37, "total_steps": 250, "loss": 0.6388, "lr": 9.941141907232765e-05, "epoch": 0.36053593179049936, "percentage": 14.8, "elapsed_time": "0:22:58", "remaining_time": "2:12:13"}
+{"current_steps": 38, "total_steps": 250, "loss": 0.6241, "lr": 9.929980185352526e-05, "epoch": 0.3702801461632156, "percentage": 15.2, "elapsed_time": "0:23:30", "remaining_time": "2:11:09"}
+{"current_steps": 39, "total_steps": 250, "loss": 0.5968, "lr": 9.917857354066931e-05, "epoch": 0.3800243605359318, "percentage": 15.6, "elapsed_time": "0:24:12", "remaining_time": "2:10:57"}
+{"current_steps": 40, "total_steps": 250, "loss": 0.6051, "lr": 9.904775776745958e-05, "epoch": 0.38976857490864797, "percentage": 16.0, "elapsed_time": "0:24:53", "remaining_time": "2:10:39"}
+{"current_steps": 41, "total_steps": 250, "loss": 0.6269, "lr": 9.890738003669029e-05, "epoch": 0.3995127892813642, "percentage": 16.4, "elapsed_time": "0:25:21", "remaining_time": "2:09:18"}
+{"current_steps": 42, "total_steps": 250, "loss": 0.6137, "lr": 9.875746771527816e-05, "epoch": 0.4092570036540804, "percentage": 16.8, "elapsed_time": "0:26:02", "remaining_time": "2:08:58"}
+{"current_steps": 43, "total_steps": 250, "loss": 0.5831, "lr": 9.859805002892732e-05, "epoch": 0.4190012180267966, "percentage": 17.2, "elapsed_time": "0:26:43", "remaining_time": "2:08:39"}
+{"current_steps": 44, "total_steps": 250, "loss": 0.5671, "lr": 9.842915805643155e-05, "epoch": 0.4287454323995128, "percentage": 17.6, "elapsed_time": "0:27:13", "remaining_time": "2:07:27"}
+{"current_steps": 45, "total_steps": 250, "loss": 0.5605, "lr": 9.825082472361557e-05, "epoch": 0.438489646772229, "percentage": 18.0, "elapsed_time": "0:27:40", "remaining_time": "2:06:05"}
+{"current_steps": 46, "total_steps": 250, "loss": 0.6192, "lr": 9.806308479691595e-05, "epoch": 0.4482338611449452, "percentage": 18.4, "elapsed_time": "0:28:16", "remaining_time": "2:05:24"}
+{"current_steps": 47, "total_steps": 250, "loss": 0.5856, "lr": 9.786597487660337e-05, "epoch": 0.4579780755176614, "percentage": 18.8, "elapsed_time": "0:28:41", "remaining_time": "2:03:55"}
+{"current_steps": 48, "total_steps": 250, "loss": 0.6433, "lr": 9.765953338964735e-05, "epoch": 0.46772228989037756, "percentage": 19.2, "elapsed_time": "0:29:23", "remaining_time": "2:03:39"}
+{"current_steps": 49, "total_steps": 250, "loss": 0.6637, "lr": 9.744380058222483e-05, "epoch": 0.4774665042630938, "percentage": 19.6, "elapsed_time": "0:29:50", "remaining_time": "2:02:26"}
+{"current_steps": 50, "total_steps": 250, "loss": 0.5722, "lr": 9.721881851187406e-05, "epoch": 0.48721071863581, "percentage": 20.0, "elapsed_time": "0:30:24", "remaining_time": "2:01:39"}
+{"current_steps": 50, "total_steps": 250, "eval_loss": 0.6059486865997314, "epoch": 0.48721071863581, "percentage": 20.0, "elapsed_time": "0:32:21", "remaining_time": "2:09:24"}
+{"current_steps": 51, "total_steps": 250, "loss": 0.6223, "lr": 9.698463103929542e-05, "epoch": 0.49695493300852617, "percentage": 20.4, "elapsed_time": "0:32:51", "remaining_time": "2:08:13"}
+{"current_steps": 52, "total_steps": 250, "loss": 0.572, "lr": 9.674128381980072e-05, "epoch": 0.5066991473812423, "percentage": 20.8, "elapsed_time": "0:33:26", "remaining_time": "2:07:18"}
+{"current_steps": 53, "total_steps": 250, "loss": 0.5225, "lr": 9.648882429441257e-05, "epoch": 0.5164433617539586, "percentage": 21.2, "elapsed_time": "0:34:02", "remaining_time": "2:06:33"}
+{"current_steps": 54, "total_steps": 250, "loss": 0.5592, "lr": 9.622730168061567e-05, "epoch": 0.5261875761266748, "percentage": 21.6, "elapsed_time": "0:34:43", "remaining_time": "2:06:02"}
+{"current_steps": 55, "total_steps": 250, "loss": 0.5857, "lr": 9.595676696276172e-05, "epoch": 0.535931790499391, "percentage": 22.0, "elapsed_time": "0:35:18", "remaining_time": "2:05:12"}
+{"current_steps": 56, "total_steps": 250, "loss": 0.5908, "lr": 9.567727288213005e-05, "epoch": 0.5456760048721072, "percentage": 22.4, "elapsed_time": "0:35:52", "remaining_time": "2:04:18"}
+{"current_steps": 57, "total_steps": 250, "loss": 0.5695, "lr": 9.538887392664544e-05, "epoch": 0.5554202192448234, "percentage": 22.8, "elapsed_time": "0:36:26", "remaining_time": "2:03:24"}
+{"current_steps": 58, "total_steps": 250, "loss": 0.5314, "lr": 9.50916263202557e-05, "epoch": 0.5651644336175395, "percentage": 23.2, "elapsed_time": "0:36:55", "remaining_time": "2:02:14"}
+{"current_steps": 59, "total_steps": 250, "loss": 0.6366, "lr": 9.478558801197065e-05, "epoch": 0.5749086479902558, "percentage": 23.6, "elapsed_time": "0:37:27", "remaining_time": "2:01:14"}
+{"current_steps": 60, "total_steps": 250, "loss": 0.4933, "lr": 9.447081866456489e-05, "epoch": 0.584652862362972, "percentage": 24.0, "elapsed_time": "0:37:54", "remaining_time": "2:00:03"}
+{"current_steps": 61, "total_steps": 250, "loss": 0.6337, "lr": 9.414737964294636e-05, "epoch": 0.5943970767356882, "percentage": 24.4, "elapsed_time": "0:38:29", "remaining_time": "1:59:15"}
+{"current_steps": 62, "total_steps": 250, "loss": 0.5714, "lr": 9.381533400219318e-05, "epoch": 0.6041412911084044, "percentage": 24.8, "elapsed_time": "0:39:04", "remaining_time": "1:58:29"}
+{"current_steps": 63, "total_steps": 250, "loss": 0.5756, "lr": 9.347474647526095e-05, "epoch": 0.6138855054811205, "percentage": 25.2, "elapsed_time": "0:39:32", "remaining_time": "1:57:21"}
+{"current_steps": 64, "total_steps": 250, "loss": 0.5635, "lr": 9.312568346036288e-05, "epoch": 0.6236297198538368, "percentage": 25.6, "elapsed_time": "0:39:58", "remaining_time": "1:56:09"}
+{"current_steps": 65, "total_steps": 250, "loss": 0.5508, "lr": 9.276821300802534e-05, "epoch": 0.633373934226553, "percentage": 26.0, "elapsed_time": "0:40:26", "remaining_time": "1:55:05"}
+{"current_steps": 66, "total_steps": 250, "loss": 0.5118, "lr": 9.24024048078213e-05, "epoch": 0.6431181485992692, "percentage": 26.4, "elapsed_time": "0:40:57", "remaining_time": "1:54:10"}
+{"current_steps": 67, "total_steps": 250, "loss": 0.5555, "lr": 9.202833017478422e-05, "epoch": 0.6528623629719854, "percentage": 26.8, "elapsed_time": "0:41:29", "remaining_time": "1:53:18"}
+{"current_steps": 68, "total_steps": 250, "loss": 0.5712, "lr": 9.164606203550497e-05, "epoch": 0.6626065773447016, "percentage": 27.2, "elapsed_time": "0:41:58", "remaining_time": "1:52:19"}
+{"current_steps": 69, "total_steps": 250, "loss": 0.54, "lr": 9.125567491391476e-05, "epoch": 0.6723507917174177, "percentage": 27.6, "elapsed_time": "0:42:34", "remaining_time": "1:51:39"}
+{"current_steps": 70, "total_steps": 250, "loss": 0.5334, "lr": 9.085724491675642e-05, "epoch": 0.682095006090134, "percentage": 28.0, "elapsed_time": "0:42:58", "remaining_time": "1:50:30"}
+{"current_steps": 71, "total_steps": 250, "loss": 0.558, "lr": 9.045084971874738e-05, "epoch": 0.6918392204628502, "percentage": 28.4, "elapsed_time": "0:43:37", "remaining_time": "1:49:59"}
+{"current_steps": 72, "total_steps": 250, "loss": 0.5592, "lr": 9.003656854743667e-05, "epoch": 0.7015834348355664, "percentage": 28.8, "elapsed_time": "0:44:10", "remaining_time": "1:49:12"}
+{"current_steps": 73, "total_steps": 250, "loss": 0.562, "lr": 8.961448216775954e-05, "epoch": 0.7113276492082826, "percentage": 29.2, "elapsed_time": "0:44:36", "remaining_time": "1:48:09"}
+{"current_steps": 74, "total_steps": 250, "loss": 0.5502, "lr": 8.9184672866292e-05, "epoch": 0.7210718635809987, "percentage": 29.6, "elapsed_time": "0:45:06", "remaining_time": "1:47:17"}
+{"current_steps": 75, "total_steps": 250, "loss": 0.5268, "lr": 8.874722443520899e-05, "epoch": 0.730816077953715, "percentage": 30.0, "elapsed_time": "0:45:45", "remaining_time": "1:46:45"}
+{"current_steps": 75, "total_steps": 250, "eval_loss": 0.5484524369239807, "epoch": 0.730816077953715, "percentage": 30.0, "elapsed_time": "0:47:41", "remaining_time": "1:51:17"}
+{"current_steps": 76, "total_steps": 250, "loss": 0.5651, "lr": 8.83022221559489e-05, "epoch": 0.7405602923264312, "percentage": 30.4, "elapsed_time": "0:48:16", "remaining_time": "1:50:30"}
+{"current_steps": 77, "total_steps": 250, "loss": 0.507, "lr": 8.784975278258783e-05, "epoch": 0.7503045066991474, "percentage": 30.8, "elapsed_time": "0:48:47", "remaining_time": "1:49:37"}
+{"current_steps": 78, "total_steps": 250, "loss": 0.5846, "lr": 8.73899045249266e-05, "epoch": 0.7600487210718636, "percentage": 31.2, "elapsed_time": "0:49:31", "remaining_time": "1:49:13"}
+{"current_steps": 79, "total_steps": 250, "loss": 0.4785, "lr": 8.692276703129421e-05, "epoch": 0.7697929354445798, "percentage": 31.6, "elapsed_time": "0:50:01", "remaining_time": "1:48:17"}
+{"current_steps": 80, "total_steps": 250, "loss": 0.5115, "lr": 8.644843137107059e-05, "epoch": 0.7795371498172959, "percentage": 32.0, "elapsed_time": "0:50:38", "remaining_time": "1:47:35"}
+{"current_steps": 81, "total_steps": 250, "loss": 0.4972, "lr": 8.596699001693255e-05, "epoch": 0.7892813641900122, "percentage": 32.4, "elapsed_time": "0:51:05", "remaining_time": "1:46:36"}
+{"current_steps": 82, "total_steps": 250, "loss": 0.5548, "lr": 8.547853682682604e-05, "epoch": 0.7990255785627284, "percentage": 32.8, "elapsed_time": "0:51:36", "remaining_time": "1:45:44"}
+{"current_steps": 83, "total_steps": 250, "loss": 0.5017, "lr": 8.498316702566828e-05, "epoch": 0.8087697929354446, "percentage": 33.2, "elapsed_time": "0:52:08", "remaining_time": "1:44:54"}
+{"current_steps": 84, "total_steps": 250, "loss": 0.5304, "lr": 8.44809771867835e-05, "epoch": 0.8185140073081608, "percentage": 33.6, "elapsed_time": "0:52:39", "remaining_time": "1:44:04"}
+{"current_steps": 85, "total_steps": 250, "loss": 0.4957, "lr": 8.397206521307584e-05, "epoch": 0.8282582216808769, "percentage": 34.0, "elapsed_time": "0:53:28", "remaining_time": "1:43:49"}
+{"current_steps": 86, "total_steps": 250, "loss": 0.4853, "lr": 8.345653031794292e-05, "epoch": 0.8380024360535931, "percentage": 34.4, "elapsed_time": "0:53:58", "remaining_time": "1:42:56"}
+{"current_steps": 87, "total_steps": 250, "loss": 0.499, "lr": 8.293447300593402e-05, "epoch": 0.8477466504263094, "percentage": 34.8, "elapsed_time": "0:54:35", "remaining_time": "1:42:16"}
+{"current_steps": 88, "total_steps": 250, "loss": 0.5061, "lr": 8.240599505315655e-05, "epoch": 0.8574908647990256, "percentage": 35.2, "elapsed_time": "0:55:08", "remaining_time": "1:41:30"}
+{"current_steps": 89, "total_steps": 250, "loss": 0.5139, "lr": 8.18711994874345e-05, "epoch": 0.8672350791717418, "percentage": 35.6, "elapsed_time": "0:55:38", "remaining_time": "1:40:39"}
+{"current_steps": 90, "total_steps": 250, "loss": 0.5355, "lr": 8.133019056822304e-05, "epoch": 0.876979293544458, "percentage": 36.0, "elapsed_time": "0:56:04", "remaining_time": "1:39:40"}
+{"current_steps": 91, "total_steps": 250, "loss": 0.4889, "lr": 8.07830737662829e-05, "epoch": 0.8867235079171741, "percentage": 36.4, "elapsed_time": "0:56:28", "remaining_time": "1:38:40"}
+{"current_steps": 92, "total_steps": 250, "loss": 0.4788, "lr": 8.022995574311876e-05, "epoch": 0.8964677222898904, "percentage": 36.8, "elapsed_time": "0:56:56", "remaining_time": "1:37:47"}
+{"current_steps": 93, "total_steps": 250, "loss": 0.5104, "lr": 7.967094433018508e-05, "epoch": 0.9062119366626066, "percentage": 37.2, "elapsed_time": "0:57:29", "remaining_time": "1:37:03"}
+{"current_steps": 94, "total_steps": 250, "loss": 0.4903, "lr": 7.910614850786448e-05, "epoch": 0.9159561510353228, "percentage": 37.6, "elapsed_time": "0:58:06", "remaining_time": "1:36:26"}
+{"current_steps": 95, "total_steps": 250, "loss": 0.4926, "lr": 7.85356783842216e-05, "epoch": 0.925700365408039, "percentage": 38.0, "elapsed_time": "0:58:35", "remaining_time": "1:35:35"}
+{"current_steps": 96, "total_steps": 250, "loss": 0.5514, "lr": 7.795964517353735e-05, "epoch": 0.9354445797807551, "percentage": 38.4, "elapsed_time": "0:59:09", "remaining_time": "1:34:54"}
+{"current_steps": 97, "total_steps": 250, "loss": 0.4886, "lr": 7.737816117462752e-05, "epoch": 0.9451887941534713, "percentage": 38.8, "elapsed_time": "0:59:54", "remaining_time": "1:34:30"}
+{"current_steps": 98, "total_steps": 250, "loss": 0.4776, "lr": 7.679133974894983e-05, "epoch": 0.9549330085261876, "percentage": 39.2, "elapsed_time": "1:00:20", "remaining_time": "1:33:35"}
+{"current_steps": 99, "total_steps": 250, "loss": 0.5343, "lr": 7.619929529850397e-05, "epoch": 0.9646772228989038, "percentage": 39.6, "elapsed_time": "1:00:55", "remaining_time": "1:32:55"}
+{"current_steps": 100, "total_steps": 250, "loss": 0.492, "lr": 7.560214324352858e-05, "epoch": 0.97442143727162, "percentage": 40.0, "elapsed_time": "1:01:30", "remaining_time": "1:32:15"}
+{"current_steps": 100, "total_steps": 250, "eval_loss": 0.5159465074539185, "epoch": 0.97442143727162, "percentage": 40.0, "elapsed_time": "1:03:26", "remaining_time": "1:35:09"}
+{"current_steps": 101, "total_steps": 250, "loss": 0.5276, "lr": 7.500000000000001e-05, "epoch": 0.9841656516443362, "percentage": 40.4, "elapsed_time": "1:03:53", "remaining_time": "1:34:15"}
+{"current_steps": 102, "total_steps": 250, "loss": 0.4887, "lr": 7.439298295693665e-05, "epoch": 0.9939098660170523, "percentage": 40.8, "elapsed_time": "1:04:23", "remaining_time": "1:33:25"}
+{"current_steps": 103, "total_steps": 250, "loss": 0.896, "lr": 7.378121045351378e-05, "epoch": 1.0097442143727162, "percentage": 41.2, "elapsed_time": "1:05:22", "remaining_time": "1:33:17"}
+{"current_steps": 104, "total_steps": 250, "loss": 0.4999, "lr": 7.316480175599309e-05, "epoch": 1.0194884287454324, "percentage": 41.6, "elapsed_time": "1:05:59", "remaining_time": "1:32:39"}
+{"current_steps": 105, "total_steps": 250, "loss": 0.4633, "lr": 7.254387703447154e-05, "epoch": 1.0292326431181487, "percentage": 42.0, "elapsed_time": "1:06:36", "remaining_time": "1:31:59"}
+{"current_steps": 106, "total_steps": 250, "loss": 0.4491, "lr": 7.191855733945387e-05, "epoch": 1.0389768574908649, "percentage": 42.4, "elapsed_time": "1:07:09", "remaining_time": "1:31:14"}
+{"current_steps": 107, "total_steps": 250, "loss": 0.4508, "lr": 7.128896457825364e-05, "epoch": 1.048721071863581, "percentage": 42.8, "elapsed_time": "1:07:37", "remaining_time": "1:30:22"}
+{"current_steps": 108, "total_steps": 250, "loss": 0.4297, "lr": 7.06552214912271e-05, "epoch": 1.058465286236297, "percentage": 43.2, "elapsed_time": "1:08:08", "remaining_time": "1:29:35"}
+{"current_steps": 109, "total_steps": 250, "loss": 0.4592, "lr": 7.001745162784477e-05, "epoch": 1.0682095006090133, "percentage": 43.6, "elapsed_time": "1:08:34", "remaining_time": "1:28:42"}
+{"current_steps": 110, "total_steps": 250, "loss": 0.4819, "lr": 6.937577932260515e-05, "epoch": 1.0779537149817295, "percentage": 44.0, "elapsed_time": "1:09:11", "remaining_time": "1:28:03"}
+{"current_steps": 111, "total_steps": 250, "loss": 0.4678, "lr": 6.873032967079561e-05, "epoch": 1.0876979293544458, "percentage": 44.4, "elapsed_time": "1:09:43", "remaining_time": "1:27:18"}
+{"current_steps": 112, "total_steps": 250, "loss": 0.4635, "lr": 6.808122850410461e-05, "epoch": 1.097442143727162, "percentage": 44.8, "elapsed_time": "1:10:19", "remaining_time": "1:26:38"}
+{"current_steps": 113, "total_steps": 250, "loss": 0.4307, "lr": 6.742860236609077e-05, "epoch": 1.1071863580998782, "percentage": 45.2, "elapsed_time": "1:10:53", "remaining_time": "1:25:56"}
+{"current_steps": 114, "total_steps": 250, "loss": 0.416, "lr": 6.677257848751277e-05, "epoch": 1.1169305724725944, "percentage": 45.6, "elapsed_time": "1:11:22", "remaining_time": "1:25:08"}
+{"current_steps": 115, "total_steps": 250, "loss": 0.4662, "lr": 6.611328476152557e-05, "epoch": 1.1266747868453106, "percentage": 46.0, "elapsed_time": "1:11:48", "remaining_time": "1:24:17"}
+{"current_steps": 116, "total_steps": 250, "loss": 0.4301, "lr": 6.545084971874738e-05, "epoch": 1.1364190012180269, "percentage": 46.4, "elapsed_time": "1:12:21", "remaining_time": "1:23:34"}
+{"current_steps": 117, "total_steps": 250, "loss": 0.4564, "lr": 6.478540250220234e-05, "epoch": 1.146163215590743, "percentage": 46.8, "elapsed_time": "1:12:51", "remaining_time": "1:22:49"}
+{"current_steps": 118, "total_steps": 250, "loss": 0.502, "lr": 6.411707284214384e-05, "epoch": 1.155907429963459, "percentage": 47.2, "elapsed_time": "1:13:22", "remaining_time": "1:22:04"}
+{"current_steps": 119, "total_steps": 250, "loss": 0.4536, "lr": 6.344599103076329e-05, "epoch": 1.1656516443361755, "percentage": 47.6, "elapsed_time": "1:14:00", "remaining_time": "1:21:28"}
+{"current_steps": 120, "total_steps": 250, "loss": 0.4576, "lr": 6.277228789678953e-05, "epoch": 1.1753958587088915, "percentage": 48.0, "elapsed_time": "1:14:27", "remaining_time": "1:20:40"}
+{"current_steps": 121, "total_steps": 250, "loss": 0.4814, "lr": 6.209609477998338e-05, "epoch": 1.1851400730816077, "percentage": 48.4, "elapsed_time": "1:14:51", "remaining_time": "1:19:48"}
+{"current_steps": 122, "total_steps": 250, "loss": 0.4277, "lr": 6.141754350553279e-05, "epoch": 1.194884287454324, "percentage": 48.8, "elapsed_time": "1:15:28", "remaining_time": "1:19:11"}
+{"current_steps": 123, "total_steps": 250, "loss": 0.5118, "lr": 6.073676635835317e-05, "epoch": 1.2046285018270402, "percentage": 49.2, "elapsed_time": "1:16:08", "remaining_time": "1:18:37"}
+{"current_steps": 124, "total_steps": 250, "loss": 0.4725, "lr": 6.005389605729824e-05, "epoch": 1.2143727161997564, "percentage": 49.6, "elapsed_time": "1:16:45", "remaining_time": "1:18:00"}
+{"current_steps": 125, "total_steps": 250, "loss": 0.4719, "lr": 5.9369065729286245e-05, "epoch": 1.2241169305724726, "percentage": 50.0, "elapsed_time": "1:17:15", "remaining_time": "1:17:15"}
+{"current_steps": 125, "total_steps": 250, "eval_loss": 0.4989548325538635, "epoch": 1.2241169305724726, "percentage": 50.0, "elapsed_time": "1:19:12", "remaining_time": "1:19:12"}
+{"current_steps": 126, "total_steps": 250, "loss": 0.4735, "lr": 5.868240888334653e-05, "epoch": 1.2338611449451888, "percentage": 50.4, "elapsed_time": "1:19:44", "remaining_time": "1:18:28"}
+{"current_steps": 127, "total_steps": 250, "loss": 0.4729, "lr": 5.799405938459175e-05, "epoch": 1.243605359317905, "percentage": 50.8, "elapsed_time": "1:20:20", "remaining_time": "1:17:48"}
+{"current_steps": 128, "total_steps": 250, "loss": 0.4589, "lr": 5.730415142812059e-05, "epoch": 1.2533495736906213, "percentage": 51.2, "elapsed_time": "1:20:56", "remaining_time": "1:17:09"}
+{"current_steps": 129, "total_steps": 250, "loss": 0.4464, "lr": 5.661281951285613e-05, "epoch": 1.2630937880633373, "percentage": 51.6, "elapsed_time": "1:21:22", "remaining_time": "1:16:19"}
+{"current_steps": 130, "total_steps": 250, "loss": 0.4537, "lr": 5.5920198415325064e-05, "epoch": 1.2728380024360537, "percentage": 52.0, "elapsed_time": "1:21:57", "remaining_time": "1:15:38"}
+{"current_steps": 131, "total_steps": 250, "loss": 0.4158, "lr": 5.522642316338268e-05, "epoch": 1.2825822168087697, "percentage": 52.4, "elapsed_time": "1:22:23", "remaining_time": "1:14:50"}
+{"current_steps": 132, "total_steps": 250, "loss": 0.4176, "lr": 5.453162900988902e-05, "epoch": 1.292326431181486, "percentage": 52.8, "elapsed_time": "1:22:50", "remaining_time": "1:14:03"}
+{"current_steps": 133, "total_steps": 250, "loss": 0.4287, "lr": 5.383595140634093e-05, "epoch": 1.3020706455542022, "percentage": 53.2, "elapsed_time": "1:23:16", "remaining_time": "1:13:15"}
+{"current_steps": 134, "total_steps": 250, "loss": 0.4118, "lr": 5.313952597646568e-05, "epoch": 1.3118148599269184, "percentage": 53.6, "elapsed_time": "1:23:47", "remaining_time": "1:12:32"}
+{"current_steps": 135, "total_steps": 250, "loss": 0.3948, "lr": 5.244248848978067e-05, "epoch": 1.3215590742996346, "percentage": 54.0, "elapsed_time": "1:24:26", "remaining_time": "1:11:55"}
+{"current_steps": 136, "total_steps": 250, "loss": 0.4579, "lr": 5.174497483512506e-05, "epoch": 1.3313032886723508, "percentage": 54.4, "elapsed_time": "1:25:06", "remaining_time": "1:11:20"}
+{"current_steps": 137, "total_steps": 250, "loss": 0.4025, "lr": 5.104712099416785e-05, "epoch": 1.341047503045067, "percentage": 54.8, "elapsed_time": "1:25:36", "remaining_time": "1:10:36"}
+{"current_steps": 138, "total_steps": 250, "loss": 0.4956, "lr": 5.034906301489808e-05, "epoch": 1.3507917174177833, "percentage": 55.2, "elapsed_time": "1:26:08", "remaining_time": "1:09:54"}
+{"current_steps": 139, "total_steps": 250, "loss": 0.4336, "lr": 4.965093698510193e-05, "epoch": 1.3605359317904995, "percentage": 55.6, "elapsed_time": "1:26:38", "remaining_time": "1:09:11"}
+{"current_steps": 140, "total_steps": 250, "loss": 0.4456, "lr": 4.895287900583216e-05, "epoch": 1.3702801461632155, "percentage": 56.0, "elapsed_time": "1:27:11", "remaining_time": "1:08:30"}
+{"current_steps": 141, "total_steps": 250, "loss": 0.3996, "lr": 4.825502516487497e-05, "epoch": 1.380024360535932, "percentage": 56.4, "elapsed_time": "1:27:44", "remaining_time": "1:07:49"}
+{"current_steps": 142, "total_steps": 250, "loss": 0.4155, "lr": 4.755751151021934e-05, "epoch": 1.389768574908648, "percentage": 56.8, "elapsed_time": "1:28:15", "remaining_time": "1:07:07"}
+{"current_steps": 143, "total_steps": 250, "loss": 0.4325, "lr": 4.6860474023534335e-05, "epoch": 1.3995127892813641, "percentage": 57.2, "elapsed_time": "1:28:47", "remaining_time": "1:06:25"}
+{"current_steps": 144, "total_steps": 250, "loss": 0.4166, "lr": 4.616404859365907e-05, "epoch": 1.4092570036540804, "percentage": 57.6, "elapsed_time": "1:29:21", "remaining_time": "1:05:46"}
+{"current_steps": 145, "total_steps": 250, "loss": 0.4436, "lr": 4.5468370990111006e-05, "epoch": 1.4190012180267966, "percentage": 58.0, "elapsed_time": "1:29:55", "remaining_time": "1:05:06"}
+{"current_steps": 146, "total_steps": 250, "loss": 0.3795, "lr": 4.477357683661734e-05, "epoch": 1.4287454323995128, "percentage": 58.4, "elapsed_time": "1:30:24", "remaining_time": "1:04:24"}
+{"current_steps": 147, "total_steps": 250, "loss": 0.3896, "lr": 4.407980158467495e-05, "epoch": 1.438489646772229, "percentage": 58.8, "elapsed_time": "1:30:53", "remaining_time": "1:03:40"}
+{"current_steps": 148, "total_steps": 250, "loss": 0.4036, "lr": 4.3387180487143876e-05, "epoch": 1.4482338611449452, "percentage": 59.2, "elapsed_time": "1:31:18", "remaining_time": "1:02:56"}
+{"current_steps": 149, "total_steps": 250, "loss": 0.4451, "lr": 4.269584857187943e-05, "epoch": 1.4579780755176615, "percentage": 59.6, "elapsed_time": "1:31:53", "remaining_time": "1:02:17"}
+{"current_steps": 150, "total_steps": 250, "loss": 0.4031, "lr": 4.2005940615408264e-05, "epoch": 1.4677222898903777, "percentage": 60.0, "elapsed_time": "1:32:20", "remaining_time": "1:01:33"}
+{"current_steps": 150, "total_steps": 250, "eval_loss": 0.4808570146560669, "epoch": 1.4677222898903777, "percentage": 60.0, "elapsed_time": "1:34:16", "remaining_time": "1:02:50"}
+{"current_steps": 151, "total_steps": 250, "loss": 0.462, "lr": 4.131759111665349e-05, "epoch": 1.4774665042630937, "percentage": 60.4, "elapsed_time": "1:34:51", "remaining_time": "1:02:11"}
+{"current_steps": 152, "total_steps": 250, "loss": 0.4265, "lr": 4.063093427071376e-05, "epoch": 1.4872107186358101, "percentage": 60.8, "elapsed_time": "1:35:22", "remaining_time": "1:01:29"}
+{"current_steps": 153, "total_steps": 250, "loss": 0.3964, "lr": 3.9946103942701777e-05, "epoch": 1.4969549330085261, "percentage": 61.2, "elapsed_time": "1:35:59", "remaining_time": "1:00:51"}
+{"current_steps": 154, "total_steps": 250, "loss": 0.4642, "lr": 3.926323364164684e-05, "epoch": 1.5066991473812423, "percentage": 61.6, "elapsed_time": "1:36:27", "remaining_time": "1:00:08"}
+{"current_steps": 155, "total_steps": 250, "loss": 0.4511, "lr": 3.858245649446721e-05, "epoch": 1.5164433617539586, "percentage": 62.0, "elapsed_time": "1:36:57", "remaining_time": "0:59:25"}
+{"current_steps": 156, "total_steps": 250, "loss": 0.388, "lr": 3.790390522001662e-05, "epoch": 1.5261875761266748, "percentage": 62.4, "elapsed_time": "1:37:43", "remaining_time": "0:58:53"}
+{"current_steps": 157, "total_steps": 250, "loss": 0.375, "lr": 3.7227712103210486e-05, "epoch": 1.535931790499391, "percentage": 62.8, "elapsed_time": "1:38:17", "remaining_time": "0:58:13"}
+{"current_steps": 158, "total_steps": 250, "loss": 0.4433, "lr": 3.655400896923672e-05, "epoch": 1.5456760048721072, "percentage": 63.2, "elapsed_time": "1:38:52", "remaining_time": "0:57:34"}
+{"current_steps": 159, "total_steps": 250, "loss": 0.4002, "lr": 3.588292715785617e-05, "epoch": 1.5554202192448234, "percentage": 63.6, "elapsed_time": "1:39:27", "remaining_time": "0:56:55"}
+{"current_steps": 160, "total_steps": 250, "loss": 0.4141, "lr": 3.5214597497797684e-05, "epoch": 1.5651644336175394, "percentage": 64.0, "elapsed_time": "1:40:10", "remaining_time": "0:56:20"}
+{"current_steps": 161, "total_steps": 250, "loss": 0.4277, "lr": 3.4549150281252636e-05, "epoch": 1.5749086479902559, "percentage": 64.4, "elapsed_time": "1:40:44", "remaining_time": "0:55:41"}
+{"current_steps": 162, "total_steps": 250, "loss": 0.3956, "lr": 3.388671523847445e-05, "epoch": 1.5846528623629719, "percentage": 64.8, "elapsed_time": "1:41:16", "remaining_time": "0:55:00"}
+{"current_steps": 163, "total_steps": 250, "loss": 0.4305, "lr": 3.322742151248725e-05, "epoch": 1.5943970767356883, "percentage": 65.2, "elapsed_time": "1:41:48", "remaining_time": "0:54:20"}
+{"current_steps": 164, "total_steps": 250, "loss": 0.4126, "lr": 3.257139763390925e-05, "epoch": 1.6041412911084043, "percentage": 65.6, "elapsed_time": "1:42:25", "remaining_time": "0:53:42"}
+{"current_steps": 165, "total_steps": 250, "loss": 0.404, "lr": 3.1918771495895396e-05, "epoch": 1.6138855054811205, "percentage": 66.0, "elapsed_time": "1:42:53", "remaining_time": "0:53:00"}
+{"current_steps": 166, "total_steps": 250, "loss": 0.4209, "lr": 3.12696703292044e-05, "epoch": 1.6236297198538368, "percentage": 66.4, "elapsed_time": "1:43:28", "remaining_time": "0:52:21"}
+{"current_steps": 167, "total_steps": 250, "loss": 0.4317, "lr": 3.062422067739485e-05, "epoch": 1.633373934226553, "percentage": 66.8, "elapsed_time": "1:44:04", "remaining_time": "0:51:43"}
+{"current_steps": 168, "total_steps": 250, "loss": 0.3964, "lr": 2.9982548372155263e-05, "epoch": 1.6431181485992692, "percentage": 67.2, "elapsed_time": "1:44:37", "remaining_time": "0:51:04"}
+{"current_steps": 169, "total_steps": 250, "loss": 0.3919, "lr": 2.934477850877292e-05, "epoch": 1.6528623629719854, "percentage": 67.6, "elapsed_time": "1:45:06", "remaining_time": "0:50:22"}
+{"current_steps": 170, "total_steps": 250, "loss": 0.4403, "lr": 2.8711035421746367e-05, "epoch": 1.6626065773447016, "percentage": 68.0, "elapsed_time": "1:45:40", "remaining_time": "0:49:43"}
+{"current_steps": 171, "total_steps": 250, "loss": 0.4265, "lr": 2.8081442660546125e-05, "epoch": 1.6723507917174176, "percentage": 68.4, "elapsed_time": "1:46:10", "remaining_time": "0:49:03"}
+{"current_steps": 172, "total_steps": 250, "loss": 0.4612, "lr": 2.7456122965528475e-05, "epoch": 1.682095006090134, "percentage": 68.8, "elapsed_time": "1:46:50", "remaining_time": "0:48:26"}
+{"current_steps": 173, "total_steps": 250, "loss": 0.3983, "lr": 2.6835198244006927e-05, "epoch": 1.69183922046285, "percentage": 69.2, "elapsed_time": "1:47:24", "remaining_time": "0:47:48"}
+{"current_steps": 174, "total_steps": 250, "loss": 0.4338, "lr": 2.6218789546486234e-05, "epoch": 1.7015834348355665, "percentage": 69.6, "elapsed_time": "1:48:00", "remaining_time": "0:47:10"}
+{"current_steps": 175, "total_steps": 250, "loss": 0.3825, "lr": 2.560701704306336e-05, "epoch": 1.7113276492082825, "percentage": 70.0, "elapsed_time": "1:48:40", "remaining_time": "0:46:34"}
+{"current_steps": 175, "total_steps": 250, "eval_loss": 0.47023555636405945, "epoch": 1.7113276492082825, "percentage": 70.0, "elapsed_time": "1:50:36", "remaining_time": "0:47:24"}
+{"current_steps": 176, "total_steps": 250, "loss": 0.4265, "lr": 2.500000000000001e-05, "epoch": 1.7210718635809987, "percentage": 70.4, "elapsed_time": "1:51:21", "remaining_time": "0:46:49"}
+{"current_steps": 177, "total_steps": 250, "loss": 0.4299, "lr": 2.4397856756471432e-05, "epoch": 1.730816077953715, "percentage": 70.8, "elapsed_time": "1:51:56", "remaining_time": "0:46:10"}
+{"current_steps": 178, "total_steps": 250, "loss": 0.4355, "lr": 2.3800704701496053e-05, "epoch": 1.7405602923264312, "percentage": 71.2, "elapsed_time": "1:52:36", "remaining_time": "0:45:32"}
+{"current_steps": 179, "total_steps": 250, "loss": 0.4235, "lr": 2.3208660251050158e-05, "epoch": 1.7503045066991474, "percentage": 71.6, "elapsed_time": "1:53:18", "remaining_time": "0:44:56"}
+{"current_steps": 180, "total_steps": 250, "loss": 0.4078, "lr": 2.2621838825372493e-05, "epoch": 1.7600487210718636, "percentage": 72.0, "elapsed_time": "1:53:51", "remaining_time": "0:44:16"}
+{"current_steps": 181, "total_steps": 250, "loss": 0.4046, "lr": 2.2040354826462668e-05, "epoch": 1.7697929354445798, "percentage": 72.4, "elapsed_time": "1:54:19", "remaining_time": "0:43:34"}
+{"current_steps": 182, "total_steps": 250, "loss": 0.433, "lr": 2.1464321615778422e-05, "epoch": 1.7795371498172958, "percentage": 72.8, "elapsed_time": "1:54:52", "remaining_time": "0:42:55"}
+{"current_steps": 183, "total_steps": 250, "loss": 0.4318, "lr": 2.0893851492135537e-05, "epoch": 1.7892813641900123, "percentage": 73.2, "elapsed_time": "1:55:27", "remaining_time": "0:42:16"}
+{"current_steps": 184, "total_steps": 250, "loss": 0.4184, "lr": 2.0329055669814934e-05, "epoch": 1.7990255785627283, "percentage": 73.6, "elapsed_time": "1:56:04", "remaining_time": "0:41:38"}
+{"current_steps": 185, "total_steps": 250, "loss": 0.4346, "lr": 1.977004425688126e-05, "epoch": 1.8087697929354447, "percentage": 74.0, "elapsed_time": "1:56:31", "remaining_time": "0:40:56"}
+{"current_steps": 186, "total_steps": 250, "loss": 0.4007, "lr": 1.9216926233717085e-05, "epoch": 1.8185140073081607, "percentage": 74.4, "elapsed_time": "1:57:03", "remaining_time": "0:40:16"}
+{"current_steps": 187, "total_steps": 250, "loss": 0.4165, "lr": 1.866980943177699e-05, "epoch": 1.828258221680877, "percentage": 74.8, "elapsed_time": "1:57:28", "remaining_time": "0:39:34"}
+{"current_steps": 188, "total_steps": 250, "loss": 0.378, "lr": 1.8128800512565513e-05, "epoch": 1.8380024360535931, "percentage": 75.2, "elapsed_time": "1:58:01", "remaining_time": "0:38:55"}
+{"current_steps": 189, "total_steps": 250, "loss": 0.3824, "lr": 1.7594004946843456e-05, "epoch": 1.8477466504263094, "percentage": 75.6, "elapsed_time": "1:58:29", "remaining_time": "0:38:14"}
+{"current_steps": 190, "total_steps": 250, "loss": 0.3788, "lr": 1.7065526994065973e-05, "epoch": 1.8574908647990256, "percentage": 76.0, "elapsed_time": "1:58:55", "remaining_time": "0:37:33"}
+{"current_steps": 191, "total_steps": 250, "loss": 0.448, "lr": 1.6543469682057106e-05, "epoch": 1.8672350791717418, "percentage": 76.4, "elapsed_time": "1:59:32", "remaining_time": "0:36:55"}
+{"current_steps": 192, "total_steps": 250, "loss": 0.3816, "lr": 1.602793478692419e-05, "epoch": 1.876979293544458, "percentage": 76.8, "elapsed_time": "1:59:59", "remaining_time": "0:36:14"}
+{"current_steps": 193, "total_steps": 250, "loss": 0.3979, "lr": 1.551902281321651e-05, "epoch": 1.886723507917174, "percentage": 77.2, "elapsed_time": "2:00:34", "remaining_time": "0:35:36"}
+{"current_steps": 194, "total_steps": 250, "loss": 0.3654, "lr": 1.5016832974331724e-05, "epoch": 1.8964677222898905, "percentage": 77.6, "elapsed_time": "2:01:03", "remaining_time": "0:34:56"}
+{"current_steps": 195, "total_steps": 250, "loss": 0.4432, "lr": 1.4521463173173965e-05, "epoch": 1.9062119366626065, "percentage": 78.0, "elapsed_time": "2:01:33", "remaining_time": "0:34:17"}
+{"current_steps": 196, "total_steps": 250, "loss": 0.364, "lr": 1.4033009983067452e-05, "epoch": 1.915956151035323, "percentage": 78.4, "elapsed_time": "2:02:09", "remaining_time": "0:33:39"}
+{"current_steps": 197, "total_steps": 250, "loss": 0.4442, "lr": 1.3551568628929434e-05, "epoch": 1.925700365408039, "percentage": 78.8, "elapsed_time": "2:02:50", "remaining_time": "0:33:03"}
+{"current_steps": 198, "total_steps": 250, "loss": 0.4042, "lr": 1.3077232968705805e-05, "epoch": 1.9354445797807551, "percentage": 79.2, "elapsed_time": "2:03:23", "remaining_time": "0:32:24"}
+{"current_steps": 199, "total_steps": 250, "loss": 0.4252, "lr": 1.2610095475073414e-05, "epoch": 1.9451887941534713, "percentage": 79.6, "elapsed_time": "2:03:56", "remaining_time": "0:31:45"}
+{"current_steps": 200, "total_steps": 250, "loss": 0.3944, "lr": 1.2150247217412186e-05, "epoch": 1.9549330085261876, "percentage": 80.0, "elapsed_time": "2:04:30", "remaining_time": "0:31:07"}
+{"current_steps": 200, "total_steps": 250, "eval_loss": 0.4625219404697418, "epoch": 1.9549330085261876, "percentage": 80.0, "elapsed_time": "2:06:26", "remaining_time": "0:31:36"}
+{"current_steps": 201, "total_steps": 250, "loss": 0.397, "lr": 1.1697777844051105e-05, "epoch": 1.9646772228989038, "percentage": 80.4, "elapsed_time": "2:06:54", "remaining_time": "0:30:56"}
+{"current_steps": 202, "total_steps": 250, "loss": 0.4191, "lr": 1.1252775564791024e-05, "epoch": 1.97442143727162, "percentage": 80.8, "elapsed_time": "2:07:27", "remaining_time": "0:30:17"}
+{"current_steps": 203, "total_steps": 250, "loss": 0.4126, "lr": 1.0815327133708015e-05, "epoch": 1.9841656516443362, "percentage": 81.2, "elapsed_time": "2:08:15", "remaining_time": "0:29:41"}
+{"current_steps": 204, "total_steps": 250, "loss": 0.3936, "lr": 1.0385517832240471e-05, "epoch": 1.9939098660170522, "percentage": 81.6, "elapsed_time": "2:08:50", "remaining_time": "0:29:03"}
+{"current_steps": 205, "total_steps": 250, "loss": 0.8769, "lr": 9.963431452563332e-06, "epoch": 2.009744214372716, "percentage": 82.0, "elapsed_time": "2:09:47", "remaining_time": "0:28:29"}
+{"current_steps": 206, "total_steps": 250, "loss": 0.3756, "lr": 9.549150281252633e-06, "epoch": 2.0194884287454324, "percentage": 82.4, "elapsed_time": "2:10:19", "remaining_time": "0:27:50"}
+{"current_steps": 207, "total_steps": 250, "loss": 0.4197, "lr": 9.142755083243576e-06, "epoch": 2.0292326431181484, "percentage": 82.8, "elapsed_time": "2:10:46", "remaining_time": "0:27:09"}
+{"current_steps": 208, "total_steps": 250, "loss": 0.4043, "lr": 8.744325086085248e-06, "epoch": 2.038976857490865, "percentage": 83.2, "elapsed_time": "2:11:11", "remaining_time": "0:26:29"}
+{"current_steps": 209, "total_steps": 250, "loss": 0.3806, "lr": 8.353937964495029e-06, "epoch": 2.048721071863581, "percentage": 83.6, "elapsed_time": "2:11:56", "remaining_time": "0:25:53"}
+{"current_steps": 210, "total_steps": 250, "loss": 0.3838, "lr": 7.971669825215788e-06, "epoch": 2.0584652862362973, "percentage": 84.0, "elapsed_time": "2:12:22", "remaining_time": "0:25:12"}
+{"current_steps": 211, "total_steps": 250, "loss": 0.3778, "lr": 7.597595192178702e-06, "epoch": 2.0682095006090133, "percentage": 84.4, "elapsed_time": "2:12:50", "remaining_time": "0:24:33"}
+{"current_steps": 212, "total_steps": 250, "loss": 0.4119, "lr": 7.2317869919746705e-06, "epoch": 2.0779537149817298, "percentage": 84.8, "elapsed_time": "2:13:30", "remaining_time": "0:23:55"}
+{"current_steps": 213, "total_steps": 250, "loss": 0.3804, "lr": 6.874316539637127e-06, "epoch": 2.0876979293544458, "percentage": 85.2, "elapsed_time": "2:14:04", "remaining_time": "0:23:17"}
+{"current_steps": 214, "total_steps": 250, "loss": 0.3932, "lr": 6.52525352473905e-06, "epoch": 2.097442143727162, "percentage": 85.6, "elapsed_time": "2:14:38", "remaining_time": "0:22:39"}
+{"current_steps": 215, "total_steps": 250, "loss": 0.3658, "lr": 6.184665997806832e-06, "epoch": 2.107186358099878, "percentage": 86.0, "elapsed_time": "2:15:04", "remaining_time": "0:21:59"}
+{"current_steps": 216, "total_steps": 250, "loss": 0.3683, "lr": 5.852620357053651e-06, "epoch": 2.116930572472594, "percentage": 86.4, "elapsed_time": "2:15:40", "remaining_time": "0:21:21"}
+{"current_steps": 217, "total_steps": 250, "loss": 0.3635, "lr": 5.529181335435124e-06, "epoch": 2.1266747868453106, "percentage": 86.8, "elapsed_time": "2:16:14", "remaining_time": "0:20:43"}
+{"current_steps": 218, "total_steps": 250, "loss": 0.3929, "lr": 5.214411988029355e-06, "epoch": 2.1364190012180266, "percentage": 87.2, "elapsed_time": "2:16:59", "remaining_time": "0:20:06"}
+{"current_steps": 219, "total_steps": 250, "loss": 0.3579, "lr": 4.908373679744316e-06, "epoch": 2.146163215590743, "percentage": 87.6, "elapsed_time": "2:17:36", "remaining_time": "0:19:28"}
+{"current_steps": 220, "total_steps": 250, "loss": 0.397, "lr": 4.611126073354571e-06, "epoch": 2.155907429963459, "percentage": 88.0, "elapsed_time": "2:18:07", "remaining_time": "0:18:50"}
+{"current_steps": 221, "total_steps": 250, "loss": 0.3996, "lr": 4.322727117869951e-06, "epoch": 2.1656516443361755, "percentage": 88.4, "elapsed_time": "2:18:44", "remaining_time": "0:18:12"}
+{"current_steps": 222, "total_steps": 250, "loss": 0.3797, "lr": 4.043233037238281e-06, "epoch": 2.1753958587088915, "percentage": 88.8, "elapsed_time": "2:19:25", "remaining_time": "0:17:35"}
+{"current_steps": 223, "total_steps": 250, "loss": 0.4177, "lr": 3.772698319384349e-06, "epoch": 2.185140073081608, "percentage": 89.2, "elapsed_time": "2:19:57", "remaining_time": "0:16:56"}
+{"current_steps": 224, "total_steps": 250, "loss": 0.4057, "lr": 3.511175705587433e-06, "epoch": 2.194884287454324, "percentage": 89.6, "elapsed_time": "2:20:38", "remaining_time": "0:16:19"}
+{"current_steps": 225, "total_steps": 250, "loss": 0.3411, "lr": 3.258716180199278e-06, "epoch": 2.2046285018270404, "percentage": 90.0, "elapsed_time": "2:21:11", "remaining_time": "0:15:41"}
+{"current_steps": 225, "total_steps": 250, "eval_loss": 0.461640328168869, "epoch": 2.2046285018270404, "percentage": 90.0, "elapsed_time": "2:23:08", "remaining_time": "0:15:54"}
+{"current_steps": 226, "total_steps": 250, "loss": 0.3767, "lr": 3.0153689607045845e-06, "epoch": 2.2143727161997564, "percentage": 90.4, "elapsed_time": "2:23:38", "remaining_time": "0:15:15"}
+{"current_steps": 227, "total_steps": 250, "loss": 0.3909, "lr": 2.7811814881259503e-06, "epoch": 2.2241169305724724, "percentage": 90.8, "elapsed_time": "2:24:06", "remaining_time": "0:14:36"}
+{"current_steps": 228, "total_steps": 250, "loss": 0.377, "lr": 2.5561994177751737e-06, "epoch": 2.233861144945189, "percentage": 91.2, "elapsed_time": "2:24:35", "remaining_time": "0:13:57"}
+{"current_steps": 229, "total_steps": 250, "loss": 0.3621, "lr": 2.340466610352654e-06, "epoch": 2.243605359317905, "percentage": 91.6, "elapsed_time": "2:25:02", "remaining_time": "0:13:18"}
+{"current_steps": 230, "total_steps": 250, "loss": 0.4011, "lr": 2.134025123396638e-06, "epoch": 2.2533495736906213, "percentage": 92.0, "elapsed_time": "2:25:43", "remaining_time": "0:12:40"}
+{"current_steps": 231, "total_steps": 250, "loss": 0.3517, "lr": 1.9369152030840556e-06, "epoch": 2.2630937880633373, "percentage": 92.4, "elapsed_time": "2:26:13", "remaining_time": "0:12:01"}
+{"current_steps": 232, "total_steps": 250, "loss": 0.3749, "lr": 1.7491752763844293e-06, "epoch": 2.2728380024360537, "percentage": 92.8, "elapsed_time": "2:26:56", "remaining_time": "0:11:24"}
+{"current_steps": 233, "total_steps": 250, "loss": 0.3629, "lr": 1.5708419435684462e-06, "epoch": 2.2825822168087697, "percentage": 93.2, "elapsed_time": "2:27:25", "remaining_time": "0:10:45"}
+{"current_steps": 234, "total_steps": 250, "loss": 0.3971, "lr": 1.4019499710726913e-06, "epoch": 2.292326431181486, "percentage": 93.6, "elapsed_time": "2:28:03", "remaining_time": "0:10:07"}
+{"current_steps": 235, "total_steps": 250, "loss": 0.3643, "lr": 1.2425322847218368e-06, "epoch": 2.302070645554202, "percentage": 94.0, "elapsed_time": "2:28:28", "remaining_time": "0:09:28"}
+{"current_steps": 236, "total_steps": 250, "loss": 0.3678, "lr": 1.0926199633097157e-06, "epoch": 2.311814859926918, "percentage": 94.4, "elapsed_time": "2:29:11", "remaining_time": "0:08:51"}
+{"current_steps": 237, "total_steps": 250, "loss": 0.4407, "lr": 9.522422325404235e-07, "epoch": 2.3215590742996346, "percentage": 94.8, "elapsed_time": "2:29:52", "remaining_time": "0:08:13"}
+{"current_steps": 238, "total_steps": 250, "loss": 0.3228, "lr": 8.214264593307098e-07, "epoch": 2.331303288672351, "percentage": 95.2, "elapsed_time": "2:30:18", "remaining_time": "0:07:34"}
+{"current_steps": 239, "total_steps": 250, "loss": 0.3825, "lr": 7.001981464747565e-07, "epoch": 2.341047503045067, "percentage": 95.6, "elapsed_time": "2:30:52", "remaining_time": "0:06:56"}
+{"current_steps": 240, "total_steps": 250, "loss": 0.3306, "lr": 5.885809276723608e-07, "epoch": 2.350791717417783, "percentage": 96.0, "elapsed_time": "2:31:20", "remaining_time": "0:06:18"}
+{"current_steps": 241, "total_steps": 250, "loss": 0.368, "lr": 4.865965629214819e-07, "epoch": 2.3605359317904995, "percentage": 96.4, "elapsed_time": "2:31:50", "remaining_time": "0:05:40"}
+{"current_steps": 242, "total_steps": 250, "loss": 0.3755, "lr": 3.9426493427611177e-07, "epoch": 2.3702801461632155, "percentage": 96.8, "elapsed_time": "2:32:20", "remaining_time": "0:05:02"}
+{"current_steps": 243, "total_steps": 250, "loss": 0.389, "lr": 3.1160404197018154e-07, "epoch": 2.380024360535932, "percentage": 97.2, "elapsed_time": "2:32:59", "remaining_time": "0:04:24"}
+{"current_steps": 244, "total_steps": 250, "loss": 0.3565, "lr": 2.386300009084408e-07, "epoch": 2.389768574908648, "percentage": 97.6, "elapsed_time": "2:33:33", "remaining_time": "0:03:46"}
+{"current_steps": 245, "total_steps": 250, "loss": 0.3858, "lr": 1.753570375247815e-07, "epoch": 2.3995127892813644, "percentage": 98.0, "elapsed_time": "2:34:11", "remaining_time": "0:03:08"}
+{"current_steps": 246, "total_steps": 250, "loss": 0.3403, "lr": 1.2179748700879012e-07, "epoch": 2.4092570036540804, "percentage": 98.4, "elapsed_time": "2:34:37", "remaining_time": "0:02:30"}
+{"current_steps": 247, "total_steps": 250, "loss": 0.3451, "lr": 7.796179090094891e-08, "epoch": 2.4190012180267964, "percentage": 98.8, "elapsed_time": "2:35:10", "remaining_time": "0:01:53"}
+{"current_steps": 248, "total_steps": 250, "loss": 0.3843, "lr": 4.385849505708084e-08, "epoch": 2.428745432399513, "percentage": 99.2, "elapsed_time": "2:35:47", "remaining_time": "0:01:15"}
+{"current_steps": 249, "total_steps": 250, "loss": 0.409, "lr": 1.949424798228239e-08, "epoch": 2.4384896467722292, "percentage": 99.6, "elapsed_time": "2:36:24", "remaining_time": "0:00:37"}
+{"current_steps": 250, "total_steps": 250, "loss": 0.3588, "lr": 4.873799534788059e-09, "epoch": 2.4482338611449452, "percentage": 100.0, "elapsed_time": "2:36:54", "remaining_time": "0:00:00"}
+{"current_steps": 250, "total_steps": 250, "eval_loss": 0.4610269367694855, "epoch": 2.4482338611449452, "percentage": 100.0, "elapsed_time": "2:38:50", "remaining_time": "0:00:00"}
+{"current_steps": 250, "total_steps": 250, "epoch": 2.4482338611449452, "percentage": 100.0, "elapsed_time": "2:38:51", "remaining_time": "0:00:00"}

TextUI-Func-7B/trainer_state.json

@@ -0,0 +1,1873 @@
+{
+  "best_global_step": 250,
+  "best_metric": 0.4610269367694855,
+  "best_model_checkpoint": "/root/autodl-tmp/model/lora-textui/stage1_cap_func/checkpoint-250",
+  "epoch": 2.4482338611449452,
+  "eval_steps": 25,
+  "global_step": 250,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.0097442143727162,
+      "grad_norm": 1.4819260835647583,
+      "learning_rate": 0.0,
+      "loss": 0.9971,
+      "step": 1
+    },
+    {
+      "epoch": 0.0194884287454324,
+      "grad_norm": 1.1177597045898438,
+      "learning_rate": 4.000000000000001e-06,
+      "loss": 0.8357,
+      "step": 2
+    },
+    {
+      "epoch": 0.029232643118148598,
+      "grad_norm": 1.5783437490463257,
+      "learning_rate": 8.000000000000001e-06,
+      "loss": 1.0968,
+      "step": 3
+    },
+    {
+      "epoch": 0.0389768574908648,
+      "grad_norm": 1.3322019577026367,
+      "learning_rate": 1.2e-05,
+      "loss": 0.9436,
+      "step": 4
+    },
+    {
+      "epoch": 0.048721071863580996,
+      "grad_norm": 1.1600998640060425,
+      "learning_rate": 1.6000000000000003e-05,
+      "loss": 0.8405,
+      "step": 5
+    },
+    {
+      "epoch": 0.058465286236297195,
+      "grad_norm": 3.9179673194885254,
+      "learning_rate": 2e-05,
+      "loss": 0.8719,
+      "step": 6
+    },
+    {
+      "epoch": 0.0682095006090134,
+      "grad_norm": 0.7671970725059509,
+      "learning_rate": 2.4e-05,
+      "loss": 0.7487,
+      "step": 7
+    },
+    {
+      "epoch": 0.0779537149817296,
+      "grad_norm": 0.6959292888641357,
+      "learning_rate": 2.8000000000000003e-05,
+      "loss": 0.8104,
+      "step": 8
+    },
+    {
+      "epoch": 0.0876979293544458,
+      "grad_norm": 0.4416683316230774,
+      "learning_rate": 3.2000000000000005e-05,
+      "loss": 0.7356,
+      "step": 9
+    },
+    {
+      "epoch": 0.09744214372716199,
+      "grad_norm": 0.48265624046325684,
+      "learning_rate": 3.6e-05,
+      "loss": 0.7642,
+      "step": 10
+    },
+    {
+      "epoch": 0.1071863580998782,
+      "grad_norm": 0.45329996943473816,
+      "learning_rate": 4e-05,
+      "loss": 0.734,
+      "step": 11
+    },
+    {
+      "epoch": 0.11693057247259439,
+      "grad_norm": 0.506803572177887,
+      "learning_rate": 4.4000000000000006e-05,
+      "loss": 0.7155,
+      "step": 12
+    },
+    {
+      "epoch": 0.12667478684531058,
+      "grad_norm": 0.5821135640144348,
+      "learning_rate": 4.8e-05,
+      "loss": 0.7207,
+      "step": 13
+    },
+    {
+      "epoch": 0.1364190012180268,
+      "grad_norm": 0.6181040406227112,
+      "learning_rate": 5.2000000000000004e-05,
+      "loss": 0.7882,
+      "step": 14
+    },
+    {
+      "epoch": 0.146163215590743,
+      "grad_norm": 0.47155848145484924,
+      "learning_rate": 5.6000000000000006e-05,
+      "loss": 0.7188,
+      "step": 15
+    },
+    {
+      "epoch": 0.1559074299634592,
+      "grad_norm": 0.3960055112838745,
+      "learning_rate": 6e-05,
+      "loss": 0.7002,
+      "step": 16
+    },
+    {
+      "epoch": 0.1656516443361754,
+      "grad_norm": 0.4034963846206665,
+      "learning_rate": 6.400000000000001e-05,
+      "loss": 0.7174,
+      "step": 17
+    },
+    {
+      "epoch": 0.1753958587088916,
+      "grad_norm": 0.408160924911499,
+      "learning_rate": 6.800000000000001e-05,
+      "loss": 0.7085,
+      "step": 18
+    },
+    {
+      "epoch": 0.1851400730816078,
+      "grad_norm": 0.4035159647464752,
+      "learning_rate": 7.2e-05,
+      "loss": 0.788,
+      "step": 19
+    },
+    {
+      "epoch": 0.19488428745432398,
+      "grad_norm": 0.38708168268203735,
+      "learning_rate": 7.6e-05,
+      "loss": 0.6491,
+      "step": 20
+    },
+    {
+      "epoch": 0.2046285018270402,
+      "grad_norm": 0.42144861817359924,
+      "learning_rate": 8e-05,
+      "loss": 0.6749,
+      "step": 21
+    },
+    {
+      "epoch": 0.2143727161997564,
+      "grad_norm": 0.3642968237400055,
+      "learning_rate": 8.4e-05,
+      "loss": 0.6431,
+      "step": 22
+    },
+    {
+      "epoch": 0.2241169305724726,
+      "grad_norm": 0.4132453203201294,
+      "learning_rate": 8.800000000000001e-05,
+      "loss": 0.6089,
+      "step": 23
+    },
+    {
+      "epoch": 0.23386114494518878,
+      "grad_norm": 0.4148790240287781,
+      "learning_rate": 9.200000000000001e-05,
+      "loss": 0.605,
+      "step": 24
+    },
+    {
+      "epoch": 0.243605359317905,
+      "grad_norm": 0.46465402841567993,
+      "learning_rate": 9.6e-05,
+      "loss": 0.6383,
+      "step": 25
+    },
+    {
+      "epoch": 0.243605359317905,
+      "eval_loss": 0.6978875398635864,
+      "eval_runtime": 116.3355,
+      "eval_samples_per_second": 7.367,
+      "eval_steps_per_second": 0.464,
+      "step": 25
+    },
+    {
+      "epoch": 0.25334957369062117,
+      "grad_norm": 0.38448578119277954,
+      "learning_rate": 0.0001,
+      "loss": 0.6573,
+      "step": 26
+    },
+    {
+      "epoch": 0.2630937880633374,
+      "grad_norm": 0.386096715927124,
+      "learning_rate": 9.999512620046522e-05,
+      "loss": 0.6503,
+      "step": 27
+    },
+    {
+      "epoch": 0.2728380024360536,
+      "grad_norm": 0.4173428416252136,
+      "learning_rate": 9.998050575201771e-05,
+      "loss": 0.6056,
+      "step": 28
+    },
+    {
+      "epoch": 0.28258221680876977,
+      "grad_norm": 0.3838996887207031,
+      "learning_rate": 9.995614150494293e-05,
+      "loss": 0.6291,
+      "step": 29
+    },
+    {
+      "epoch": 0.292326431181486,
+      "grad_norm": 0.37374845147132874,
+      "learning_rate": 9.992203820909906e-05,
+      "loss": 0.5929,
+      "step": 30
+    },
+    {
+      "epoch": 0.3020706455542022,
+      "grad_norm": 0.38990911841392517,
+      "learning_rate": 9.987820251299122e-05,
+      "loss": 0.6166,
+      "step": 31
+    },
+    {
+      "epoch": 0.3118148599269184,
+      "grad_norm": 0.3717946410179138,
+      "learning_rate": 9.982464296247522e-05,
+      "loss": 0.631,
+      "step": 32
+    },
+    {
+      "epoch": 0.3215590742996346,
+      "grad_norm": 0.38515135645866394,
+      "learning_rate": 9.976136999909156e-05,
+      "loss": 0.6309,
+      "step": 33
+    },
+    {
+      "epoch": 0.3313032886723508,
+      "grad_norm": 0.4617915749549866,
+      "learning_rate": 9.968839595802982e-05,
+      "loss": 0.6514,
+      "step": 34
+    },
+    {
+      "epoch": 0.341047503045067,
+      "grad_norm": 0.36573508381843567,
+      "learning_rate": 9.96057350657239e-05,
+      "loss": 0.5839,
+      "step": 35
+    },
+    {
+      "epoch": 0.3507917174177832,
+      "grad_norm": 0.38394173979759216,
+      "learning_rate": 9.951340343707852e-05,
+      "loss": 0.5927,
+      "step": 36
+    },
+    {
+      "epoch": 0.36053593179049936,
+      "grad_norm": 0.41442376375198364,
+      "learning_rate": 9.941141907232765e-05,
+      "loss": 0.6388,
+      "step": 37
+    },
+    {
+      "epoch": 0.3702801461632156,
+      "grad_norm": 0.3883739709854126,
+      "learning_rate": 9.929980185352526e-05,
+      "loss": 0.6241,
+      "step": 38
+    },
+    {
+      "epoch": 0.3800243605359318,
+      "grad_norm": 0.3784323036670685,
+      "learning_rate": 9.917857354066931e-05,
+      "loss": 0.5968,
+      "step": 39
+    },
+    {
+      "epoch": 0.38976857490864797,
+      "grad_norm": 0.38477954268455505,
+      "learning_rate": 9.904775776745958e-05,
+      "loss": 0.6051,
+      "step": 40
+    },
+    {
+      "epoch": 0.3995127892813642,
+      "grad_norm": 0.42043524980545044,
+      "learning_rate": 9.890738003669029e-05,
+      "loss": 0.6269,
+      "step": 41
+    },
+    {
+      "epoch": 0.4092570036540804,
+      "grad_norm": 0.4155956208705902,
+      "learning_rate": 9.875746771527816e-05,
+      "loss": 0.6137,
+      "step": 42
+    },
+    {
+      "epoch": 0.4190012180267966,
+      "grad_norm": 0.39818403124809265,
+      "learning_rate": 9.859805002892732e-05,
+      "loss": 0.5831,
+      "step": 43
+    },
+    {
+      "epoch": 0.4287454323995128,
+      "grad_norm": 0.4027486741542816,
+      "learning_rate": 9.842915805643155e-05,
+      "loss": 0.5671,
+      "step": 44
+    },
+    {
+      "epoch": 0.438489646772229,
+      "grad_norm": 0.3745126724243164,
+      "learning_rate": 9.825082472361557e-05,
+      "loss": 0.5605,
+      "step": 45
+    },
+    {
+      "epoch": 0.4482338611449452,
+      "grad_norm": 0.4132031798362732,
+      "learning_rate": 9.806308479691595e-05,
+      "loss": 0.6192,
+      "step": 46
+    },
+    {
+      "epoch": 0.4579780755176614,
+      "grad_norm": 0.42464327812194824,
+      "learning_rate": 9.786597487660337e-05,
+      "loss": 0.5856,
+      "step": 47
+    },
+    {
+      "epoch": 0.46772228989037756,
+      "grad_norm": 0.42480695247650146,
+      "learning_rate": 9.765953338964735e-05,
+      "loss": 0.6433,
+      "step": 48
+    },
+    {
+      "epoch": 0.4774665042630938,
+      "grad_norm": 0.4505927562713623,
+      "learning_rate": 9.744380058222483e-05,
+      "loss": 0.6637,
+      "step": 49
+    },
+    {
+      "epoch": 0.48721071863581,
+      "grad_norm": 0.40766066312789917,
+      "learning_rate": 9.721881851187406e-05,
+      "loss": 0.5722,
+      "step": 50
+    },
+    {
+      "epoch": 0.48721071863581,
+      "eval_loss": 0.6059486865997314,
+      "eval_runtime": 116.3481,
+      "eval_samples_per_second": 7.366,
+      "eval_steps_per_second": 0.464,
+      "step": 50
+    },
+    {
+      "epoch": 0.49695493300852617,
+      "grad_norm": 0.45385217666625977,
+      "learning_rate": 9.698463103929542e-05,
+      "loss": 0.6223,
+      "step": 51
+    },
+    {
+      "epoch": 0.5066991473812423,
+      "grad_norm": 0.4196796417236328,
+      "learning_rate": 9.674128381980072e-05,
+      "loss": 0.572,
+      "step": 52
+    },
+    {
+      "epoch": 0.5164433617539586,
+      "grad_norm": 0.4284449517726898,
+      "learning_rate": 9.648882429441257e-05,
+      "loss": 0.5225,
+      "step": 53
+    },
+    {
+      "epoch": 0.5261875761266748,
+      "grad_norm": 0.45584678649902344,
+      "learning_rate": 9.622730168061567e-05,
+      "loss": 0.5592,
+      "step": 54
+    },
+    {
+      "epoch": 0.535931790499391,
+      "grad_norm": 0.4218933582305908,
+      "learning_rate": 9.595676696276172e-05,
+      "loss": 0.5857,
+      "step": 55
+    },
+    {
+      "epoch": 0.5456760048721072,
+      "grad_norm": 0.45864835381507874,
+      "learning_rate": 9.567727288213005e-05,
+      "loss": 0.5908,
+      "step": 56
+    },
+    {
+      "epoch": 0.5554202192448234,
+      "grad_norm": 0.4483995735645294,
+      "learning_rate": 9.538887392664544e-05,
+      "loss": 0.5695,
+      "step": 57
+    },
+    {
+      "epoch": 0.5651644336175395,
+      "grad_norm": 0.48954787850379944,
+      "learning_rate": 9.50916263202557e-05,
+      "loss": 0.5314,
+      "step": 58
+    },
+    {
+      "epoch": 0.5749086479902558,
+      "grad_norm": 0.515805184841156,
+      "learning_rate": 9.478558801197065e-05,
+      "loss": 0.6366,
+      "step": 59
+    },
+    {
+      "epoch": 0.584652862362972,
+      "grad_norm": 0.4741595387458801,
+      "learning_rate": 9.447081866456489e-05,
+      "loss": 0.4933,
+      "step": 60
+    },
+    {
+      "epoch": 0.5943970767356882,
+      "grad_norm": 0.4829859137535095,
+      "learning_rate": 9.414737964294636e-05,
+      "loss": 0.6337,
+      "step": 61
+    },
+    {
+      "epoch": 0.6041412911084044,
+      "grad_norm": 0.45033347606658936,
+      "learning_rate": 9.381533400219318e-05,
+      "loss": 0.5714,
+      "step": 62
+    },
+    {
+      "epoch": 0.6138855054811205,
+      "grad_norm": 0.4400843381881714,
+      "learning_rate": 9.347474647526095e-05,
+      "loss": 0.5756,
+      "step": 63
+    },
+    {
+      "epoch": 0.6236297198538368,
+      "grad_norm": 0.45498228073120117,
+      "learning_rate": 9.312568346036288e-05,
+      "loss": 0.5635,
+      "step": 64
+    },
+    {
+      "epoch": 0.633373934226553,
+      "grad_norm": 0.4397442936897278,
+      "learning_rate": 9.276821300802534e-05,
+      "loss": 0.5508,
+      "step": 65
+    },
+    {
+      "epoch": 0.6431181485992692,
+      "grad_norm": 0.465465247631073,
+      "learning_rate": 9.24024048078213e-05,
+      "loss": 0.5118,
+      "step": 66
+    },
+    {
+      "epoch": 0.6528623629719854,
+      "grad_norm": 0.4904666244983673,
+      "learning_rate": 9.202833017478422e-05,
+      "loss": 0.5555,
+      "step": 67
+    },
+    {
+      "epoch": 0.6626065773447016,
+      "grad_norm": 0.4522901177406311,
+      "learning_rate": 9.164606203550497e-05,
+      "loss": 0.5712,
+      "step": 68
+    },
+    {
+      "epoch": 0.6723507917174177,
+      "grad_norm": 0.46516191959381104,
+      "learning_rate": 9.125567491391476e-05,
+      "loss": 0.54,
+      "step": 69
+    },
+    {
+      "epoch": 0.682095006090134,
+      "grad_norm": 0.563292384147644,
+      "learning_rate": 9.085724491675642e-05,
+      "loss": 0.5334,
+      "step": 70
+    },
+    {
+      "epoch": 0.6918392204628502,
+      "grad_norm": 0.4758321940898895,
+      "learning_rate": 9.045084971874738e-05,
+      "loss": 0.558,
+      "step": 71
+    },
+    {
+      "epoch": 0.7015834348355664,
+      "grad_norm": 0.4505232870578766,
+      "learning_rate": 9.003656854743667e-05,
+      "loss": 0.5592,
+      "step": 72
+    },
+    {
+      "epoch": 0.7113276492082826,
+      "grad_norm": 0.49200811982154846,
+      "learning_rate": 8.961448216775954e-05,
+      "loss": 0.562,
+      "step": 73
+    },
+    {
+      "epoch": 0.7210718635809987,
+      "grad_norm": 0.49411916732788086,
+      "learning_rate": 8.9184672866292e-05,
+      "loss": 0.5502,
+      "step": 74
+    },
+    {
+      "epoch": 0.730816077953715,
+      "grad_norm": 0.49506062269210815,
+      "learning_rate": 8.874722443520899e-05,
+      "loss": 0.5268,
+      "step": 75
+    },
+    {
+      "epoch": 0.730816077953715,
+      "eval_loss": 0.5484524369239807,
+      "eval_runtime": 116.2855,
+      "eval_samples_per_second": 7.37,
+      "eval_steps_per_second": 0.464,
+      "step": 75
+    },
+    {
+      "epoch": 0.7405602923264312,
+      "grad_norm": 0.4459410607814789,
+      "learning_rate": 8.83022221559489e-05,
+      "loss": 0.5651,
+      "step": 76
+    },
+    {
+      "epoch": 0.7503045066991474,
+      "grad_norm": 0.4649423360824585,
+      "learning_rate": 8.784975278258783e-05,
+      "loss": 0.507,
+      "step": 77
+    },
+    {
+      "epoch": 0.7600487210718636,
+      "grad_norm": 0.5267335176467896,
+      "learning_rate": 8.73899045249266e-05,
+      "loss": 0.5846,
+      "step": 78
+    },
+    {
+      "epoch": 0.7697929354445798,
+      "grad_norm": 0.48191651701927185,
+      "learning_rate": 8.692276703129421e-05,
+      "loss": 0.4785,
+      "step": 79
+    },
+    {
+      "epoch": 0.7795371498172959,
+      "grad_norm": 0.4713154137134552,
+      "learning_rate": 8.644843137107059e-05,
+      "loss": 0.5115,
+      "step": 80
+    },
+    {
+      "epoch": 0.7892813641900122,
+      "grad_norm": 0.48336002230644226,
+      "learning_rate": 8.596699001693255e-05,
+      "loss": 0.4972,
+      "step": 81
+    },
+    {
+      "epoch": 0.7990255785627284,
+      "grad_norm": 0.5115373730659485,
+      "learning_rate": 8.547853682682604e-05,
+      "loss": 0.5548,
+      "step": 82
+    },
+    {
+      "epoch": 0.8087697929354446,
+      "grad_norm": 0.4678809344768524,
+      "learning_rate": 8.498316702566828e-05,
+      "loss": 0.5017,
+      "step": 83
+    },
+    {
+      "epoch": 0.8185140073081608,
+      "grad_norm": 0.46973857283592224,
+      "learning_rate": 8.44809771867835e-05,
+      "loss": 0.5304,
+      "step": 84
+    },
+    {
+      "epoch": 0.8282582216808769,
+      "grad_norm": 0.5022630095481873,
+      "learning_rate": 8.397206521307584e-05,
+      "loss": 0.4957,
+      "step": 85
+    },
+    {
+      "epoch": 0.8380024360535931,
+      "grad_norm": 0.47750282287597656,
+      "learning_rate": 8.345653031794292e-05,
+      "loss": 0.4853,
+      "step": 86
+    },
+    {
+      "epoch": 0.8477466504263094,
+      "grad_norm": 0.48647361993789673,
+      "learning_rate": 8.293447300593402e-05,
+      "loss": 0.499,
+      "step": 87
+    },
+    {
+      "epoch": 0.8574908647990256,
+      "grad_norm": 0.5240001082420349,
+      "learning_rate": 8.240599505315655e-05,
+      "loss": 0.5061,
+      "step": 88
+    },
+    {
+      "epoch": 0.8672350791717418,
+      "grad_norm": 0.4904966354370117,
+      "learning_rate": 8.18711994874345e-05,
+      "loss": 0.5139,
+      "step": 89
+    },
+    {
+      "epoch": 0.876979293544458,
+      "grad_norm": 0.5042212605476379,
+      "learning_rate": 8.133019056822304e-05,
+      "loss": 0.5355,
+      "step": 90
+    },
+    {
+      "epoch": 0.8867235079171741,
+      "grad_norm": 0.4775819778442383,
+      "learning_rate": 8.07830737662829e-05,
+      "loss": 0.4889,
+      "step": 91
+    },
+    {
+      "epoch": 0.8964677222898904,
+      "grad_norm": 0.5047743320465088,
+      "learning_rate": 8.022995574311876e-05,
+      "loss": 0.4788,
+      "step": 92
+    },
+    {
+      "epoch": 0.9062119366626066,
+      "grad_norm": 0.4905475676059723,
+      "learning_rate": 7.967094433018508e-05,
+      "loss": 0.5104,
+      "step": 93
+    },
+    {
+      "epoch": 0.9159561510353228,
+      "grad_norm": 0.49578583240509033,
+      "learning_rate": 7.910614850786448e-05,
+      "loss": 0.4903,
+      "step": 94
+    },
+    {
+      "epoch": 0.925700365408039,
+      "grad_norm": 0.5329849123954773,
+      "learning_rate": 7.85356783842216e-05,
+      "loss": 0.4926,
+      "step": 95
+    },
+    {
+      "epoch": 0.9354445797807551,
+      "grad_norm": 0.5267957448959351,
+      "learning_rate": 7.795964517353735e-05,
+      "loss": 0.5514,
+      "step": 96
+    },
+    {
+      "epoch": 0.9451887941534713,
+      "grad_norm": 0.5095996856689453,
+      "learning_rate": 7.737816117462752e-05,
+      "loss": 0.4886,
+      "step": 97
+    },
+    {
+      "epoch": 0.9549330085261876,
+      "grad_norm": 0.46476784348487854,
+      "learning_rate": 7.679133974894983e-05,
+      "loss": 0.4776,
+      "step": 98
+    },
+    {
+      "epoch": 0.9646772228989038,
+      "grad_norm": 0.516237735748291,
+      "learning_rate": 7.619929529850397e-05,
+      "loss": 0.5343,
+      "step": 99
+    },
+    {
+      "epoch": 0.97442143727162,
+      "grad_norm": 0.5128530859947205,
+      "learning_rate": 7.560214324352858e-05,
+      "loss": 0.492,
+      "step": 100
+    },
+    {
+      "epoch": 0.97442143727162,
+      "eval_loss": 0.5159465074539185,
+      "eval_runtime": 116.1788,
+      "eval_samples_per_second": 7.377,
+      "eval_steps_per_second": 0.465,
+      "step": 100
+    },
+    {
+      "epoch": 0.9841656516443362,
+      "grad_norm": 0.525909960269928,
+      "learning_rate": 7.500000000000001e-05,
+      "loss": 0.5276,
+      "step": 101
+    },
+    {
+      "epoch": 0.9939098660170523,
+      "grad_norm": 0.4755876958370209,
+      "learning_rate": 7.439298295693665e-05,
+      "loss": 0.4887,
+      "step": 102
+    },
+    {
+      "epoch": 1.0097442143727162,
+      "grad_norm": 0.898318350315094,
+      "learning_rate": 7.378121045351378e-05,
+      "loss": 0.896,
+      "step": 103
+    },
+    {
+      "epoch": 1.0194884287454324,
+      "grad_norm": 0.5060648918151855,
+      "learning_rate": 7.316480175599309e-05,
+      "loss": 0.4999,
+      "step": 104
+    },
+    {
+      "epoch": 1.0292326431181487,
+      "grad_norm": 0.46954262256622314,
+      "learning_rate": 7.254387703447154e-05,
+      "loss": 0.4633,
+      "step": 105
+    },
+    {
+      "epoch": 1.0389768574908649,
+      "grad_norm": 0.4725915193557739,
+      "learning_rate": 7.191855733945387e-05,
+      "loss": 0.4491,
+      "step": 106
+    },
+    {
+      "epoch": 1.048721071863581,
+      "grad_norm": 0.4837670624256134,
+      "learning_rate": 7.128896457825364e-05,
+      "loss": 0.4508,
+      "step": 107
+    },
+    {
+      "epoch": 1.058465286236297,
+      "grad_norm": 0.5884471535682678,
+      "learning_rate": 7.06552214912271e-05,
+      "loss": 0.4297,
+      "step": 108
+    },
+    {
+      "epoch": 1.0682095006090133,
+      "grad_norm": 0.5307117104530334,
+      "learning_rate": 7.001745162784477e-05,
+      "loss": 0.4592,
+      "step": 109
+    },
+    {
+      "epoch": 1.0779537149817295,
+      "grad_norm": 0.5245863795280457,
+      "learning_rate": 6.937577932260515e-05,
+      "loss": 0.4819,
+      "step": 110
+    },
+    {
+      "epoch": 1.0876979293544458,
+      "grad_norm": 0.5525639653205872,
+      "learning_rate": 6.873032967079561e-05,
+      "loss": 0.4678,
+      "step": 111
+    },
+    {
+      "epoch": 1.097442143727162,
+      "grad_norm": 0.5659409761428833,
+      "learning_rate": 6.808122850410461e-05,
+      "loss": 0.4635,
+      "step": 112
+    },
+    {
+      "epoch": 1.1071863580998782,
+      "grad_norm": 0.5493988394737244,
+      "learning_rate": 6.742860236609077e-05,
+      "loss": 0.4307,
+      "step": 113
+    },
+    {
+      "epoch": 1.1169305724725944,
+      "grad_norm": 0.5591247081756592,
+      "learning_rate": 6.677257848751277e-05,
+      "loss": 0.416,
+      "step": 114
+    },
+    {
+      "epoch": 1.1266747868453106,
+      "grad_norm": 0.4955357611179352,
+      "learning_rate": 6.611328476152557e-05,
+      "loss": 0.4662,
+      "step": 115
+    },
+    {
+      "epoch": 1.1364190012180269,
+      "grad_norm": 0.5241750478744507,
+      "learning_rate": 6.545084971874738e-05,
+      "loss": 0.4301,
+      "step": 116
+    },
+    {
+      "epoch": 1.146163215590743,
+      "grad_norm": 0.4876319468021393,
+      "learning_rate": 6.478540250220234e-05,
+      "loss": 0.4564,
+      "step": 117
+    },
+    {
+      "epoch": 1.155907429963459,
+      "grad_norm": 0.5395438075065613,
+      "learning_rate": 6.411707284214384e-05,
+      "loss": 0.502,
+      "step": 118
+    },
+    {
+      "epoch": 1.1656516443361755,
+      "grad_norm": 0.5435388684272766,
+      "learning_rate": 6.344599103076329e-05,
+      "loss": 0.4536,
+      "step": 119
+    },
+    {
+      "epoch": 1.1753958587088915,
+      "grad_norm": 0.526055097579956,
+      "learning_rate": 6.277228789678953e-05,
+      "loss": 0.4576,
+      "step": 120
+    },
+    {
+      "epoch": 1.1851400730816077,
+      "grad_norm": 0.5060620903968811,
+      "learning_rate": 6.209609477998338e-05,
+      "loss": 0.4814,
+      "step": 121
+    },
+    {
+      "epoch": 1.194884287454324,
+      "grad_norm": 0.4862349033355713,
+      "learning_rate": 6.141754350553279e-05,
+      "loss": 0.4277,
+      "step": 122
+    },
+    {
+      "epoch": 1.2046285018270402,
+      "grad_norm": 0.5572500824928284,
+      "learning_rate": 6.073676635835317e-05,
+      "loss": 0.5118,
+      "step": 123
+    },
+    {
+      "epoch": 1.2143727161997564,
+      "grad_norm": 0.5726194381713867,
+      "learning_rate": 6.005389605729824e-05,
+      "loss": 0.4725,
+      "step": 124
+    },
+    {
+      "epoch": 1.2241169305724726,
+      "grad_norm": 0.5314717888832092,
+      "learning_rate": 5.9369065729286245e-05,
+      "loss": 0.4719,
+      "step": 125
+    },
+    {
+      "epoch": 1.2241169305724726,
+      "eval_loss": 0.4989548325538635,
+      "eval_runtime": 116.3548,
+      "eval_samples_per_second": 7.365,
+      "eval_steps_per_second": 0.464,
+      "step": 125
+    },
+    {
+      "epoch": 1.2338611449451888,
+      "grad_norm": 0.5402824878692627,
+      "learning_rate": 5.868240888334653e-05,
+      "loss": 0.4735,
+      "step": 126
+    },
+    {
+      "epoch": 1.243605359317905,
+      "grad_norm": 0.5422326922416687,
+      "learning_rate": 5.799405938459175e-05,
+      "loss": 0.4729,
+      "step": 127
+    },
+    {
+      "epoch": 1.2533495736906213,
+      "grad_norm": 0.5375432968139648,
+      "learning_rate": 5.730415142812059e-05,
+      "loss": 0.4589,
+      "step": 128
+    },
+    {
+      "epoch": 1.2630937880633373,
+      "grad_norm": 0.5534482002258301,
+      "learning_rate": 5.661281951285613e-05,
+      "loss": 0.4464,
+      "step": 129
+    },
+    {
+      "epoch": 1.2728380024360537,
+      "grad_norm": 0.5432469844818115,
+      "learning_rate": 5.5920198415325064e-05,
+      "loss": 0.4537,
+      "step": 130
+    },
+    {
+      "epoch": 1.2825822168087697,
+      "grad_norm": 0.5186154246330261,
+      "learning_rate": 5.522642316338268e-05,
+      "loss": 0.4158,
+      "step": 131
+    },
+    {
+      "epoch": 1.292326431181486,
+      "grad_norm": 0.5382589101791382,
+      "learning_rate": 5.453162900988902e-05,
+      "loss": 0.4176,
+      "step": 132
+    },
+    {
+      "epoch": 1.3020706455542022,
+      "grad_norm": 0.5565094351768494,
+      "learning_rate": 5.383595140634093e-05,
+      "loss": 0.4287,
+      "step": 133
+    },
+    {
+      "epoch": 1.3118148599269184,
+      "grad_norm": 0.5403843522071838,
+      "learning_rate": 5.313952597646568e-05,
+      "loss": 0.4118,
+      "step": 134
+    },
+    {
+      "epoch": 1.3215590742996346,
+      "grad_norm": 0.5338913798332214,
+      "learning_rate": 5.244248848978067e-05,
+      "loss": 0.3948,
+      "step": 135
+    },
+    {
+      "epoch": 1.3313032886723508,
+      "grad_norm": 0.5245387554168701,
+      "learning_rate": 5.174497483512506e-05,
+      "loss": 0.4579,
+      "step": 136
+    },
+    {
+      "epoch": 1.341047503045067,
+      "grad_norm": 0.51710045337677,
+      "learning_rate": 5.104712099416785e-05,
+      "loss": 0.4025,
+      "step": 137
+    },
+    {
+      "epoch": 1.3507917174177833,
+      "grad_norm": 0.56063312292099,
+      "learning_rate": 5.034906301489808e-05,
+      "loss": 0.4956,
+      "step": 138
+    },
+    {
+      "epoch": 1.3605359317904995,
+      "grad_norm": 0.6041215658187866,
+      "learning_rate": 4.965093698510193e-05,
+      "loss": 0.4336,
+      "step": 139
+    },
+    {
+      "epoch": 1.3702801461632155,
+      "grad_norm": 0.5541957020759583,
+      "learning_rate": 4.895287900583216e-05,
+      "loss": 0.4456,
+      "step": 140
+    },
+    {
+      "epoch": 1.380024360535932,
+      "grad_norm": 0.5618797540664673,
+      "learning_rate": 4.825502516487497e-05,
+      "loss": 0.3996,
+      "step": 141
+    },
+    {
+      "epoch": 1.389768574908648,
+      "grad_norm": 0.533968448638916,
+      "learning_rate": 4.755751151021934e-05,
+      "loss": 0.4155,
+      "step": 142
+    },
+    {
+      "epoch": 1.3995127892813641,
+      "grad_norm": 0.5411080121994019,
+      "learning_rate": 4.6860474023534335e-05,
+      "loss": 0.4325,
+      "step": 143
+    },
+    {
+      "epoch": 1.4092570036540804,
+      "grad_norm": 0.5761292576789856,
+      "learning_rate": 4.616404859365907e-05,
+      "loss": 0.4166,
+      "step": 144
+    },
+    {
+      "epoch": 1.4190012180267966,
+      "grad_norm": 0.5804659128189087,
+      "learning_rate": 4.5468370990111006e-05,
+      "loss": 0.4436,
+      "step": 145
+    },
+    {
+      "epoch": 1.4287454323995128,
+      "grad_norm": 0.5537294745445251,
+      "learning_rate": 4.477357683661734e-05,
+      "loss": 0.3795,
+      "step": 146
+    },
+    {
+      "epoch": 1.438489646772229,
+      "grad_norm": 0.5477214455604553,
+      "learning_rate": 4.407980158467495e-05,
+      "loss": 0.3896,
+      "step": 147
+    },
+    {
+      "epoch": 1.4482338611449452,
+      "grad_norm": 0.5110722780227661,
+      "learning_rate": 4.3387180487143876e-05,
+      "loss": 0.4036,
+      "step": 148
+    },
+    {
+      "epoch": 1.4579780755176615,
+      "grad_norm": 0.5480209589004517,
+      "learning_rate": 4.269584857187943e-05,
+      "loss": 0.4451,
+      "step": 149
+    },
+    {
+      "epoch": 1.4677222898903777,
+      "grad_norm": 0.5255818367004395,
+      "learning_rate": 4.2005940615408264e-05,
+      "loss": 0.4031,
+      "step": 150
+    },
+    {
+      "epoch": 1.4677222898903777,
+      "eval_loss": 0.4808570146560669,
+      "eval_runtime": 116.3103,
+      "eval_samples_per_second": 7.368,
+      "eval_steps_per_second": 0.464,
+      "step": 150
+    },
+    {
+      "epoch": 1.4774665042630937,
+      "grad_norm": 0.5485397577285767,
+      "learning_rate": 4.131759111665349e-05,
+      "loss": 0.462,
+      "step": 151
+    },
+    {
+      "epoch": 1.4872107186358101,
+      "grad_norm": 0.5463838577270508,
+      "learning_rate": 4.063093427071376e-05,
+      "loss": 0.4265,
+      "step": 152
+    },
+    {
+      "epoch": 1.4969549330085261,
+      "grad_norm": 0.5511963367462158,
+      "learning_rate": 3.9946103942701777e-05,
+      "loss": 0.3964,
+      "step": 153
+    },
+    {
+      "epoch": 1.5066991473812423,
+      "grad_norm": 0.5571511387825012,
+      "learning_rate": 3.926323364164684e-05,
+      "loss": 0.4642,
+      "step": 154
+    },
+    {
+      "epoch": 1.5164433617539586,
+      "grad_norm": 0.5894230604171753,
+      "learning_rate": 3.858245649446721e-05,
+      "loss": 0.4511,
+      "step": 155
+    },
+    {
+      "epoch": 1.5261875761266748,
+      "grad_norm": 0.5373761653900146,
+      "learning_rate": 3.790390522001662e-05,
+      "loss": 0.388,
+      "step": 156
+    },
+    {
+      "epoch": 1.535931790499391,
+      "grad_norm": 0.5737512707710266,
+      "learning_rate": 3.7227712103210486e-05,
+      "loss": 0.375,
+      "step": 157
+    },
+    {
+      "epoch": 1.5456760048721072,
+      "grad_norm": 0.5502772331237793,
+      "learning_rate": 3.655400896923672e-05,
+      "loss": 0.4433,
+      "step": 158
+    },
+    {
+      "epoch": 1.5554202192448234,
+      "grad_norm": 0.5434299111366272,
+      "learning_rate": 3.588292715785617e-05,
+      "loss": 0.4002,
+      "step": 159
+    },
+    {
+      "epoch": 1.5651644336175394,
+      "grad_norm": 0.5924922227859497,
+      "learning_rate": 3.5214597497797684e-05,
+      "loss": 0.4141,
+      "step": 160
+    },
+    {
+      "epoch": 1.5749086479902559,
+      "grad_norm": 0.6273884177207947,
+      "learning_rate": 3.4549150281252636e-05,
+      "loss": 0.4277,
+      "step": 161
+    },
+    {
+      "epoch": 1.5846528623629719,
+      "grad_norm": 0.578081488609314,
+      "learning_rate": 3.388671523847445e-05,
+      "loss": 0.3956,
+      "step": 162
+    },
+    {
+      "epoch": 1.5943970767356883,
+      "grad_norm": 0.5401508212089539,
+      "learning_rate": 3.322742151248725e-05,
+      "loss": 0.4305,
+      "step": 163
+    },
+    {
+      "epoch": 1.6041412911084043,
+      "grad_norm": 0.6144226789474487,
+      "learning_rate": 3.257139763390925e-05,
+      "loss": 0.4126,
+      "step": 164
+    },
+    {
+      "epoch": 1.6138855054811205,
+      "grad_norm": 0.5739960670471191,
+      "learning_rate": 3.1918771495895396e-05,
+      "loss": 0.404,
+      "step": 165
+    },
+    {
+      "epoch": 1.6236297198538368,
+      "grad_norm": 0.5783050060272217,
+      "learning_rate": 3.12696703292044e-05,
+      "loss": 0.4209,
+      "step": 166
+    },
+    {
+      "epoch": 1.633373934226553,
+      "grad_norm": 0.5928875207901001,
+      "learning_rate": 3.062422067739485e-05,
+      "loss": 0.4317,
+      "step": 167
+    },
+    {
+      "epoch": 1.6431181485992692,
+      "grad_norm": 0.5249680876731873,
+      "learning_rate": 2.9982548372155263e-05,
+      "loss": 0.3964,
+      "step": 168
+    },
+    {
+      "epoch": 1.6528623629719854,
+      "grad_norm": 0.5612180233001709,
+      "learning_rate": 2.934477850877292e-05,
+      "loss": 0.3919,
+      "step": 169
+    },
+    {
+      "epoch": 1.6626065773447016,
+      "grad_norm": 0.5700953006744385,
+      "learning_rate": 2.8711035421746367e-05,
+      "loss": 0.4403,
+      "step": 170
+    },
+    {
+      "epoch": 1.6723507917174176,
+      "grad_norm": 0.5822266936302185,
+      "learning_rate": 2.8081442660546125e-05,
+      "loss": 0.4265,
+      "step": 171
+    },
+    {
+      "epoch": 1.682095006090134,
+      "grad_norm": 0.5738089680671692,
+      "learning_rate": 2.7456122965528475e-05,
+      "loss": 0.4612,
+      "step": 172
+    },
+    {
+      "epoch": 1.69183922046285,
+      "grad_norm": 0.5751779079437256,
+      "learning_rate": 2.6835198244006927e-05,
+      "loss": 0.3983,
+      "step": 173
+    },
+    {
+      "epoch": 1.7015834348355665,
+      "grad_norm": 0.5598529577255249,
+      "learning_rate": 2.6218789546486234e-05,
+      "loss": 0.4338,
+      "step": 174
+    },
+    {
+      "epoch": 1.7113276492082825,
+      "grad_norm": 0.5587442517280579,
+      "learning_rate": 2.560701704306336e-05,
+      "loss": 0.3825,
+      "step": 175
+    },
+    {
+      "epoch": 1.7113276492082825,
+      "eval_loss": 0.47023555636405945,
+      "eval_runtime": 116.2392,
+      "eval_samples_per_second": 7.373,
+      "eval_steps_per_second": 0.465,
+      "step": 175
+    },
+    {
+      "epoch": 1.7210718635809987,
+      "grad_norm": 0.5803806185722351,
+      "learning_rate": 2.500000000000001e-05,
+      "loss": 0.4265,
+      "step": 176
+    },
+    {
+      "epoch": 1.730816077953715,
+      "grad_norm": 0.5986764430999756,
+      "learning_rate": 2.4397856756471432e-05,
+      "loss": 0.4299,
+      "step": 177
+    },
+    {
+      "epoch": 1.7405602923264312,
+      "grad_norm": 0.6137004494667053,
+      "learning_rate": 2.3800704701496053e-05,
+      "loss": 0.4355,
+      "step": 178
+    },
+    {
+      "epoch": 1.7503045066991474,
+      "grad_norm": 0.5777759552001953,
+      "learning_rate": 2.3208660251050158e-05,
+      "loss": 0.4235,
+      "step": 179
+    },
+    {
+      "epoch": 1.7600487210718636,
+      "grad_norm": 0.599251389503479,
+      "learning_rate": 2.2621838825372493e-05,
+      "loss": 0.4078,
+      "step": 180
+    },
+    {
+      "epoch": 1.7697929354445798,
+      "grad_norm": 0.5639720559120178,
+      "learning_rate": 2.2040354826462668e-05,
+      "loss": 0.4046,
+      "step": 181
+    },
+    {
+      "epoch": 1.7795371498172958,
+      "grad_norm": 0.5639522075653076,
+      "learning_rate": 2.1464321615778422e-05,
+      "loss": 0.433,
+      "step": 182
+    },
+    {
+      "epoch": 1.7892813641900123,
+      "grad_norm": 0.5366583466529846,
+      "learning_rate": 2.0893851492135537e-05,
+      "loss": 0.4318,
+      "step": 183
+    },
+    {
+      "epoch": 1.7990255785627283,
+      "grad_norm": 0.5910248160362244,
+      "learning_rate": 2.0329055669814934e-05,
+      "loss": 0.4184,
+      "step": 184
+    },
+    {
+      "epoch": 1.8087697929354447,
+      "grad_norm": 0.5742807388305664,
+      "learning_rate": 1.977004425688126e-05,
+      "loss": 0.4346,
+      "step": 185
+    },
+    {
+      "epoch": 1.8185140073081607,
+      "grad_norm": 0.5683897137641907,
+      "learning_rate": 1.9216926233717085e-05,
+      "loss": 0.4007,
+      "step": 186
+    },
+    {
+      "epoch": 1.828258221680877,
+      "grad_norm": 0.5249460339546204,
+      "learning_rate": 1.866980943177699e-05,
+      "loss": 0.4165,
+      "step": 187
+    },
+    {
+      "epoch": 1.8380024360535931,
+      "grad_norm": 0.5429449677467346,
+      "learning_rate": 1.8128800512565513e-05,
+      "loss": 0.378,
+      "step": 188
+    },
+    {
+      "epoch": 1.8477466504263094,
+      "grad_norm": 0.5251733660697937,
+      "learning_rate": 1.7594004946843456e-05,
+      "loss": 0.3824,
+      "step": 189
+    },
+    {
+      "epoch": 1.8574908647990256,
+      "grad_norm": 0.5763549208641052,
+      "learning_rate": 1.7065526994065973e-05,
+      "loss": 0.3788,
+      "step": 190
+    },
+    {
+      "epoch": 1.8672350791717418,
+      "grad_norm": 0.5946308970451355,
+      "learning_rate": 1.6543469682057106e-05,
+      "loss": 0.448,
+      "step": 191
+    },
+    {
+      "epoch": 1.876979293544458,
+      "grad_norm": 0.5707454085350037,
+      "learning_rate": 1.602793478692419e-05,
+      "loss": 0.3816,
+      "step": 192
+    },
+    {
+      "epoch": 1.886723507917174,
+      "grad_norm": 0.5635607838630676,
+      "learning_rate": 1.551902281321651e-05,
+      "loss": 0.3979,
+      "step": 193
+    },
+    {
+      "epoch": 1.8964677222898905,
+      "grad_norm": 1.6317293643951416,
+      "learning_rate": 1.5016832974331724e-05,
+      "loss": 0.3654,
+      "step": 194
+    },
+    {
+      "epoch": 1.9062119366626065,
+      "grad_norm": 0.5927464365959167,
+      "learning_rate": 1.4521463173173965e-05,
+      "loss": 0.4432,
+      "step": 195
+    },
+    {
+      "epoch": 1.915956151035323,
+      "grad_norm": 0.5671654343605042,
+      "learning_rate": 1.4033009983067452e-05,
+      "loss": 0.364,
+      "step": 196
+    },
+    {
+      "epoch": 1.925700365408039,
+      "grad_norm": 0.5950899124145508,
+      "learning_rate": 1.3551568628929434e-05,
+      "loss": 0.4442,
+      "step": 197
+    },
+    {
+      "epoch": 1.9354445797807551,
+      "grad_norm": 0.5787199139595032,
+      "learning_rate": 1.3077232968705805e-05,
+      "loss": 0.4042,
+      "step": 198
+    },
+    {
+      "epoch": 1.9451887941534713,
+      "grad_norm": 0.5602390766143799,
+      "learning_rate": 1.2610095475073414e-05,
+      "loss": 0.4252,
+      "step": 199
+    },
+    {
+      "epoch": 1.9549330085261876,
+      "grad_norm": 0.5912858843803406,
+      "learning_rate": 1.2150247217412186e-05,
+      "loss": 0.3944,
+      "step": 200
+    },
+    {
+      "epoch": 1.9549330085261876,
+      "eval_loss": 0.4625219404697418,
+      "eval_runtime": 116.3528,
+      "eval_samples_per_second": 7.366,
+      "eval_steps_per_second": 0.464,
+      "step": 200
+    },
+    {
+      "epoch": 1.9646772228989038,
+      "grad_norm": 0.5247693657875061,
+      "learning_rate": 1.1697777844051105e-05,
+      "loss": 0.397,
+      "step": 201
+    },
+    {
+      "epoch": 1.97442143727162,
+      "grad_norm": 0.5671912431716919,
+      "learning_rate": 1.1252775564791024e-05,
+      "loss": 0.4191,
+      "step": 202
+    },
+    {
+      "epoch": 1.9841656516443362,
+      "grad_norm": 0.5699170827865601,
+      "learning_rate": 1.0815327133708015e-05,
+      "loss": 0.4126,
+      "step": 203
+    },
+    {
+      "epoch": 1.9939098660170522,
+      "grad_norm": 0.5686872005462646,
+      "learning_rate": 1.0385517832240471e-05,
+      "loss": 0.3936,
+      "step": 204
+    },
+    {
+      "epoch": 2.009744214372716,
+      "grad_norm": 0.9932243824005127,
+      "learning_rate": 9.963431452563332e-06,
+      "loss": 0.8769,
+      "step": 205
+    },
+    {
+      "epoch": 2.0194884287454324,
+      "grad_norm": 0.5336227416992188,
+      "learning_rate": 9.549150281252633e-06,
+      "loss": 0.3756,
+      "step": 206
+    },
+    {
+      "epoch": 2.0292326431181484,
+      "grad_norm": 0.5651218891143799,
+      "learning_rate": 9.142755083243576e-06,
+      "loss": 0.4197,
+      "step": 207
+    },
+    {
+      "epoch": 2.038976857490865,
+      "grad_norm": 0.5759946703910828,
+      "learning_rate": 8.744325086085248e-06,
+      "loss": 0.4043,
+      "step": 208
+    },
+    {
+      "epoch": 2.048721071863581,
+      "grad_norm": 0.529643177986145,
+      "learning_rate": 8.353937964495029e-06,
+      "loss": 0.3806,
+      "step": 209
+    },
+    {
+      "epoch": 2.0584652862362973,
+      "grad_norm": 0.563081681728363,
+      "learning_rate": 7.971669825215788e-06,
+      "loss": 0.3838,
+      "step": 210
+    },
+    {
+      "epoch": 2.0682095006090133,
+      "grad_norm": 0.5327872037887573,
+      "learning_rate": 7.597595192178702e-06,
+      "loss": 0.3778,
+      "step": 211
+    },
+    {
+      "epoch": 2.0779537149817298,
+      "grad_norm": 0.5525795817375183,
+      "learning_rate": 7.2317869919746705e-06,
+      "loss": 0.4119,
+      "step": 212
+    },
+    {
+      "epoch": 2.0876979293544458,
+      "grad_norm": 0.5779188871383667,
+      "learning_rate": 6.874316539637127e-06,
+      "loss": 0.3804,
+      "step": 213
+    },
+    {
+      "epoch": 2.097442143727162,
+      "grad_norm": 0.5842592716217041,
+      "learning_rate": 6.52525352473905e-06,
+      "loss": 0.3932,
+      "step": 214
+    },
+    {
+      "epoch": 2.107186358099878,
+      "grad_norm": 0.5471872091293335,
+      "learning_rate": 6.184665997806832e-06,
+      "loss": 0.3658,
+      "step": 215
+    },
+    {
+      "epoch": 2.116930572472594,
+      "grad_norm": 0.5467835664749146,
+      "learning_rate": 5.852620357053651e-06,
+      "loss": 0.3683,
+      "step": 216
+    },
+    {
+      "epoch": 2.1266747868453106,
+      "grad_norm": 0.5607587099075317,
+      "learning_rate": 5.529181335435124e-06,
+      "loss": 0.3635,
+      "step": 217
+    },
+    {
+      "epoch": 2.1364190012180266,
+      "grad_norm": 0.5682641267776489,
+      "learning_rate": 5.214411988029355e-06,
+      "loss": 0.3929,
+      "step": 218
+    },
+    {
+      "epoch": 2.146163215590743,
+      "grad_norm": 0.5493900775909424,
+      "learning_rate": 4.908373679744316e-06,
+      "loss": 0.3579,
+      "step": 219
+    },
+    {
+      "epoch": 2.155907429963459,
+      "grad_norm": 0.5399561524391174,
+      "learning_rate": 4.611126073354571e-06,
+      "loss": 0.397,
+      "step": 220
+    },
+    {
+      "epoch": 2.1656516443361755,
+      "grad_norm": 0.566953182220459,
+      "learning_rate": 4.322727117869951e-06,
+      "loss": 0.3996,
+      "step": 221
+    },
+    {
+      "epoch": 2.1753958587088915,
+      "grad_norm": 0.5458848476409912,
+      "learning_rate": 4.043233037238281e-06,
+      "loss": 0.3797,
+      "step": 222
+    },
+    {
+      "epoch": 2.185140073081608,
+      "grad_norm": 0.5842291116714478,
+      "learning_rate": 3.772698319384349e-06,
+      "loss": 0.4177,
+      "step": 223
+    },
+    {
+      "epoch": 2.194884287454324,
+      "grad_norm": 0.5811557769775391,
+      "learning_rate": 3.511175705587433e-06,
+      "loss": 0.4057,
+      "step": 224
+    },
+    {
+      "epoch": 2.2046285018270404,
+      "grad_norm": 0.5538292527198792,
+      "learning_rate": 3.258716180199278e-06,
+      "loss": 0.3411,
+      "step": 225
+    },
+    {
+      "epoch": 2.2046285018270404,
+      "eval_loss": 0.461640328168869,
+      "eval_runtime": 116.2914,
+      "eval_samples_per_second": 7.369,
+      "eval_steps_per_second": 0.464,
+      "step": 225
+    },
+    {
+      "epoch": 2.2143727161997564,
+      "grad_norm": 0.5587625503540039,
+      "learning_rate": 3.0153689607045845e-06,
+      "loss": 0.3767,
+      "step": 226
+    },
+    {
+      "epoch": 2.2241169305724724,
+      "grad_norm": 0.6179119348526001,
+      "learning_rate": 2.7811814881259503e-06,
+      "loss": 0.3909,
+      "step": 227
+    },
+    {
+      "epoch": 2.233861144945189,
+      "grad_norm": 0.5846551060676575,
+      "learning_rate": 2.5561994177751737e-06,
+      "loss": 0.377,
+      "step": 228
+    },
+    {
+      "epoch": 2.243605359317905,
+      "grad_norm": 0.5826045274734497,
+      "learning_rate": 2.340466610352654e-06,
+      "loss": 0.3621,
+      "step": 229
+    },
+    {
+      "epoch": 2.2533495736906213,
+      "grad_norm": 0.5827783942222595,
+      "learning_rate": 2.134025123396638e-06,
+      "loss": 0.4011,
+      "step": 230
+    },
+    {
+      "epoch": 2.2630937880633373,
+      "grad_norm": 0.5747119188308716,
+      "learning_rate": 1.9369152030840556e-06,
+      "loss": 0.3517,
+      "step": 231
+    },
+    {
+      "epoch": 2.2728380024360537,
+      "grad_norm": 0.5735805630683899,
+      "learning_rate": 1.7491752763844293e-06,
+      "loss": 0.3749,
+      "step": 232
+    },
+    {
+      "epoch": 2.2825822168087697,
+      "grad_norm": 0.5682513117790222,
+      "learning_rate": 1.5708419435684462e-06,
+      "loss": 0.3629,
+      "step": 233
+    },
+    {
+      "epoch": 2.292326431181486,
+      "grad_norm": 0.587968111038208,
+      "learning_rate": 1.4019499710726913e-06,
+      "loss": 0.3971,
+      "step": 234
+    },
+    {
+      "epoch": 2.302070645554202,
+      "grad_norm": 0.5531240105628967,
+      "learning_rate": 1.2425322847218368e-06,
+      "loss": 0.3643,
+      "step": 235
+    },
+    {
+      "epoch": 2.311814859926918,
+      "grad_norm": 0.5963295698165894,
+      "learning_rate": 1.0926199633097157e-06,
+      "loss": 0.3678,
+      "step": 236
+    },
+    {
+      "epoch": 2.3215590742996346,
+      "grad_norm": 0.593429684638977,
+      "learning_rate": 9.522422325404235e-07,
+      "loss": 0.4407,
+      "step": 237
+    },
+    {
+      "epoch": 2.331303288672351,
+      "grad_norm": 0.5391296148300171,
+      "learning_rate": 8.214264593307098e-07,
+      "loss": 0.3228,
+      "step": 238
+    },
+    {
+      "epoch": 2.341047503045067,
+      "grad_norm": 0.5678541660308838,
+      "learning_rate": 7.001981464747565e-07,
+      "loss": 0.3825,
+      "step": 239
+    },
+    {
+      "epoch": 2.350791717417783,
+      "grad_norm": 0.5584573149681091,
+      "learning_rate": 5.885809276723608e-07,
+      "loss": 0.3306,
+      "step": 240
+    },
+    {
+      "epoch": 2.3605359317904995,
+      "grad_norm": 0.5642800331115723,
+      "learning_rate": 4.865965629214819e-07,
+      "loss": 0.368,
+      "step": 241
+    },
+    {
+      "epoch": 2.3702801461632155,
+      "grad_norm": 0.5758326053619385,
+      "learning_rate": 3.9426493427611177e-07,
+      "loss": 0.3755,
+      "step": 242
+    },
+    {
+      "epoch": 2.380024360535932,
+      "grad_norm": 0.5884226560592651,
+      "learning_rate": 3.1160404197018154e-07,
+      "loss": 0.389,
+      "step": 243
+    },
+    {
+      "epoch": 2.389768574908648,
+      "grad_norm": 0.5593277812004089,
+      "learning_rate": 2.386300009084408e-07,
+      "loss": 0.3565,
+      "step": 244
+    },
+    {
+      "epoch": 2.3995127892813644,
+      "grad_norm": 0.5782268643379211,
+      "learning_rate": 1.753570375247815e-07,
+      "loss": 0.3858,
+      "step": 245
+    },
+    {
+      "epoch": 2.4092570036540804,
+      "grad_norm": 0.5798349380493164,
+      "learning_rate": 1.2179748700879012e-07,
+      "loss": 0.3403,
+      "step": 246
+    },
+    {
+      "epoch": 2.4190012180267964,
+      "grad_norm": 0.596785843372345,
+      "learning_rate": 7.796179090094891e-08,
+      "loss": 0.3451,
+      "step": 247
+    },
+    {
+      "epoch": 2.428745432399513,
+      "grad_norm": 0.5822293162345886,
+      "learning_rate": 4.385849505708084e-08,
+      "loss": 0.3843,
+      "step": 248
+    },
+    {
+      "epoch": 2.4384896467722292,
+      "grad_norm": 0.5595471262931824,
+      "learning_rate": 1.949424798228239e-08,
+      "loss": 0.409,
+      "step": 249
+    },
+    {
+      "epoch": 2.4482338611449452,
+      "grad_norm": 0.5454703569412231,
+      "learning_rate": 4.873799534788059e-09,
+      "loss": 0.3588,
+      "step": 250
+    },
+    {
+      "epoch": 2.4482338611449452,
+      "eval_loss": 0.4610269367694855,
+      "eval_runtime": 116.2672,
+      "eval_samples_per_second": 7.371,
+      "eval_steps_per_second": 0.464,
+      "step": 250
+    },
+    {
+      "epoch": 2.4482338611449452,
+      "step": 250,
+      "total_flos": 2.3792355349217935e+18,
+      "train_loss": 0.49713707935810086,
+      "train_runtime": 9531.3935,
+      "train_samples_per_second": 2.518,
+      "train_steps_per_second": 0.026
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 250,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 3,
+  "save_steps": 50,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 2.3792355349217935e+18,
+  "train_batch_size": 3,
+  "trial_name": null,
+  "trial_params": null
+}

TextUI-Func-7B/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d36469e2996ad0c3d0d1b2842ae5cdcc53ba9c32c2656bf00d763c2ed75ffd28
+size 6161

TextUI-Trans-7B/README.md

@@ -0,0 +1,202 @@
+---
+base_model: /root/autodl-fs/Qwen2.5-7B-Instruct
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.15.1

TextUI-Trans-7B/adapter_config.json

@@ -0,0 +1,39 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "/root/autodl-fs/Qwen2.5-7B-Instruct",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "down_proj",
+    "up_proj",
+    "o_proj",
+    "q_proj",
+    "k_proj",
+    "v_proj",
+    "gate_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_rslora": false
+}

TextUI-Trans-7B/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:142327ece53e49d1a23f29308e93a0b5ab9c5c3f4e374ab7c941ce6c2640287d
+size 161533192

TextUI-Trans-7B/added_tokens.json

@@ -0,0 +1,24 @@
+{
+  "</tool_call>": 151658,
+  "<tool_call>": 151657,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}

TextUI-Trans-7B/special_tokens_map.json

@@ -0,0 +1,31 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

TextUI-Trans-7B/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
+size 11421896

TextUI-Trans-7B/tokenizer_config.json

@@ -0,0 +1,209 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151646": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151647": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151648": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151649": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151650": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151651": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151652": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151653": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151654": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151655": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151656": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151657": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151658": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151659": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151660": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151661": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151662": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151663": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151664": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "chat_template": "{%- if tools %}\n    {{- '<|im_start|>system\\n' }}\n    {%- if messages[0]['role'] == 'system' %}\n        {{- messages[0]['content'] }}\n    {%- else %}\n        {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}\n    {%- endif %}\n    {{- \"\\n\\n# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n    {%- for tool in tools %}\n        {{- \"\\n\" }}\n        {{- tool | tojson }}\n    {%- endfor %}\n    {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n    {%- if messages[0]['role'] == 'system' %}\n        {{- '<|im_start|>system\\n' + messages[0]['content'] + '<|im_end|>\\n' }}\n    {%- else %}\n        {{- '<|im_start|>system\\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\\n' }}\n    {%- endif %}\n{%- endif %}\n{%- for message in messages %}\n    {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) or (message.role == \"assistant\" and not message.tool_calls) %}\n        {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n    {%- elif message.role == \"assistant\" %}\n        {{- '<|im_start|>' + message.role }}\n        {%- if message.content %}\n            {{- '\\n' + message.content }}\n        {%- endif %}\n        {%- for tool_call in message.tool_calls %}\n            {%- if tool_call.function is defined %}\n                {%- set tool_call = tool_call.function %}\n            {%- endif %}\n            {{- '\\n<tool_call>\\n{\"name\": \"' }}\n            {{- tool_call.name }}\n            {{- '\", \"arguments\": ' }}\n            {{- tool_call.arguments | tojson }}\n            {{- '}\\n</tool_call>' }}\n        {%- endfor %}\n        {{- '<|im_end|>\\n' }}\n    {%- elif message.role == \"tool\" %}\n        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != \"tool\") %}\n            {{- '<|im_start|>user' }}\n        {%- endif %}\n        {{- '\\n<tool_response>\\n' }}\n        {{- message.content }}\n        {{- '\\n</tool_response>' }}\n        {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n            {{- '<|im_end|>\\n' }}\n        {%- endif %}\n    {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n    {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "padding_side": "right",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

TextUI-Trans-7B/trainer_log.jsonl

@@ -0,0 +1,169 @@
+{"current_steps": 1, "total_steps": 300, "loss": 1.5618, "lr": 0.0, "epoch": 0.008537886872998933, "percentage": 0.33, "elapsed_time": "0:00:31", "remaining_time": "2:34:39"}
+{"current_steps": 2, "total_steps": 300, "loss": 1.5366, "lr": 3.3333333333333333e-06, "epoch": 0.017075773745997867, "percentage": 0.67, "elapsed_time": "0:01:02", "remaining_time": "2:36:15"}
+{"current_steps": 3, "total_steps": 300, "loss": 1.5274, "lr": 6.666666666666667e-06, "epoch": 0.025613660618996798, "percentage": 1.0, "elapsed_time": "0:01:31", "remaining_time": "2:31:07"}
+{"current_steps": 4, "total_steps": 300, "loss": 1.3764, "lr": 1e-05, "epoch": 0.03415154749199573, "percentage": 1.33, "elapsed_time": "0:02:03", "remaining_time": "2:31:47"}
+{"current_steps": 5, "total_steps": 300, "loss": 1.3908, "lr": 1.3333333333333333e-05, "epoch": 0.042689434364994665, "percentage": 1.67, "elapsed_time": "0:02:39", "remaining_time": "2:36:29"}
+{"current_steps": 6, "total_steps": 300, "loss": 1.3127, "lr": 1.6666666666666667e-05, "epoch": 0.051227321237993596, "percentage": 2.0, "elapsed_time": "0:03:08", "remaining_time": "2:33:53"}
+{"current_steps": 7, "total_steps": 300, "loss": 1.2693, "lr": 2e-05, "epoch": 0.05976520811099253, "percentage": 2.33, "elapsed_time": "0:03:43", "remaining_time": "2:35:58"}
+{"current_steps": 8, "total_steps": 300, "loss": 1.3037, "lr": 2.3333333333333336e-05, "epoch": 0.06830309498399147, "percentage": 2.67, "elapsed_time": "0:04:09", "remaining_time": "2:31:40"}
+{"current_steps": 9, "total_steps": 300, "loss": 1.1871, "lr": 2.6666666666666667e-05, "epoch": 0.0768409818569904, "percentage": 3.0, "elapsed_time": "0:04:35", "remaining_time": "2:28:32"}
+{"current_steps": 10, "total_steps": 300, "loss": 1.15, "lr": 3e-05, "epoch": 0.08537886872998933, "percentage": 3.33, "elapsed_time": "0:05:06", "remaining_time": "2:27:58"}
+{"current_steps": 11, "total_steps": 300, "loss": 1.2154, "lr": 3.3333333333333335e-05, "epoch": 0.09391675560298826, "percentage": 3.67, "elapsed_time": "0:05:40", "remaining_time": "2:29:08"}
+{"current_steps": 12, "total_steps": 300, "loss": 1.1687, "lr": 3.6666666666666666e-05, "epoch": 0.10245464247598719, "percentage": 4.0, "elapsed_time": "0:06:08", "remaining_time": "2:27:16"}
+{"current_steps": 13, "total_steps": 300, "loss": 1.2469, "lr": 4e-05, "epoch": 0.11099252934898612, "percentage": 4.33, "elapsed_time": "0:06:39", "remaining_time": "2:27:01"}
+{"current_steps": 14, "total_steps": 300, "loss": 1.0827, "lr": 4.3333333333333334e-05, "epoch": 0.11953041622198506, "percentage": 4.67, "elapsed_time": "0:07:09", "remaining_time": "2:26:07"}
+{"current_steps": 15, "total_steps": 300, "loss": 1.188, "lr": 4.666666666666667e-05, "epoch": 0.128068303094984, "percentage": 5.0, "elapsed_time": "0:07:42", "remaining_time": "2:26:35"}
+{"current_steps": 16, "total_steps": 300, "loss": 1.1076, "lr": 5e-05, "epoch": 0.13660618996798293, "percentage": 5.33, "elapsed_time": "0:08:23", "remaining_time": "2:28:50"}
+{"current_steps": 17, "total_steps": 300, "loss": 1.047, "lr": 5.333333333333333e-05, "epoch": 0.14514407684098185, "percentage": 5.67, "elapsed_time": "0:09:01", "remaining_time": "2:30:18"}
+{"current_steps": 18, "total_steps": 300, "loss": 1.0498, "lr": 5.666666666666667e-05, "epoch": 0.1536819637139808, "percentage": 6.0, "elapsed_time": "0:09:43", "remaining_time": "2:32:19"}
+{"current_steps": 19, "total_steps": 300, "loss": 1.0226, "lr": 6e-05, "epoch": 0.1622198505869797, "percentage": 6.33, "elapsed_time": "0:10:10", "remaining_time": "2:30:23"}
+{"current_steps": 20, "total_steps": 300, "loss": 1.0192, "lr": 6.333333333333333e-05, "epoch": 0.17075773745997866, "percentage": 6.67, "elapsed_time": "0:10:40", "remaining_time": "2:29:23"}
+{"current_steps": 21, "total_steps": 300, "loss": 1.0255, "lr": 6.666666666666667e-05, "epoch": 0.17929562433297758, "percentage": 7.0, "elapsed_time": "0:11:20", "remaining_time": "2:30:39"}
+{"current_steps": 22, "total_steps": 300, "loss": 1.0127, "lr": 7e-05, "epoch": 0.18783351120597652, "percentage": 7.33, "elapsed_time": "0:11:47", "remaining_time": "2:29:04"}
+{"current_steps": 23, "total_steps": 300, "loss": 1.0648, "lr": 7.333333333333333e-05, "epoch": 0.19637139807897544, "percentage": 7.67, "elapsed_time": "0:12:18", "remaining_time": "2:28:11"}
+{"current_steps": 24, "total_steps": 300, "loss": 0.9899, "lr": 7.666666666666667e-05, "epoch": 0.20490928495197439, "percentage": 8.0, "elapsed_time": "0:12:49", "remaining_time": "2:27:34"}
+{"current_steps": 25, "total_steps": 300, "loss": 0.9888, "lr": 8e-05, "epoch": 0.21344717182497333, "percentage": 8.33, "elapsed_time": "0:13:24", "remaining_time": "2:27:26"}
+{"current_steps": 25, "total_steps": 300, "eval_loss": 0.9922655820846558, "epoch": 0.21344717182497333, "percentage": 8.33, "elapsed_time": "0:15:30", "remaining_time": "2:50:36"}
+{"current_steps": 26, "total_steps": 300, "loss": 0.9876, "lr": 8.333333333333334e-05, "epoch": 0.22198505869797225, "percentage": 8.67, "elapsed_time": "0:16:06", "remaining_time": "2:49:44"}
+{"current_steps": 27, "total_steps": 300, "loss": 0.9778, "lr": 8.666666666666667e-05, "epoch": 0.2305229455709712, "percentage": 9.0, "elapsed_time": "0:16:41", "remaining_time": "2:48:44"}
+{"current_steps": 28, "total_steps": 300, "loss": 0.9561, "lr": 9e-05, "epoch": 0.2390608324439701, "percentage": 9.33, "elapsed_time": "0:17:13", "remaining_time": "2:47:19"}
+{"current_steps": 29, "total_steps": 300, "loss": 0.9958, "lr": 9.333333333333334e-05, "epoch": 0.24759871931696906, "percentage": 9.67, "elapsed_time": "0:17:40", "remaining_time": "2:45:08"}
+{"current_steps": 30, "total_steps": 300, "loss": 1.0282, "lr": 9.666666666666667e-05, "epoch": 0.256136606189968, "percentage": 10.0, "elapsed_time": "0:18:13", "remaining_time": "2:44:03"}
+{"current_steps": 31, "total_steps": 300, "loss": 0.9626, "lr": 0.0001, "epoch": 0.2646744930629669, "percentage": 10.33, "elapsed_time": "0:18:40", "remaining_time": "2:42:02"}
+{"current_steps": 32, "total_steps": 300, "loss": 1.0061, "lr": 9.999661540018812e-05, "epoch": 0.27321237993596587, "percentage": 10.67, "elapsed_time": "0:19:05", "remaining_time": "2:39:50"}
+{"current_steps": 33, "total_steps": 300, "loss": 0.9061, "lr": 9.998646205897309e-05, "epoch": 0.28175026680896476, "percentage": 11.0, "elapsed_time": "0:19:56", "remaining_time": "2:41:24"}
+{"current_steps": 34, "total_steps": 300, "loss": 0.9743, "lr": 9.99695413509548e-05, "epoch": 0.2902881536819637, "percentage": 11.33, "elapsed_time": "0:20:27", "remaining_time": "2:40:06"}
+{"current_steps": 35, "total_steps": 300, "loss": 0.9536, "lr": 9.994585556692624e-05, "epoch": 0.29882604055496265, "percentage": 11.67, "elapsed_time": "0:21:02", "remaining_time": "2:39:18"}
+{"current_steps": 36, "total_steps": 300, "loss": 0.998, "lr": 9.991540791356342e-05, "epoch": 0.3073639274279616, "percentage": 12.0, "elapsed_time": "0:21:33", "remaining_time": "2:38:08"}
+{"current_steps": 37, "total_steps": 300, "loss": 1.0049, "lr": 9.987820251299122e-05, "epoch": 0.31590181430096054, "percentage": 12.33, "elapsed_time": "0:22:00", "remaining_time": "2:36:26"}
+{"current_steps": 38, "total_steps": 300, "loss": 0.9955, "lr": 9.983424440222531e-05, "epoch": 0.3244397011739594, "percentage": 12.67, "elapsed_time": "0:22:30", "remaining_time": "2:35:13"}
+{"current_steps": 39, "total_steps": 300, "loss": 0.9684, "lr": 9.978353953249022e-05, "epoch": 0.3329775880469584, "percentage": 13.0, "elapsed_time": "0:23:00", "remaining_time": "2:34:00"}
+{"current_steps": 40, "total_steps": 300, "loss": 1.0183, "lr": 9.972609476841367e-05, "epoch": 0.3415154749199573, "percentage": 13.33, "elapsed_time": "0:23:32", "remaining_time": "2:33:01"}
+{"current_steps": 41, "total_steps": 300, "loss": 0.9516, "lr": 9.966191788709716e-05, "epoch": 0.35005336179295626, "percentage": 13.67, "elapsed_time": "0:24:01", "remaining_time": "2:31:46"}
+{"current_steps": 42, "total_steps": 300, "loss": 0.9607, "lr": 9.959101757706308e-05, "epoch": 0.35859124866595515, "percentage": 14.0, "elapsed_time": "0:24:32", "remaining_time": "2:30:46"}
+{"current_steps": 43, "total_steps": 300, "loss": 0.9116, "lr": 9.951340343707852e-05, "epoch": 0.3671291355389541, "percentage": 14.33, "elapsed_time": "0:25:04", "remaining_time": "2:29:51"}
+{"current_steps": 44, "total_steps": 300, "loss": 1.0001, "lr": 9.942908597485558e-05, "epoch": 0.37566702241195304, "percentage": 14.67, "elapsed_time": "0:25:39", "remaining_time": "2:29:14"}
+{"current_steps": 45, "total_steps": 300, "loss": 0.9237, "lr": 9.933807660562898e-05, "epoch": 0.384204909284952, "percentage": 15.0, "elapsed_time": "0:26:10", "remaining_time": "2:28:21"}
+{"current_steps": 46, "total_steps": 300, "loss": 0.9682, "lr": 9.924038765061042e-05, "epoch": 0.3927427961579509, "percentage": 15.33, "elapsed_time": "0:26:45", "remaining_time": "2:27:46"}
+{"current_steps": 47, "total_steps": 300, "loss": 0.9255, "lr": 9.913603233532067e-05, "epoch": 0.4012806830309498, "percentage": 15.67, "elapsed_time": "0:27:15", "remaining_time": "2:26:45"}
+{"current_steps": 48, "total_steps": 300, "loss": 0.8936, "lr": 9.902502478779896e-05, "epoch": 0.40981856990394877, "percentage": 16.0, "elapsed_time": "0:27:45", "remaining_time": "2:25:42"}
+{"current_steps": 49, "total_steps": 300, "loss": 0.953, "lr": 9.890738003669029e-05, "epoch": 0.4183564567769477, "percentage": 16.33, "elapsed_time": "0:28:20", "remaining_time": "2:25:08"}
+{"current_steps": 50, "total_steps": 300, "loss": 0.9401, "lr": 9.878311400921072e-05, "epoch": 0.42689434364994666, "percentage": 16.67, "elapsed_time": "0:28:48", "remaining_time": "2:24:02"}
+{"current_steps": 50, "total_steps": 300, "eval_loss": 0.9200984835624695, "epoch": 0.42689434364994666, "percentage": 16.67, "elapsed_time": "0:30:54", "remaining_time": "2:34:34"}
+{"current_steps": 51, "total_steps": 300, "loss": 0.8947, "lr": 9.865224352899119e-05, "epoch": 0.43543223052294555, "percentage": 17.0, "elapsed_time": "0:31:24", "remaining_time": "2:33:21"}
+{"current_steps": 52, "total_steps": 300, "loss": 0.9038, "lr": 9.851478631379982e-05, "epoch": 0.4439701173959445, "percentage": 17.33, "elapsed_time": "0:31:58", "remaining_time": "2:32:30"}
+{"current_steps": 53, "total_steps": 300, "loss": 0.9348, "lr": 9.837076097314319e-05, "epoch": 0.45250800426894344, "percentage": 17.67, "elapsed_time": "0:32:31", "remaining_time": "2:31:32"}
+{"current_steps": 54, "total_steps": 300, "loss": 0.9275, "lr": 9.822018700574695e-05, "epoch": 0.4610458911419424, "percentage": 18.0, "elapsed_time": "0:33:07", "remaining_time": "2:30:52"}
+{"current_steps": 55, "total_steps": 300, "loss": 0.928, "lr": 9.806308479691595e-05, "epoch": 0.4695837780149413, "percentage": 18.33, "elapsed_time": "0:33:42", "remaining_time": "2:30:07"}
+{"current_steps": 56, "total_steps": 300, "loss": 0.9702, "lr": 9.789947561577445e-05, "epoch": 0.4781216648879402, "percentage": 18.67, "elapsed_time": "0:34:14", "remaining_time": "2:29:13"}
+{"current_steps": 57, "total_steps": 300, "loss": 0.9534, "lr": 9.77293816123866e-05, "epoch": 0.48665955176093917, "percentage": 19.0, "elapsed_time": "0:34:51", "remaining_time": "2:28:37"}
+{"current_steps": 58, "total_steps": 300, "loss": 0.9474, "lr": 9.755282581475769e-05, "epoch": 0.4951974386339381, "percentage": 19.33, "elapsed_time": "0:35:25", "remaining_time": "2:27:50"}
+{"current_steps": 59, "total_steps": 300, "loss": 0.8856, "lr": 9.736983212571646e-05, "epoch": 0.503735325506937, "percentage": 19.67, "elapsed_time": "0:35:54", "remaining_time": "2:26:40"}
+{"current_steps": 60, "total_steps": 300, "loss": 0.946, "lr": 9.718042531967918e-05, "epoch": 0.512273212379936, "percentage": 20.0, "elapsed_time": "0:36:22", "remaining_time": "2:25:29"}
+{"current_steps": 61, "total_steps": 300, "loss": 0.9204, "lr": 9.698463103929542e-05, "epoch": 0.5208110992529349, "percentage": 20.33, "elapsed_time": "0:36:56", "remaining_time": "2:24:42"}
+{"current_steps": 62, "total_steps": 300, "loss": 0.9127, "lr": 9.678247579197657e-05, "epoch": 0.5293489861259338, "percentage": 20.67, "elapsed_time": "0:37:26", "remaining_time": "2:23:45"}
+{"current_steps": 63, "total_steps": 300, "loss": 0.8976, "lr": 9.657398694630712e-05, "epoch": 0.5378868729989328, "percentage": 21.0, "elapsed_time": "0:37:58", "remaining_time": "2:22:51"}
+{"current_steps": 64, "total_steps": 300, "loss": 0.8394, "lr": 9.635919272833938e-05, "epoch": 0.5464247598719317, "percentage": 21.33, "elapsed_time": "0:38:32", "remaining_time": "2:22:08"}
+{"current_steps": 65, "total_steps": 300, "loss": 0.9153, "lr": 9.613812221777212e-05, "epoch": 0.5549626467449307, "percentage": 21.67, "elapsed_time": "0:39:00", "remaining_time": "2:21:02"}
+{"current_steps": 66, "total_steps": 300, "loss": 0.9224, "lr": 9.591080534401371e-05, "epoch": 0.5635005336179295, "percentage": 22.0, "elapsed_time": "0:39:27", "remaining_time": "2:19:53"}
+{"current_steps": 67, "total_steps": 300, "loss": 0.9281, "lr": 9.567727288213005e-05, "epoch": 0.5720384204909285, "percentage": 22.33, "elapsed_time": "0:40:02", "remaining_time": "2:19:13"}
+{"current_steps": 68, "total_steps": 300, "loss": 0.8459, "lr": 9.543755644867822e-05, "epoch": 0.5805763073639274, "percentage": 22.67, "elapsed_time": "0:40:28", "remaining_time": "2:18:04"}
+{"current_steps": 69, "total_steps": 300, "loss": 0.9076, "lr": 9.519168849742604e-05, "epoch": 0.5891141942369263, "percentage": 23.0, "elapsed_time": "0:41:02", "remaining_time": "2:17:23"}
+{"current_steps": 70, "total_steps": 300, "loss": 0.9292, "lr": 9.493970231495835e-05, "epoch": 0.5976520811099253, "percentage": 23.33, "elapsed_time": "0:41:36", "remaining_time": "2:16:41"}
+{"current_steps": 71, "total_steps": 300, "loss": 0.7814, "lr": 9.468163201617062e-05, "epoch": 0.6061899679829242, "percentage": 23.67, "elapsed_time": "0:42:11", "remaining_time": "2:16:03"}
+{"current_steps": 72, "total_steps": 300, "loss": 0.8878, "lr": 9.441751253965021e-05, "epoch": 0.6147278548559232, "percentage": 24.0, "elapsed_time": "0:42:45", "remaining_time": "2:15:24"}
+{"current_steps": 73, "total_steps": 300, "loss": 0.9064, "lr": 9.414737964294636e-05, "epoch": 0.6232657417289221, "percentage": 24.33, "elapsed_time": "0:43:22", "remaining_time": "2:14:52"}
+{"current_steps": 74, "total_steps": 300, "loss": 0.9185, "lr": 9.38712698977291e-05, "epoch": 0.6318036286019211, "percentage": 24.67, "elapsed_time": "0:43:56", "remaining_time": "2:14:10"}
+{"current_steps": 75, "total_steps": 300, "loss": 0.9435, "lr": 9.358922068483812e-05, "epoch": 0.6403415154749199, "percentage": 25.0, "elapsed_time": "0:44:25", "remaining_time": "2:13:17"}
+{"current_steps": 75, "total_steps": 300, "eval_loss": 0.8910433650016785, "epoch": 0.6403415154749199, "percentage": 25.0, "elapsed_time": "0:46:32", "remaining_time": "2:19:36"}
+{"current_steps": 76, "total_steps": 300, "loss": 0.91, "lr": 9.330127018922194e-05, "epoch": 0.6488794023479189, "percentage": 25.33, "elapsed_time": "0:47:09", "remaining_time": "2:18:58"}
+{"current_steps": 77, "total_steps": 300, "loss": 0.9656, "lr": 9.300745739476829e-05, "epoch": 0.6574172892209178, "percentage": 25.67, "elapsed_time": "0:47:39", "remaining_time": "2:18:02"}
+{"current_steps": 78, "total_steps": 300, "loss": 0.9734, "lr": 9.270782207902629e-05, "epoch": 0.6659551760939167, "percentage": 26.0, "elapsed_time": "0:48:11", "remaining_time": "2:17:09"}
+{"current_steps": 79, "total_steps": 300, "loss": 0.9102, "lr": 9.24024048078213e-05, "epoch": 0.6744930629669157, "percentage": 26.33, "elapsed_time": "0:48:48", "remaining_time": "2:16:33"}
+{"current_steps": 80, "total_steps": 300, "loss": 0.9166, "lr": 9.209124692976287e-05, "epoch": 0.6830309498399146, "percentage": 26.67, "elapsed_time": "0:49:21", "remaining_time": "2:15:43"}
+{"current_steps": 81, "total_steps": 300, "loss": 0.8672, "lr": 9.177439057064683e-05, "epoch": 0.6915688367129136, "percentage": 27.0, "elapsed_time": "0:49:53", "remaining_time": "2:14:53"}
+{"current_steps": 82, "total_steps": 300, "loss": 0.8953, "lr": 9.145187862775209e-05, "epoch": 0.7001067235859125, "percentage": 27.33, "elapsed_time": "0:50:24", "remaining_time": "2:14:01"}
+{"current_steps": 83, "total_steps": 300, "loss": 0.914, "lr": 9.112375476403312e-05, "epoch": 0.7086446104589115, "percentage": 27.67, "elapsed_time": "0:50:52", "remaining_time": "2:13:01"}
+{"current_steps": 84, "total_steps": 300, "loss": 0.8936, "lr": 9.079006340220862e-05, "epoch": 0.7171824973319103, "percentage": 28.0, "elapsed_time": "0:51:29", "remaining_time": "2:12:23"}
+{"current_steps": 85, "total_steps": 300, "loss": 0.9096, "lr": 9.045084971874738e-05, "epoch": 0.7257203842049093, "percentage": 28.33, "elapsed_time": "0:52:07", "remaining_time": "2:11:49"}
+{"current_steps": 86, "total_steps": 300, "loss": 0.957, "lr": 9.01061596377522e-05, "epoch": 0.7342582710779082, "percentage": 28.67, "elapsed_time": "0:52:35", "remaining_time": "2:10:52"}
+{"current_steps": 87, "total_steps": 300, "loss": 0.8853, "lr": 8.97560398247424e-05, "epoch": 0.7427961579509071, "percentage": 29.0, "elapsed_time": "0:53:07", "remaining_time": "2:10:04"}
+{"current_steps": 88, "total_steps": 300, "loss": 0.907, "lr": 8.940053768033609e-05, "epoch": 0.7513340448239061, "percentage": 29.33, "elapsed_time": "0:53:38", "remaining_time": "2:09:13"}
+{"current_steps": 89, "total_steps": 300, "loss": 0.8719, "lr": 8.903970133383297e-05, "epoch": 0.759871931696905, "percentage": 29.67, "elapsed_time": "0:54:10", "remaining_time": "2:08:25"}
+{"current_steps": 90, "total_steps": 300, "loss": 0.9782, "lr": 8.86735796366982e-05, "epoch": 0.768409818569904, "percentage": 30.0, "elapsed_time": "0:54:44", "remaining_time": "2:07:43"}
+{"current_steps": 91, "total_steps": 300, "loss": 0.9225, "lr": 8.83022221559489e-05, "epoch": 0.7769477054429029, "percentage": 30.33, "elapsed_time": "0:55:17", "remaining_time": "2:06:58"}
+{"current_steps": 92, "total_steps": 300, "loss": 0.9045, "lr": 8.792567916744346e-05, "epoch": 0.7854855923159018, "percentage": 30.67, "elapsed_time": "0:55:52", "remaining_time": "2:06:19"}
+{"current_steps": 93, "total_steps": 300, "loss": 0.9335, "lr": 8.754400164907497e-05, "epoch": 0.7940234791889007, "percentage": 31.0, "elapsed_time": "0:56:31", "remaining_time": "2:05:48"}
+{"current_steps": 94, "total_steps": 300, "loss": 0.9086, "lr": 8.715724127386972e-05, "epoch": 0.8025613660618997, "percentage": 31.33, "elapsed_time": "0:56:56", "remaining_time": "2:04:47"}
+{"current_steps": 95, "total_steps": 300, "loss": 0.9079, "lr": 8.676545040299145e-05, "epoch": 0.8110992529348986, "percentage": 31.67, "elapsed_time": "0:57:23", "remaining_time": "2:03:51"}
+{"current_steps": 96, "total_steps": 300, "loss": 0.9059, "lr": 8.636868207865244e-05, "epoch": 0.8196371398078975, "percentage": 32.0, "elapsed_time": "0:57:53", "remaining_time": "2:03:00"}
+{"current_steps": 97, "total_steps": 300, "loss": 0.847, "lr": 8.596699001693255e-05, "epoch": 0.8281750266808965, "percentage": 32.33, "elapsed_time": "0:58:24", "remaining_time": "2:02:15"}
+{"current_steps": 98, "total_steps": 300, "loss": 0.911, "lr": 8.556042860050687e-05, "epoch": 0.8367129135538954, "percentage": 32.67, "elapsed_time": "0:58:55", "remaining_time": "2:01:28"}
+{"current_steps": 99, "total_steps": 300, "loss": 0.8864, "lr": 8.51490528712831e-05, "epoch": 0.8452508004268944, "percentage": 33.0, "elapsed_time": "0:59:26", "remaining_time": "2:00:41"}
+{"current_steps": 100, "total_steps": 300, "loss": 0.8479, "lr": 8.473291852294987e-05, "epoch": 0.8537886872998933, "percentage": 33.33, "elapsed_time": "0:59:56", "remaining_time": "1:59:52"}
+{"current_steps": 100, "total_steps": 300, "eval_loss": 0.8699346780776978, "epoch": 0.8537886872998933, "percentage": 33.33, "elapsed_time": "1:02:02", "remaining_time": "2:04:04"}
+{"current_steps": 101, "total_steps": 300, "loss": 0.92, "lr": 8.43120818934367e-05, "epoch": 0.8623265741728922, "percentage": 33.67, "elapsed_time": "1:02:30", "remaining_time": "2:03:10"}
+{"current_steps": 102, "total_steps": 300, "loss": 0.8551, "lr": 8.388659995728663e-05, "epoch": 0.8708644610458911, "percentage": 34.0, "elapsed_time": "1:03:05", "remaining_time": "2:02:28"}
+{"current_steps": 103, "total_steps": 300, "loss": 0.9024, "lr": 8.345653031794292e-05, "epoch": 0.87940234791889, "percentage": 34.33, "elapsed_time": "1:03:36", "remaining_time": "2:01:39"}
+{"current_steps": 104, "total_steps": 300, "loss": 0.9081, "lr": 8.302193119995039e-05, "epoch": 0.887940234791889, "percentage": 34.67, "elapsed_time": "1:04:06", "remaining_time": "2:00:49"}
+{"current_steps": 105, "total_steps": 300, "loss": 0.9215, "lr": 8.258286144107276e-05, "epoch": 0.8964781216648879, "percentage": 35.0, "elapsed_time": "1:04:34", "remaining_time": "1:59:55"}
+{"current_steps": 106, "total_steps": 300, "loss": 0.886, "lr": 8.213938048432697e-05, "epoch": 0.9050160085378869, "percentage": 35.33, "elapsed_time": "1:05:05", "remaining_time": "1:59:08"}
+{"current_steps": 107, "total_steps": 300, "loss": 0.8436, "lr": 8.169154836993551e-05, "epoch": 0.9135538954108858, "percentage": 35.67, "elapsed_time": "1:05:35", "remaining_time": "1:58:18"}
+{"current_steps": 108, "total_steps": 300, "loss": 0.8181, "lr": 8.1239425727198e-05, "epoch": 0.9220917822838848, "percentage": 36.0, "elapsed_time": "1:06:05", "remaining_time": "1:57:29"}
+{"current_steps": 109, "total_steps": 300, "loss": 0.8687, "lr": 8.07830737662829e-05, "epoch": 0.9306296691568837, "percentage": 36.33, "elapsed_time": "1:06:29", "remaining_time": "1:56:31"}
+{"current_steps": 110, "total_steps": 300, "loss": 0.8341, "lr": 8.032255426994069e-05, "epoch": 0.9391675560298826, "percentage": 36.67, "elapsed_time": "1:06:58", "remaining_time": "1:55:40"}
+{"current_steps": 111, "total_steps": 300, "loss": 0.9307, "lr": 7.985792958513931e-05, "epoch": 0.9477054429028815, "percentage": 37.0, "elapsed_time": "1:07:26", "remaining_time": "1:54:49"}
+{"current_steps": 112, "total_steps": 300, "loss": 0.8765, "lr": 7.938926261462366e-05, "epoch": 0.9562433297758804, "percentage": 37.33, "elapsed_time": "1:07:56", "remaining_time": "1:54:03"}
+{"current_steps": 113, "total_steps": 300, "loss": 0.8956, "lr": 7.891661680839932e-05, "epoch": 0.9647812166488794, "percentage": 37.67, "elapsed_time": "1:08:32", "remaining_time": "1:53:25"}
+{"current_steps": 114, "total_steps": 300, "loss": 0.8607, "lr": 7.844005615514259e-05, "epoch": 0.9733191035218783, "percentage": 38.0, "elapsed_time": "1:09:00", "remaining_time": "1:52:35"}
+{"current_steps": 115, "total_steps": 300, "loss": 0.8357, "lr": 7.795964517353735e-05, "epoch": 0.9818569903948773, "percentage": 38.33, "elapsed_time": "1:09:31", "remaining_time": "1:51:51"}
+{"current_steps": 116, "total_steps": 300, "loss": 0.9093, "lr": 7.74754489035403e-05, "epoch": 0.9903948772678762, "percentage": 38.67, "elapsed_time": "1:10:06", "remaining_time": "1:51:11"}
+{"current_steps": 117, "total_steps": 300, "loss": 0.8595, "lr": 7.698753289757565e-05, "epoch": 0.9989327641408752, "percentage": 39.0, "elapsed_time": "1:10:36", "remaining_time": "1:50:26"}
+{"current_steps": 118, "total_steps": 300, "loss": 0.968, "lr": 7.649596321166024e-05, "epoch": 1.0, "percentage": 39.33, "elapsed_time": "1:10:40", "remaining_time": "1:49:01"}
+{"current_steps": 119, "total_steps": 300, "loss": 0.8389, "lr": 7.600080639646077e-05, "epoch": 1.0085378868729988, "percentage": 39.67, "elapsed_time": "1:11:11", "remaining_time": "1:48:16"}
+{"current_steps": 120, "total_steps": 300, "loss": 0.8826, "lr": 7.550212948828377e-05, "epoch": 1.017075773745998, "percentage": 40.0, "elapsed_time": "1:11:46", "remaining_time": "1:47:39"}
+{"current_steps": 121, "total_steps": 300, "loss": 0.8961, "lr": 7.500000000000001e-05, "epoch": 1.0256136606189967, "percentage": 40.33, "elapsed_time": "1:12:13", "remaining_time": "1:46:51"}
+{"current_steps": 122, "total_steps": 300, "loss": 0.7779, "lr": 7.449448591190435e-05, "epoch": 1.0341515474919958, "percentage": 40.67, "elapsed_time": "1:12:46", "remaining_time": "1:46:10"}
+{"current_steps": 123, "total_steps": 300, "loss": 0.882, "lr": 7.398565566251232e-05, "epoch": 1.0426894343649946, "percentage": 41.0, "elapsed_time": "1:13:15", "remaining_time": "1:45:25"}
+{"current_steps": 124, "total_steps": 300, "loss": 0.8583, "lr": 7.347357813929454e-05, "epoch": 1.0512273212379937, "percentage": 41.33, "elapsed_time": "1:13:46", "remaining_time": "1:44:43"}
+{"current_steps": 125, "total_steps": 300, "loss": 0.8085, "lr": 7.295832266935059e-05, "epoch": 1.0597652081109925, "percentage": 41.67, "elapsed_time": "1:14:15", "remaining_time": "1:43:57"}
+{"current_steps": 125, "total_steps": 300, "eval_loss": 0.855903685092926, "epoch": 1.0597652081109925, "percentage": 41.67, "elapsed_time": "1:16:21", "remaining_time": "1:46:54"}
+{"current_steps": 126, "total_steps": 300, "loss": 0.8287, "lr": 7.243995901002312e-05, "epoch": 1.0683030949839916, "percentage": 42.0, "elapsed_time": "1:16:51", "remaining_time": "1:46:08"}
+{"current_steps": 127, "total_steps": 300, "loss": 0.8779, "lr": 7.191855733945387e-05, "epoch": 1.0768409818569904, "percentage": 42.33, "elapsed_time": "1:17:20", "remaining_time": "1:45:20"}
+{"current_steps": 128, "total_steps": 300, "loss": 0.8207, "lr": 7.139418824708272e-05, "epoch": 1.0853788687299892, "percentage": 42.67, "elapsed_time": "1:17:55", "remaining_time": "1:44:43"}
+{"current_steps": 129, "total_steps": 300, "loss": 0.8071, "lr": 7.08669227240909e-05, "epoch": 1.0939167556029883, "percentage": 43.0, "elapsed_time": "1:18:30", "remaining_time": "1:44:04"}
+{"current_steps": 130, "total_steps": 300, "loss": 0.816, "lr": 7.033683215379002e-05, "epoch": 1.1024546424759871, "percentage": 43.33, "elapsed_time": "1:19:04", "remaining_time": "1:43:23"}
+{"current_steps": 131, "total_steps": 300, "loss": 0.8307, "lr": 6.980398830195785e-05, "epoch": 1.1109925293489862, "percentage": 43.67, "elapsed_time": "1:19:33", "remaining_time": "1:42:38"}
+{"current_steps": 132, "total_steps": 300, "loss": 0.8799, "lr": 6.926846330712242e-05, "epoch": 1.119530416221985, "percentage": 44.0, "elapsed_time": "1:20:03", "remaining_time": "1:41:53"}
+{"current_steps": 133, "total_steps": 300, "loss": 0.8427, "lr": 6.873032967079561e-05, "epoch": 1.128068303094984, "percentage": 44.33, "elapsed_time": "1:20:28", "remaining_time": "1:41:03"}
+{"current_steps": 134, "total_steps": 300, "loss": 0.857, "lr": 6.818966024765758e-05, "epoch": 1.136606189967983, "percentage": 44.67, "elapsed_time": "1:21:00", "remaining_time": "1:40:20"}
+{"current_steps": 135, "total_steps": 300, "loss": 0.8238, "lr": 6.764652823569344e-05, "epoch": 1.1451440768409817, "percentage": 45.0, "elapsed_time": "1:21:37", "remaining_time": "1:39:45"}
+{"current_steps": 136, "total_steps": 300, "loss": 0.8208, "lr": 6.710100716628344e-05, "epoch": 1.1536819637139808, "percentage": 45.33, "elapsed_time": "1:22:11", "remaining_time": "1:39:06"}
+{"current_steps": 137, "total_steps": 300, "loss": 0.7936, "lr": 6.65531708942479e-05, "epoch": 1.1622198505869796, "percentage": 45.67, "elapsed_time": "1:22:40", "remaining_time": "1:38:22"}
+{"current_steps": 138, "total_steps": 300, "loss": 0.8355, "lr": 6.600309358784857e-05, "epoch": 1.1707577374599787, "percentage": 46.0, "elapsed_time": "1:23:20", "remaining_time": "1:37:49"}
+{"current_steps": 139, "total_steps": 300, "loss": 0.7518, "lr": 6.545084971874738e-05, "epoch": 1.1792956243329775, "percentage": 46.33, "elapsed_time": "1:23:47", "remaining_time": "1:37:03"}
+{"current_steps": 140, "total_steps": 300, "loss": 0.8091, "lr": 6.48965140519241e-05, "epoch": 1.1878335112059766, "percentage": 46.67, "elapsed_time": "1:24:23", "remaining_time": "1:36:26"}
+{"current_steps": 141, "total_steps": 300, "loss": 0.8138, "lr": 6.434016163555452e-05, "epoch": 1.1963713980789754, "percentage": 47.0, "elapsed_time": "1:24:50", "remaining_time": "1:35:40"}
+{"current_steps": 142, "total_steps": 300, "loss": 0.8357, "lr": 6.378186779084995e-05, "epoch": 1.2049092849519745, "percentage": 47.33, "elapsed_time": "1:25:26", "remaining_time": "1:35:03"}
+{"current_steps": 143, "total_steps": 300, "loss": 0.8278, "lr": 6.322170810186012e-05, "epoch": 1.2134471718249733, "percentage": 47.67, "elapsed_time": "1:25:52", "remaining_time": "1:34:17"}
+{"current_steps": 144, "total_steps": 300, "loss": 0.8395, "lr": 6.26597584052401e-05, "epoch": 1.2219850586979724, "percentage": 48.0, "elapsed_time": "1:26:19", "remaining_time": "1:33:30"}
+{"current_steps": 145, "total_steps": 300, "loss": 0.811, "lr": 6.209609477998338e-05, "epoch": 1.2305229455709712, "percentage": 48.33, "elapsed_time": "1:26:53", "remaining_time": "1:32:52"}
+{"current_steps": 146, "total_steps": 300, "loss": 0.8305, "lr": 6.153079353712201e-05, "epoch": 1.23906083244397, "percentage": 48.67, "elapsed_time": "1:27:19", "remaining_time": "1:32:06"}
+{"current_steps": 147, "total_steps": 300, "loss": 0.8235, "lr": 6.096393120939516e-05, "epoch": 1.247598719316969, "percentage": 49.0, "elapsed_time": "1:27:48", "remaining_time": "1:31:23"}
+{"current_steps": 148, "total_steps": 300, "loss": 0.8181, "lr": 6.0395584540887963e-05, "epoch": 1.256136606189968, "percentage": 49.33, "elapsed_time": "1:28:21", "remaining_time": "1:30:44"}
+{"current_steps": 149, "total_steps": 300, "loss": 0.8309, "lr": 5.982583047664151e-05, "epoch": 1.264674493062967, "percentage": 49.67, "elapsed_time": "1:28:55", "remaining_time": "1:30:07"}
+{"current_steps": 150, "total_steps": 300, "loss": 0.8345, "lr": 5.925474615223573e-05, "epoch": 1.2732123799359658, "percentage": 50.0, "elapsed_time": "1:29:26", "remaining_time": "1:29:26"}
+{"current_steps": 150, "total_steps": 300, "eval_loss": 0.8430656790733337, "epoch": 1.2732123799359658, "percentage": 50.0, "elapsed_time": "1:31:32", "remaining_time": "1:31:32"}
+{"current_steps": 151, "total_steps": 300, "loss": 0.8162, "lr": 5.868240888334653e-05, "epoch": 1.2817502668089649, "percentage": 50.33, "elapsed_time": "1:32:03", "remaining_time": "1:30:50"}
+{"current_steps": 152, "total_steps": 300, "loss": 0.8663, "lr": 5.810889615527838e-05, "epoch": 1.2902881536819637, "percentage": 50.67, "elapsed_time": "1:32:34", "remaining_time": "1:30:08"}
+{"current_steps": 153, "total_steps": 300, "loss": 0.8306, "lr": 5.753428561247416e-05, "epoch": 1.2988260405549625, "percentage": 51.0, "elapsed_time": "1:33:02", "remaining_time": "1:29:23"}
+{"current_steps": 154, "total_steps": 300, "loss": 0.7522, "lr": 5.695865504800327e-05, "epoch": 1.3073639274279616, "percentage": 51.33, "elapsed_time": "1:33:38", "remaining_time": "1:28:46"}
+{"current_steps": 155, "total_steps": 300, "loss": 0.8092, "lr": 5.6382082393029746e-05, "epoch": 1.3159018143009606, "percentage": 51.67, "elapsed_time": "1:34:08", "remaining_time": "1:28:04"}
+{"current_steps": 156, "total_steps": 300, "loss": 0.8326, "lr": 5.5804645706261514e-05, "epoch": 1.3244397011739595, "percentage": 52.0, "elapsed_time": "1:34:33", "remaining_time": "1:27:17"}
+{"current_steps": 157, "total_steps": 300, "loss": 0.7984, "lr": 5.522642316338268e-05, "epoch": 1.3329775880469583, "percentage": 52.33, "elapsed_time": "1:35:03", "remaining_time": "1:26:34"}
+{"current_steps": 158, "total_steps": 300, "loss": 0.8724, "lr": 5.464749304646962e-05, "epoch": 1.3415154749199574, "percentage": 52.67, "elapsed_time": "1:35:28", "remaining_time": "1:25:48"}
+{"current_steps": 159, "total_steps": 300, "loss": 0.8529, "lr": 5.4067933733392915e-05, "epoch": 1.3500533617929562, "percentage": 53.0, "elapsed_time": "1:36:00", "remaining_time": "1:25:08"}
+{"current_steps": 160, "total_steps": 300, "loss": 0.7884, "lr": 5.348782368720626e-05, "epoch": 1.358591248665955, "percentage": 53.33, "elapsed_time": "1:36:27", "remaining_time": "1:24:24"}
+{"current_steps": 161, "total_steps": 300, "loss": 0.7394, "lr": 5.290724144552379e-05, "epoch": 1.367129135538954, "percentage": 53.67, "elapsed_time": "1:37:01", "remaining_time": "1:23:45"}
+{"current_steps": 162, "total_steps": 300, "loss": 0.8742, "lr": 5.232626560988735e-05, "epoch": 1.3756670224119532, "percentage": 54.0, "elapsed_time": "1:37:39", "remaining_time": "1:23:11"}
+{"current_steps": 163, "total_steps": 300, "loss": 0.8229, "lr": 5.174497483512506e-05, "epoch": 1.384204909284952, "percentage": 54.33, "elapsed_time": "1:38:17", "remaining_time": "1:22:36"}

TextUI-Trans-7B/trainer_state.json

@@ -0,0 +1,1132 @@
+{
+  "best_global_step": 150,
+  "best_metric": 0.8430656790733337,
+  "best_model_checkpoint": "/root/autodl-tmp/model/lora-textui/stage2_cap_func_trans/checkpoint-150",
+  "epoch": 1.2732123799359658,
+  "eval_steps": 25,
+  "global_step": 150,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.008537886872998933,
+      "grad_norm": 3.569350242614746,
+      "learning_rate": 0.0,
+      "loss": 1.5618,
+      "step": 1
+    },
+    {
+      "epoch": 0.017075773745997867,
+      "grad_norm": 3.5417115688323975,
+      "learning_rate": 3.3333333333333333e-06,
+      "loss": 1.5366,
+      "step": 2
+    },
+    {
+      "epoch": 0.025613660618996798,
+      "grad_norm": 3.087338924407959,
+      "learning_rate": 6.666666666666667e-06,
+      "loss": 1.5274,
+      "step": 3
+    },
+    {
+      "epoch": 0.03415154749199573,
+      "grad_norm": 2.873836040496826,
+      "learning_rate": 1e-05,
+      "loss": 1.3764,
+      "step": 4
+    },
+    {
+      "epoch": 0.042689434364994665,
+      "grad_norm": 2.4693570137023926,
+      "learning_rate": 1.3333333333333333e-05,
+      "loss": 1.3908,
+      "step": 5
+    },
+    {
+      "epoch": 0.051227321237993596,
+      "grad_norm": 1.9929084777832031,
+      "learning_rate": 1.6666666666666667e-05,
+      "loss": 1.3127,
+      "step": 6
+    },
+    {
+      "epoch": 0.05976520811099253,
+      "grad_norm": 1.4752813577651978,
+      "learning_rate": 2e-05,
+      "loss": 1.2693,
+      "step": 7
+    },
+    {
+      "epoch": 0.06830309498399147,
+      "grad_norm": 1.0920029878616333,
+      "learning_rate": 2.3333333333333336e-05,
+      "loss": 1.3037,
+      "step": 8
+    },
+    {
+      "epoch": 0.0768409818569904,
+      "grad_norm": 0.8210710287094116,
+      "learning_rate": 2.6666666666666667e-05,
+      "loss": 1.1871,
+      "step": 9
+    },
+    {
+      "epoch": 0.08537886872998933,
+      "grad_norm": 0.7052881717681885,
+      "learning_rate": 3e-05,
+      "loss": 1.15,
+      "step": 10
+    },
+    {
+      "epoch": 0.09391675560298826,
+      "grad_norm": 0.6850194334983826,
+      "learning_rate": 3.3333333333333335e-05,
+      "loss": 1.2154,
+      "step": 11
+    },
+    {
+      "epoch": 0.10245464247598719,
+      "grad_norm": 0.6714601516723633,
+      "learning_rate": 3.6666666666666666e-05,
+      "loss": 1.1687,
+      "step": 12
+    },
+    {
+      "epoch": 0.11099252934898612,
+      "grad_norm": 0.6564128994941711,
+      "learning_rate": 4e-05,
+      "loss": 1.2469,
+      "step": 13
+    },
+    {
+      "epoch": 0.11953041622198506,
+      "grad_norm": 0.6847338080406189,
+      "learning_rate": 4.3333333333333334e-05,
+      "loss": 1.0827,
+      "step": 14
+    },
+    {
+      "epoch": 0.128068303094984,
+      "grad_norm": 0.5931199789047241,
+      "learning_rate": 4.666666666666667e-05,
+      "loss": 1.188,
+      "step": 15
+    },
+    {
+      "epoch": 0.13660618996798293,
+      "grad_norm": 0.5378791689872742,
+      "learning_rate": 5e-05,
+      "loss": 1.1076,
+      "step": 16
+    },
+    {
+      "epoch": 0.14514407684098185,
+      "grad_norm": 0.503239631652832,
+      "learning_rate": 5.333333333333333e-05,
+      "loss": 1.047,
+      "step": 17
+    },
+    {
+      "epoch": 0.1536819637139808,
+      "grad_norm": 0.4387917220592499,
+      "learning_rate": 5.666666666666667e-05,
+      "loss": 1.0498,
+      "step": 18
+    },
+    {
+      "epoch": 0.1622198505869797,
+      "grad_norm": 0.4416464865207672,
+      "learning_rate": 6e-05,
+      "loss": 1.0226,
+      "step": 19
+    },
+    {
+      "epoch": 0.17075773745997866,
+      "grad_norm": 0.44988617300987244,
+      "learning_rate": 6.333333333333333e-05,
+      "loss": 1.0192,
+      "step": 20
+    },
+    {
+      "epoch": 0.17929562433297758,
+      "grad_norm": 0.42736634612083435,
+      "learning_rate": 6.666666666666667e-05,
+      "loss": 1.0255,
+      "step": 21
+    },
+    {
+      "epoch": 0.18783351120597652,
+      "grad_norm": 0.43649032711982727,
+      "learning_rate": 7e-05,
+      "loss": 1.0127,
+      "step": 22
+    },
+    {
+      "epoch": 0.19637139807897544,
+      "grad_norm": 0.4321700632572174,
+      "learning_rate": 7.333333333333333e-05,
+      "loss": 1.0648,
+      "step": 23
+    },
+    {
+      "epoch": 0.20490928495197439,
+      "grad_norm": 0.4347881078720093,
+      "learning_rate": 7.666666666666667e-05,
+      "loss": 0.9899,
+      "step": 24
+    },
+    {
+      "epoch": 0.21344717182497333,
+      "grad_norm": 0.3858855962753296,
+      "learning_rate": 8e-05,
+      "loss": 0.9888,
+      "step": 25
+    },
+    {
+      "epoch": 0.21344717182497333,
+      "eval_loss": 0.9922655820846558,
+      "eval_runtime": 126.3706,
+      "eval_samples_per_second": 7.739,
+      "eval_steps_per_second": 0.491,
+      "step": 25
+    },
+    {
+      "epoch": 0.22198505869797225,
+      "grad_norm": 0.36364927887916565,
+      "learning_rate": 8.333333333333334e-05,
+      "loss": 0.9876,
+      "step": 26
+    },
+    {
+      "epoch": 0.2305229455709712,
+      "grad_norm": 0.3517715334892273,
+      "learning_rate": 8.666666666666667e-05,
+      "loss": 0.9778,
+      "step": 27
+    },
+    {
+      "epoch": 0.2390608324439701,
+      "grad_norm": 0.31786659359931946,
+      "learning_rate": 9e-05,
+      "loss": 0.9561,
+      "step": 28
+    },
+    {
+      "epoch": 0.24759871931696906,
+      "grad_norm": 0.34954020380973816,
+      "learning_rate": 9.333333333333334e-05,
+      "loss": 0.9958,
+      "step": 29
+    },
+    {
+      "epoch": 0.256136606189968,
+      "grad_norm": 0.3508739769458771,
+      "learning_rate": 9.666666666666667e-05,
+      "loss": 1.0282,
+      "step": 30
+    },
+    {
+      "epoch": 0.2646744930629669,
+      "grad_norm": 0.33114153146743774,
+      "learning_rate": 0.0001,
+      "loss": 0.9626,
+      "step": 31
+    },
+    {
+      "epoch": 0.27321237993596587,
+      "grad_norm": 0.3469662666320801,
+      "learning_rate": 9.999661540018812e-05,
+      "loss": 1.0061,
+      "step": 32
+    },
+    {
+      "epoch": 0.28175026680896476,
+      "grad_norm": 0.34702596068382263,
+      "learning_rate": 9.998646205897309e-05,
+      "loss": 0.9061,
+      "step": 33
+    },
+    {
+      "epoch": 0.2902881536819637,
+      "grad_norm": 0.30591893196105957,
+      "learning_rate": 9.99695413509548e-05,
+      "loss": 0.9743,
+      "step": 34
+    },
+    {
+      "epoch": 0.29882604055496265,
+      "grad_norm": 0.30477747321128845,
+      "learning_rate": 9.994585556692624e-05,
+      "loss": 0.9536,
+      "step": 35
+    },
+    {
+      "epoch": 0.3073639274279616,
+      "grad_norm": 0.31681594252586365,
+      "learning_rate": 9.991540791356342e-05,
+      "loss": 0.998,
+      "step": 36
+    },
+    {
+      "epoch": 0.31590181430096054,
+      "grad_norm": 0.30779823660850525,
+      "learning_rate": 9.987820251299122e-05,
+      "loss": 1.0049,
+      "step": 37
+    },
+    {
+      "epoch": 0.3244397011739594,
+      "grad_norm": 0.30715224146842957,
+      "learning_rate": 9.983424440222531e-05,
+      "loss": 0.9955,
+      "step": 38
+    },
+    {
+      "epoch": 0.3329775880469584,
+      "grad_norm": 0.30985817313194275,
+      "learning_rate": 9.978353953249022e-05,
+      "loss": 0.9684,
+      "step": 39
+    },
+    {
+      "epoch": 0.3415154749199573,
+      "grad_norm": 0.31904837489128113,
+      "learning_rate": 9.972609476841367e-05,
+      "loss": 1.0183,
+      "step": 40
+    },
+    {
+      "epoch": 0.35005336179295626,
+      "grad_norm": 0.29088112711906433,
+      "learning_rate": 9.966191788709716e-05,
+      "loss": 0.9516,
+      "step": 41
+    },
+    {
+      "epoch": 0.35859124866595515,
+      "grad_norm": 0.3119213283061981,
+      "learning_rate": 9.959101757706308e-05,
+      "loss": 0.9607,
+      "step": 42
+    },
+    {
+      "epoch": 0.3671291355389541,
+      "grad_norm": 0.2980335056781769,
+      "learning_rate": 9.951340343707852e-05,
+      "loss": 0.9116,
+      "step": 43
+    },
+    {
+      "epoch": 0.37566702241195304,
+      "grad_norm": 0.31713929772377014,
+      "learning_rate": 9.942908597485558e-05,
+      "loss": 1.0001,
+      "step": 44
+    },
+    {
+      "epoch": 0.384204909284952,
+      "grad_norm": 0.30609187483787537,
+      "learning_rate": 9.933807660562898e-05,
+      "loss": 0.9237,
+      "step": 45
+    },
+    {
+      "epoch": 0.3927427961579509,
+      "grad_norm": 0.30118709802627563,
+      "learning_rate": 9.924038765061042e-05,
+      "loss": 0.9682,
+      "step": 46
+    },
+    {
+      "epoch": 0.4012806830309498,
+      "grad_norm": 0.3028307855129242,
+      "learning_rate": 9.913603233532067e-05,
+      "loss": 0.9255,
+      "step": 47
+    },
+    {
+      "epoch": 0.40981856990394877,
+      "grad_norm": 0.31861209869384766,
+      "learning_rate": 9.902502478779896e-05,
+      "loss": 0.8936,
+      "step": 48
+    },
+    {
+      "epoch": 0.4183564567769477,
+      "grad_norm": 0.2734357416629791,
+      "learning_rate": 9.890738003669029e-05,
+      "loss": 0.953,
+      "step": 49
+    },
+    {
+      "epoch": 0.42689434364994666,
+      "grad_norm": 0.29771876335144043,
+      "learning_rate": 9.878311400921072e-05,
+      "loss": 0.9401,
+      "step": 50
+    },
+    {
+      "epoch": 0.42689434364994666,
+      "eval_loss": 0.9200984835624695,
+      "eval_runtime": 126.2659,
+      "eval_samples_per_second": 7.746,
+      "eval_steps_per_second": 0.491,
+      "step": 50
+    },
+    {
+      "epoch": 0.43543223052294555,
+      "grad_norm": 0.3155674338340759,
+      "learning_rate": 9.865224352899119e-05,
+      "loss": 0.8947,
+      "step": 51
+    },
+    {
+      "epoch": 0.4439701173959445,
+      "grad_norm": 0.30623170733451843,
+      "learning_rate": 9.851478631379982e-05,
+      "loss": 0.9038,
+      "step": 52
+    },
+    {
+      "epoch": 0.45250800426894344,
+      "grad_norm": 0.30273666977882385,
+      "learning_rate": 9.837076097314319e-05,
+      "loss": 0.9348,
+      "step": 53
+    },
+    {
+      "epoch": 0.4610458911419424,
+      "grad_norm": 0.3075931966304779,
+      "learning_rate": 9.822018700574695e-05,
+      "loss": 0.9275,
+      "step": 54
+    },
+    {
+      "epoch": 0.4695837780149413,
+      "grad_norm": 0.2986295521259308,
+      "learning_rate": 9.806308479691595e-05,
+      "loss": 0.928,
+      "step": 55
+    },
+    {
+      "epoch": 0.4781216648879402,
+      "grad_norm": 0.3007640540599823,
+      "learning_rate": 9.789947561577445e-05,
+      "loss": 0.9702,
+      "step": 56
+    },
+    {
+      "epoch": 0.48665955176093917,
+      "grad_norm": 0.30233699083328247,
+      "learning_rate": 9.77293816123866e-05,
+      "loss": 0.9534,
+      "step": 57
+    },
+    {
+      "epoch": 0.4951974386339381,
+      "grad_norm": 0.30345094203948975,
+      "learning_rate": 9.755282581475769e-05,
+      "loss": 0.9474,
+      "step": 58
+    },
+    {
+      "epoch": 0.503735325506937,
+      "grad_norm": 0.3086802065372467,
+      "learning_rate": 9.736983212571646e-05,
+      "loss": 0.8856,
+      "step": 59
+    },
+    {
+      "epoch": 0.512273212379936,
+      "grad_norm": 0.28710058331489563,
+      "learning_rate": 9.718042531967918e-05,
+      "loss": 0.946,
+      "step": 60
+    },
+    {
+      "epoch": 0.5208110992529349,
+      "grad_norm": 0.3032543361186981,
+      "learning_rate": 9.698463103929542e-05,
+      "loss": 0.9204,
+      "step": 61
+    },
+    {
+      "epoch": 0.5293489861259338,
+      "grad_norm": 0.33324557542800903,
+      "learning_rate": 9.678247579197657e-05,
+      "loss": 0.9127,
+      "step": 62
+    },
+    {
+      "epoch": 0.5378868729989328,
+      "grad_norm": 0.31016331911087036,
+      "learning_rate": 9.657398694630712e-05,
+      "loss": 0.8976,
+      "step": 63
+    },
+    {
+      "epoch": 0.5464247598719317,
+      "grad_norm": 0.3162042498588562,
+      "learning_rate": 9.635919272833938e-05,
+      "loss": 0.8394,
+      "step": 64
+    },
+    {
+      "epoch": 0.5549626467449307,
+      "grad_norm": 0.3050558865070343,
+      "learning_rate": 9.613812221777212e-05,
+      "loss": 0.9153,
+      "step": 65
+    },
+    {
+      "epoch": 0.5635005336179295,
+      "grad_norm": 0.3125409483909607,
+      "learning_rate": 9.591080534401371e-05,
+      "loss": 0.9224,
+      "step": 66
+    },
+    {
+      "epoch": 0.5720384204909285,
+      "grad_norm": 0.3080565333366394,
+      "learning_rate": 9.567727288213005e-05,
+      "loss": 0.9281,
+      "step": 67
+    },
+    {
+      "epoch": 0.5805763073639274,
+      "grad_norm": 0.31865012645721436,
+      "learning_rate": 9.543755644867822e-05,
+      "loss": 0.8459,
+      "step": 68
+    },
+    {
+      "epoch": 0.5891141942369263,
+      "grad_norm": 0.3252212107181549,
+      "learning_rate": 9.519168849742604e-05,
+      "loss": 0.9076,
+      "step": 69
+    },
+    {
+      "epoch": 0.5976520811099253,
+      "grad_norm": 0.31885048747062683,
+      "learning_rate": 9.493970231495835e-05,
+      "loss": 0.9292,
+      "step": 70
+    },
+    {
+      "epoch": 0.6061899679829242,
+      "grad_norm": 0.3276972770690918,
+      "learning_rate": 9.468163201617062e-05,
+      "loss": 0.7814,
+      "step": 71
+    },
+    {
+      "epoch": 0.6147278548559232,
+      "grad_norm": 0.3108748495578766,
+      "learning_rate": 9.441751253965021e-05,
+      "loss": 0.8878,
+      "step": 72
+    },
+    {
+      "epoch": 0.6232657417289221,
+      "grad_norm": 0.3175681531429291,
+      "learning_rate": 9.414737964294636e-05,
+      "loss": 0.9064,
+      "step": 73
+    },
+    {
+      "epoch": 0.6318036286019211,
+      "grad_norm": 0.3110436499118805,
+      "learning_rate": 9.38712698977291e-05,
+      "loss": 0.9185,
+      "step": 74
+    },
+    {
+      "epoch": 0.6403415154749199,
+      "grad_norm": 0.31339648365974426,
+      "learning_rate": 9.358922068483812e-05,
+      "loss": 0.9435,
+      "step": 75
+    },
+    {
+      "epoch": 0.6403415154749199,
+      "eval_loss": 0.8910433650016785,
+      "eval_runtime": 126.3701,
+      "eval_samples_per_second": 7.739,
+      "eval_steps_per_second": 0.491,
+      "step": 75
+    },
+    {
+      "epoch": 0.6488794023479189,
+      "grad_norm": 0.32126352190971375,
+      "learning_rate": 9.330127018922194e-05,
+      "loss": 0.91,
+      "step": 76
+    },
+    {
+      "epoch": 0.6574172892209178,
+      "grad_norm": 0.31005603075027466,
+      "learning_rate": 9.300745739476829e-05,
+      "loss": 0.9656,
+      "step": 77
+    },
+    {
+      "epoch": 0.6659551760939167,
+      "grad_norm": 0.3075394630432129,
+      "learning_rate": 9.270782207902629e-05,
+      "loss": 0.9734,
+      "step": 78
+    },
+    {
+      "epoch": 0.6744930629669157,
+      "grad_norm": 0.3072083294391632,
+      "learning_rate": 9.24024048078213e-05,
+      "loss": 0.9102,
+      "step": 79
+    },
+    {
+      "epoch": 0.6830309498399146,
+      "grad_norm": 0.3321980834007263,
+      "learning_rate": 9.209124692976287e-05,
+      "loss": 0.9166,
+      "step": 80
+    },
+    {
+      "epoch": 0.6915688367129136,
+      "grad_norm": 0.3266827464103699,
+      "learning_rate": 9.177439057064683e-05,
+      "loss": 0.8672,
+      "step": 81
+    },
+    {
+      "epoch": 0.7001067235859125,
+      "grad_norm": 0.33046409487724304,
+      "learning_rate": 9.145187862775209e-05,
+      "loss": 0.8953,
+      "step": 82
+    },
+    {
+      "epoch": 0.7086446104589115,
+      "grad_norm": 0.33084535598754883,
+      "learning_rate": 9.112375476403312e-05,
+      "loss": 0.914,
+      "step": 83
+    },
+    {
+      "epoch": 0.7171824973319103,
+      "grad_norm": 0.3533576726913452,
+      "learning_rate": 9.079006340220862e-05,
+      "loss": 0.8936,
+      "step": 84
+    },
+    {
+      "epoch": 0.7257203842049093,
+      "grad_norm": 0.3123546242713928,
+      "learning_rate": 9.045084971874738e-05,
+      "loss": 0.9096,
+      "step": 85
+    },
+    {
+      "epoch": 0.7342582710779082,
+      "grad_norm": 0.3312874138355255,
+      "learning_rate": 9.01061596377522e-05,
+      "loss": 0.957,
+      "step": 86
+    },
+    {
+      "epoch": 0.7427961579509071,
+      "grad_norm": 0.3258456885814667,
+      "learning_rate": 8.97560398247424e-05,
+      "loss": 0.8853,
+      "step": 87
+    },
+    {
+      "epoch": 0.7513340448239061,
+      "grad_norm": 0.35378894209861755,
+      "learning_rate": 8.940053768033609e-05,
+      "loss": 0.907,
+      "step": 88
+    },
+    {
+      "epoch": 0.759871931696905,
+      "grad_norm": 0.30806443095207214,
+      "learning_rate": 8.903970133383297e-05,
+      "loss": 0.8719,
+      "step": 89
+    },
+    {
+      "epoch": 0.768409818569904,
+      "grad_norm": 0.33278632164001465,
+      "learning_rate": 8.86735796366982e-05,
+      "loss": 0.9782,
+      "step": 90
+    },
+    {
+      "epoch": 0.7769477054429029,
+      "grad_norm": 0.31797873973846436,
+      "learning_rate": 8.83022221559489e-05,
+      "loss": 0.9225,
+      "step": 91
+    },
+    {
+      "epoch": 0.7854855923159018,
+      "grad_norm": 0.3217017352581024,
+      "learning_rate": 8.792567916744346e-05,
+      "loss": 0.9045,
+      "step": 92
+    },
+    {
+      "epoch": 0.7940234791889007,
+      "grad_norm": 0.37561750411987305,
+      "learning_rate": 8.754400164907497e-05,
+      "loss": 0.9335,
+      "step": 93
+    },
+    {
+      "epoch": 0.8025613660618997,
+      "grad_norm": 0.3165503144264221,
+      "learning_rate": 8.715724127386972e-05,
+      "loss": 0.9086,
+      "step": 94
+    },
+    {
+      "epoch": 0.8110992529348986,
+      "grad_norm": 0.3458029329776764,
+      "learning_rate": 8.676545040299145e-05,
+      "loss": 0.9079,
+      "step": 95
+    },
+    {
+      "epoch": 0.8196371398078975,
+      "grad_norm": 0.336024671792984,
+      "learning_rate": 8.636868207865244e-05,
+      "loss": 0.9059,
+      "step": 96
+    },
+    {
+      "epoch": 0.8281750266808965,
+      "grad_norm": 0.3598126471042633,
+      "learning_rate": 8.596699001693255e-05,
+      "loss": 0.847,
+      "step": 97
+    },
+    {
+      "epoch": 0.8367129135538954,
+      "grad_norm": 0.33313530683517456,
+      "learning_rate": 8.556042860050687e-05,
+      "loss": 0.911,
+      "step": 98
+    },
+    {
+      "epoch": 0.8452508004268944,
+      "grad_norm": 0.3099718689918518,
+      "learning_rate": 8.51490528712831e-05,
+      "loss": 0.8864,
+      "step": 99
+    },
+    {
+      "epoch": 0.8537886872998933,
+      "grad_norm": 0.3349950611591339,
+      "learning_rate": 8.473291852294987e-05,
+      "loss": 0.8479,
+      "step": 100
+    },
+    {
+      "epoch": 0.8537886872998933,
+      "eval_loss": 0.8699346780776978,
+      "eval_runtime": 126.3565,
+      "eval_samples_per_second": 7.74,
+      "eval_steps_per_second": 0.491,
+      "step": 100
+    },
+    {
+      "epoch": 0.8623265741728922,
+      "grad_norm": 0.3409707546234131,
+      "learning_rate": 8.43120818934367e-05,
+      "loss": 0.92,
+      "step": 101
+    },
+    {
+      "epoch": 0.8708644610458911,
+      "grad_norm": 0.349369078874588,
+      "learning_rate": 8.388659995728663e-05,
+      "loss": 0.8551,
+      "step": 102
+    },
+    {
+      "epoch": 0.87940234791889,
+      "grad_norm": 0.3358254134654999,
+      "learning_rate": 8.345653031794292e-05,
+      "loss": 0.9024,
+      "step": 103
+    },
+    {
+      "epoch": 0.887940234791889,
+      "grad_norm": 0.30185699462890625,
+      "learning_rate": 8.302193119995039e-05,
+      "loss": 0.9081,
+      "step": 104
+    },
+    {
+      "epoch": 0.8964781216648879,
+      "grad_norm": 0.33944496512413025,
+      "learning_rate": 8.258286144107276e-05,
+      "loss": 0.9215,
+      "step": 105
+    },
+    {
+      "epoch": 0.9050160085378869,
+      "grad_norm": 0.31531962752342224,
+      "learning_rate": 8.213938048432697e-05,
+      "loss": 0.886,
+      "step": 106
+    },
+    {
+      "epoch": 0.9135538954108858,
+      "grad_norm": 0.33005067706108093,
+      "learning_rate": 8.169154836993551e-05,
+      "loss": 0.8436,
+      "step": 107
+    },
+    {
+      "epoch": 0.9220917822838848,
+      "grad_norm": 0.32761579751968384,
+      "learning_rate": 8.1239425727198e-05,
+      "loss": 0.8181,
+      "step": 108
+    },
+    {
+      "epoch": 0.9306296691568837,
+      "grad_norm": 0.3269185423851013,
+      "learning_rate": 8.07830737662829e-05,
+      "loss": 0.8687,
+      "step": 109
+    },
+    {
+      "epoch": 0.9391675560298826,
+      "grad_norm": 0.3282541036605835,
+      "learning_rate": 8.032255426994069e-05,
+      "loss": 0.8341,
+      "step": 110
+    },
+    {
+      "epoch": 0.9477054429028815,
+      "grad_norm": 0.331903338432312,
+      "learning_rate": 7.985792958513931e-05,
+      "loss": 0.9307,
+      "step": 111
+    },
+    {
+      "epoch": 0.9562433297758804,
+      "grad_norm": 0.37399402260780334,
+      "learning_rate": 7.938926261462366e-05,
+      "loss": 0.8765,
+      "step": 112
+    },
+    {
+      "epoch": 0.9647812166488794,
+      "grad_norm": 0.3470500409603119,
+      "learning_rate": 7.891661680839932e-05,
+      "loss": 0.8956,
+      "step": 113
+    },
+    {
+      "epoch": 0.9733191035218783,
+      "grad_norm": 0.33433717489242554,
+      "learning_rate": 7.844005615514259e-05,
+      "loss": 0.8607,
+      "step": 114
+    },
+    {
+      "epoch": 0.9818569903948773,
+      "grad_norm": 0.3233843743801117,
+      "learning_rate": 7.795964517353735e-05,
+      "loss": 0.8357,
+      "step": 115
+    },
+    {
+      "epoch": 0.9903948772678762,
+      "grad_norm": 0.32620981335639954,
+      "learning_rate": 7.74754489035403e-05,
+      "loss": 0.9093,
+      "step": 116
+    },
+    {
+      "epoch": 0.9989327641408752,
+      "grad_norm": 0.3210049569606781,
+      "learning_rate": 7.698753289757565e-05,
+      "loss": 0.8595,
+      "step": 117
+    },
+    {
+      "epoch": 1.0,
+      "grad_norm": 0.883870542049408,
+      "learning_rate": 7.649596321166024e-05,
+      "loss": 0.968,
+      "step": 118
+    },
+    {
+      "epoch": 1.0085378868729988,
+      "grad_norm": 0.36958256363868713,
+      "learning_rate": 7.600080639646077e-05,
+      "loss": 0.8389,
+      "step": 119
+    },
+    {
+      "epoch": 1.017075773745998,
+      "grad_norm": 0.32345816493034363,
+      "learning_rate": 7.550212948828377e-05,
+      "loss": 0.8826,
+      "step": 120
+    },
+    {
+      "epoch": 1.0256136606189967,
+      "grad_norm": 0.33251067996025085,
+      "learning_rate": 7.500000000000001e-05,
+      "loss": 0.8961,
+      "step": 121
+    },
+    {
+      "epoch": 1.0341515474919958,
+      "grad_norm": 0.3673892915248871,
+      "learning_rate": 7.449448591190435e-05,
+      "loss": 0.7779,
+      "step": 122
+    },
+    {
+      "epoch": 1.0426894343649946,
+      "grad_norm": 0.3406680226325989,
+      "learning_rate": 7.398565566251232e-05,
+      "loss": 0.882,
+      "step": 123
+    },
+    {
+      "epoch": 1.0512273212379937,
+      "grad_norm": 0.35136982798576355,
+      "learning_rate": 7.347357813929454e-05,
+      "loss": 0.8583,
+      "step": 124
+    },
+    {
+      "epoch": 1.0597652081109925,
+      "grad_norm": 0.38215872645378113,
+      "learning_rate": 7.295832266935059e-05,
+      "loss": 0.8085,
+      "step": 125
+    },
+    {
+      "epoch": 1.0597652081109925,
+      "eval_loss": 0.855903685092926,
+      "eval_runtime": 126.4753,
+      "eval_samples_per_second": 7.733,
+      "eval_steps_per_second": 0.49,
+      "step": 125
+    },
+    {
+      "epoch": 1.0683030949839916,
+      "grad_norm": 0.3545176386833191,
+      "learning_rate": 7.243995901002312e-05,
+      "loss": 0.8287,
+      "step": 126
+    },
+    {
+      "epoch": 1.0768409818569904,
+      "grad_norm": 0.36242854595184326,
+      "learning_rate": 7.191855733945387e-05,
+      "loss": 0.8779,
+      "step": 127
+    },
+    {
+      "epoch": 1.0853788687299892,
+      "grad_norm": 0.3716667890548706,
+      "learning_rate": 7.139418824708272e-05,
+      "loss": 0.8207,
+      "step": 128
+    },
+    {
+      "epoch": 1.0939167556029883,
+      "grad_norm": 0.3446180820465088,
+      "learning_rate": 7.08669227240909e-05,
+      "loss": 0.8071,
+      "step": 129
+    },
+    {
+      "epoch": 1.1024546424759871,
+      "grad_norm": 0.348202109336853,
+      "learning_rate": 7.033683215379002e-05,
+      "loss": 0.816,
+      "step": 130
+    },
+    {
+      "epoch": 1.1109925293489862,
+      "grad_norm": 0.3857647776603699,
+      "learning_rate": 6.980398830195785e-05,
+      "loss": 0.8307,
+      "step": 131
+    },
+    {
+      "epoch": 1.119530416221985,
+      "grad_norm": 0.3619552254676819,
+      "learning_rate": 6.926846330712242e-05,
+      "loss": 0.8799,
+      "step": 132
+    },
+    {
+      "epoch": 1.128068303094984,
+      "grad_norm": 0.36076459288597107,
+      "learning_rate": 6.873032967079561e-05,
+      "loss": 0.8427,
+      "step": 133
+    },
+    {
+      "epoch": 1.136606189967983,
+      "grad_norm": 0.3395594358444214,
+      "learning_rate": 6.818966024765758e-05,
+      "loss": 0.857,
+      "step": 134
+    },
+    {
+      "epoch": 1.1451440768409817,
+      "grad_norm": 0.3523291051387787,
+      "learning_rate": 6.764652823569344e-05,
+      "loss": 0.8238,
+      "step": 135
+    },
+    {
+      "epoch": 1.1536819637139808,
+      "grad_norm": 0.35138288140296936,
+      "learning_rate": 6.710100716628344e-05,
+      "loss": 0.8208,
+      "step": 136
+    },
+    {
+      "epoch": 1.1622198505869796,
+      "grad_norm": 0.3666648864746094,
+      "learning_rate": 6.65531708942479e-05,
+      "loss": 0.7936,
+      "step": 137
+    },
+    {
+      "epoch": 1.1707577374599787,
+      "grad_norm": 0.38198062777519226,
+      "learning_rate": 6.600309358784857e-05,
+      "loss": 0.8355,
+      "step": 138
+    },
+    {
+      "epoch": 1.1792956243329775,
+      "grad_norm": 0.361715167760849,
+      "learning_rate": 6.545084971874738e-05,
+      "loss": 0.7518,
+      "step": 139
+    },
+    {
+      "epoch": 1.1878335112059766,
+      "grad_norm": 0.3789786100387573,
+      "learning_rate": 6.48965140519241e-05,
+      "loss": 0.8091,
+      "step": 140
+    },
+    {
+      "epoch": 1.1963713980789754,
+      "grad_norm": 0.3489861488342285,
+      "learning_rate": 6.434016163555452e-05,
+      "loss": 0.8138,
+      "step": 141
+    },
+    {
+      "epoch": 1.2049092849519745,
+      "grad_norm": 0.3795143961906433,
+      "learning_rate": 6.378186779084995e-05,
+      "loss": 0.8357,
+      "step": 142
+    },
+    {
+      "epoch": 1.2134471718249733,
+      "grad_norm": 0.3954067826271057,
+      "learning_rate": 6.322170810186012e-05,
+      "loss": 0.8278,
+      "step": 143
+    },
+    {
+      "epoch": 1.2219850586979724,
+      "grad_norm": 0.37652266025543213,
+      "learning_rate": 6.26597584052401e-05,
+      "loss": 0.8395,
+      "step": 144
+    },
+    {
+      "epoch": 1.2305229455709712,
+      "grad_norm": 0.3819694519042969,
+      "learning_rate": 6.209609477998338e-05,
+      "loss": 0.811,
+      "step": 145
+    },
+    {
+      "epoch": 1.23906083244397,
+      "grad_norm": 0.3565637767314911,
+      "learning_rate": 6.153079353712201e-05,
+      "loss": 0.8305,
+      "step": 146
+    },
+    {
+      "epoch": 1.247598719316969,
+      "grad_norm": 0.37492281198501587,
+      "learning_rate": 6.096393120939516e-05,
+      "loss": 0.8235,
+      "step": 147
+    },
+    {
+      "epoch": 1.256136606189968,
+      "grad_norm": 0.3353641927242279,
+      "learning_rate": 6.0395584540887963e-05,
+      "loss": 0.8181,
+      "step": 148
+    },
+    {
+      "epoch": 1.264674493062967,
+      "grad_norm": 0.37503373622894287,
+      "learning_rate": 5.982583047664151e-05,
+      "loss": 0.8309,
+      "step": 149
+    },
+    {
+      "epoch": 1.2732123799359658,
+      "grad_norm": 0.34756171703338623,
+      "learning_rate": 5.925474615223573e-05,
+      "loss": 0.8345,
+      "step": 150
+    },
+    {
+      "epoch": 1.2732123799359658,
+      "eval_loss": 0.8430656790733337,
+      "eval_runtime": 126.4713,
+      "eval_samples_per_second": 7.733,
+      "eval_steps_per_second": 0.49,
+      "step": 150
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 300,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 3,
+  "save_steps": 50,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 1.4140777917830922e+18,
+  "train_batch_size": 3,
+  "trial_name": null,
+  "trial_params": null
+}

TextUI-Trans-7B/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:317d8fbe31bcf06a0ec571c13c58278b73ace8dc6147ca47db99a7934571c640
+size 6161