diff --git a/.gitattributes b/.gitattributes
index a6344aac8c09253b3b630fb776ae94478aa0275b..264a9accacd874a024bc0dc01ace9ce8ef8aea23 100644
--- a/.gitattributes
+++ b/.gitattributes
@@ -33,3 +33,32 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
+checkpoint-10/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-100/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1188/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-125/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1386/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-15/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-150/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1584/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-175/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1782/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-198/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1980/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-20/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-200/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-225/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-25/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-250/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-30/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-35/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-396/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-40/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-45/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-5/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-50/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-594/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-75/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-792/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-990/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+final/tokenizer.json filter=lfs diff=lfs merge=lfs -text
diff --git a/README.md b/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..33b9bfca30ff3744ae4199616420d0d98c9b9b8c
--- /dev/null
+++ b/README.md
@@ -0,0 +1,59 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: transformers
+model_name: output
+tags:
+- generated_from_trainer
+- sft
+- trl
+- unsloth
+licence: license
+---
+
+# Model Card for output
+
+This model is a fine-tuned version of [unsloth/Qwen3-4B-unsloth-bnb-4bit](https://huggingface.co/unsloth/Qwen3-4B-unsloth-bnb-4bit).
+It has been trained using [TRL](https://github.com/huggingface/trl).
+
+## Quick start
+
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="None", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
+
+
+
+
+This model was trained with SFT.
+
+### Framework versions
+
+- TRL: 0.24.0
+- Transformers: 5.6.2
+- Pytorch: 2.10.0
+- Datasets: 4.3.0
+- Tokenizers: 0.22.2
+
+## Citations
+
+
+
+Cite TRL as:
+
+```bibtex
+@misc{vonwerra2022trl,
+ title = {{TRL: Transformer Reinforcement Learning}},
+ author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
+ year = 2020,
+ journal = {GitHub repository},
+ publisher = {GitHub},
+ howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```
\ No newline at end of file
diff --git a/checkpoint-10/README.md b/checkpoint-10/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..17bc522e13c6998ab7f14e4524a99f96b2e38000
--- /dev/null
+++ b/checkpoint-10/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-10/adapter_config.json b/checkpoint-10/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b01b681148ff188ab3d162c0d6bb07268b3adfca
--- /dev/null
+++ b/checkpoint-10/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-1.7B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "o_proj",
+ "v_proj",
+ "up_proj",
+ "down_proj",
+ "q_proj",
+ "gate_proj",
+ "k_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-10/adapter_model.safetensors b/checkpoint-10/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..e0ea61edad119ac9717a1521800120a4d27dc046
--- /dev/null
+++ b/checkpoint-10/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:166a09e9291350a1b4c9808933c58ce549fa35845dd8ba47a37b746417f0994b
+size 69782384
diff --git a/checkpoint-10/chat_template.jinja b/checkpoint-10/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-10/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-10/optimizer.pt b/checkpoint-10/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..a495e71b48dea189c8e874ea066b154d0ca7938b
--- /dev/null
+++ b/checkpoint-10/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10c5f594938f9c2bdc065ce0ab9280e9fb053fb1332cf609d87d819a28719cd1
+size 35873029
diff --git a/checkpoint-10/rng_state.pth b/checkpoint-10/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..a18368651274f7c0847c1b9873fe8c9f4ac945ba
--- /dev/null
+++ b/checkpoint-10/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c800b778fa7e115e4c34de8529902de8b61c9a1b4bab3eb8295d06dafff030e
+size 14645
diff --git a/checkpoint-10/scheduler.pt b/checkpoint-10/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..185c8d2073d914033605c76ec095b5d232b95928
--- /dev/null
+++ b/checkpoint-10/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:844a884673308e17d0d3d8cc35787aaf480a79645ae446fc3b30a1509a108ee7
+size 1465
diff --git a/checkpoint-10/tokenizer.json b/checkpoint-10/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-10/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-10/tokenizer_config.json b/checkpoint-10/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-10/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-10/trainer_state.json b/checkpoint-10/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..783d4d8f98c674f1b6bedf85f14c1e918e548021
--- /dev/null
+++ b/checkpoint-10/trainer_state.json
@@ -0,0 +1,104 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 2.0,
+ "eval_steps": 500,
+ "global_step": 10,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.8728970289230347,
+ "learning_rate": 0.0,
+ "loss": 1.7144343852996826,
+ "step": 1
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.6763373613357544,
+ "learning_rate": 2e-05,
+ "loss": 1.4952771663665771,
+ "step": 2
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 1.7191307544708252,
+ "learning_rate": 4e-05,
+ "loss": 1.574378252029419,
+ "step": 3
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 1.7878174781799316,
+ "learning_rate": 6e-05,
+ "loss": 1.6600843667984009,
+ "step": 4
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 1.929695725440979,
+ "learning_rate": 8e-05,
+ "loss": 1.7657139301300049,
+ "step": 5
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 1.8718829154968262,
+ "learning_rate": 0.0001,
+ "loss": 1.6730849742889404,
+ "step": 6
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 1.7125587463378906,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 1.5219359397888184,
+ "step": 7
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 1.4176026582717896,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 1.2670559883117676,
+ "step": 8
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 1.132968544960022,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.9341962933540344,
+ "step": 9
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 1.0091828107833862,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.9576144218444824,
+ "step": 10
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 50,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 185158513631232.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-10/training_args.bin b/checkpoint-10/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-10/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-100/README.md b/checkpoint-100/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-100/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-100/adapter_config.json b/checkpoint-100/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-100/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-100/adapter_model.safetensors b/checkpoint-100/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ad347f69cef7a62e50f195c555dad9fcea832091
--- /dev/null
+++ b/checkpoint-100/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7ec55170087ab5a04ac5a94ab9ea0467964979602d50acffcabb4db238304096
+size 132187888
diff --git a/checkpoint-100/chat_template.jinja b/checkpoint-100/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-100/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-100/optimizer.pt b/checkpoint-100/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..e8da659d2ae2bf29bab20ffe5e194024f81dc3a0
--- /dev/null
+++ b/checkpoint-100/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dcf6547a52417ca7c693de3fb9030eaa06a7fa982e1c750685e6ce41da0e9753
+size 67688197
diff --git a/checkpoint-100/rng_state.pth b/checkpoint-100/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..fead4304753e2900e172284781541c879e4507c4
--- /dev/null
+++ b/checkpoint-100/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d6d8fafcd1ee268414be5acf0366296af5b03d60871978712eac1979cb42d65
+size 14645
diff --git a/checkpoint-100/scheduler.pt b/checkpoint-100/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..7062f5d648d4683641e25134378c40531b587f65
--- /dev/null
+++ b/checkpoint-100/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95c774f440b747c5aa2e564755081073e987552abd5057d235a9e66d0bcb8a44
+size 1465
diff --git a/checkpoint-100/tokenizer.json b/checkpoint-100/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-100/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-100/tokenizer_config.json b/checkpoint-100/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-100/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-100/trainer_state.json b/checkpoint-100/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..22b6dd446b64141dfddfbd2c93c402f18db77f54
--- /dev/null
+++ b/checkpoint-100/trainer_state.json
@@ -0,0 +1,734 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 4.0,
+ "eval_steps": 500,
+ "global_step": 100,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ },
+ {
+ "epoch": 1.04,
+ "grad_norm": 0.36699211597442627,
+ "learning_rate": 0.0001,
+ "loss": 0.4363247752189636,
+ "step": 26
+ },
+ {
+ "epoch": 1.08,
+ "grad_norm": 0.3731786608695984,
+ "learning_rate": 9.955555555555556e-05,
+ "loss": 0.4297473430633545,
+ "step": 27
+ },
+ {
+ "epoch": 1.12,
+ "grad_norm": 0.3378784954547882,
+ "learning_rate": 9.911111111111112e-05,
+ "loss": 0.35973912477493286,
+ "step": 28
+ },
+ {
+ "epoch": 1.16,
+ "grad_norm": 0.36273664236068726,
+ "learning_rate": 9.866666666666668e-05,
+ "loss": 0.34903788566589355,
+ "step": 29
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 0.362885981798172,
+ "learning_rate": 9.822222222222223e-05,
+ "loss": 0.3119792342185974,
+ "step": 30
+ },
+ {
+ "epoch": 1.24,
+ "grad_norm": 0.3790324032306671,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 0.29530155658721924,
+ "step": 31
+ },
+ {
+ "epoch": 1.28,
+ "grad_norm": 0.37333837151527405,
+ "learning_rate": 9.733333333333335e-05,
+ "loss": 0.2653456926345825,
+ "step": 32
+ },
+ {
+ "epoch": 1.32,
+ "grad_norm": 0.32163503766059875,
+ "learning_rate": 9.68888888888889e-05,
+ "loss": 0.19654956459999084,
+ "step": 33
+ },
+ {
+ "epoch": 1.3599999999999999,
+ "grad_norm": 0.5297159552574158,
+ "learning_rate": 9.644444444444445e-05,
+ "loss": 0.23580318689346313,
+ "step": 34
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.4474238455295563,
+ "learning_rate": 9.6e-05,
+ "loss": 0.18798796832561493,
+ "step": 35
+ },
+ {
+ "epoch": 1.44,
+ "grad_norm": 0.31346794962882996,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 0.12066371738910675,
+ "step": 36
+ },
+ {
+ "epoch": 1.48,
+ "grad_norm": 0.3099532723426819,
+ "learning_rate": 9.511111111111112e-05,
+ "loss": 0.08859007060527802,
+ "step": 37
+ },
+ {
+ "epoch": 1.52,
+ "grad_norm": 0.3490828275680542,
+ "learning_rate": 9.466666666666667e-05,
+ "loss": 0.07878822088241577,
+ "step": 38
+ },
+ {
+ "epoch": 1.56,
+ "grad_norm": 0.32395538687705994,
+ "learning_rate": 9.422222222222223e-05,
+ "loss": 0.06694570928812027,
+ "step": 39
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 0.20870603621006012,
+ "learning_rate": 9.377777777777779e-05,
+ "loss": 0.04379018768668175,
+ "step": 40
+ },
+ {
+ "epoch": 1.6400000000000001,
+ "grad_norm": 0.3310009837150574,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.048647329211235046,
+ "step": 41
+ },
+ {
+ "epoch": 1.6800000000000002,
+ "grad_norm": 0.26949432492256165,
+ "learning_rate": 9.28888888888889e-05,
+ "loss": 0.039286017417907715,
+ "step": 42
+ },
+ {
+ "epoch": 1.72,
+ "grad_norm": 0.11029712855815887,
+ "learning_rate": 9.244444444444445e-05,
+ "loss": 0.029231950640678406,
+ "step": 43
+ },
+ {
+ "epoch": 1.76,
+ "grad_norm": 0.1476302146911621,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.027003085240721703,
+ "step": 44
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.18617521226406097,
+ "learning_rate": 9.155555555555557e-05,
+ "loss": 0.025106143206357956,
+ "step": 45
+ },
+ {
+ "epoch": 1.8399999999999999,
+ "grad_norm": 0.13198262453079224,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.025741657242178917,
+ "step": 46
+ },
+ {
+ "epoch": 1.88,
+ "grad_norm": 0.26712384819984436,
+ "learning_rate": 9.066666666666667e-05,
+ "loss": 0.035036977380514145,
+ "step": 47
+ },
+ {
+ "epoch": 1.92,
+ "grad_norm": 0.3569182753562927,
+ "learning_rate": 9.022222222222224e-05,
+ "loss": 0.04259534925222397,
+ "step": 48
+ },
+ {
+ "epoch": 1.96,
+ "grad_norm": 0.1843830794095993,
+ "learning_rate": 8.977777777777779e-05,
+ "loss": 0.03471647948026657,
+ "step": 49
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.1248057410120964,
+ "learning_rate": 8.933333333333334e-05,
+ "loss": 0.030936148017644882,
+ "step": 50
+ },
+ {
+ "epoch": 2.04,
+ "grad_norm": 0.12060711532831192,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.032452136278152466,
+ "step": 51
+ },
+ {
+ "epoch": 2.08,
+ "grad_norm": 0.2026030570268631,
+ "learning_rate": 8.844444444444445e-05,
+ "loss": 0.03268110007047653,
+ "step": 52
+ },
+ {
+ "epoch": 2.12,
+ "grad_norm": 0.21289987862110138,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.03406357392668724,
+ "step": 53
+ },
+ {
+ "epoch": 2.16,
+ "grad_norm": 0.14732478559017181,
+ "learning_rate": 8.755555555555556e-05,
+ "loss": 0.02936721034348011,
+ "step": 54
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.10120426118373871,
+ "learning_rate": 8.711111111111112e-05,
+ "loss": 0.02511693350970745,
+ "step": 55
+ },
+ {
+ "epoch": 2.24,
+ "grad_norm": 0.08917918056249619,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.025877539068460464,
+ "step": 56
+ },
+ {
+ "epoch": 2.2800000000000002,
+ "grad_norm": 0.08735086023807526,
+ "learning_rate": 8.622222222222222e-05,
+ "loss": 0.02145460993051529,
+ "step": 57
+ },
+ {
+ "epoch": 2.32,
+ "grad_norm": 0.07835431396961212,
+ "learning_rate": 8.577777777777777e-05,
+ "loss": 0.021244943141937256,
+ "step": 58
+ },
+ {
+ "epoch": 2.36,
+ "grad_norm": 0.06953317672014236,
+ "learning_rate": 8.533333333333334e-05,
+ "loss": 0.02279437705874443,
+ "step": 59
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.0854259729385376,
+ "learning_rate": 8.488888888888889e-05,
+ "loss": 0.023704543709754944,
+ "step": 60
+ },
+ {
+ "epoch": 2.44,
+ "grad_norm": 0.17068363726139069,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.035272784531116486,
+ "step": 61
+ },
+ {
+ "epoch": 2.48,
+ "grad_norm": 0.11971863359212875,
+ "learning_rate": 8.4e-05,
+ "loss": 0.02707826718688011,
+ "step": 62
+ },
+ {
+ "epoch": 2.52,
+ "grad_norm": 0.05303095281124115,
+ "learning_rate": 8.355555555555556e-05,
+ "loss": 0.01696968823671341,
+ "step": 63
+ },
+ {
+ "epoch": 2.56,
+ "grad_norm": 0.06503961980342865,
+ "learning_rate": 8.311111111111111e-05,
+ "loss": 0.018413860350847244,
+ "step": 64
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.05390244349837303,
+ "learning_rate": 8.266666666666667e-05,
+ "loss": 0.01641814410686493,
+ "step": 65
+ },
+ {
+ "epoch": 2.64,
+ "grad_norm": 0.07149611413478851,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.020658448338508606,
+ "step": 66
+ },
+ {
+ "epoch": 2.68,
+ "grad_norm": 0.09244706481695175,
+ "learning_rate": 8.177777777777778e-05,
+ "loss": 0.022394295781850815,
+ "step": 67
+ },
+ {
+ "epoch": 2.7199999999999998,
+ "grad_norm": 0.11381954699754715,
+ "learning_rate": 8.133333333333334e-05,
+ "loss": 0.028476765379309654,
+ "step": 68
+ },
+ {
+ "epoch": 2.76,
+ "grad_norm": 0.07354001700878143,
+ "learning_rate": 8.088888888888889e-05,
+ "loss": 0.019497834146022797,
+ "step": 69
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.06727641820907593,
+ "learning_rate": 8.044444444444444e-05,
+ "loss": 0.014356930740177631,
+ "step": 70
+ },
+ {
+ "epoch": 2.84,
+ "grad_norm": 0.07417713105678558,
+ "learning_rate": 8e-05,
+ "loss": 0.01823577657341957,
+ "step": 71
+ },
+ {
+ "epoch": 2.88,
+ "grad_norm": 0.09163317829370499,
+ "learning_rate": 7.955555555555556e-05,
+ "loss": 0.02139071188867092,
+ "step": 72
+ },
+ {
+ "epoch": 2.92,
+ "grad_norm": 0.08178975433111191,
+ "learning_rate": 7.911111111111111e-05,
+ "loss": 0.018335483968257904,
+ "step": 73
+ },
+ {
+ "epoch": 2.96,
+ "grad_norm": 0.08015220612287521,
+ "learning_rate": 7.866666666666666e-05,
+ "loss": 0.016001513227820396,
+ "step": 74
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.08509402722120285,
+ "learning_rate": 7.822222222222223e-05,
+ "loss": 0.017747700214385986,
+ "step": 75
+ },
+ {
+ "epoch": 3.04,
+ "grad_norm": 0.07863253355026245,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.015054607763886452,
+ "step": 76
+ },
+ {
+ "epoch": 3.08,
+ "grad_norm": 0.09398715198040009,
+ "learning_rate": 7.733333333333333e-05,
+ "loss": 0.01887289062142372,
+ "step": 77
+ },
+ {
+ "epoch": 3.12,
+ "grad_norm": 0.12165197730064392,
+ "learning_rate": 7.688888888888889e-05,
+ "loss": 0.020169202238321304,
+ "step": 78
+ },
+ {
+ "epoch": 3.16,
+ "grad_norm": 0.07627179473638535,
+ "learning_rate": 7.644444444444445e-05,
+ "loss": 0.012153002433478832,
+ "step": 79
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.0885142832994461,
+ "learning_rate": 7.6e-05,
+ "loss": 0.015390444546937943,
+ "step": 80
+ },
+ {
+ "epoch": 3.24,
+ "grad_norm": 0.11557707190513611,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.019245222210884094,
+ "step": 81
+ },
+ {
+ "epoch": 3.2800000000000002,
+ "grad_norm": 0.0976581946015358,
+ "learning_rate": 7.511111111111111e-05,
+ "loss": 0.014158917590975761,
+ "step": 82
+ },
+ {
+ "epoch": 3.32,
+ "grad_norm": 0.09829393774271011,
+ "learning_rate": 7.466666666666667e-05,
+ "loss": 0.013099931180477142,
+ "step": 83
+ },
+ {
+ "epoch": 3.36,
+ "grad_norm": 0.10063999146223068,
+ "learning_rate": 7.422222222222223e-05,
+ "loss": 0.013834481127560139,
+ "step": 84
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.09943496435880661,
+ "learning_rate": 7.377777777777778e-05,
+ "loss": 0.012920765206217766,
+ "step": 85
+ },
+ {
+ "epoch": 3.44,
+ "grad_norm": 0.1093878448009491,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.013458158820867538,
+ "step": 86
+ },
+ {
+ "epoch": 3.48,
+ "grad_norm": 0.1128634586930275,
+ "learning_rate": 7.28888888888889e-05,
+ "loss": 0.013067865744233131,
+ "step": 87
+ },
+ {
+ "epoch": 3.52,
+ "grad_norm": 0.11049138009548187,
+ "learning_rate": 7.244444444444445e-05,
+ "loss": 0.01237843930721283,
+ "step": 88
+ },
+ {
+ "epoch": 3.56,
+ "grad_norm": 0.1535821557044983,
+ "learning_rate": 7.2e-05,
+ "loss": 0.015146344900131226,
+ "step": 89
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.10436677187681198,
+ "learning_rate": 7.155555555555555e-05,
+ "loss": 0.00996164046227932,
+ "step": 90
+ },
+ {
+ "epoch": 3.64,
+ "grad_norm": 0.14084051549434662,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.013795388862490654,
+ "step": 91
+ },
+ {
+ "epoch": 3.68,
+ "grad_norm": 0.12718933820724487,
+ "learning_rate": 7.066666666666667e-05,
+ "loss": 0.011878985911607742,
+ "step": 92
+ },
+ {
+ "epoch": 3.7199999999999998,
+ "grad_norm": 0.1412353217601776,
+ "learning_rate": 7.022222222222222e-05,
+ "loss": 0.010964864864945412,
+ "step": 93
+ },
+ {
+ "epoch": 3.76,
+ "grad_norm": 0.11453556269407272,
+ "learning_rate": 6.977777777777779e-05,
+ "loss": 0.008170144632458687,
+ "step": 94
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.16155096888542175,
+ "learning_rate": 6.933333333333334e-05,
+ "loss": 0.011488870717585087,
+ "step": 95
+ },
+ {
+ "epoch": 3.84,
+ "grad_norm": 0.11969174444675446,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.007895090617239475,
+ "step": 96
+ },
+ {
+ "epoch": 3.88,
+ "grad_norm": 0.22626101970672607,
+ "learning_rate": 6.844444444444445e-05,
+ "loss": 0.01467936858534813,
+ "step": 97
+ },
+ {
+ "epoch": 3.92,
+ "grad_norm": 0.21040032804012299,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.010772328823804855,
+ "step": 98
+ },
+ {
+ "epoch": 3.96,
+ "grad_norm": 0.19558775424957275,
+ "learning_rate": 6.755555555555557e-05,
+ "loss": 0.009220557287335396,
+ "step": 99
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.18061381578445435,
+ "learning_rate": 6.711111111111112e-05,
+ "loss": 0.006471008062362671,
+ "step": 100
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 4905305320980480.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-100/training_args.bin b/checkpoint-100/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-100/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-1188/README.md b/checkpoint-1188/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-1188/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-1188/adapter_config.json b/checkpoint-1188/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..879d59d17cdb2aff2a9fcb7e4537a4f740bf19f5
--- /dev/null
+++ b/checkpoint-1188/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "o_proj",
+ "up_proj",
+ "down_proj",
+ "v_proj",
+ "k_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-1188/adapter_model.safetensors b/checkpoint-1188/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..da531029a48ceac928e2e02bdb137f21f9457c7f
--- /dev/null
+++ b/checkpoint-1188/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4cb1042934755d765e721fc2cea13b78a3d47ab7dc0ee9562a3a1015081fab18
+size 132187888
diff --git a/checkpoint-1188/chat_template.jinja b/checkpoint-1188/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-1188/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-1188/optimizer.pt b/checkpoint-1188/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..b20fec787a2952c4eb918e7343fd00f472ef085a
--- /dev/null
+++ b/checkpoint-1188/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1261085ebc53be58802345f754c1dc5e49d23342600afbcc4bf77e4e069cc23f
+size 67688645
diff --git a/checkpoint-1188/rng_state.pth b/checkpoint-1188/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..119a2feec6d0222b6a987748eb278f3a8baec0d9
--- /dev/null
+++ b/checkpoint-1188/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d895ccae2b55d4ea213653ca4a80d00de131463e105716eab1b7022906f260bf
+size 14645
diff --git a/checkpoint-1188/scheduler.pt b/checkpoint-1188/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..62ac4a57383b99e170c51563497cf1c68877d5d9
--- /dev/null
+++ b/checkpoint-1188/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2fcc675fb65ddae93b833f4c66275c1680ff23438e40501c1b99131593965d66
+size 1465
diff --git a/checkpoint-1188/tokenizer.json b/checkpoint-1188/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-1188/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-1188/tokenizer_config.json b/checkpoint-1188/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-1188/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-1188/trainer_state.json b/checkpoint-1188/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..dd0d6f4638032ccc5d9e982f2a0add233e1c1fb4
--- /dev/null
+++ b/checkpoint-1188/trainer_state.json
@@ -0,0 +1,8350 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 6.0,
+ "eval_steps": 500,
+ "global_step": 1188,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.54137122631073,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279057860374451,
+ "learning_rate": 5.050505050505052e-07,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.7017749547958374,
+ "learning_rate": 1.0101010101010103e-06,
+ "loss": 1.0435928106307983,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6033008098602295,
+ "learning_rate": 1.5151515151515152e-06,
+ "loss": 0.8843490481376648,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5495544672012329,
+ "learning_rate": 2.0202020202020206e-06,
+ "loss": 0.8034592866897583,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.802371621131897,
+ "learning_rate": 2.5252525252525253e-06,
+ "loss": 1.1588364839553833,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8238587975502014,
+ "learning_rate": 3.0303030303030305e-06,
+ "loss": 1.228503942489624,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6073964238166809,
+ "learning_rate": 3.5353535353535352e-06,
+ "loss": 0.8989433646202087,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 0.6492345333099365,
+ "learning_rate": 4.040404040404041e-06,
+ "loss": 0.9615614414215088,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.6880183815956116,
+ "learning_rate": 4.5454545454545455e-06,
+ "loss": 0.9233697652816772,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.470304012298584,
+ "learning_rate": 5.050505050505051e-06,
+ "loss": 0.7186562418937683,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6361913681030273,
+ "learning_rate": 5.555555555555556e-06,
+ "loss": 0.9312829375267029,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5554782152175903,
+ "learning_rate": 6.060606060606061e-06,
+ "loss": 0.8529565334320068,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5414550304412842,
+ "learning_rate": 6.565656565656567e-06,
+ "loss": 0.8071130514144897,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9267164468765259,
+ "learning_rate": 7.0707070707070704e-06,
+ "loss": 1.3577998876571655,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.6104046106338501,
+ "learning_rate": 7.5757575757575764e-06,
+ "loss": 0.923499345779419,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.7241935133934021,
+ "learning_rate": 8.080808080808082e-06,
+ "loss": 1.0400190353393555,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.6026384830474854,
+ "learning_rate": 8.585858585858587e-06,
+ "loss": 0.8413939476013184,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.7690514922142029,
+ "learning_rate": 9.090909090909091e-06,
+ "loss": 1.0870859622955322,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.5940403342247009,
+ "learning_rate": 9.595959595959595e-06,
+ "loss": 0.8468416929244995,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.669230580329895,
+ "learning_rate": 1.0101010101010101e-05,
+ "loss": 0.9340983629226685,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.5750640034675598,
+ "learning_rate": 1.0606060606060607e-05,
+ "loss": 0.8230171799659729,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.6579262614250183,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.9293508529663086,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.5956451296806335,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.8316305875778198,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.7270558476448059,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.9129499197006226,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.7505611777305603,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 1.0138367414474487,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.6870062947273254,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.901283860206604,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.7679643630981445,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.9833810329437256,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.866938591003418,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.8958402872085571,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.8687500357627869,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 1.1289801597595215,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 4.008030891418457,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 1.2739044427871704,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.7689681053161621,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.8514111638069153,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.7880434393882751,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.8862775564193726,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.6183183789253235,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.7857811450958252,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.6437809467315674,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.7093011736869812,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.5481512546539307,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.7350327968597412,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.4838634729385376,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.6584650874137878,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.523994505405426,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.7211161851882935,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.6523379683494568,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.9044773578643799,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.4274725615978241,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.568337082862854,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.5060272812843323,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.7201821208000183,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.3760877251625061,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.5880123376846313,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.3715391457080841,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.5693179368972778,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.4332570731639862,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.7277271151542664,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.38201987743377686,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.6458995938301086,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.4358846843242645,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.7559939026832581,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.4566098749637604,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.7792297601699829,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.3864676356315613,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.6894873380661011,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.31187522411346436,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.545581579208374,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.3325943350791931,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.5917496085166931,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.6410307884216309,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.44281136989593506,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.36323168873786926,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.6426926851272583,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.31924113631248474,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.5482619404792786,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.3632371723651886,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.6188253164291382,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.375381201505661,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.5487836003303528,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.3163473606109619,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.5367064476013184,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.42646294832229614,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.41221165657043457,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.41622766852378845,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.5274936556816101,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.30204030871391296,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.44855833053588867,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.3178975582122803,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.4036139249801636,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.2893930673599243,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.39234185218811035,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.2833489775657654,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.37406405806541443,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.3216562867164612,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.3938276767730713,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.26721706986427307,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.30402088165283203,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.3702670931816101,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.30594947934150696,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.2632184326648712,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.2691727876663208,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.36898860335350037,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.33992528915405273,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.2976086735725403,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.27603086829185486,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.32201430201530457,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.25665703415870667,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.35001808404922485,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.24190445244312286,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.5106059908866882,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.3093336820602417,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.3261374831199646,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.18783289194107056,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.38757652044296265,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.19549766182899475,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.4723363518714905,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.15751558542251587,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.36796173453330994,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.14514681696891785,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.3855208456516266,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.14030519127845764,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.5906668305397034,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.1478388011455536,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.2658001780509949,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.13253600895404816,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.33554506301879883,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.12156252562999725,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.2643960416316986,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.1089208647608757,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.19129537045955658,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.08515600860118866,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.22168858349323273,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.09310197830200195,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.16676382720470428,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.07711787521839142,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.23891882598400116,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.09763285517692566,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.28446146845817566,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.08980057388544083,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.146108940243721,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.06573648750782013,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.2007656991481781,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.0699995830655098,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.3082621395587921,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.0885838121175766,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.1624963879585266,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.06935172528028488,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.1562737673521042,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.07147250324487686,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.1660323292016983,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.0672944188117981,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.21427564322948456,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.07051930576562881,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.16495929658412933,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.05429624393582344,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.1978198140859604,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.07144488394260406,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.15077605843544006,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.055798254907131195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.2806876301765442,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.06058178097009659,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.1219187006354332,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.05044667422771454,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10286939144134521,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.048498690128326416,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.12813609838485718,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.06252863258123398,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10565406829118729,
+ "learning_rate": 5e-05,
+ "loss": 0.051401108503341675,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.09147113561630249,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.047376491129398346,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.08723224699497223,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.039745647460222244,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.16071128845214844,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.058398712426424026,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.1370300054550171,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.05132289230823517,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.19449608027935028,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.06682188808917999,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.13085028529167175,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.049861155450344086,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.1768050193786621,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.055694688111543655,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.2819313704967499,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.062391363084316254,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.10738537460565567,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.05093343183398247,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.11759619414806366,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.044827841222286224,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.21941131353378296,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.05238347500562668,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.1697252243757248,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.04869212955236435,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.19701889157295227,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.04484856128692627,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.11779771000146866,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.04135368764400482,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.19823911786079407,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.05097956955432892,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.17355702817440033,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.05781872197985649,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.13029292225837708,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.041528262197971344,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.1292058229446411,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.0442211888730526,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10058800131082535,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.03813612461090088,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.22936487197875977,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.056090980768203735,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.13063806295394897,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.04347142577171326,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.167104110121727,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.04442849010229111,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.11942817270755768,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.03964124619960785,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.17906631529331207,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.04372458904981613,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.13760331273078918,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.03980286419391632,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.18043340742588043,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.05500294268131256,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.31386223435401917,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.04253799840807915,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.1428707093000412,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.047894880175590515,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.11010178923606873,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.04534825310111046,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.10444525629281998,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.041347943246364594,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.18076039850711823,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.04535853862762451,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.19424672424793243,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.05037602037191391,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.1457783728837967,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.047546930611133575,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.1189681887626648,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.03254905715584755,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.18887822329998016,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.04018670320510864,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.12217189371585846,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.03981504589319229,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.10866257548332214,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.04322533681988716,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.15904399752616882,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.04488902539014816,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.12598516047000885,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.04718853533267975,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.22092872858047485,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.03646199405193329,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.1717238426208496,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.04607801511883736,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.16268078982830048,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.04759417474269867,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.19621087610721588,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.051741112023591995,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.15362979471683502,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.04363569617271423,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.1404130607843399,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.045428819954395294,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.12262272834777832,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.03828439861536026,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.10626570880413055,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.03420639410614967,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.12686072289943695,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.03474457561969757,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.153709277510643,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.03174472972750664,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.13035084307193756,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.02982976846396923,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.12288431823253632,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.03588784486055374,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.19307470321655273,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.04750734567642212,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.0996781438589096,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.027098631486296654,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.16898290812969208,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.040447790175676346,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.10996036231517792,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.02525201067328453,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.16161896288394928,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.04199359938502312,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.1536172777414322,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.02943507581949234,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.18457260727882385,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.04093889892101288,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.11232347041368484,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.029609719291329384,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.19080978631973267,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.0357801653444767,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.16634301841259003,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02980419248342514,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.28601372241973877,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.032849978655576706,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.1359848529100418,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.0230826735496521,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.11285015195608139,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.02447221614420414,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.14712421596050262,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.022657420486211777,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.18246804177761078,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.035991013050079346,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.143621563911438,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.024444863200187683,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.12458691000938416,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.039701592177152634,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05614984780550003,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.029840555042028427,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.06097931042313576,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.027426715940237045,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.09883654862642288,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031690437346696854,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.0700431764125824,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.024079838767647743,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.05957406386733055,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.02303817868232727,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.14374858140945435,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.031183632090687752,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.09187919646501541,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.031176958233118057,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.0540630929172039,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.024949276819825172,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06875574588775635,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.02890622243285179,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.10081329196691513,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.03019360452890396,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.11833225935697556,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.020365778356790543,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.08700298517942429,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.027046984061598778,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.08660133928060532,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.027088070288300514,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.06983930617570877,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.019332535564899445,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.09463227540254593,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.02780212089419365,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.10251298546791077,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.026878856122493744,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.15963847935199738,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.03437665104866028,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.11342372000217438,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.02877948433160782,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.0937543660402298,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.02759186364710331,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.07137084752321243,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.02941890060901642,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.3511611819267273,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.024331524968147278,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.12344356626272202,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.0348694771528244,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.07144290208816528,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.021711278706789017,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.09835992008447647,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.03408564254641533,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.4978399872779846,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.03810017928481102,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.06314591318368912,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.0201277956366539,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.07504695653915405,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.025770913809537888,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.1028534397482872,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.02469150349497795,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.09341974556446075,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.036506302654743195,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09348680078983307,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02507903426885605,
+ "step": 198
+ },
+ {
+ "epoch": 1.0050632911392405,
+ "grad_norm": 0.06890113651752472,
+ "learning_rate": 0.0001,
+ "loss": 0.028374083340168,
+ "step": 199
+ },
+ {
+ "epoch": 1.010126582278481,
+ "grad_norm": 0.051041170954704285,
+ "learning_rate": 9.994388327721661e-05,
+ "loss": 0.022860335186123848,
+ "step": 200
+ },
+ {
+ "epoch": 1.0151898734177216,
+ "grad_norm": 0.10253743082284927,
+ "learning_rate": 9.988776655443322e-05,
+ "loss": 0.02864072285592556,
+ "step": 201
+ },
+ {
+ "epoch": 1.0202531645569621,
+ "grad_norm": 0.08295776695013046,
+ "learning_rate": 9.983164983164983e-05,
+ "loss": 0.0327395498752594,
+ "step": 202
+ },
+ {
+ "epoch": 1.0253164556962024,
+ "grad_norm": 0.07240694016218185,
+ "learning_rate": 9.977553310886645e-05,
+ "loss": 0.029215697199106216,
+ "step": 203
+ },
+ {
+ "epoch": 1.030379746835443,
+ "grad_norm": 0.0688897892832756,
+ "learning_rate": 9.971941638608306e-05,
+ "loss": 0.027594968676567078,
+ "step": 204
+ },
+ {
+ "epoch": 1.0354430379746835,
+ "grad_norm": 0.08463896065950394,
+ "learning_rate": 9.966329966329967e-05,
+ "loss": 0.02292536199092865,
+ "step": 205
+ },
+ {
+ "epoch": 1.040506329113924,
+ "grad_norm": 0.062013301998376846,
+ "learning_rate": 9.960718294051628e-05,
+ "loss": 0.023678191006183624,
+ "step": 206
+ },
+ {
+ "epoch": 1.0455696202531646,
+ "grad_norm": 0.08735264092683792,
+ "learning_rate": 9.955106621773289e-05,
+ "loss": 0.022060325369238853,
+ "step": 207
+ },
+ {
+ "epoch": 1.0506329113924051,
+ "grad_norm": 0.07634295523166656,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02764434739947319,
+ "step": 208
+ },
+ {
+ "epoch": 1.0556962025316456,
+ "grad_norm": 0.09735682606697083,
+ "learning_rate": 9.943883277216612e-05,
+ "loss": 0.03304428607225418,
+ "step": 209
+ },
+ {
+ "epoch": 1.0607594936708862,
+ "grad_norm": 0.06860044598579407,
+ "learning_rate": 9.938271604938272e-05,
+ "loss": 0.0340178906917572,
+ "step": 210
+ },
+ {
+ "epoch": 1.0658227848101265,
+ "grad_norm": 0.3715139627456665,
+ "learning_rate": 9.932659932659934e-05,
+ "loss": 0.02541016787290573,
+ "step": 211
+ },
+ {
+ "epoch": 1.070886075949367,
+ "grad_norm": 0.07673332840204239,
+ "learning_rate": 9.927048260381594e-05,
+ "loss": 0.025950253009796143,
+ "step": 212
+ },
+ {
+ "epoch": 1.0759493670886076,
+ "grad_norm": 0.07359500974416733,
+ "learning_rate": 9.921436588103256e-05,
+ "loss": 0.024356549605727196,
+ "step": 213
+ },
+ {
+ "epoch": 1.081012658227848,
+ "grad_norm": 0.07760954648256302,
+ "learning_rate": 9.915824915824916e-05,
+ "loss": 0.02338298037648201,
+ "step": 214
+ },
+ {
+ "epoch": 1.0860759493670886,
+ "grad_norm": 0.09183681756258011,
+ "learning_rate": 9.910213243546578e-05,
+ "loss": 0.020955465734004974,
+ "step": 215
+ },
+ {
+ "epoch": 1.0911392405063292,
+ "grad_norm": 0.21278677880764008,
+ "learning_rate": 9.904601571268239e-05,
+ "loss": 0.028164055198431015,
+ "step": 216
+ },
+ {
+ "epoch": 1.0962025316455697,
+ "grad_norm": 0.22437937557697296,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.03543347865343094,
+ "step": 217
+ },
+ {
+ "epoch": 1.1012658227848102,
+ "grad_norm": 0.08677598088979721,
+ "learning_rate": 9.893378226711561e-05,
+ "loss": 0.031265974044799805,
+ "step": 218
+ },
+ {
+ "epoch": 1.1063291139240505,
+ "grad_norm": 0.09595583379268646,
+ "learning_rate": 9.887766554433222e-05,
+ "loss": 0.02384507656097412,
+ "step": 219
+ },
+ {
+ "epoch": 1.111392405063291,
+ "grad_norm": 0.08256062865257263,
+ "learning_rate": 9.882154882154883e-05,
+ "loss": 0.022209012880921364,
+ "step": 220
+ },
+ {
+ "epoch": 1.1164556962025316,
+ "grad_norm": 0.07712455838918686,
+ "learning_rate": 9.876543209876543e-05,
+ "loss": 0.025278344750404358,
+ "step": 221
+ },
+ {
+ "epoch": 1.1215189873417721,
+ "grad_norm": 0.09704182296991348,
+ "learning_rate": 9.870931537598205e-05,
+ "loss": 0.024904735386371613,
+ "step": 222
+ },
+ {
+ "epoch": 1.1265822784810127,
+ "grad_norm": 0.09094078838825226,
+ "learning_rate": 9.865319865319865e-05,
+ "loss": 0.0280012097209692,
+ "step": 223
+ },
+ {
+ "epoch": 1.1316455696202532,
+ "grad_norm": 0.07607442885637283,
+ "learning_rate": 9.859708193041527e-05,
+ "loss": 0.026181645691394806,
+ "step": 224
+ },
+ {
+ "epoch": 1.1367088607594937,
+ "grad_norm": 0.06568697839975357,
+ "learning_rate": 9.854096520763188e-05,
+ "loss": 0.02883346565067768,
+ "step": 225
+ },
+ {
+ "epoch": 1.1417721518987343,
+ "grad_norm": 0.07192376255989075,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.027345171198248863,
+ "step": 226
+ },
+ {
+ "epoch": 1.1468354430379746,
+ "grad_norm": 0.1464017778635025,
+ "learning_rate": 9.84287317620651e-05,
+ "loss": 0.03213154152035713,
+ "step": 227
+ },
+ {
+ "epoch": 1.1518987341772151,
+ "grad_norm": 0.06766578555107117,
+ "learning_rate": 9.837261503928171e-05,
+ "loss": 0.02554963156580925,
+ "step": 228
+ },
+ {
+ "epoch": 1.1569620253164556,
+ "grad_norm": 0.09428609162569046,
+ "learning_rate": 9.831649831649832e-05,
+ "loss": 0.02484097331762314,
+ "step": 229
+ },
+ {
+ "epoch": 1.1620253164556962,
+ "grad_norm": 0.1648297905921936,
+ "learning_rate": 9.826038159371493e-05,
+ "loss": 0.03450813889503479,
+ "step": 230
+ },
+ {
+ "epoch": 1.1670886075949367,
+ "grad_norm": 0.06389904767274857,
+ "learning_rate": 9.820426487093154e-05,
+ "loss": 0.02957337349653244,
+ "step": 231
+ },
+ {
+ "epoch": 1.1721518987341772,
+ "grad_norm": 0.11517420411109924,
+ "learning_rate": 9.814814814814815e-05,
+ "loss": 0.024299729615449905,
+ "step": 232
+ },
+ {
+ "epoch": 1.1772151898734178,
+ "grad_norm": 0.06960142403841019,
+ "learning_rate": 9.809203142536476e-05,
+ "loss": 0.025762220844626427,
+ "step": 233
+ },
+ {
+ "epoch": 1.1822784810126583,
+ "grad_norm": 0.11682946234941483,
+ "learning_rate": 9.803591470258137e-05,
+ "loss": 0.02457268163561821,
+ "step": 234
+ },
+ {
+ "epoch": 1.1873417721518988,
+ "grad_norm": 0.07964848726987839,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.027285631746053696,
+ "step": 235
+ },
+ {
+ "epoch": 1.1924050632911392,
+ "grad_norm": 0.053044773638248444,
+ "learning_rate": 9.79236812570146e-05,
+ "loss": 0.020997609943151474,
+ "step": 236
+ },
+ {
+ "epoch": 1.1974683544303797,
+ "grad_norm": 0.13531149923801422,
+ "learning_rate": 9.78675645342312e-05,
+ "loss": 0.02474522590637207,
+ "step": 237
+ },
+ {
+ "epoch": 1.2025316455696202,
+ "grad_norm": 0.0774424746632576,
+ "learning_rate": 9.781144781144782e-05,
+ "loss": 0.025272740051150322,
+ "step": 238
+ },
+ {
+ "epoch": 1.2075949367088608,
+ "grad_norm": 0.042708419263362885,
+ "learning_rate": 9.775533108866442e-05,
+ "loss": 0.019522909075021744,
+ "step": 239
+ },
+ {
+ "epoch": 1.2126582278481013,
+ "grad_norm": 0.10364090651273727,
+ "learning_rate": 9.769921436588104e-05,
+ "loss": 0.02728935517370701,
+ "step": 240
+ },
+ {
+ "epoch": 1.2177215189873418,
+ "grad_norm": 0.0756702646613121,
+ "learning_rate": 9.764309764309764e-05,
+ "loss": 0.02659972943365574,
+ "step": 241
+ },
+ {
+ "epoch": 1.2227848101265824,
+ "grad_norm": 0.07232004404067993,
+ "learning_rate": 9.758698092031426e-05,
+ "loss": 0.017723949626088142,
+ "step": 242
+ },
+ {
+ "epoch": 1.2278481012658227,
+ "grad_norm": 0.058345306664705276,
+ "learning_rate": 9.753086419753087e-05,
+ "loss": 0.019348861649632454,
+ "step": 243
+ },
+ {
+ "epoch": 1.2329113924050632,
+ "grad_norm": 0.14832371473312378,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.03227488696575165,
+ "step": 244
+ },
+ {
+ "epoch": 1.2379746835443037,
+ "grad_norm": 0.05343412607908249,
+ "learning_rate": 9.74186307519641e-05,
+ "loss": 0.0210015457123518,
+ "step": 245
+ },
+ {
+ "epoch": 1.2430379746835443,
+ "grad_norm": 0.054104797542095184,
+ "learning_rate": 9.736251402918069e-05,
+ "loss": 0.02430287003517151,
+ "step": 246
+ },
+ {
+ "epoch": 1.2481012658227848,
+ "grad_norm": 0.11686044931411743,
+ "learning_rate": 9.730639730639732e-05,
+ "loss": 0.029372017830610275,
+ "step": 247
+ },
+ {
+ "epoch": 1.2531645569620253,
+ "grad_norm": 0.05970177799463272,
+ "learning_rate": 9.725028058361391e-05,
+ "loss": 0.024995045736432076,
+ "step": 248
+ },
+ {
+ "epoch": 1.2582278481012659,
+ "grad_norm": 0.06506923586130142,
+ "learning_rate": 9.719416386083054e-05,
+ "loss": 0.024779727682471275,
+ "step": 249
+ },
+ {
+ "epoch": 1.2632911392405064,
+ "grad_norm": 0.12711220979690552,
+ "learning_rate": 9.713804713804715e-05,
+ "loss": 0.026196476072072983,
+ "step": 250
+ },
+ {
+ "epoch": 1.268354430379747,
+ "grad_norm": 0.056023694574832916,
+ "learning_rate": 9.708193041526376e-05,
+ "loss": 0.01813146471977234,
+ "step": 251
+ },
+ {
+ "epoch": 1.2734177215189875,
+ "grad_norm": 0.04508040472865105,
+ "learning_rate": 9.702581369248037e-05,
+ "loss": 0.019225183874368668,
+ "step": 252
+ },
+ {
+ "epoch": 1.2784810126582278,
+ "grad_norm": 0.10354425758123398,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.02940209209918976,
+ "step": 253
+ },
+ {
+ "epoch": 1.2835443037974683,
+ "grad_norm": 0.06974297761917114,
+ "learning_rate": 9.691358024691359e-05,
+ "loss": 0.02482295036315918,
+ "step": 254
+ },
+ {
+ "epoch": 1.2886075949367088,
+ "grad_norm": 0.06940010190010071,
+ "learning_rate": 9.68574635241302e-05,
+ "loss": 0.020605089142918587,
+ "step": 255
+ },
+ {
+ "epoch": 1.2936708860759494,
+ "grad_norm": 0.09167850762605667,
+ "learning_rate": 9.68013468013468e-05,
+ "loss": 0.02429921180009842,
+ "step": 256
+ },
+ {
+ "epoch": 1.29873417721519,
+ "grad_norm": 0.048866868019104004,
+ "learning_rate": 9.674523007856342e-05,
+ "loss": 0.021776504814624786,
+ "step": 257
+ },
+ {
+ "epoch": 1.3037974683544304,
+ "grad_norm": 0.06977155059576035,
+ "learning_rate": 9.668911335578003e-05,
+ "loss": 0.02758147194981575,
+ "step": 258
+ },
+ {
+ "epoch": 1.3088607594936708,
+ "grad_norm": 0.17602303624153137,
+ "learning_rate": 9.663299663299664e-05,
+ "loss": 0.026518259197473526,
+ "step": 259
+ },
+ {
+ "epoch": 1.3139240506329113,
+ "grad_norm": 0.08011946082115173,
+ "learning_rate": 9.657687991021325e-05,
+ "loss": 0.026240577921271324,
+ "step": 260
+ },
+ {
+ "epoch": 1.3189873417721518,
+ "grad_norm": 0.06296376883983612,
+ "learning_rate": 9.652076318742987e-05,
+ "loss": 0.03159455955028534,
+ "step": 261
+ },
+ {
+ "epoch": 1.3240506329113924,
+ "grad_norm": 0.04424722492694855,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.024151435121893883,
+ "step": 262
+ },
+ {
+ "epoch": 1.3291139240506329,
+ "grad_norm": 0.045779623091220856,
+ "learning_rate": 9.640852974186309e-05,
+ "loss": 0.018655993044376373,
+ "step": 263
+ },
+ {
+ "epoch": 1.3341772151898734,
+ "grad_norm": 0.06355931609869003,
+ "learning_rate": 9.635241301907969e-05,
+ "loss": 0.01999380812048912,
+ "step": 264
+ },
+ {
+ "epoch": 1.339240506329114,
+ "grad_norm": 0.04477616026997566,
+ "learning_rate": 9.62962962962963e-05,
+ "loss": 0.021614115685224533,
+ "step": 265
+ },
+ {
+ "epoch": 1.3443037974683545,
+ "grad_norm": 0.05851180478930473,
+ "learning_rate": 9.62401795735129e-05,
+ "loss": 0.023495908826589584,
+ "step": 266
+ },
+ {
+ "epoch": 1.349367088607595,
+ "grad_norm": 0.04724022373557091,
+ "learning_rate": 9.618406285072952e-05,
+ "loss": 0.02053767442703247,
+ "step": 267
+ },
+ {
+ "epoch": 1.3544303797468356,
+ "grad_norm": 0.12757639586925507,
+ "learning_rate": 9.612794612794614e-05,
+ "loss": 0.030612681061029434,
+ "step": 268
+ },
+ {
+ "epoch": 1.3594936708860759,
+ "grad_norm": 0.18316853046417236,
+ "learning_rate": 9.607182940516274e-05,
+ "loss": 0.039485104382038116,
+ "step": 269
+ },
+ {
+ "epoch": 1.3645569620253164,
+ "grad_norm": 0.09149223566055298,
+ "learning_rate": 9.601571268237936e-05,
+ "loss": 0.031156456097960472,
+ "step": 270
+ },
+ {
+ "epoch": 1.369620253164557,
+ "grad_norm": 0.07885908335447311,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.026395633816719055,
+ "step": 271
+ },
+ {
+ "epoch": 1.3746835443037975,
+ "grad_norm": 0.0984397754073143,
+ "learning_rate": 9.590347923681258e-05,
+ "loss": 0.02990398183465004,
+ "step": 272
+ },
+ {
+ "epoch": 1.379746835443038,
+ "grad_norm": 0.08566205203533173,
+ "learning_rate": 9.584736251402918e-05,
+ "loss": 0.024353420361876488,
+ "step": 273
+ },
+ {
+ "epoch": 1.3848101265822785,
+ "grad_norm": 0.16623689234256744,
+ "learning_rate": 9.57912457912458e-05,
+ "loss": 0.03626095876097679,
+ "step": 274
+ },
+ {
+ "epoch": 1.389873417721519,
+ "grad_norm": 0.07134243100881577,
+ "learning_rate": 9.57351290684624e-05,
+ "loss": 0.026036158204078674,
+ "step": 275
+ },
+ {
+ "epoch": 1.3949367088607594,
+ "grad_norm": 0.07753578573465347,
+ "learning_rate": 9.567901234567902e-05,
+ "loss": 0.03266923502087593,
+ "step": 276
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.07113673537969589,
+ "learning_rate": 9.562289562289563e-05,
+ "loss": 0.024128902703523636,
+ "step": 277
+ },
+ {
+ "epoch": 1.4050632911392404,
+ "grad_norm": 0.0954187884926796,
+ "learning_rate": 9.556677890011224e-05,
+ "loss": 0.03310588374733925,
+ "step": 278
+ },
+ {
+ "epoch": 1.410126582278481,
+ "grad_norm": 0.08755122870206833,
+ "learning_rate": 9.551066217732885e-05,
+ "loss": 0.030977975577116013,
+ "step": 279
+ },
+ {
+ "epoch": 1.4151898734177215,
+ "grad_norm": 0.06839736551046371,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.029557062312960625,
+ "step": 280
+ },
+ {
+ "epoch": 1.420253164556962,
+ "grad_norm": 0.051050763577222824,
+ "learning_rate": 9.539842873176207e-05,
+ "loss": 0.022091392427682877,
+ "step": 281
+ },
+ {
+ "epoch": 1.4253164556962026,
+ "grad_norm": 0.05898132920265198,
+ "learning_rate": 9.534231200897868e-05,
+ "loss": 0.024804875254631042,
+ "step": 282
+ },
+ {
+ "epoch": 1.4303797468354431,
+ "grad_norm": 0.04517035931348801,
+ "learning_rate": 9.528619528619529e-05,
+ "loss": 0.024234894663095474,
+ "step": 283
+ },
+ {
+ "epoch": 1.4354430379746836,
+ "grad_norm": 0.05625253543257713,
+ "learning_rate": 9.52300785634119e-05,
+ "loss": 0.02342807501554489,
+ "step": 284
+ },
+ {
+ "epoch": 1.4405063291139242,
+ "grad_norm": 0.047006960958242416,
+ "learning_rate": 9.517396184062851e-05,
+ "loss": 0.021819880232214928,
+ "step": 285
+ },
+ {
+ "epoch": 1.4455696202531645,
+ "grad_norm": 0.051774390041828156,
+ "learning_rate": 9.511784511784512e-05,
+ "loss": 0.020575571805238724,
+ "step": 286
+ },
+ {
+ "epoch": 1.450632911392405,
+ "grad_norm": 0.0684620812535286,
+ "learning_rate": 9.506172839506173e-05,
+ "loss": 0.025043494999408722,
+ "step": 287
+ },
+ {
+ "epoch": 1.4556962025316456,
+ "grad_norm": 0.05345604941248894,
+ "learning_rate": 9.500561167227834e-05,
+ "loss": 0.020829960703849792,
+ "step": 288
+ },
+ {
+ "epoch": 1.460759493670886,
+ "grad_norm": 0.07588688284158707,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.02842051535844803,
+ "step": 289
+ },
+ {
+ "epoch": 1.4658227848101266,
+ "grad_norm": 0.0371188148856163,
+ "learning_rate": 9.489337822671156e-05,
+ "loss": 0.020213091745972633,
+ "step": 290
+ },
+ {
+ "epoch": 1.4708860759493672,
+ "grad_norm": 0.03922685980796814,
+ "learning_rate": 9.483726150392817e-05,
+ "loss": 0.020665431395173073,
+ "step": 291
+ },
+ {
+ "epoch": 1.4759493670886075,
+ "grad_norm": 0.10213606059551239,
+ "learning_rate": 9.478114478114478e-05,
+ "loss": 0.024979032576084137,
+ "step": 292
+ },
+ {
+ "epoch": 1.481012658227848,
+ "grad_norm": 0.04574638605117798,
+ "learning_rate": 9.472502805836139e-05,
+ "loss": 0.0215127132833004,
+ "step": 293
+ },
+ {
+ "epoch": 1.4860759493670885,
+ "grad_norm": 0.0829704999923706,
+ "learning_rate": 9.4668911335578e-05,
+ "loss": 0.023608818650245667,
+ "step": 294
+ },
+ {
+ "epoch": 1.491139240506329,
+ "grad_norm": 0.036335594952106476,
+ "learning_rate": 9.461279461279463e-05,
+ "loss": 0.01993970200419426,
+ "step": 295
+ },
+ {
+ "epoch": 1.4962025316455696,
+ "grad_norm": 0.08291227370500565,
+ "learning_rate": 9.455667789001122e-05,
+ "loss": 0.02223093807697296,
+ "step": 296
+ },
+ {
+ "epoch": 1.5012658227848101,
+ "grad_norm": 0.048284996300935745,
+ "learning_rate": 9.450056116722785e-05,
+ "loss": 0.019440360367298126,
+ "step": 297
+ },
+ {
+ "epoch": 1.5063291139240507,
+ "grad_norm": 0.25126877427101135,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.030357610434293747,
+ "step": 298
+ },
+ {
+ "epoch": 1.5113924050632912,
+ "grad_norm": 0.08812759816646576,
+ "learning_rate": 9.438832772166107e-05,
+ "loss": 0.025407828390598297,
+ "step": 299
+ },
+ {
+ "epoch": 1.5164556962025317,
+ "grad_norm": 0.09417422115802765,
+ "learning_rate": 9.433221099887766e-05,
+ "loss": 0.028768496587872505,
+ "step": 300
+ },
+ {
+ "epoch": 1.5215189873417723,
+ "grad_norm": 0.10820329934358597,
+ "learning_rate": 9.427609427609429e-05,
+ "loss": 0.03250410035252571,
+ "step": 301
+ },
+ {
+ "epoch": 1.5265822784810128,
+ "grad_norm": 0.06633433699607849,
+ "learning_rate": 9.42199775533109e-05,
+ "loss": 0.019816454499959946,
+ "step": 302
+ },
+ {
+ "epoch": 1.5316455696202531,
+ "grad_norm": 0.05545264482498169,
+ "learning_rate": 9.41638608305275e-05,
+ "loss": 0.020919661968946457,
+ "step": 303
+ },
+ {
+ "epoch": 1.5367088607594936,
+ "grad_norm": 0.08201726526021957,
+ "learning_rate": 9.410774410774412e-05,
+ "loss": 0.0309453085064888,
+ "step": 304
+ },
+ {
+ "epoch": 1.5417721518987342,
+ "grad_norm": 0.047229036688804626,
+ "learning_rate": 9.405162738496073e-05,
+ "loss": 0.02079029008746147,
+ "step": 305
+ },
+ {
+ "epoch": 1.5468354430379747,
+ "grad_norm": 0.04493536427617073,
+ "learning_rate": 9.399551066217734e-05,
+ "loss": 0.020319776609539986,
+ "step": 306
+ },
+ {
+ "epoch": 1.5518987341772152,
+ "grad_norm": 0.07935966551303864,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.03144281357526779,
+ "step": 307
+ },
+ {
+ "epoch": 1.5569620253164556,
+ "grad_norm": 0.10108500719070435,
+ "learning_rate": 9.388327721661056e-05,
+ "loss": 0.029823362827301025,
+ "step": 308
+ },
+ {
+ "epoch": 1.562025316455696,
+ "grad_norm": 0.05187584087252617,
+ "learning_rate": 9.382716049382717e-05,
+ "loss": 0.029090257361531258,
+ "step": 309
+ },
+ {
+ "epoch": 1.5670886075949366,
+ "grad_norm": 0.09131086617708206,
+ "learning_rate": 9.377104377104378e-05,
+ "loss": 0.020090997219085693,
+ "step": 310
+ },
+ {
+ "epoch": 1.5721518987341772,
+ "grad_norm": 0.06874370574951172,
+ "learning_rate": 9.371492704826039e-05,
+ "loss": 0.022118568420410156,
+ "step": 311
+ },
+ {
+ "epoch": 1.5772151898734177,
+ "grad_norm": 0.07480651885271072,
+ "learning_rate": 9.3658810325477e-05,
+ "loss": 0.030924849212169647,
+ "step": 312
+ },
+ {
+ "epoch": 1.5822784810126582,
+ "grad_norm": 0.04049983248114586,
+ "learning_rate": 9.36026936026936e-05,
+ "loss": 0.02086808532476425,
+ "step": 313
+ },
+ {
+ "epoch": 1.5873417721518988,
+ "grad_norm": 0.037067580968141556,
+ "learning_rate": 9.354657687991022e-05,
+ "loss": 0.022019919008016586,
+ "step": 314
+ },
+ {
+ "epoch": 1.5924050632911393,
+ "grad_norm": 0.0599038302898407,
+ "learning_rate": 9.349046015712683e-05,
+ "loss": 0.02305535599589348,
+ "step": 315
+ },
+ {
+ "epoch": 1.5974683544303798,
+ "grad_norm": 0.056727997958660126,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.025360889732837677,
+ "step": 316
+ },
+ {
+ "epoch": 1.6025316455696204,
+ "grad_norm": 0.06659650057554245,
+ "learning_rate": 9.337822671156005e-05,
+ "loss": 0.02528395690023899,
+ "step": 317
+ },
+ {
+ "epoch": 1.6075949367088609,
+ "grad_norm": 0.06213822215795517,
+ "learning_rate": 9.332210998877666e-05,
+ "loss": 0.028841618448495865,
+ "step": 318
+ },
+ {
+ "epoch": 1.6126582278481014,
+ "grad_norm": 0.03757556155323982,
+ "learning_rate": 9.326599326599327e-05,
+ "loss": 0.02282278798520565,
+ "step": 319
+ },
+ {
+ "epoch": 1.6177215189873417,
+ "grad_norm": 0.061945486813783646,
+ "learning_rate": 9.320987654320989e-05,
+ "loss": 0.02733437530696392,
+ "step": 320
+ },
+ {
+ "epoch": 1.6227848101265823,
+ "grad_norm": 0.07904566079378128,
+ "learning_rate": 9.315375982042649e-05,
+ "loss": 0.02630138024687767,
+ "step": 321
+ },
+ {
+ "epoch": 1.6278481012658228,
+ "grad_norm": 0.07157077640295029,
+ "learning_rate": 9.309764309764311e-05,
+ "loss": 0.023403439670801163,
+ "step": 322
+ },
+ {
+ "epoch": 1.6329113924050633,
+ "grad_norm": 0.03518318012356758,
+ "learning_rate": 9.304152637485971e-05,
+ "loss": 0.021487422287464142,
+ "step": 323
+ },
+ {
+ "epoch": 1.6379746835443036,
+ "grad_norm": 0.11178159713745117,
+ "learning_rate": 9.298540965207633e-05,
+ "loss": 0.03142111003398895,
+ "step": 324
+ },
+ {
+ "epoch": 1.6430379746835442,
+ "grad_norm": 0.05046987161040306,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.020960725843906403,
+ "step": 325
+ },
+ {
+ "epoch": 1.6481012658227847,
+ "grad_norm": 0.05356504023075104,
+ "learning_rate": 9.287317620650955e-05,
+ "loss": 0.01934133842587471,
+ "step": 326
+ },
+ {
+ "epoch": 1.6531645569620252,
+ "grad_norm": 0.07995260506868362,
+ "learning_rate": 9.281705948372615e-05,
+ "loss": 0.0248265378177166,
+ "step": 327
+ },
+ {
+ "epoch": 1.6582278481012658,
+ "grad_norm": 0.08783978968858719,
+ "learning_rate": 9.276094276094277e-05,
+ "loss": 0.024171534925699234,
+ "step": 328
+ },
+ {
+ "epoch": 1.6632911392405063,
+ "grad_norm": 0.043143950402736664,
+ "learning_rate": 9.270482603815938e-05,
+ "loss": 0.021554211154580116,
+ "step": 329
+ },
+ {
+ "epoch": 1.6683544303797468,
+ "grad_norm": 0.05635169520974159,
+ "learning_rate": 9.264870931537598e-05,
+ "loss": 0.025942442938685417,
+ "step": 330
+ },
+ {
+ "epoch": 1.6734177215189874,
+ "grad_norm": 0.042691316455602646,
+ "learning_rate": 9.25925925925926e-05,
+ "loss": 0.021898634731769562,
+ "step": 331
+ },
+ {
+ "epoch": 1.678481012658228,
+ "grad_norm": 0.07666946202516556,
+ "learning_rate": 9.25364758698092e-05,
+ "loss": 0.02928568609058857,
+ "step": 332
+ },
+ {
+ "epoch": 1.6835443037974684,
+ "grad_norm": 0.04230545833706856,
+ "learning_rate": 9.248035914702582e-05,
+ "loss": 0.020812246948480606,
+ "step": 333
+ },
+ {
+ "epoch": 1.688607594936709,
+ "grad_norm": 0.1077270656824112,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.025568369776010513,
+ "step": 334
+ },
+ {
+ "epoch": 1.6936708860759495,
+ "grad_norm": 0.04277936369180679,
+ "learning_rate": 9.236812570145904e-05,
+ "loss": 0.018935058265924454,
+ "step": 335
+ },
+ {
+ "epoch": 1.6987341772151898,
+ "grad_norm": 0.04454135522246361,
+ "learning_rate": 9.231200897867565e-05,
+ "loss": 0.01933746598660946,
+ "step": 336
+ },
+ {
+ "epoch": 1.7037974683544304,
+ "grad_norm": 0.0674893856048584,
+ "learning_rate": 9.225589225589226e-05,
+ "loss": 0.021518435329198837,
+ "step": 337
+ },
+ {
+ "epoch": 1.7088607594936709,
+ "grad_norm": 0.06007042154669762,
+ "learning_rate": 9.219977553310887e-05,
+ "loss": 0.019427424296736717,
+ "step": 338
+ },
+ {
+ "epoch": 1.7139240506329114,
+ "grad_norm": 0.09564489126205444,
+ "learning_rate": 9.214365881032548e-05,
+ "loss": 0.027250545099377632,
+ "step": 339
+ },
+ {
+ "epoch": 1.7189873417721517,
+ "grad_norm": 0.053655482828617096,
+ "learning_rate": 9.208754208754209e-05,
+ "loss": 0.020125389099121094,
+ "step": 340
+ },
+ {
+ "epoch": 1.7240506329113923,
+ "grad_norm": 0.038283221423625946,
+ "learning_rate": 9.20314253647587e-05,
+ "loss": 0.017948098480701447,
+ "step": 341
+ },
+ {
+ "epoch": 1.7291139240506328,
+ "grad_norm": 0.04724166542291641,
+ "learning_rate": 9.197530864197531e-05,
+ "loss": 0.02523602545261383,
+ "step": 342
+ },
+ {
+ "epoch": 1.7341772151898733,
+ "grad_norm": 0.10365224629640579,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.035696640610694885,
+ "step": 343
+ },
+ {
+ "epoch": 1.7392405063291139,
+ "grad_norm": 0.07362233102321625,
+ "learning_rate": 9.186307519640853e-05,
+ "loss": 0.026104427874088287,
+ "step": 344
+ },
+ {
+ "epoch": 1.7443037974683544,
+ "grad_norm": 0.05976846069097519,
+ "learning_rate": 9.180695847362514e-05,
+ "loss": 0.026634451001882553,
+ "step": 345
+ },
+ {
+ "epoch": 1.749367088607595,
+ "grad_norm": 0.07387223839759827,
+ "learning_rate": 9.175084175084175e-05,
+ "loss": 0.025733446702361107,
+ "step": 346
+ },
+ {
+ "epoch": 1.7544303797468355,
+ "grad_norm": 0.04727378115057945,
+ "learning_rate": 9.169472502805838e-05,
+ "loss": 0.01889938861131668,
+ "step": 347
+ },
+ {
+ "epoch": 1.759493670886076,
+ "grad_norm": 0.10614906996488571,
+ "learning_rate": 9.163860830527497e-05,
+ "loss": 0.02275039628148079,
+ "step": 348
+ },
+ {
+ "epoch": 1.7645569620253165,
+ "grad_norm": 0.04877970367670059,
+ "learning_rate": 9.15824915824916e-05,
+ "loss": 0.022580452263355255,
+ "step": 349
+ },
+ {
+ "epoch": 1.769620253164557,
+ "grad_norm": 0.18825598061084747,
+ "learning_rate": 9.152637485970819e-05,
+ "loss": 0.03054988384246826,
+ "step": 350
+ },
+ {
+ "epoch": 1.7746835443037976,
+ "grad_norm": 0.06315254420042038,
+ "learning_rate": 9.147025813692482e-05,
+ "loss": 0.025584843009710312,
+ "step": 351
+ },
+ {
+ "epoch": 1.7797468354430381,
+ "grad_norm": 0.04519108682870865,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.0214737206697464,
+ "step": 352
+ },
+ {
+ "epoch": 1.7848101265822784,
+ "grad_norm": 0.07401937246322632,
+ "learning_rate": 9.135802469135802e-05,
+ "loss": 0.02984039857983589,
+ "step": 353
+ },
+ {
+ "epoch": 1.789873417721519,
+ "grad_norm": 0.05138625577092171,
+ "learning_rate": 9.130190796857465e-05,
+ "loss": 0.024221282452344894,
+ "step": 354
+ },
+ {
+ "epoch": 1.7949367088607595,
+ "grad_norm": 0.10182037204504013,
+ "learning_rate": 9.124579124579124e-05,
+ "loss": 0.0237903892993927,
+ "step": 355
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.056737013161182404,
+ "learning_rate": 9.118967452300787e-05,
+ "loss": 0.026514701545238495,
+ "step": 356
+ },
+ {
+ "epoch": 1.8050632911392404,
+ "grad_norm": 0.04826146364212036,
+ "learning_rate": 9.113355780022446e-05,
+ "loss": 0.021808844059705734,
+ "step": 357
+ },
+ {
+ "epoch": 1.810126582278481,
+ "grad_norm": 0.07099983841180801,
+ "learning_rate": 9.107744107744109e-05,
+ "loss": 0.028031716123223305,
+ "step": 358
+ },
+ {
+ "epoch": 1.8151898734177214,
+ "grad_norm": 0.04242753982543945,
+ "learning_rate": 9.102132435465768e-05,
+ "loss": 0.018858186900615692,
+ "step": 359
+ },
+ {
+ "epoch": 1.820253164556962,
+ "grad_norm": 0.053701240569353104,
+ "learning_rate": 9.096520763187431e-05,
+ "loss": 0.025603849440813065,
+ "step": 360
+ },
+ {
+ "epoch": 1.8253164556962025,
+ "grad_norm": 0.05277755856513977,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.021214714273810387,
+ "step": 361
+ },
+ {
+ "epoch": 1.830379746835443,
+ "grad_norm": 0.048843637108802795,
+ "learning_rate": 9.085297418630753e-05,
+ "loss": 0.024215007200837135,
+ "step": 362
+ },
+ {
+ "epoch": 1.8354430379746836,
+ "grad_norm": 0.04203329607844353,
+ "learning_rate": 9.079685746352414e-05,
+ "loss": 0.022748971357941628,
+ "step": 363
+ },
+ {
+ "epoch": 1.840506329113924,
+ "grad_norm": 0.04655196890234947,
+ "learning_rate": 9.074074074074075e-05,
+ "loss": 0.019658325240015984,
+ "step": 364
+ },
+ {
+ "epoch": 1.8455696202531646,
+ "grad_norm": 0.10654491931200027,
+ "learning_rate": 9.068462401795736e-05,
+ "loss": 0.03210999816656113,
+ "step": 365
+ },
+ {
+ "epoch": 1.8506329113924052,
+ "grad_norm": 0.04377336800098419,
+ "learning_rate": 9.062850729517397e-05,
+ "loss": 0.01867927983403206,
+ "step": 366
+ },
+ {
+ "epoch": 1.8556962025316457,
+ "grad_norm": 0.04619381204247475,
+ "learning_rate": 9.057239057239058e-05,
+ "loss": 0.01952965185046196,
+ "step": 367
+ },
+ {
+ "epoch": 1.8607594936708862,
+ "grad_norm": 0.04015986621379852,
+ "learning_rate": 9.051627384960719e-05,
+ "loss": 0.017353296279907227,
+ "step": 368
+ },
+ {
+ "epoch": 1.8658227848101265,
+ "grad_norm": 0.11403095722198486,
+ "learning_rate": 9.04601571268238e-05,
+ "loss": 0.02238992229104042,
+ "step": 369
+ },
+ {
+ "epoch": 1.870886075949367,
+ "grad_norm": 0.043767284601926804,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.02202833816409111,
+ "step": 370
+ },
+ {
+ "epoch": 1.8759493670886076,
+ "grad_norm": 0.053445883095264435,
+ "learning_rate": 9.034792368125702e-05,
+ "loss": 0.023765750229358673,
+ "step": 371
+ },
+ {
+ "epoch": 1.8810126582278481,
+ "grad_norm": 0.05750055983662605,
+ "learning_rate": 9.029180695847364e-05,
+ "loss": 0.026259474456310272,
+ "step": 372
+ },
+ {
+ "epoch": 1.8860759493670884,
+ "grad_norm": 0.04525497183203697,
+ "learning_rate": 9.023569023569024e-05,
+ "loss": 0.024194583296775818,
+ "step": 373
+ },
+ {
+ "epoch": 1.891139240506329,
+ "grad_norm": 0.04918856918811798,
+ "learning_rate": 9.017957351290685e-05,
+ "loss": 0.020951319485902786,
+ "step": 374
+ },
+ {
+ "epoch": 1.8962025316455695,
+ "grad_norm": 0.08538687229156494,
+ "learning_rate": 9.012345679012346e-05,
+ "loss": 0.022266045212745667,
+ "step": 375
+ },
+ {
+ "epoch": 1.90126582278481,
+ "grad_norm": 0.07101748883724213,
+ "learning_rate": 9.006734006734007e-05,
+ "loss": 0.028090521693229675,
+ "step": 376
+ },
+ {
+ "epoch": 1.9063291139240506,
+ "grad_norm": 0.06256446987390518,
+ "learning_rate": 9.001122334455668e-05,
+ "loss": 0.027174800634384155,
+ "step": 377
+ },
+ {
+ "epoch": 1.9113924050632911,
+ "grad_norm": 0.07588270306587219,
+ "learning_rate": 8.995510662177329e-05,
+ "loss": 0.028438206762075424,
+ "step": 378
+ },
+ {
+ "epoch": 1.9164556962025316,
+ "grad_norm": 5.8829851150512695,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.01749270409345627,
+ "step": 379
+ },
+ {
+ "epoch": 1.9215189873417722,
+ "grad_norm": 0.038905344903469086,
+ "learning_rate": 8.984287317620651e-05,
+ "loss": 0.019571108743548393,
+ "step": 380
+ },
+ {
+ "epoch": 1.9265822784810127,
+ "grad_norm": 0.05960959196090698,
+ "learning_rate": 8.978675645342313e-05,
+ "loss": 0.024591946974396706,
+ "step": 381
+ },
+ {
+ "epoch": 1.9316455696202532,
+ "grad_norm": 0.07935867458581924,
+ "learning_rate": 8.973063973063973e-05,
+ "loss": 0.020205039530992508,
+ "step": 382
+ },
+ {
+ "epoch": 1.9367088607594938,
+ "grad_norm": 0.08682888746261597,
+ "learning_rate": 8.967452300785635e-05,
+ "loss": 0.023299653083086014,
+ "step": 383
+ },
+ {
+ "epoch": 1.9417721518987343,
+ "grad_norm": 0.07220255583524704,
+ "learning_rate": 8.961840628507295e-05,
+ "loss": 0.025364618748426437,
+ "step": 384
+ },
+ {
+ "epoch": 1.9468354430379748,
+ "grad_norm": 0.08230294287204742,
+ "learning_rate": 8.956228956228957e-05,
+ "loss": 0.023587457835674286,
+ "step": 385
+ },
+ {
+ "epoch": 1.9518987341772152,
+ "grad_norm": 0.05176795646548271,
+ "learning_rate": 8.950617283950617e-05,
+ "loss": 0.018942706286907196,
+ "step": 386
+ },
+ {
+ "epoch": 1.9569620253164557,
+ "grad_norm": 0.04784144088625908,
+ "learning_rate": 8.945005611672279e-05,
+ "loss": 0.020134730264544487,
+ "step": 387
+ },
+ {
+ "epoch": 1.9620253164556962,
+ "grad_norm": 0.04668115824460983,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.022084465250372887,
+ "step": 388
+ },
+ {
+ "epoch": 1.9670886075949368,
+ "grad_norm": 0.05892647057771683,
+ "learning_rate": 8.933782267115601e-05,
+ "loss": 0.02586008608341217,
+ "step": 389
+ },
+ {
+ "epoch": 1.972151898734177,
+ "grad_norm": 0.048669006675481796,
+ "learning_rate": 8.928170594837262e-05,
+ "loss": 0.020011097192764282,
+ "step": 390
+ },
+ {
+ "epoch": 1.9772151898734176,
+ "grad_norm": 0.0973723903298378,
+ "learning_rate": 8.922558922558923e-05,
+ "loss": 0.030240919440984726,
+ "step": 391
+ },
+ {
+ "epoch": 1.9822784810126581,
+ "grad_norm": 0.090507872402668,
+ "learning_rate": 8.916947250280584e-05,
+ "loss": 0.028250183910131454,
+ "step": 392
+ },
+ {
+ "epoch": 1.9873417721518987,
+ "grad_norm": 0.03921318054199219,
+ "learning_rate": 8.911335578002245e-05,
+ "loss": 0.02076716348528862,
+ "step": 393
+ },
+ {
+ "epoch": 1.9924050632911392,
+ "grad_norm": 0.04830043017864227,
+ "learning_rate": 8.905723905723906e-05,
+ "loss": 0.02241525426506996,
+ "step": 394
+ },
+ {
+ "epoch": 1.9974683544303797,
+ "grad_norm": 0.04455797001719475,
+ "learning_rate": 8.900112233445567e-05,
+ "loss": 0.026035301387310028,
+ "step": 395
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.10931648313999176,
+ "learning_rate": 8.894500561167228e-05,
+ "loss": 0.03514251485466957,
+ "step": 396
+ },
+ {
+ "epoch": 2.0050632911392405,
+ "grad_norm": 0.07531362026929855,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.021771814674139023,
+ "step": 397
+ },
+ {
+ "epoch": 2.010126582278481,
+ "grad_norm": 0.0649140477180481,
+ "learning_rate": 8.88327721661055e-05,
+ "loss": 0.02932022325694561,
+ "step": 398
+ },
+ {
+ "epoch": 2.0151898734177216,
+ "grad_norm": 0.07461163401603699,
+ "learning_rate": 8.877665544332211e-05,
+ "loss": 0.023864082992076874,
+ "step": 399
+ },
+ {
+ "epoch": 2.020253164556962,
+ "grad_norm": 0.054510265588760376,
+ "learning_rate": 8.872053872053872e-05,
+ "loss": 0.027578316628932953,
+ "step": 400
+ },
+ {
+ "epoch": 2.0253164556962027,
+ "grad_norm": 0.04434451460838318,
+ "learning_rate": 8.866442199775533e-05,
+ "loss": 0.022873830050230026,
+ "step": 401
+ },
+ {
+ "epoch": 2.030379746835443,
+ "grad_norm": 0.052791960537433624,
+ "learning_rate": 8.860830527497194e-05,
+ "loss": 0.021092431619763374,
+ "step": 402
+ },
+ {
+ "epoch": 2.0354430379746837,
+ "grad_norm": 0.04550998657941818,
+ "learning_rate": 8.855218855218855e-05,
+ "loss": 0.022475749254226685,
+ "step": 403
+ },
+ {
+ "epoch": 2.0405063291139243,
+ "grad_norm": 0.2512972354888916,
+ "learning_rate": 8.849607182940516e-05,
+ "loss": 0.02201610803604126,
+ "step": 404
+ },
+ {
+ "epoch": 2.0455696202531644,
+ "grad_norm": 0.04554569348692894,
+ "learning_rate": 8.843995510662177e-05,
+ "loss": 0.02180359698832035,
+ "step": 405
+ },
+ {
+ "epoch": 2.050632911392405,
+ "grad_norm": 0.04094229266047478,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.01960112899541855,
+ "step": 406
+ },
+ {
+ "epoch": 2.0556962025316454,
+ "grad_norm": 0.07398641109466553,
+ "learning_rate": 8.8327721661055e-05,
+ "loss": 0.02206597849726677,
+ "step": 407
+ },
+ {
+ "epoch": 2.060759493670886,
+ "grad_norm": 0.07659231871366501,
+ "learning_rate": 8.827160493827162e-05,
+ "loss": 0.019660351797938347,
+ "step": 408
+ },
+ {
+ "epoch": 2.0658227848101265,
+ "grad_norm": 0.05986466258764267,
+ "learning_rate": 8.821548821548821e-05,
+ "loss": 0.027121691033244133,
+ "step": 409
+ },
+ {
+ "epoch": 2.070886075949367,
+ "grad_norm": 0.03376661241054535,
+ "learning_rate": 8.815937149270484e-05,
+ "loss": 0.021059338003396988,
+ "step": 410
+ },
+ {
+ "epoch": 2.0759493670886076,
+ "grad_norm": 0.081104576587677,
+ "learning_rate": 8.810325476992143e-05,
+ "loss": 0.031228341162204742,
+ "step": 411
+ },
+ {
+ "epoch": 2.081012658227848,
+ "grad_norm": 0.04295242205262184,
+ "learning_rate": 8.804713804713806e-05,
+ "loss": 0.020738180726766586,
+ "step": 412
+ },
+ {
+ "epoch": 2.0860759493670886,
+ "grad_norm": 0.03715268895030022,
+ "learning_rate": 8.799102132435467e-05,
+ "loss": 0.018579209223389626,
+ "step": 413
+ },
+ {
+ "epoch": 2.091139240506329,
+ "grad_norm": 0.06769359856843948,
+ "learning_rate": 8.793490460157128e-05,
+ "loss": 0.026761794462800026,
+ "step": 414
+ },
+ {
+ "epoch": 2.0962025316455697,
+ "grad_norm": 0.03715744614601135,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.022879980504512787,
+ "step": 415
+ },
+ {
+ "epoch": 2.1012658227848102,
+ "grad_norm": 0.04305677488446236,
+ "learning_rate": 8.78226711560045e-05,
+ "loss": 0.022773049771785736,
+ "step": 416
+ },
+ {
+ "epoch": 2.1063291139240508,
+ "grad_norm": 0.0449112169444561,
+ "learning_rate": 8.776655443322111e-05,
+ "loss": 0.022499293088912964,
+ "step": 417
+ },
+ {
+ "epoch": 2.1113924050632913,
+ "grad_norm": 0.0457427054643631,
+ "learning_rate": 8.77104377104377e-05,
+ "loss": 0.024978693574666977,
+ "step": 418
+ },
+ {
+ "epoch": 2.116455696202532,
+ "grad_norm": 0.04705161228775978,
+ "learning_rate": 8.765432098765433e-05,
+ "loss": 0.024807877838611603,
+ "step": 419
+ },
+ {
+ "epoch": 2.1215189873417724,
+ "grad_norm": 0.04377812147140503,
+ "learning_rate": 8.759820426487092e-05,
+ "loss": 0.025857431814074516,
+ "step": 420
+ },
+ {
+ "epoch": 2.1265822784810124,
+ "grad_norm": 0.08598720282316208,
+ "learning_rate": 8.754208754208755e-05,
+ "loss": 0.021972455084323883,
+ "step": 421
+ },
+ {
+ "epoch": 2.131645569620253,
+ "grad_norm": 0.4669632017612457,
+ "learning_rate": 8.748597081930416e-05,
+ "loss": 0.02055199444293976,
+ "step": 422
+ },
+ {
+ "epoch": 2.1367088607594935,
+ "grad_norm": 0.05292733013629913,
+ "learning_rate": 8.742985409652077e-05,
+ "loss": 0.020852137356996536,
+ "step": 423
+ },
+ {
+ "epoch": 2.141772151898734,
+ "grad_norm": 0.05878116562962532,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.02444305270910263,
+ "step": 424
+ },
+ {
+ "epoch": 2.1468354430379746,
+ "grad_norm": 0.05234210565686226,
+ "learning_rate": 8.731762065095399e-05,
+ "loss": 0.02202335000038147,
+ "step": 425
+ },
+ {
+ "epoch": 2.151898734177215,
+ "grad_norm": 0.04706348851323128,
+ "learning_rate": 8.72615039281706e-05,
+ "loss": 0.019998187199234962,
+ "step": 426
+ },
+ {
+ "epoch": 2.1569620253164556,
+ "grad_norm": 0.05263376981019974,
+ "learning_rate": 8.720538720538721e-05,
+ "loss": 0.028126951307058334,
+ "step": 427
+ },
+ {
+ "epoch": 2.162025316455696,
+ "grad_norm": 0.062016960233449936,
+ "learning_rate": 8.714927048260382e-05,
+ "loss": 0.0286184661090374,
+ "step": 428
+ },
+ {
+ "epoch": 2.1670886075949367,
+ "grad_norm": 0.13798244297504425,
+ "learning_rate": 8.709315375982043e-05,
+ "loss": 0.026699248701334,
+ "step": 429
+ },
+ {
+ "epoch": 2.1721518987341772,
+ "grad_norm": 0.09159042686223984,
+ "learning_rate": 8.703703703703704e-05,
+ "loss": 0.025515643879771233,
+ "step": 430
+ },
+ {
+ "epoch": 2.1772151898734178,
+ "grad_norm": 0.0828855037689209,
+ "learning_rate": 8.698092031425365e-05,
+ "loss": 0.025481123477220535,
+ "step": 431
+ },
+ {
+ "epoch": 2.1822784810126583,
+ "grad_norm": 0.09840776771306992,
+ "learning_rate": 8.692480359147026e-05,
+ "loss": 0.020968927070498466,
+ "step": 432
+ },
+ {
+ "epoch": 2.187341772151899,
+ "grad_norm": 0.10999752581119537,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.028588412329554558,
+ "step": 433
+ },
+ {
+ "epoch": 2.1924050632911394,
+ "grad_norm": 0.06938561797142029,
+ "learning_rate": 8.681257014590348e-05,
+ "loss": 0.024119220674037933,
+ "step": 434
+ },
+ {
+ "epoch": 2.19746835443038,
+ "grad_norm": 0.054689887911081314,
+ "learning_rate": 8.67564534231201e-05,
+ "loss": 0.02173299714922905,
+ "step": 435
+ },
+ {
+ "epoch": 2.2025316455696204,
+ "grad_norm": 0.09605880081653595,
+ "learning_rate": 8.67003367003367e-05,
+ "loss": 0.02312455326318741,
+ "step": 436
+ },
+ {
+ "epoch": 2.207594936708861,
+ "grad_norm": 0.06863043457269669,
+ "learning_rate": 8.664421997755332e-05,
+ "loss": 0.020868321880698204,
+ "step": 437
+ },
+ {
+ "epoch": 2.212658227848101,
+ "grad_norm": 0.11743242293596268,
+ "learning_rate": 8.658810325476992e-05,
+ "loss": 0.029748965054750443,
+ "step": 438
+ },
+ {
+ "epoch": 2.2177215189873416,
+ "grad_norm": 0.08399086445569992,
+ "learning_rate": 8.653198653198653e-05,
+ "loss": 0.02379520982503891,
+ "step": 439
+ },
+ {
+ "epoch": 2.222784810126582,
+ "grad_norm": 0.052164461463689804,
+ "learning_rate": 8.647586980920315e-05,
+ "loss": 0.02010851353406906,
+ "step": 440
+ },
+ {
+ "epoch": 2.2278481012658227,
+ "grad_norm": 0.11834696680307388,
+ "learning_rate": 8.641975308641975e-05,
+ "loss": 0.02748255990445614,
+ "step": 441
+ },
+ {
+ "epoch": 2.232911392405063,
+ "grad_norm": 0.06718999892473221,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.026828233152627945,
+ "step": 442
+ },
+ {
+ "epoch": 2.2379746835443037,
+ "grad_norm": 0.042458854615688324,
+ "learning_rate": 8.630751964085297e-05,
+ "loss": 0.021280258893966675,
+ "step": 443
+ },
+ {
+ "epoch": 2.2430379746835443,
+ "grad_norm": 0.036516617983579636,
+ "learning_rate": 8.62514029180696e-05,
+ "loss": 0.021773381158709526,
+ "step": 444
+ },
+ {
+ "epoch": 2.248101265822785,
+ "grad_norm": 0.04317261651158333,
+ "learning_rate": 8.619528619528619e-05,
+ "loss": 0.022671079263091087,
+ "step": 445
+ },
+ {
+ "epoch": 2.2531645569620253,
+ "grad_norm": 0.08610037714242935,
+ "learning_rate": 8.613916947250281e-05,
+ "loss": 0.02425701916217804,
+ "step": 446
+ },
+ {
+ "epoch": 2.258227848101266,
+ "grad_norm": 0.03478290140628815,
+ "learning_rate": 8.608305274971942e-05,
+ "loss": 0.022291556000709534,
+ "step": 447
+ },
+ {
+ "epoch": 2.2632911392405064,
+ "grad_norm": 0.04682233929634094,
+ "learning_rate": 8.602693602693603e-05,
+ "loss": 0.02036888152360916,
+ "step": 448
+ },
+ {
+ "epoch": 2.268354430379747,
+ "grad_norm": 0.0808606892824173,
+ "learning_rate": 8.597081930415264e-05,
+ "loss": 0.025470012798905373,
+ "step": 449
+ },
+ {
+ "epoch": 2.2734177215189875,
+ "grad_norm": 0.042830612510442734,
+ "learning_rate": 8.591470258136925e-05,
+ "loss": 0.020565971732139587,
+ "step": 450
+ },
+ {
+ "epoch": 2.278481012658228,
+ "grad_norm": 0.06374406069517136,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031990330666303635,
+ "step": 451
+ },
+ {
+ "epoch": 2.2835443037974685,
+ "grad_norm": 0.05716697871685028,
+ "learning_rate": 8.580246913580247e-05,
+ "loss": 0.024125374853610992,
+ "step": 452
+ },
+ {
+ "epoch": 2.2886075949367086,
+ "grad_norm": 0.04057484492659569,
+ "learning_rate": 8.574635241301908e-05,
+ "loss": 0.021739482879638672,
+ "step": 453
+ },
+ {
+ "epoch": 2.293670886075949,
+ "grad_norm": 0.07754945009946823,
+ "learning_rate": 8.56902356902357e-05,
+ "loss": 0.02694481424987316,
+ "step": 454
+ },
+ {
+ "epoch": 2.2987341772151897,
+ "grad_norm": 0.06022442877292633,
+ "learning_rate": 8.56341189674523e-05,
+ "loss": 0.021221034228801727,
+ "step": 455
+ },
+ {
+ "epoch": 2.3037974683544302,
+ "grad_norm": 0.06909896433353424,
+ "learning_rate": 8.557800224466891e-05,
+ "loss": 0.02247895672917366,
+ "step": 456
+ },
+ {
+ "epoch": 2.3088607594936708,
+ "grad_norm": 0.05362236499786377,
+ "learning_rate": 8.552188552188552e-05,
+ "loss": 0.020700538530945778,
+ "step": 457
+ },
+ {
+ "epoch": 2.3139240506329113,
+ "grad_norm": 0.09836408495903015,
+ "learning_rate": 8.546576879910215e-05,
+ "loss": 0.02611887827515602,
+ "step": 458
+ },
+ {
+ "epoch": 2.318987341772152,
+ "grad_norm": 0.036625102162361145,
+ "learning_rate": 8.540965207631874e-05,
+ "loss": 0.0196938905864954,
+ "step": 459
+ },
+ {
+ "epoch": 2.3240506329113924,
+ "grad_norm": 0.07372298091650009,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.020545657724142075,
+ "step": 460
+ },
+ {
+ "epoch": 2.329113924050633,
+ "grad_norm": 0.20502988994121552,
+ "learning_rate": 8.529741863075196e-05,
+ "loss": 0.02884715050458908,
+ "step": 461
+ },
+ {
+ "epoch": 2.3341772151898734,
+ "grad_norm": 0.04867224395275116,
+ "learning_rate": 8.524130190796857e-05,
+ "loss": 0.019854716956615448,
+ "step": 462
+ },
+ {
+ "epoch": 2.339240506329114,
+ "grad_norm": 0.029550092294812202,
+ "learning_rate": 8.518518518518518e-05,
+ "loss": 0.01884104311466217,
+ "step": 463
+ },
+ {
+ "epoch": 2.3443037974683545,
+ "grad_norm": 0.04299351945519447,
+ "learning_rate": 8.51290684624018e-05,
+ "loss": 0.01954217068850994,
+ "step": 464
+ },
+ {
+ "epoch": 2.349367088607595,
+ "grad_norm": 0.043467242270708084,
+ "learning_rate": 8.507295173961842e-05,
+ "loss": 0.024274462834000587,
+ "step": 465
+ },
+ {
+ "epoch": 2.3544303797468356,
+ "grad_norm": 0.05131510645151138,
+ "learning_rate": 8.501683501683501e-05,
+ "loss": 0.026246599853038788,
+ "step": 466
+ },
+ {
+ "epoch": 2.359493670886076,
+ "grad_norm": 0.06280570477247238,
+ "learning_rate": 8.496071829405164e-05,
+ "loss": 0.024986159056425095,
+ "step": 467
+ },
+ {
+ "epoch": 2.3645569620253166,
+ "grad_norm": 0.04968208447098732,
+ "learning_rate": 8.490460157126824e-05,
+ "loss": 0.02912936732172966,
+ "step": 468
+ },
+ {
+ "epoch": 2.369620253164557,
+ "grad_norm": 0.08504039794206619,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.027097277343273163,
+ "step": 469
+ },
+ {
+ "epoch": 2.3746835443037977,
+ "grad_norm": 0.18385924398899078,
+ "learning_rate": 8.479236812570146e-05,
+ "loss": 0.02459462732076645,
+ "step": 470
+ },
+ {
+ "epoch": 2.379746835443038,
+ "grad_norm": 0.0663745328783989,
+ "learning_rate": 8.473625140291808e-05,
+ "loss": 0.020224973559379578,
+ "step": 471
+ },
+ {
+ "epoch": 2.3848101265822783,
+ "grad_norm": 0.04759671539068222,
+ "learning_rate": 8.468013468013468e-05,
+ "loss": 0.02591642364859581,
+ "step": 472
+ },
+ {
+ "epoch": 2.389873417721519,
+ "grad_norm": 0.044010091572999954,
+ "learning_rate": 8.46240179573513e-05,
+ "loss": 0.025122515857219696,
+ "step": 473
+ },
+ {
+ "epoch": 2.3949367088607594,
+ "grad_norm": 0.035054467618465424,
+ "learning_rate": 8.456790123456791e-05,
+ "loss": 0.019854065030813217,
+ "step": 474
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.03171153366565704,
+ "learning_rate": 8.451178451178452e-05,
+ "loss": 0.02009584940969944,
+ "step": 475
+ },
+ {
+ "epoch": 2.4050632911392404,
+ "grad_norm": 0.17388089001178741,
+ "learning_rate": 8.445566778900113e-05,
+ "loss": 0.02714207023382187,
+ "step": 476
+ },
+ {
+ "epoch": 2.410126582278481,
+ "grad_norm": 0.038392502814531326,
+ "learning_rate": 8.439955106621774e-05,
+ "loss": 0.020382478833198547,
+ "step": 477
+ },
+ {
+ "epoch": 2.4151898734177215,
+ "grad_norm": 0.04264051839709282,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.022726822644472122,
+ "step": 478
+ },
+ {
+ "epoch": 2.420253164556962,
+ "grad_norm": 0.046432014554739,
+ "learning_rate": 8.428731762065096e-05,
+ "loss": 0.021431483328342438,
+ "step": 479
+ },
+ {
+ "epoch": 2.4253164556962026,
+ "grad_norm": 0.07288242876529694,
+ "learning_rate": 8.423120089786757e-05,
+ "loss": 0.026229504495859146,
+ "step": 480
+ },
+ {
+ "epoch": 2.430379746835443,
+ "grad_norm": 0.04801097884774208,
+ "learning_rate": 8.417508417508418e-05,
+ "loss": 0.020924456417560577,
+ "step": 481
+ },
+ {
+ "epoch": 2.4354430379746836,
+ "grad_norm": 0.11201190203428268,
+ "learning_rate": 8.411896745230079e-05,
+ "loss": 0.022652529180049896,
+ "step": 482
+ },
+ {
+ "epoch": 2.440506329113924,
+ "grad_norm": 0.06151285395026207,
+ "learning_rate": 8.40628507295174e-05,
+ "loss": 0.02416859194636345,
+ "step": 483
+ },
+ {
+ "epoch": 2.4455696202531647,
+ "grad_norm": 0.04006446525454521,
+ "learning_rate": 8.400673400673401e-05,
+ "loss": 0.02390255406498909,
+ "step": 484
+ },
+ {
+ "epoch": 2.4506329113924052,
+ "grad_norm": 0.027193108573555946,
+ "learning_rate": 8.395061728395062e-05,
+ "loss": 0.015282701700925827,
+ "step": 485
+ },
+ {
+ "epoch": 2.4556962025316453,
+ "grad_norm": 0.05453994497656822,
+ "learning_rate": 8.389450056116723e-05,
+ "loss": 0.025738034397363663,
+ "step": 486
+ },
+ {
+ "epoch": 2.460759493670886,
+ "grad_norm": 0.03226681798696518,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.02111941948533058,
+ "step": 487
+ },
+ {
+ "epoch": 2.4658227848101264,
+ "grad_norm": 0.0451083667576313,
+ "learning_rate": 8.378226711560045e-05,
+ "loss": 0.020694585517048836,
+ "step": 488
+ },
+ {
+ "epoch": 2.470886075949367,
+ "grad_norm": 0.0390113927423954,
+ "learning_rate": 8.372615039281706e-05,
+ "loss": 0.022557765245437622,
+ "step": 489
+ },
+ {
+ "epoch": 2.4759493670886075,
+ "grad_norm": 0.05983779951930046,
+ "learning_rate": 8.367003367003367e-05,
+ "loss": 0.02489873766899109,
+ "step": 490
+ },
+ {
+ "epoch": 2.481012658227848,
+ "grad_norm": 0.03961458057165146,
+ "learning_rate": 8.361391694725028e-05,
+ "loss": 0.021655399352312088,
+ "step": 491
+ },
+ {
+ "epoch": 2.4860759493670885,
+ "grad_norm": 0.03814523667097092,
+ "learning_rate": 8.35578002244669e-05,
+ "loss": 0.02217719703912735,
+ "step": 492
+ },
+ {
+ "epoch": 2.491139240506329,
+ "grad_norm": 0.030563514679670334,
+ "learning_rate": 8.35016835016835e-05,
+ "loss": 0.01679009571671486,
+ "step": 493
+ },
+ {
+ "epoch": 2.4962025316455696,
+ "grad_norm": 0.04566824436187744,
+ "learning_rate": 8.344556677890012e-05,
+ "loss": 0.019699417054653168,
+ "step": 494
+ },
+ {
+ "epoch": 2.50126582278481,
+ "grad_norm": 0.06117499992251396,
+ "learning_rate": 8.338945005611672e-05,
+ "loss": 0.028571851551532745,
+ "step": 495
+ },
+ {
+ "epoch": 2.5063291139240507,
+ "grad_norm": 0.03510760888457298,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.023387223482131958,
+ "step": 496
+ },
+ {
+ "epoch": 2.511392405063291,
+ "grad_norm": 0.028878437355160713,
+ "learning_rate": 8.327721661054994e-05,
+ "loss": 0.023329850286245346,
+ "step": 497
+ },
+ {
+ "epoch": 2.5164556962025317,
+ "grad_norm": 0.02818676456809044,
+ "learning_rate": 8.322109988776656e-05,
+ "loss": 0.017786618322134018,
+ "step": 498
+ },
+ {
+ "epoch": 2.5215189873417723,
+ "grad_norm": 0.06660276651382446,
+ "learning_rate": 8.316498316498317e-05,
+ "loss": 0.023636367172002792,
+ "step": 499
+ },
+ {
+ "epoch": 2.526582278481013,
+ "grad_norm": 0.05663186311721802,
+ "learning_rate": 8.310886644219978e-05,
+ "loss": 0.02607567049562931,
+ "step": 500
+ },
+ {
+ "epoch": 2.5316455696202533,
+ "grad_norm": 0.04156090319156647,
+ "learning_rate": 8.30527497194164e-05,
+ "loss": 0.024936942383646965,
+ "step": 501
+ },
+ {
+ "epoch": 2.536708860759494,
+ "grad_norm": 0.036135219037532806,
+ "learning_rate": 8.2996632996633e-05,
+ "loss": 0.023583384230732918,
+ "step": 502
+ },
+ {
+ "epoch": 2.5417721518987344,
+ "grad_norm": 0.052026644349098206,
+ "learning_rate": 8.294051627384961e-05,
+ "loss": 0.02324807643890381,
+ "step": 503
+ },
+ {
+ "epoch": 2.546835443037975,
+ "grad_norm": 0.03599514439702034,
+ "learning_rate": 8.288439955106621e-05,
+ "loss": 0.01879853755235672,
+ "step": 504
+ },
+ {
+ "epoch": 2.5518987341772155,
+ "grad_norm": 0.03505280241370201,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.017342131584882736,
+ "step": 505
+ },
+ {
+ "epoch": 2.5569620253164556,
+ "grad_norm": 0.0403706431388855,
+ "learning_rate": 8.277216610549943e-05,
+ "loss": 0.02082991972565651,
+ "step": 506
+ },
+ {
+ "epoch": 2.562025316455696,
+ "grad_norm": 0.031072309240698814,
+ "learning_rate": 8.271604938271605e-05,
+ "loss": 0.01711331121623516,
+ "step": 507
+ },
+ {
+ "epoch": 2.5670886075949366,
+ "grad_norm": 0.04118587449193001,
+ "learning_rate": 8.265993265993266e-05,
+ "loss": 0.01940922439098358,
+ "step": 508
+ },
+ {
+ "epoch": 2.572151898734177,
+ "grad_norm": 0.039908040314912796,
+ "learning_rate": 8.260381593714927e-05,
+ "loss": 0.021229952573776245,
+ "step": 509
+ },
+ {
+ "epoch": 2.5772151898734177,
+ "grad_norm": 0.02886618860065937,
+ "learning_rate": 8.254769921436589e-05,
+ "loss": 0.02004890888929367,
+ "step": 510
+ },
+ {
+ "epoch": 2.5822784810126582,
+ "grad_norm": 0.04229263588786125,
+ "learning_rate": 8.24915824915825e-05,
+ "loss": 0.019512392580509186,
+ "step": 511
+ },
+ {
+ "epoch": 2.5873417721518988,
+ "grad_norm": 0.030951635912060738,
+ "learning_rate": 8.24354657687991e-05,
+ "loss": 0.01836536079645157,
+ "step": 512
+ },
+ {
+ "epoch": 2.5924050632911393,
+ "grad_norm": 0.057054903358221054,
+ "learning_rate": 8.237934904601572e-05,
+ "loss": 0.028897594660520554,
+ "step": 513
+ },
+ {
+ "epoch": 2.59746835443038,
+ "grad_norm": 0.10734204202890396,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.024986904114484787,
+ "step": 514
+ },
+ {
+ "epoch": 2.6025316455696204,
+ "grad_norm": 0.029653102159500122,
+ "learning_rate": 8.226711560044894e-05,
+ "loss": 0.02242947742342949,
+ "step": 515
+ },
+ {
+ "epoch": 2.607594936708861,
+ "grad_norm": 0.05601462349295616,
+ "learning_rate": 8.221099887766555e-05,
+ "loss": 0.020091768354177475,
+ "step": 516
+ },
+ {
+ "epoch": 2.6126582278481014,
+ "grad_norm": 0.04170191287994385,
+ "learning_rate": 8.215488215488217e-05,
+ "loss": 0.021796470507979393,
+ "step": 517
+ },
+ {
+ "epoch": 2.6177215189873415,
+ "grad_norm": 0.06347091495990753,
+ "learning_rate": 8.209876543209877e-05,
+ "loss": 0.024338826537132263,
+ "step": 518
+ },
+ {
+ "epoch": 2.622784810126582,
+ "grad_norm": 0.06084204465150833,
+ "learning_rate": 8.204264870931539e-05,
+ "loss": 0.02493124082684517,
+ "step": 519
+ },
+ {
+ "epoch": 2.6278481012658226,
+ "grad_norm": 0.03094005584716797,
+ "learning_rate": 8.198653198653199e-05,
+ "loss": 0.021345658227801323,
+ "step": 520
+ },
+ {
+ "epoch": 2.632911392405063,
+ "grad_norm": 0.04017730429768562,
+ "learning_rate": 8.193041526374861e-05,
+ "loss": 0.019823770970106125,
+ "step": 521
+ },
+ {
+ "epoch": 2.6379746835443036,
+ "grad_norm": 0.045351576060056686,
+ "learning_rate": 8.18742985409652e-05,
+ "loss": 0.02385132387280464,
+ "step": 522
+ },
+ {
+ "epoch": 2.643037974683544,
+ "grad_norm": 0.04823896288871765,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.021753432229161263,
+ "step": 523
+ },
+ {
+ "epoch": 2.6481012658227847,
+ "grad_norm": 0.0442446693778038,
+ "learning_rate": 8.176206509539843e-05,
+ "loss": 0.022134695202112198,
+ "step": 524
+ },
+ {
+ "epoch": 2.6531645569620252,
+ "grad_norm": 0.07998359203338623,
+ "learning_rate": 8.170594837261504e-05,
+ "loss": 0.021159570664167404,
+ "step": 525
+ },
+ {
+ "epoch": 2.6582278481012658,
+ "grad_norm": 0.07844395190477371,
+ "learning_rate": 8.164983164983166e-05,
+ "loss": 0.023695990443229675,
+ "step": 526
+ },
+ {
+ "epoch": 2.6632911392405063,
+ "grad_norm": 0.025296518579125404,
+ "learning_rate": 8.159371492704826e-05,
+ "loss": 0.020914766937494278,
+ "step": 527
+ },
+ {
+ "epoch": 2.668354430379747,
+ "grad_norm": 0.337454617023468,
+ "learning_rate": 8.153759820426488e-05,
+ "loss": 0.02948678657412529,
+ "step": 528
+ },
+ {
+ "epoch": 2.6734177215189874,
+ "grad_norm": 0.03531114012002945,
+ "learning_rate": 8.148148148148148e-05,
+ "loss": 0.020608587190508842,
+ "step": 529
+ },
+ {
+ "epoch": 2.678481012658228,
+ "grad_norm": 0.0496559739112854,
+ "learning_rate": 8.14253647586981e-05,
+ "loss": 0.023600757122039795,
+ "step": 530
+ },
+ {
+ "epoch": 2.6835443037974684,
+ "grad_norm": 0.04093128815293312,
+ "learning_rate": 8.13692480359147e-05,
+ "loss": 0.022392068058252335,
+ "step": 531
+ },
+ {
+ "epoch": 2.688607594936709,
+ "grad_norm": 0.05343819782137871,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.01882098615169525,
+ "step": 532
+ },
+ {
+ "epoch": 2.6936708860759495,
+ "grad_norm": 0.0334453359246254,
+ "learning_rate": 8.125701459034793e-05,
+ "loss": 0.020492104813456535,
+ "step": 533
+ },
+ {
+ "epoch": 2.69873417721519,
+ "grad_norm": 0.045540470629930496,
+ "learning_rate": 8.120089786756454e-05,
+ "loss": 0.021309707313776016,
+ "step": 534
+ },
+ {
+ "epoch": 2.7037974683544306,
+ "grad_norm": 0.03238926827907562,
+ "learning_rate": 8.114478114478115e-05,
+ "loss": 0.01929772086441517,
+ "step": 535
+ },
+ {
+ "epoch": 2.708860759493671,
+ "grad_norm": 0.10985280573368073,
+ "learning_rate": 8.108866442199776e-05,
+ "loss": 0.02431013062596321,
+ "step": 536
+ },
+ {
+ "epoch": 2.7139240506329116,
+ "grad_norm": 0.039785534143447876,
+ "learning_rate": 8.103254769921437e-05,
+ "loss": 0.022708022966980934,
+ "step": 537
+ },
+ {
+ "epoch": 2.7189873417721517,
+ "grad_norm": 0.06239910051226616,
+ "learning_rate": 8.097643097643098e-05,
+ "loss": 0.02715257555246353,
+ "step": 538
+ },
+ {
+ "epoch": 2.7240506329113923,
+ "grad_norm": 0.03662843257188797,
+ "learning_rate": 8.092031425364759e-05,
+ "loss": 0.024876421317458153,
+ "step": 539
+ },
+ {
+ "epoch": 2.729113924050633,
+ "grad_norm": 0.05869411304593086,
+ "learning_rate": 8.08641975308642e-05,
+ "loss": 0.022937750443816185,
+ "step": 540
+ },
+ {
+ "epoch": 2.7341772151898733,
+ "grad_norm": 0.07220412790775299,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02227093279361725,
+ "step": 541
+ },
+ {
+ "epoch": 2.739240506329114,
+ "grad_norm": 0.03881363570690155,
+ "learning_rate": 8.075196408529742e-05,
+ "loss": 0.020784813910722733,
+ "step": 542
+ },
+ {
+ "epoch": 2.7443037974683544,
+ "grad_norm": 0.04756273329257965,
+ "learning_rate": 8.069584736251403e-05,
+ "loss": 0.02334344945847988,
+ "step": 543
+ },
+ {
+ "epoch": 2.749367088607595,
+ "grad_norm": 0.05327540263533592,
+ "learning_rate": 8.063973063973065e-05,
+ "loss": 0.026313351467251778,
+ "step": 544
+ },
+ {
+ "epoch": 2.7544303797468355,
+ "grad_norm": 0.1605764925479889,
+ "learning_rate": 8.058361391694725e-05,
+ "loss": 0.02474561519920826,
+ "step": 545
+ },
+ {
+ "epoch": 2.759493670886076,
+ "grad_norm": 0.044486165046691895,
+ "learning_rate": 8.052749719416387e-05,
+ "loss": 0.023557808250188828,
+ "step": 546
+ },
+ {
+ "epoch": 2.7645569620253165,
+ "grad_norm": 0.04645116999745369,
+ "learning_rate": 8.047138047138047e-05,
+ "loss": 0.017340417951345444,
+ "step": 547
+ },
+ {
+ "epoch": 2.769620253164557,
+ "grad_norm": 0.04009381681680679,
+ "learning_rate": 8.041526374859708e-05,
+ "loss": 0.018324140459299088,
+ "step": 548
+ },
+ {
+ "epoch": 2.7746835443037976,
+ "grad_norm": 0.12476589530706406,
+ "learning_rate": 8.035914702581369e-05,
+ "loss": 0.023337965831160545,
+ "step": 549
+ },
+ {
+ "epoch": 2.779746835443038,
+ "grad_norm": 0.04257349297404289,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.021878249943256378,
+ "step": 550
+ },
+ {
+ "epoch": 2.7848101265822782,
+ "grad_norm": 0.044377341866493225,
+ "learning_rate": 8.024691358024692e-05,
+ "loss": 0.019643619656562805,
+ "step": 551
+ },
+ {
+ "epoch": 2.7898734177215188,
+ "grad_norm": 0.0801771879196167,
+ "learning_rate": 8.019079685746352e-05,
+ "loss": 0.021452955901622772,
+ "step": 552
+ },
+ {
+ "epoch": 2.7949367088607593,
+ "grad_norm": 0.04462383687496185,
+ "learning_rate": 8.013468013468015e-05,
+ "loss": 0.02363801747560501,
+ "step": 553
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.05768737941980362,
+ "learning_rate": 8.007856341189674e-05,
+ "loss": 0.03572218120098114,
+ "step": 554
+ },
+ {
+ "epoch": 2.8050632911392404,
+ "grad_norm": 0.03812364116311073,
+ "learning_rate": 8.002244668911337e-05,
+ "loss": 0.01964751072227955,
+ "step": 555
+ },
+ {
+ "epoch": 2.810126582278481,
+ "grad_norm": 0.03297588974237442,
+ "learning_rate": 7.996632996632996e-05,
+ "loss": 0.019139982759952545,
+ "step": 556
+ },
+ {
+ "epoch": 2.8151898734177214,
+ "grad_norm": 0.024627596139907837,
+ "learning_rate": 7.991021324354659e-05,
+ "loss": 0.021029513329267502,
+ "step": 557
+ },
+ {
+ "epoch": 2.820253164556962,
+ "grad_norm": 0.058927983045578,
+ "learning_rate": 7.985409652076318e-05,
+ "loss": 0.03308084234595299,
+ "step": 558
+ },
+ {
+ "epoch": 2.8253164556962025,
+ "grad_norm": 0.11811497062444687,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.028271127492189407,
+ "step": 559
+ },
+ {
+ "epoch": 2.830379746835443,
+ "grad_norm": 0.043665409088134766,
+ "learning_rate": 7.974186307519642e-05,
+ "loss": 0.02708129584789276,
+ "step": 560
+ },
+ {
+ "epoch": 2.8354430379746836,
+ "grad_norm": 0.034729309380054474,
+ "learning_rate": 7.968574635241303e-05,
+ "loss": 0.023845072835683823,
+ "step": 561
+ },
+ {
+ "epoch": 2.840506329113924,
+ "grad_norm": 0.028991155326366425,
+ "learning_rate": 7.962962962962964e-05,
+ "loss": 0.018426496535539627,
+ "step": 562
+ },
+ {
+ "epoch": 2.8455696202531646,
+ "grad_norm": 0.04660327732563019,
+ "learning_rate": 7.957351290684625e-05,
+ "loss": 0.02610144019126892,
+ "step": 563
+ },
+ {
+ "epoch": 2.850632911392405,
+ "grad_norm": 0.03947063535451889,
+ "learning_rate": 7.951739618406286e-05,
+ "loss": 0.025909483432769775,
+ "step": 564
+ },
+ {
+ "epoch": 2.8556962025316457,
+ "grad_norm": 0.06056501716375351,
+ "learning_rate": 7.946127946127947e-05,
+ "loss": 0.030405592173337936,
+ "step": 565
+ },
+ {
+ "epoch": 2.8607594936708862,
+ "grad_norm": 0.03398960456252098,
+ "learning_rate": 7.940516273849608e-05,
+ "loss": 0.02486085705459118,
+ "step": 566
+ },
+ {
+ "epoch": 2.8658227848101268,
+ "grad_norm": 0.03136906027793884,
+ "learning_rate": 7.934904601571269e-05,
+ "loss": 0.020573778077960014,
+ "step": 567
+ },
+ {
+ "epoch": 2.8708860759493673,
+ "grad_norm": 0.03404523804783821,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.021034879609942436,
+ "step": 568
+ },
+ {
+ "epoch": 2.875949367088608,
+ "grad_norm": 0.02937588468194008,
+ "learning_rate": 7.92368125701459e-05,
+ "loss": 0.02275373972952366,
+ "step": 569
+ },
+ {
+ "epoch": 2.8810126582278484,
+ "grad_norm": 0.03971172124147415,
+ "learning_rate": 7.918069584736252e-05,
+ "loss": 0.021558552980422974,
+ "step": 570
+ },
+ {
+ "epoch": 2.8860759493670884,
+ "grad_norm": 0.05636494606733322,
+ "learning_rate": 7.912457912457913e-05,
+ "loss": 0.025583568960428238,
+ "step": 571
+ },
+ {
+ "epoch": 2.891139240506329,
+ "grad_norm": 0.2013683319091797,
+ "learning_rate": 7.906846240179574e-05,
+ "loss": 0.025386696681380272,
+ "step": 572
+ },
+ {
+ "epoch": 2.8962025316455695,
+ "grad_norm": 0.05875328183174133,
+ "learning_rate": 7.901234567901235e-05,
+ "loss": 0.023778585717082024,
+ "step": 573
+ },
+ {
+ "epoch": 2.90126582278481,
+ "grad_norm": 0.031178263947367668,
+ "learning_rate": 7.895622895622896e-05,
+ "loss": 0.02130977436900139,
+ "step": 574
+ },
+ {
+ "epoch": 2.9063291139240506,
+ "grad_norm": 0.028125282377004623,
+ "learning_rate": 7.890011223344557e-05,
+ "loss": 0.023941578343510628,
+ "step": 575
+ },
+ {
+ "epoch": 2.911392405063291,
+ "grad_norm": 0.03701331466436386,
+ "learning_rate": 7.884399551066218e-05,
+ "loss": 0.01856887713074684,
+ "step": 576
+ },
+ {
+ "epoch": 2.9164556962025316,
+ "grad_norm": 0.05281993746757507,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.023393619805574417,
+ "step": 577
+ },
+ {
+ "epoch": 2.921518987341772,
+ "grad_norm": 0.03958812728524208,
+ "learning_rate": 7.873176206509541e-05,
+ "loss": 0.019871000200510025,
+ "step": 578
+ },
+ {
+ "epoch": 2.9265822784810127,
+ "grad_norm": 0.0439714752137661,
+ "learning_rate": 7.867564534231201e-05,
+ "loss": 0.025316016748547554,
+ "step": 579
+ },
+ {
+ "epoch": 2.9316455696202532,
+ "grad_norm": 0.03543296083807945,
+ "learning_rate": 7.861952861952863e-05,
+ "loss": 0.022549735382199287,
+ "step": 580
+ },
+ {
+ "epoch": 2.9367088607594938,
+ "grad_norm": 0.05503656715154648,
+ "learning_rate": 7.856341189674523e-05,
+ "loss": 0.02716357260942459,
+ "step": 581
+ },
+ {
+ "epoch": 2.9417721518987343,
+ "grad_norm": 0.03273561969399452,
+ "learning_rate": 7.850729517396185e-05,
+ "loss": 0.017606684938073158,
+ "step": 582
+ },
+ {
+ "epoch": 2.946835443037975,
+ "grad_norm": 0.04668378457427025,
+ "learning_rate": 7.845117845117845e-05,
+ "loss": 0.022529952228069305,
+ "step": 583
+ },
+ {
+ "epoch": 2.951898734177215,
+ "grad_norm": 0.034348756074905396,
+ "learning_rate": 7.839506172839507e-05,
+ "loss": 0.02549612522125244,
+ "step": 584
+ },
+ {
+ "epoch": 2.9569620253164555,
+ "grad_norm": 0.03485729172825813,
+ "learning_rate": 7.833894500561168e-05,
+ "loss": 0.019362375140190125,
+ "step": 585
+ },
+ {
+ "epoch": 2.962025316455696,
+ "grad_norm": 0.034695904701948166,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.023550841957330704,
+ "step": 586
+ },
+ {
+ "epoch": 2.9670886075949365,
+ "grad_norm": 0.02703205682337284,
+ "learning_rate": 7.82267115600449e-05,
+ "loss": 0.016860410571098328,
+ "step": 587
+ },
+ {
+ "epoch": 2.972151898734177,
+ "grad_norm": 0.0694100558757782,
+ "learning_rate": 7.817059483726151e-05,
+ "loss": 0.02669605240225792,
+ "step": 588
+ },
+ {
+ "epoch": 2.9772151898734176,
+ "grad_norm": 0.02641797810792923,
+ "learning_rate": 7.811447811447812e-05,
+ "loss": 0.019620027393102646,
+ "step": 589
+ },
+ {
+ "epoch": 2.982278481012658,
+ "grad_norm": 0.03643452376127243,
+ "learning_rate": 7.805836139169473e-05,
+ "loss": 0.018797604367136955,
+ "step": 590
+ },
+ {
+ "epoch": 2.9873417721518987,
+ "grad_norm": 0.04125158116221428,
+ "learning_rate": 7.800224466891134e-05,
+ "loss": 0.020387161523103714,
+ "step": 591
+ },
+ {
+ "epoch": 2.992405063291139,
+ "grad_norm": 0.037161167711019516,
+ "learning_rate": 7.794612794612795e-05,
+ "loss": 0.02484878897666931,
+ "step": 592
+ },
+ {
+ "epoch": 2.9974683544303797,
+ "grad_norm": 0.03352266550064087,
+ "learning_rate": 7.789001122334456e-05,
+ "loss": 0.022045889869332314,
+ "step": 593
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.07333379238843918,
+ "learning_rate": 7.783389450056117e-05,
+ "loss": 0.025806350633502007,
+ "step": 594
+ },
+ {
+ "epoch": 3.0050632911392405,
+ "grad_norm": 0.05492037162184715,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.025387149304151535,
+ "step": 595
+ },
+ {
+ "epoch": 3.010126582278481,
+ "grad_norm": 0.03932039067149162,
+ "learning_rate": 7.772166105499439e-05,
+ "loss": 0.020961906760931015,
+ "step": 596
+ },
+ {
+ "epoch": 3.0151898734177216,
+ "grad_norm": 0.03346814960241318,
+ "learning_rate": 7.7665544332211e-05,
+ "loss": 0.018602946773171425,
+ "step": 597
+ },
+ {
+ "epoch": 3.020253164556962,
+ "grad_norm": 0.041588157415390015,
+ "learning_rate": 7.760942760942761e-05,
+ "loss": 0.02350936457514763,
+ "step": 598
+ },
+ {
+ "epoch": 3.0253164556962027,
+ "grad_norm": 0.0634593740105629,
+ "learning_rate": 7.755331088664422e-05,
+ "loss": 0.02807607129216194,
+ "step": 599
+ },
+ {
+ "epoch": 3.030379746835443,
+ "grad_norm": 0.037369582802057266,
+ "learning_rate": 7.749719416386083e-05,
+ "loss": 0.01987743005156517,
+ "step": 600
+ },
+ {
+ "epoch": 3.0354430379746837,
+ "grad_norm": 0.051795534789562225,
+ "learning_rate": 7.744107744107744e-05,
+ "loss": 0.02273828536272049,
+ "step": 601
+ },
+ {
+ "epoch": 3.0405063291139243,
+ "grad_norm": 0.06508016586303711,
+ "learning_rate": 7.738496071829405e-05,
+ "loss": 0.022526375949382782,
+ "step": 602
+ },
+ {
+ "epoch": 3.0455696202531644,
+ "grad_norm": 0.05076521635055542,
+ "learning_rate": 7.732884399551068e-05,
+ "loss": 0.030540699139237404,
+ "step": 603
+ },
+ {
+ "epoch": 3.050632911392405,
+ "grad_norm": 0.05223327502608299,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.025222979485988617,
+ "step": 604
+ },
+ {
+ "epoch": 3.0556962025316454,
+ "grad_norm": 0.040298622101545334,
+ "learning_rate": 7.72166105499439e-05,
+ "loss": 0.024349395185709,
+ "step": 605
+ },
+ {
+ "epoch": 3.060759493670886,
+ "grad_norm": 0.031546592712402344,
+ "learning_rate": 7.716049382716049e-05,
+ "loss": 0.022118842229247093,
+ "step": 606
+ },
+ {
+ "epoch": 3.0658227848101265,
+ "grad_norm": 0.03639276325702667,
+ "learning_rate": 7.710437710437712e-05,
+ "loss": 0.019809089601039886,
+ "step": 607
+ },
+ {
+ "epoch": 3.070886075949367,
+ "grad_norm": 0.03702636435627937,
+ "learning_rate": 7.704826038159371e-05,
+ "loss": 0.023927533999085426,
+ "step": 608
+ },
+ {
+ "epoch": 3.0759493670886076,
+ "grad_norm": 0.027585966512560844,
+ "learning_rate": 7.699214365881034e-05,
+ "loss": 0.017853228375315666,
+ "step": 609
+ },
+ {
+ "epoch": 3.081012658227848,
+ "grad_norm": 0.036372315138578415,
+ "learning_rate": 7.693602693602693e-05,
+ "loss": 0.027036674320697784,
+ "step": 610
+ },
+ {
+ "epoch": 3.0860759493670886,
+ "grad_norm": 0.03734718635678291,
+ "learning_rate": 7.687991021324356e-05,
+ "loss": 0.021930409595370293,
+ "step": 611
+ },
+ {
+ "epoch": 3.091139240506329,
+ "grad_norm": 0.04167135804891586,
+ "learning_rate": 7.682379349046017e-05,
+ "loss": 0.02211524173617363,
+ "step": 612
+ },
+ {
+ "epoch": 3.0962025316455697,
+ "grad_norm": 0.06541049480438232,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.02102654054760933,
+ "step": 613
+ },
+ {
+ "epoch": 3.1012658227848102,
+ "grad_norm": 0.03505360335111618,
+ "learning_rate": 7.671156004489339e-05,
+ "loss": 0.021799035370349884,
+ "step": 614
+ },
+ {
+ "epoch": 3.1063291139240508,
+ "grad_norm": 0.038781505078077316,
+ "learning_rate": 7.665544332210998e-05,
+ "loss": 0.020275672897696495,
+ "step": 615
+ },
+ {
+ "epoch": 3.1113924050632913,
+ "grad_norm": 0.05527551844716072,
+ "learning_rate": 7.65993265993266e-05,
+ "loss": 0.02752656675875187,
+ "step": 616
+ },
+ {
+ "epoch": 3.116455696202532,
+ "grad_norm": 0.092417873442173,
+ "learning_rate": 7.65432098765432e-05,
+ "loss": 0.034416262060403824,
+ "step": 617
+ },
+ {
+ "epoch": 3.1215189873417724,
+ "grad_norm": 0.04619184136390686,
+ "learning_rate": 7.648709315375983e-05,
+ "loss": 0.028675489127635956,
+ "step": 618
+ },
+ {
+ "epoch": 3.1265822784810124,
+ "grad_norm": 0.027103425934910774,
+ "learning_rate": 7.643097643097644e-05,
+ "loss": 0.01944906637072563,
+ "step": 619
+ },
+ {
+ "epoch": 3.131645569620253,
+ "grad_norm": 0.062025271356105804,
+ "learning_rate": 7.637485970819305e-05,
+ "loss": 0.030966270714998245,
+ "step": 620
+ },
+ {
+ "epoch": 3.1367088607594935,
+ "grad_norm": 0.029828928411006927,
+ "learning_rate": 7.631874298540966e-05,
+ "loss": 0.02199825644493103,
+ "step": 621
+ },
+ {
+ "epoch": 3.141772151898734,
+ "grad_norm": 0.029867300763726234,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.02649630233645439,
+ "step": 622
+ },
+ {
+ "epoch": 3.1468354430379746,
+ "grad_norm": 0.055938251316547394,
+ "learning_rate": 7.620650953984288e-05,
+ "loss": 0.03135379031300545,
+ "step": 623
+ },
+ {
+ "epoch": 3.151898734177215,
+ "grad_norm": 0.035160645842552185,
+ "learning_rate": 7.615039281705949e-05,
+ "loss": 0.025492198765277863,
+ "step": 624
+ },
+ {
+ "epoch": 3.1569620253164556,
+ "grad_norm": 0.0550227165222168,
+ "learning_rate": 7.60942760942761e-05,
+ "loss": 0.024527709931135178,
+ "step": 625
+ },
+ {
+ "epoch": 3.162025316455696,
+ "grad_norm": 0.045406773686409,
+ "learning_rate": 7.603815937149271e-05,
+ "loss": 0.021749500185251236,
+ "step": 626
+ },
+ {
+ "epoch": 3.1670886075949367,
+ "grad_norm": 0.03407207131385803,
+ "learning_rate": 7.598204264870932e-05,
+ "loss": 0.022218957543373108,
+ "step": 627
+ },
+ {
+ "epoch": 3.1721518987341772,
+ "grad_norm": 0.07292751222848892,
+ "learning_rate": 7.592592592592593e-05,
+ "loss": 0.027731608599424362,
+ "step": 628
+ },
+ {
+ "epoch": 3.1772151898734178,
+ "grad_norm": 0.05087915435433388,
+ "learning_rate": 7.586980920314254e-05,
+ "loss": 0.025174522772431374,
+ "step": 629
+ },
+ {
+ "epoch": 3.1822784810126583,
+ "grad_norm": 0.03146078437566757,
+ "learning_rate": 7.581369248035916e-05,
+ "loss": 0.023854102939367294,
+ "step": 630
+ },
+ {
+ "epoch": 3.187341772151899,
+ "grad_norm": 0.03517632558941841,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.021264635026454926,
+ "step": 631
+ },
+ {
+ "epoch": 3.1924050632911394,
+ "grad_norm": 0.0355447381734848,
+ "learning_rate": 7.570145903479238e-05,
+ "loss": 0.023219801485538483,
+ "step": 632
+ },
+ {
+ "epoch": 3.19746835443038,
+ "grad_norm": 0.03751067817211151,
+ "learning_rate": 7.564534231200898e-05,
+ "loss": 0.02329118922352791,
+ "step": 633
+ },
+ {
+ "epoch": 3.2025316455696204,
+ "grad_norm": 0.03923696279525757,
+ "learning_rate": 7.558922558922559e-05,
+ "loss": 0.025390561670064926,
+ "step": 634
+ },
+ {
+ "epoch": 3.207594936708861,
+ "grad_norm": 0.03601266071200371,
+ "learning_rate": 7.55331088664422e-05,
+ "loss": 0.02001899480819702,
+ "step": 635
+ },
+ {
+ "epoch": 3.212658227848101,
+ "grad_norm": 0.032203998416662216,
+ "learning_rate": 7.547699214365881e-05,
+ "loss": 0.022725094109773636,
+ "step": 636
+ },
+ {
+ "epoch": 3.2177215189873416,
+ "grad_norm": 0.040842000395059586,
+ "learning_rate": 7.542087542087543e-05,
+ "loss": 0.021683380007743835,
+ "step": 637
+ },
+ {
+ "epoch": 3.222784810126582,
+ "grad_norm": 0.03078434057533741,
+ "learning_rate": 7.536475869809203e-05,
+ "loss": 0.02051977440714836,
+ "step": 638
+ },
+ {
+ "epoch": 3.2278481012658227,
+ "grad_norm": 0.025937417522072792,
+ "learning_rate": 7.530864197530865e-05,
+ "loss": 0.01884596049785614,
+ "step": 639
+ },
+ {
+ "epoch": 3.232911392405063,
+ "grad_norm": 0.0464826263487339,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.018389636650681496,
+ "step": 640
+ },
+ {
+ "epoch": 3.2379746835443037,
+ "grad_norm": 0.04150732606649399,
+ "learning_rate": 7.519640852974187e-05,
+ "loss": 0.020952530205249786,
+ "step": 641
+ },
+ {
+ "epoch": 3.2430379746835443,
+ "grad_norm": 0.04317227005958557,
+ "learning_rate": 7.514029180695847e-05,
+ "loss": 0.024093877524137497,
+ "step": 642
+ },
+ {
+ "epoch": 3.248101265822785,
+ "grad_norm": 0.04621734470129013,
+ "learning_rate": 7.508417508417509e-05,
+ "loss": 0.029940858483314514,
+ "step": 643
+ },
+ {
+ "epoch": 3.2531645569620253,
+ "grad_norm": 0.03514556586742401,
+ "learning_rate": 7.50280583613917e-05,
+ "loss": 0.022350966930389404,
+ "step": 644
+ },
+ {
+ "epoch": 3.258227848101266,
+ "grad_norm": 0.025245223194360733,
+ "learning_rate": 7.497194163860831e-05,
+ "loss": 0.018291346728801727,
+ "step": 645
+ },
+ {
+ "epoch": 3.2632911392405064,
+ "grad_norm": 0.02498617395758629,
+ "learning_rate": 7.491582491582492e-05,
+ "loss": 0.01909235306084156,
+ "step": 646
+ },
+ {
+ "epoch": 3.268354430379747,
+ "grad_norm": 0.022831663489341736,
+ "learning_rate": 7.485970819304153e-05,
+ "loss": 0.01462332159280777,
+ "step": 647
+ },
+ {
+ "epoch": 3.2734177215189875,
+ "grad_norm": 0.03779070824384689,
+ "learning_rate": 7.480359147025814e-05,
+ "loss": 0.019472766667604446,
+ "step": 648
+ },
+ {
+ "epoch": 3.278481012658228,
+ "grad_norm": 0.030341917648911476,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.018727967515587807,
+ "step": 649
+ },
+ {
+ "epoch": 3.2835443037974685,
+ "grad_norm": 0.045589644461870193,
+ "learning_rate": 7.469135802469136e-05,
+ "loss": 0.023640938103199005,
+ "step": 650
+ },
+ {
+ "epoch": 3.2886075949367086,
+ "grad_norm": 0.023883633315563202,
+ "learning_rate": 7.463524130190797e-05,
+ "loss": 0.019227800890803337,
+ "step": 651
+ },
+ {
+ "epoch": 3.293670886075949,
+ "grad_norm": 0.03794898837804794,
+ "learning_rate": 7.457912457912458e-05,
+ "loss": 0.02445095032453537,
+ "step": 652
+ },
+ {
+ "epoch": 3.2987341772151897,
+ "grad_norm": 0.1442285180091858,
+ "learning_rate": 7.452300785634119e-05,
+ "loss": 0.023129010573029518,
+ "step": 653
+ },
+ {
+ "epoch": 3.3037974683544302,
+ "grad_norm": 0.03197013959288597,
+ "learning_rate": 7.44668911335578e-05,
+ "loss": 0.02768155373632908,
+ "step": 654
+ },
+ {
+ "epoch": 3.3088607594936708,
+ "grad_norm": 0.0434270016849041,
+ "learning_rate": 7.441077441077443e-05,
+ "loss": 0.02330004796385765,
+ "step": 655
+ },
+ {
+ "epoch": 3.3139240506329113,
+ "grad_norm": 0.03878983482718468,
+ "learning_rate": 7.435465768799102e-05,
+ "loss": 0.028383342549204826,
+ "step": 656
+ },
+ {
+ "epoch": 3.318987341772152,
+ "grad_norm": 0.035334642976522446,
+ "learning_rate": 7.429854096520763e-05,
+ "loss": 0.02583262138068676,
+ "step": 657
+ },
+ {
+ "epoch": 3.3240506329113924,
+ "grad_norm": 0.0473608672618866,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.030471306294202805,
+ "step": 658
+ },
+ {
+ "epoch": 3.329113924050633,
+ "grad_norm": 0.04193368926644325,
+ "learning_rate": 7.418630751964085e-05,
+ "loss": 0.016215423122048378,
+ "step": 659
+ },
+ {
+ "epoch": 3.3341772151898734,
+ "grad_norm": 0.023891586810350418,
+ "learning_rate": 7.413019079685746e-05,
+ "loss": 0.021040987223386765,
+ "step": 660
+ },
+ {
+ "epoch": 3.339240506329114,
+ "grad_norm": 0.029971614480018616,
+ "learning_rate": 7.407407407407407e-05,
+ "loss": 0.022258542478084564,
+ "step": 661
+ },
+ {
+ "epoch": 3.3443037974683545,
+ "grad_norm": 0.035308364778757095,
+ "learning_rate": 7.401795735129068e-05,
+ "loss": 0.02215534821152687,
+ "step": 662
+ },
+ {
+ "epoch": 3.349367088607595,
+ "grad_norm": 0.036979664117097855,
+ "learning_rate": 7.39618406285073e-05,
+ "loss": 0.027577020227909088,
+ "step": 663
+ },
+ {
+ "epoch": 3.3544303797468356,
+ "grad_norm": 0.03403281047940254,
+ "learning_rate": 7.390572390572392e-05,
+ "loss": 0.024540117010474205,
+ "step": 664
+ },
+ {
+ "epoch": 3.359493670886076,
+ "grad_norm": 0.04739405959844589,
+ "learning_rate": 7.384960718294051e-05,
+ "loss": 0.01647120714187622,
+ "step": 665
+ },
+ {
+ "epoch": 3.3645569620253166,
+ "grad_norm": 0.036933764815330505,
+ "learning_rate": 7.379349046015714e-05,
+ "loss": 0.02817656472325325,
+ "step": 666
+ },
+ {
+ "epoch": 3.369620253164557,
+ "grad_norm": 0.05966564640402794,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.028103439137339592,
+ "step": 667
+ },
+ {
+ "epoch": 3.3746835443037977,
+ "grad_norm": 0.09403033554553986,
+ "learning_rate": 7.368125701459036e-05,
+ "loss": 0.024899154901504517,
+ "step": 668
+ },
+ {
+ "epoch": 3.379746835443038,
+ "grad_norm": 0.056374453008174896,
+ "learning_rate": 7.362514029180695e-05,
+ "loss": 0.025570789352059364,
+ "step": 669
+ },
+ {
+ "epoch": 3.3848101265822783,
+ "grad_norm": 0.056454673409461975,
+ "learning_rate": 7.356902356902358e-05,
+ "loss": 0.02471453696489334,
+ "step": 670
+ },
+ {
+ "epoch": 3.389873417721519,
+ "grad_norm": 0.04115903005003929,
+ "learning_rate": 7.351290684624019e-05,
+ "loss": 0.017306309193372726,
+ "step": 671
+ },
+ {
+ "epoch": 3.3949367088607594,
+ "grad_norm": 0.030604340136051178,
+ "learning_rate": 7.34567901234568e-05,
+ "loss": 0.019510511308908463,
+ "step": 672
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.059018854051828384,
+ "learning_rate": 7.340067340067341e-05,
+ "loss": 0.02810611203312874,
+ "step": 673
+ },
+ {
+ "epoch": 3.4050632911392404,
+ "grad_norm": 0.026413513347506523,
+ "learning_rate": 7.334455667789002e-05,
+ "loss": 0.018966296687722206,
+ "step": 674
+ },
+ {
+ "epoch": 3.410126582278481,
+ "grad_norm": 0.03285476937890053,
+ "learning_rate": 7.328843995510663e-05,
+ "loss": 0.026708189398050308,
+ "step": 675
+ },
+ {
+ "epoch": 3.4151898734177215,
+ "grad_norm": 0.0392388291656971,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.022320115938782692,
+ "step": 676
+ },
+ {
+ "epoch": 3.420253164556962,
+ "grad_norm": 0.0305775236338377,
+ "learning_rate": 7.317620650953985e-05,
+ "loss": 0.018710114061832428,
+ "step": 677
+ },
+ {
+ "epoch": 3.4253164556962026,
+ "grad_norm": 0.033393554389476776,
+ "learning_rate": 7.312008978675646e-05,
+ "loss": 0.018753021955490112,
+ "step": 678
+ },
+ {
+ "epoch": 3.430379746835443,
+ "grad_norm": 0.02704286389052868,
+ "learning_rate": 7.306397306397307e-05,
+ "loss": 0.01539788581430912,
+ "step": 679
+ },
+ {
+ "epoch": 3.4354430379746836,
+ "grad_norm": 0.038779884576797485,
+ "learning_rate": 7.300785634118968e-05,
+ "loss": 0.024458929896354675,
+ "step": 680
+ },
+ {
+ "epoch": 3.440506329113924,
+ "grad_norm": 0.061135295778512955,
+ "learning_rate": 7.295173961840629e-05,
+ "loss": 0.021106259897351265,
+ "step": 681
+ },
+ {
+ "epoch": 3.4455696202531647,
+ "grad_norm": 0.02436748333275318,
+ "learning_rate": 7.28956228956229e-05,
+ "loss": 0.019037332385778427,
+ "step": 682
+ },
+ {
+ "epoch": 3.4506329113924052,
+ "grad_norm": 0.037567682564258575,
+ "learning_rate": 7.283950617283951e-05,
+ "loss": 0.02065495029091835,
+ "step": 683
+ },
+ {
+ "epoch": 3.4556962025316453,
+ "grad_norm": 0.03743781894445419,
+ "learning_rate": 7.278338945005612e-05,
+ "loss": 0.02559451386332512,
+ "step": 684
+ },
+ {
+ "epoch": 3.460759493670886,
+ "grad_norm": 0.04715351387858391,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.021420618519186974,
+ "step": 685
+ },
+ {
+ "epoch": 3.4658227848101264,
+ "grad_norm": 0.02502383477985859,
+ "learning_rate": 7.267115600448934e-05,
+ "loss": 0.019398193806409836,
+ "step": 686
+ },
+ {
+ "epoch": 3.470886075949367,
+ "grad_norm": 0.02199714072048664,
+ "learning_rate": 7.261503928170595e-05,
+ "loss": 0.019068796187639236,
+ "step": 687
+ },
+ {
+ "epoch": 3.4759493670886075,
+ "grad_norm": 0.034711211919784546,
+ "learning_rate": 7.255892255892256e-05,
+ "loss": 0.021794648841023445,
+ "step": 688
+ },
+ {
+ "epoch": 3.481012658227848,
+ "grad_norm": 0.040784433484077454,
+ "learning_rate": 7.250280583613918e-05,
+ "loss": 0.022812314331531525,
+ "step": 689
+ },
+ {
+ "epoch": 3.4860759493670885,
+ "grad_norm": 0.035993628203868866,
+ "learning_rate": 7.244668911335578e-05,
+ "loss": 0.026385463774204254,
+ "step": 690
+ },
+ {
+ "epoch": 3.491139240506329,
+ "grad_norm": 0.031834330409765244,
+ "learning_rate": 7.23905723905724e-05,
+ "loss": 0.022114556282758713,
+ "step": 691
+ },
+ {
+ "epoch": 3.4962025316455696,
+ "grad_norm": 0.025820165872573853,
+ "learning_rate": 7.2334455667789e-05,
+ "loss": 0.01813361421227455,
+ "step": 692
+ },
+ {
+ "epoch": 3.50126582278481,
+ "grad_norm": 0.04998617246747017,
+ "learning_rate": 7.227833894500562e-05,
+ "loss": 0.022573690861463547,
+ "step": 693
+ },
+ {
+ "epoch": 3.5063291139240507,
+ "grad_norm": 0.04184528812766075,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.026092834770679474,
+ "step": 694
+ },
+ {
+ "epoch": 3.511392405063291,
+ "grad_norm": 0.050683457404375076,
+ "learning_rate": 7.216610549943884e-05,
+ "loss": 0.021743692457675934,
+ "step": 695
+ },
+ {
+ "epoch": 3.5164556962025317,
+ "grad_norm": 0.07393304258584976,
+ "learning_rate": 7.210998877665545e-05,
+ "loss": 0.024253465235233307,
+ "step": 696
+ },
+ {
+ "epoch": 3.5215189873417723,
+ "grad_norm": 0.02564188838005066,
+ "learning_rate": 7.205387205387206e-05,
+ "loss": 0.019201550632715225,
+ "step": 697
+ },
+ {
+ "epoch": 3.526582278481013,
+ "grad_norm": 0.035527680069208145,
+ "learning_rate": 7.199775533108867e-05,
+ "loss": 0.02153913676738739,
+ "step": 698
+ },
+ {
+ "epoch": 3.5316455696202533,
+ "grad_norm": 0.036737874150276184,
+ "learning_rate": 7.194163860830527e-05,
+ "loss": 0.025572702288627625,
+ "step": 699
+ },
+ {
+ "epoch": 3.536708860759494,
+ "grad_norm": 0.03383871540427208,
+ "learning_rate": 7.188552188552189e-05,
+ "loss": 0.017153475433588028,
+ "step": 700
+ },
+ {
+ "epoch": 3.5417721518987344,
+ "grad_norm": 0.0350637212395668,
+ "learning_rate": 7.182940516273849e-05,
+ "loss": 0.018297579139471054,
+ "step": 701
+ },
+ {
+ "epoch": 3.546835443037975,
+ "grad_norm": 0.029637211933732033,
+ "learning_rate": 7.177328843995511e-05,
+ "loss": 0.017981912940740585,
+ "step": 702
+ },
+ {
+ "epoch": 3.5518987341772155,
+ "grad_norm": 0.03611799329519272,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.02710491605103016,
+ "step": 703
+ },
+ {
+ "epoch": 3.5569620253164556,
+ "grad_norm": 0.02008277364075184,
+ "learning_rate": 7.166105499438833e-05,
+ "loss": 0.02035117708146572,
+ "step": 704
+ },
+ {
+ "epoch": 3.562025316455696,
+ "grad_norm": 0.026698170229792595,
+ "learning_rate": 7.160493827160494e-05,
+ "loss": 0.017481079325079918,
+ "step": 705
+ },
+ {
+ "epoch": 3.5670886075949366,
+ "grad_norm": 0.036382947117090225,
+ "learning_rate": 7.154882154882155e-05,
+ "loss": 0.019109399989247322,
+ "step": 706
+ },
+ {
+ "epoch": 3.572151898734177,
+ "grad_norm": 0.04591331630945206,
+ "learning_rate": 7.149270482603816e-05,
+ "loss": 0.023143479600548744,
+ "step": 707
+ },
+ {
+ "epoch": 3.5772151898734177,
+ "grad_norm": 0.04864713177084923,
+ "learning_rate": 7.143658810325477e-05,
+ "loss": 0.022374317049980164,
+ "step": 708
+ },
+ {
+ "epoch": 3.5822784810126582,
+ "grad_norm": 0.03528938442468643,
+ "learning_rate": 7.138047138047138e-05,
+ "loss": 0.021928273141384125,
+ "step": 709
+ },
+ {
+ "epoch": 3.5873417721518988,
+ "grad_norm": 0.03548784181475639,
+ "learning_rate": 7.1324354657688e-05,
+ "loss": 0.02179766446352005,
+ "step": 710
+ },
+ {
+ "epoch": 3.5924050632911393,
+ "grad_norm": 0.041786350309848785,
+ "learning_rate": 7.12682379349046e-05,
+ "loss": 0.028576329350471497,
+ "step": 711
+ },
+ {
+ "epoch": 3.59746835443038,
+ "grad_norm": 0.03197047486901283,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.018731534481048584,
+ "step": 712
+ },
+ {
+ "epoch": 3.6025316455696204,
+ "grad_norm": 0.04037933051586151,
+ "learning_rate": 7.115600448933782e-05,
+ "loss": 0.024375513195991516,
+ "step": 713
+ },
+ {
+ "epoch": 3.607594936708861,
+ "grad_norm": 0.032266534864902496,
+ "learning_rate": 7.109988776655443e-05,
+ "loss": 0.016232451424002647,
+ "step": 714
+ },
+ {
+ "epoch": 3.6126582278481014,
+ "grad_norm": 0.02890392392873764,
+ "learning_rate": 7.104377104377104e-05,
+ "loss": 0.018303632736206055,
+ "step": 715
+ },
+ {
+ "epoch": 3.6177215189873415,
+ "grad_norm": 0.032750677317380905,
+ "learning_rate": 7.098765432098767e-05,
+ "loss": 0.021466076374053955,
+ "step": 716
+ },
+ {
+ "epoch": 3.622784810126582,
+ "grad_norm": 0.05076618492603302,
+ "learning_rate": 7.093153759820426e-05,
+ "loss": 0.022349126636981964,
+ "step": 717
+ },
+ {
+ "epoch": 3.6278481012658226,
+ "grad_norm": 0.034143563359975815,
+ "learning_rate": 7.087542087542089e-05,
+ "loss": 0.02274998091161251,
+ "step": 718
+ },
+ {
+ "epoch": 3.632911392405063,
+ "grad_norm": 0.025406064465641975,
+ "learning_rate": 7.081930415263748e-05,
+ "loss": 0.016980832442641258,
+ "step": 719
+ },
+ {
+ "epoch": 3.6379746835443036,
+ "grad_norm": 0.031938597559928894,
+ "learning_rate": 7.076318742985411e-05,
+ "loss": 0.023153938353061676,
+ "step": 720
+ },
+ {
+ "epoch": 3.643037974683544,
+ "grad_norm": 0.03354712948203087,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.018384695053100586,
+ "step": 721
+ },
+ {
+ "epoch": 3.6481012658227847,
+ "grad_norm": 0.028671689331531525,
+ "learning_rate": 7.065095398428731e-05,
+ "loss": 0.021795600652694702,
+ "step": 722
+ },
+ {
+ "epoch": 3.6531645569620252,
+ "grad_norm": 0.057982735335826874,
+ "learning_rate": 7.059483726150394e-05,
+ "loss": 0.026870068162679672,
+ "step": 723
+ },
+ {
+ "epoch": 3.6582278481012658,
+ "grad_norm": 0.036460306495428085,
+ "learning_rate": 7.053872053872053e-05,
+ "loss": 0.019742611795663834,
+ "step": 724
+ },
+ {
+ "epoch": 3.6632911392405063,
+ "grad_norm": 0.06633497029542923,
+ "learning_rate": 7.048260381593716e-05,
+ "loss": 0.01737678050994873,
+ "step": 725
+ },
+ {
+ "epoch": 3.668354430379747,
+ "grad_norm": 0.0410747192800045,
+ "learning_rate": 7.042648709315375e-05,
+ "loss": 0.023570548743009567,
+ "step": 726
+ },
+ {
+ "epoch": 3.6734177215189874,
+ "grad_norm": 0.04499414190649986,
+ "learning_rate": 7.037037037037038e-05,
+ "loss": 0.024305228143930435,
+ "step": 727
+ },
+ {
+ "epoch": 3.678481012658228,
+ "grad_norm": 0.024429699406027794,
+ "learning_rate": 7.031425364758697e-05,
+ "loss": 0.018056385219097137,
+ "step": 728
+ },
+ {
+ "epoch": 3.6835443037974684,
+ "grad_norm": 0.03042393922805786,
+ "learning_rate": 7.02581369248036e-05,
+ "loss": 0.019678741693496704,
+ "step": 729
+ },
+ {
+ "epoch": 3.688607594936709,
+ "grad_norm": 0.04088849946856499,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.026466136798262596,
+ "step": 730
+ },
+ {
+ "epoch": 3.6936708860759495,
+ "grad_norm": 0.03353559225797653,
+ "learning_rate": 7.014590347923682e-05,
+ "loss": 0.021056771278381348,
+ "step": 731
+ },
+ {
+ "epoch": 3.69873417721519,
+ "grad_norm": 0.03120904415845871,
+ "learning_rate": 7.008978675645343e-05,
+ "loss": 0.020675398409366608,
+ "step": 732
+ },
+ {
+ "epoch": 3.7037974683544306,
+ "grad_norm": 0.05723356828093529,
+ "learning_rate": 7.003367003367004e-05,
+ "loss": 0.033802516758441925,
+ "step": 733
+ },
+ {
+ "epoch": 3.708860759493671,
+ "grad_norm": 0.03580084443092346,
+ "learning_rate": 6.997755331088665e-05,
+ "loss": 0.026392754167318344,
+ "step": 734
+ },
+ {
+ "epoch": 3.7139240506329116,
+ "grad_norm": 0.05164967477321625,
+ "learning_rate": 6.992143658810326e-05,
+ "loss": 0.0241309255361557,
+ "step": 735
+ },
+ {
+ "epoch": 3.7189873417721517,
+ "grad_norm": 0.02190530300140381,
+ "learning_rate": 6.986531986531987e-05,
+ "loss": 0.018209822475910187,
+ "step": 736
+ },
+ {
+ "epoch": 3.7240506329113923,
+ "grad_norm": 0.027256503701210022,
+ "learning_rate": 6.980920314253648e-05,
+ "loss": 0.022063471376895905,
+ "step": 737
+ },
+ {
+ "epoch": 3.729113924050633,
+ "grad_norm": 0.03337831795215607,
+ "learning_rate": 6.975308641975309e-05,
+ "loss": 0.018506363034248352,
+ "step": 738
+ },
+ {
+ "epoch": 3.7341772151898733,
+ "grad_norm": 0.025730784982442856,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.016883976757526398,
+ "step": 739
+ },
+ {
+ "epoch": 3.739240506329114,
+ "grad_norm": 0.026203135028481483,
+ "learning_rate": 6.964085297418631e-05,
+ "loss": 0.023329125717282295,
+ "step": 740
+ },
+ {
+ "epoch": 3.7443037974683544,
+ "grad_norm": 0.02676830254495144,
+ "learning_rate": 6.958473625140293e-05,
+ "loss": 0.020962664857506752,
+ "step": 741
+ },
+ {
+ "epoch": 3.749367088607595,
+ "grad_norm": 0.019974667578935623,
+ "learning_rate": 6.952861952861953e-05,
+ "loss": 0.018353454768657684,
+ "step": 742
+ },
+ {
+ "epoch": 3.7544303797468355,
+ "grad_norm": 0.02399631030857563,
+ "learning_rate": 6.947250280583614e-05,
+ "loss": 0.01820143684744835,
+ "step": 743
+ },
+ {
+ "epoch": 3.759493670886076,
+ "grad_norm": 0.02083951234817505,
+ "learning_rate": 6.941638608305275e-05,
+ "loss": 0.02312408946454525,
+ "step": 744
+ },
+ {
+ "epoch": 3.7645569620253165,
+ "grad_norm": 0.025636207312345505,
+ "learning_rate": 6.936026936026936e-05,
+ "loss": 0.01757936365902424,
+ "step": 745
+ },
+ {
+ "epoch": 3.769620253164557,
+ "grad_norm": 0.036856744438409805,
+ "learning_rate": 6.930415263748597e-05,
+ "loss": 0.028933756053447723,
+ "step": 746
+ },
+ {
+ "epoch": 3.7746835443037976,
+ "grad_norm": 0.037415456026792526,
+ "learning_rate": 6.924803591470258e-05,
+ "loss": 0.022136090323328972,
+ "step": 747
+ },
+ {
+ "epoch": 3.779746835443038,
+ "grad_norm": 0.027949288487434387,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.022943630814552307,
+ "step": 748
+ },
+ {
+ "epoch": 3.7848101265822782,
+ "grad_norm": 0.037508148699998856,
+ "learning_rate": 6.91358024691358e-05,
+ "loss": 0.020460065454244614,
+ "step": 749
+ },
+ {
+ "epoch": 3.7898734177215188,
+ "grad_norm": 0.037965189665555954,
+ "learning_rate": 6.907968574635242e-05,
+ "loss": 0.024793215095996857,
+ "step": 750
+ },
+ {
+ "epoch": 3.7949367088607593,
+ "grad_norm": 0.027956753969192505,
+ "learning_rate": 6.902356902356902e-05,
+ "loss": 0.02188705839216709,
+ "step": 751
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.027417965233325958,
+ "learning_rate": 6.896745230078564e-05,
+ "loss": 0.01465995516628027,
+ "step": 752
+ },
+ {
+ "epoch": 3.8050632911392404,
+ "grad_norm": 0.036644525825977325,
+ "learning_rate": 6.891133557800224e-05,
+ "loss": 0.020246809348464012,
+ "step": 753
+ },
+ {
+ "epoch": 3.810126582278481,
+ "grad_norm": 0.027043674141168594,
+ "learning_rate": 6.885521885521886e-05,
+ "loss": 0.02293788641691208,
+ "step": 754
+ },
+ {
+ "epoch": 3.8151898734177214,
+ "grad_norm": 0.033968694508075714,
+ "learning_rate": 6.879910213243546e-05,
+ "loss": 0.024979766458272934,
+ "step": 755
+ },
+ {
+ "epoch": 3.820253164556962,
+ "grad_norm": 0.022790739312767982,
+ "learning_rate": 6.874298540965208e-05,
+ "loss": 0.019254112616181374,
+ "step": 756
+ },
+ {
+ "epoch": 3.8253164556962025,
+ "grad_norm": 0.028349611908197403,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.018624842166900635,
+ "step": 757
+ },
+ {
+ "epoch": 3.830379746835443,
+ "grad_norm": 0.034140367060899734,
+ "learning_rate": 6.86307519640853e-05,
+ "loss": 0.01691599376499653,
+ "step": 758
+ },
+ {
+ "epoch": 3.8354430379746836,
+ "grad_norm": 0.03422265127301216,
+ "learning_rate": 6.857463524130191e-05,
+ "loss": 0.01864086464047432,
+ "step": 759
+ },
+ {
+ "epoch": 3.840506329113924,
+ "grad_norm": 0.037322208285331726,
+ "learning_rate": 6.851851851851852e-05,
+ "loss": 0.024382904171943665,
+ "step": 760
+ },
+ {
+ "epoch": 3.8455696202531646,
+ "grad_norm": 0.022540392354130745,
+ "learning_rate": 6.846240179573513e-05,
+ "loss": 0.017390096560120583,
+ "step": 761
+ },
+ {
+ "epoch": 3.850632911392405,
+ "grad_norm": 0.035701289772987366,
+ "learning_rate": 6.840628507295174e-05,
+ "loss": 0.01928594335913658,
+ "step": 762
+ },
+ {
+ "epoch": 3.8556962025316457,
+ "grad_norm": 0.047425150871276855,
+ "learning_rate": 6.835016835016835e-05,
+ "loss": 0.026818927377462387,
+ "step": 763
+ },
+ {
+ "epoch": 3.8607594936708862,
+ "grad_norm": 0.0244912076741457,
+ "learning_rate": 6.829405162738496e-05,
+ "loss": 0.01811584085226059,
+ "step": 764
+ },
+ {
+ "epoch": 3.8658227848101268,
+ "grad_norm": 0.03282126039266586,
+ "learning_rate": 6.823793490460157e-05,
+ "loss": 0.01521163061261177,
+ "step": 765
+ },
+ {
+ "epoch": 3.8708860759493673,
+ "grad_norm": 0.030519530177116394,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.023735523223876953,
+ "step": 766
+ },
+ {
+ "epoch": 3.875949367088608,
+ "grad_norm": 0.03829387575387955,
+ "learning_rate": 6.81257014590348e-05,
+ "loss": 0.02391430363059044,
+ "step": 767
+ },
+ {
+ "epoch": 3.8810126582278484,
+ "grad_norm": 0.03133988752961159,
+ "learning_rate": 6.80695847362514e-05,
+ "loss": 0.022026970982551575,
+ "step": 768
+ },
+ {
+ "epoch": 3.8860759493670884,
+ "grad_norm": 0.036327920854091644,
+ "learning_rate": 6.801346801346801e-05,
+ "loss": 0.01740797609090805,
+ "step": 769
+ },
+ {
+ "epoch": 3.891139240506329,
+ "grad_norm": 0.06766671687364578,
+ "learning_rate": 6.795735129068462e-05,
+ "loss": 0.02804078534245491,
+ "step": 770
+ },
+ {
+ "epoch": 3.8962025316455695,
+ "grad_norm": 0.06390757858753204,
+ "learning_rate": 6.790123456790123e-05,
+ "loss": 0.032084181904792786,
+ "step": 771
+ },
+ {
+ "epoch": 3.90126582278481,
+ "grad_norm": 0.03238178789615631,
+ "learning_rate": 6.784511784511784e-05,
+ "loss": 0.02189403772354126,
+ "step": 772
+ },
+ {
+ "epoch": 3.9063291139240506,
+ "grad_norm": 0.03206197917461395,
+ "learning_rate": 6.778900112233445e-05,
+ "loss": 0.022829271852970123,
+ "step": 773
+ },
+ {
+ "epoch": 3.911392405063291,
+ "grad_norm": 0.030897945165634155,
+ "learning_rate": 6.773288439955107e-05,
+ "loss": 0.021807631477713585,
+ "step": 774
+ },
+ {
+ "epoch": 3.9164556962025316,
+ "grad_norm": 0.04285162314772606,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.023028545081615448,
+ "step": 775
+ },
+ {
+ "epoch": 3.921518987341772,
+ "grad_norm": 0.02819208987057209,
+ "learning_rate": 6.762065095398429e-05,
+ "loss": 0.02110828459262848,
+ "step": 776
+ },
+ {
+ "epoch": 3.9265822784810127,
+ "grad_norm": 0.03159799054265022,
+ "learning_rate": 6.756453423120091e-05,
+ "loss": 0.02116553671658039,
+ "step": 777
+ },
+ {
+ "epoch": 3.9316455696202532,
+ "grad_norm": 0.028514137491583824,
+ "learning_rate": 6.75084175084175e-05,
+ "loss": 0.020262988284230232,
+ "step": 778
+ },
+ {
+ "epoch": 3.9367088607594938,
+ "grad_norm": 0.03610249608755112,
+ "learning_rate": 6.745230078563413e-05,
+ "loss": 0.016928158700466156,
+ "step": 779
+ },
+ {
+ "epoch": 3.9417721518987343,
+ "grad_norm": 0.02753387950360775,
+ "learning_rate": 6.739618406285073e-05,
+ "loss": 0.022629719227552414,
+ "step": 780
+ },
+ {
+ "epoch": 3.946835443037975,
+ "grad_norm": 0.026071136817336082,
+ "learning_rate": 6.734006734006735e-05,
+ "loss": 0.020297978073358536,
+ "step": 781
+ },
+ {
+ "epoch": 3.951898734177215,
+ "grad_norm": 0.04774617776274681,
+ "learning_rate": 6.728395061728396e-05,
+ "loss": 0.01858438178896904,
+ "step": 782
+ },
+ {
+ "epoch": 3.9569620253164555,
+ "grad_norm": 0.03666248545050621,
+ "learning_rate": 6.722783389450057e-05,
+ "loss": 0.024037979543209076,
+ "step": 783
+ },
+ {
+ "epoch": 3.962025316455696,
+ "grad_norm": 0.04990983009338379,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.027675451710820198,
+ "step": 784
+ },
+ {
+ "epoch": 3.9670886075949365,
+ "grad_norm": 0.04734862968325615,
+ "learning_rate": 6.711560044893379e-05,
+ "loss": 0.02003151923418045,
+ "step": 785
+ },
+ {
+ "epoch": 3.972151898734177,
+ "grad_norm": 0.031911976635456085,
+ "learning_rate": 6.70594837261504e-05,
+ "loss": 0.02302616462111473,
+ "step": 786
+ },
+ {
+ "epoch": 3.9772151898734176,
+ "grad_norm": 0.03199504688382149,
+ "learning_rate": 6.7003367003367e-05,
+ "loss": 0.020066704601049423,
+ "step": 787
+ },
+ {
+ "epoch": 3.982278481012658,
+ "grad_norm": 0.02664150856435299,
+ "learning_rate": 6.694725028058362e-05,
+ "loss": 0.01888475939631462,
+ "step": 788
+ },
+ {
+ "epoch": 3.9873417721518987,
+ "grad_norm": 0.03886157646775246,
+ "learning_rate": 6.689113355780023e-05,
+ "loss": 0.016029106453061104,
+ "step": 789
+ },
+ {
+ "epoch": 3.992405063291139,
+ "grad_norm": 0.025033561512827873,
+ "learning_rate": 6.683501683501684e-05,
+ "loss": 0.01627909578382969,
+ "step": 790
+ },
+ {
+ "epoch": 3.9974683544303797,
+ "grad_norm": 0.04991500452160835,
+ "learning_rate": 6.677890011223345e-05,
+ "loss": 0.02633330039680004,
+ "step": 791
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.0552835538983345,
+ "learning_rate": 6.672278338945006e-05,
+ "loss": 0.025268658995628357,
+ "step": 792
+ },
+ {
+ "epoch": 4.0050632911392405,
+ "grad_norm": 0.04223925992846489,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.023410093039274216,
+ "step": 793
+ },
+ {
+ "epoch": 4.010126582278481,
+ "grad_norm": 0.03191488981246948,
+ "learning_rate": 6.661054994388328e-05,
+ "loss": 0.01913982629776001,
+ "step": 794
+ },
+ {
+ "epoch": 4.015189873417722,
+ "grad_norm": 0.03535325452685356,
+ "learning_rate": 6.655443322109989e-05,
+ "loss": 0.020550835877656937,
+ "step": 795
+ },
+ {
+ "epoch": 4.020253164556962,
+ "grad_norm": 0.027277838438749313,
+ "learning_rate": 6.64983164983165e-05,
+ "loss": 0.02178161032497883,
+ "step": 796
+ },
+ {
+ "epoch": 4.025316455696203,
+ "grad_norm": 0.03889140114188194,
+ "learning_rate": 6.644219977553311e-05,
+ "loss": 0.02359630912542343,
+ "step": 797
+ },
+ {
+ "epoch": 4.030379746835443,
+ "grad_norm": 0.03794289380311966,
+ "learning_rate": 6.638608305274972e-05,
+ "loss": 0.02135687693953514,
+ "step": 798
+ },
+ {
+ "epoch": 4.035443037974684,
+ "grad_norm": 0.030842013657093048,
+ "learning_rate": 6.632996632996633e-05,
+ "loss": 0.026881888508796692,
+ "step": 799
+ },
+ {
+ "epoch": 4.040506329113924,
+ "grad_norm": 0.036720771342515945,
+ "learning_rate": 6.627384960718295e-05,
+ "loss": 0.017526758834719658,
+ "step": 800
+ },
+ {
+ "epoch": 4.045569620253165,
+ "grad_norm": 0.04940621554851532,
+ "learning_rate": 6.621773288439955e-05,
+ "loss": 0.023458952084183693,
+ "step": 801
+ },
+ {
+ "epoch": 4.050632911392405,
+ "grad_norm": 0.0228698942810297,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.017165549099445343,
+ "step": 802
+ },
+ {
+ "epoch": 4.055696202531646,
+ "grad_norm": 0.0323697030544281,
+ "learning_rate": 6.610549943883277e-05,
+ "loss": 0.020573658868670464,
+ "step": 803
+ },
+ {
+ "epoch": 4.060759493670886,
+ "grad_norm": 0.03041171282529831,
+ "learning_rate": 6.60493827160494e-05,
+ "loss": 0.022557582706212997,
+ "step": 804
+ },
+ {
+ "epoch": 4.065822784810127,
+ "grad_norm": 0.030996058136224747,
+ "learning_rate": 6.599326599326599e-05,
+ "loss": 0.024344075471162796,
+ "step": 805
+ },
+ {
+ "epoch": 4.0708860759493675,
+ "grad_norm": 0.02448248863220215,
+ "learning_rate": 6.593714927048261e-05,
+ "loss": 0.018718231469392776,
+ "step": 806
+ },
+ {
+ "epoch": 4.075949367088608,
+ "grad_norm": 0.03839370980858803,
+ "learning_rate": 6.588103254769921e-05,
+ "loss": 0.02680569887161255,
+ "step": 807
+ },
+ {
+ "epoch": 4.0810126582278485,
+ "grad_norm": 0.029364196583628654,
+ "learning_rate": 6.582491582491582e-05,
+ "loss": 0.01946680247783661,
+ "step": 808
+ },
+ {
+ "epoch": 4.086075949367088,
+ "grad_norm": 0.02478131465613842,
+ "learning_rate": 6.576879910213244e-05,
+ "loss": 0.021097835153341293,
+ "step": 809
+ },
+ {
+ "epoch": 4.091139240506329,
+ "grad_norm": 0.030616244301199913,
+ "learning_rate": 6.571268237934904e-05,
+ "loss": 0.021518010646104813,
+ "step": 810
+ },
+ {
+ "epoch": 4.096202531645569,
+ "grad_norm": 0.02732054330408573,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.02008533477783203,
+ "step": 811
+ },
+ {
+ "epoch": 4.10126582278481,
+ "grad_norm": 0.0323524996638298,
+ "learning_rate": 6.560044893378226e-05,
+ "loss": 0.025486933067440987,
+ "step": 812
+ },
+ {
+ "epoch": 4.10632911392405,
+ "grad_norm": 0.026200806722044945,
+ "learning_rate": 6.554433221099888e-05,
+ "loss": 0.019320383667945862,
+ "step": 813
+ },
+ {
+ "epoch": 4.111392405063291,
+ "grad_norm": 0.03883595019578934,
+ "learning_rate": 6.548821548821548e-05,
+ "loss": 0.021837443113327026,
+ "step": 814
+ },
+ {
+ "epoch": 4.116455696202531,
+ "grad_norm": 0.037654533982276917,
+ "learning_rate": 6.54320987654321e-05,
+ "loss": 0.024574559181928635,
+ "step": 815
+ },
+ {
+ "epoch": 4.121518987341772,
+ "grad_norm": 0.04923658072948456,
+ "learning_rate": 6.537598204264871e-05,
+ "loss": 0.01940765418112278,
+ "step": 816
+ },
+ {
+ "epoch": 4.1265822784810124,
+ "grad_norm": 0.02900642342865467,
+ "learning_rate": 6.531986531986533e-05,
+ "loss": 0.019193468615412712,
+ "step": 817
+ },
+ {
+ "epoch": 4.131645569620253,
+ "grad_norm": 0.03798971325159073,
+ "learning_rate": 6.526374859708194e-05,
+ "loss": 0.022473281249403954,
+ "step": 818
+ },
+ {
+ "epoch": 4.1367088607594935,
+ "grad_norm": 0.05821327865123749,
+ "learning_rate": 6.520763187429855e-05,
+ "loss": 0.025292381644248962,
+ "step": 819
+ },
+ {
+ "epoch": 4.141772151898734,
+ "grad_norm": 0.02774794027209282,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.021283335983753204,
+ "step": 820
+ },
+ {
+ "epoch": 4.146835443037975,
+ "grad_norm": 0.03002094104886055,
+ "learning_rate": 6.509539842873177e-05,
+ "loss": 0.020336506888270378,
+ "step": 821
+ },
+ {
+ "epoch": 4.151898734177215,
+ "grad_norm": 0.02205439656972885,
+ "learning_rate": 6.503928170594838e-05,
+ "loss": 0.01669773831963539,
+ "step": 822
+ },
+ {
+ "epoch": 4.156962025316456,
+ "grad_norm": 0.023610664531588554,
+ "learning_rate": 6.498316498316499e-05,
+ "loss": 0.016195815056562424,
+ "step": 823
+ },
+ {
+ "epoch": 4.162025316455696,
+ "grad_norm": 0.02679222822189331,
+ "learning_rate": 6.49270482603816e-05,
+ "loss": 0.020671207457780838,
+ "step": 824
+ },
+ {
+ "epoch": 4.167088607594937,
+ "grad_norm": 0.043805427849292755,
+ "learning_rate": 6.48709315375982e-05,
+ "loss": 0.029262011870741844,
+ "step": 825
+ },
+ {
+ "epoch": 4.172151898734177,
+ "grad_norm": 0.024075932800769806,
+ "learning_rate": 6.481481481481482e-05,
+ "loss": 0.0180169977247715,
+ "step": 826
+ },
+ {
+ "epoch": 4.177215189873418,
+ "grad_norm": 0.027496427297592163,
+ "learning_rate": 6.475869809203144e-05,
+ "loss": 0.01985255442559719,
+ "step": 827
+ },
+ {
+ "epoch": 4.182278481012658,
+ "grad_norm": 0.028868619352579117,
+ "learning_rate": 6.470258136924804e-05,
+ "loss": 0.02416200190782547,
+ "step": 828
+ },
+ {
+ "epoch": 4.187341772151899,
+ "grad_norm": 0.026004688814282417,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.01904168725013733,
+ "step": 829
+ },
+ {
+ "epoch": 4.192405063291139,
+ "grad_norm": 0.04274019971489906,
+ "learning_rate": 6.459034792368126e-05,
+ "loss": 0.02680842950940132,
+ "step": 830
+ },
+ {
+ "epoch": 4.19746835443038,
+ "grad_norm": 0.024735039100050926,
+ "learning_rate": 6.453423120089787e-05,
+ "loss": 0.016491729766130447,
+ "step": 831
+ },
+ {
+ "epoch": 4.2025316455696204,
+ "grad_norm": 0.04336397722363472,
+ "learning_rate": 6.447811447811448e-05,
+ "loss": 0.02140970341861248,
+ "step": 832
+ },
+ {
+ "epoch": 4.207594936708861,
+ "grad_norm": 0.025922754779458046,
+ "learning_rate": 6.442199775533109e-05,
+ "loss": 0.017252741381525993,
+ "step": 833
+ },
+ {
+ "epoch": 4.2126582278481015,
+ "grad_norm": 0.0322343185544014,
+ "learning_rate": 6.436588103254771e-05,
+ "loss": 0.015862349420785904,
+ "step": 834
+ },
+ {
+ "epoch": 4.217721518987342,
+ "grad_norm": 0.033133670687675476,
+ "learning_rate": 6.43097643097643e-05,
+ "loss": 0.02029406651854515,
+ "step": 835
+ },
+ {
+ "epoch": 4.222784810126583,
+ "grad_norm": 0.044879183173179626,
+ "learning_rate": 6.425364758698093e-05,
+ "loss": 0.021223746240139008,
+ "step": 836
+ },
+ {
+ "epoch": 4.227848101265823,
+ "grad_norm": 0.031861864030361176,
+ "learning_rate": 6.419753086419753e-05,
+ "loss": 0.023331837728619576,
+ "step": 837
+ },
+ {
+ "epoch": 4.232911392405064,
+ "grad_norm": 0.03642997145652771,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.025932632386684418,
+ "step": 838
+ },
+ {
+ "epoch": 4.237974683544304,
+ "grad_norm": 0.025531062856316566,
+ "learning_rate": 6.408529741863075e-05,
+ "loss": 0.019921796396374702,
+ "step": 839
+ },
+ {
+ "epoch": 4.243037974683545,
+ "grad_norm": 0.025292333215475082,
+ "learning_rate": 6.402918069584737e-05,
+ "loss": 0.017363781109452248,
+ "step": 840
+ },
+ {
+ "epoch": 4.248101265822784,
+ "grad_norm": 0.03679105266928673,
+ "learning_rate": 6.397306397306398e-05,
+ "loss": 0.026451613754034042,
+ "step": 841
+ },
+ {
+ "epoch": 4.253164556962025,
+ "grad_norm": 0.029125263914465904,
+ "learning_rate": 6.391694725028059e-05,
+ "loss": 0.018277600407600403,
+ "step": 842
+ },
+ {
+ "epoch": 4.258227848101265,
+ "grad_norm": 0.03969479724764824,
+ "learning_rate": 6.38608305274972e-05,
+ "loss": 0.026814289391040802,
+ "step": 843
+ },
+ {
+ "epoch": 4.263291139240506,
+ "grad_norm": 0.03083009086549282,
+ "learning_rate": 6.380471380471381e-05,
+ "loss": 0.01898398995399475,
+ "step": 844
+ },
+ {
+ "epoch": 4.2683544303797465,
+ "grad_norm": 0.04128425940871239,
+ "learning_rate": 6.374859708193042e-05,
+ "loss": 0.02890118584036827,
+ "step": 845
+ },
+ {
+ "epoch": 4.273417721518987,
+ "grad_norm": 0.03675759211182594,
+ "learning_rate": 6.369248035914703e-05,
+ "loss": 0.0232902429997921,
+ "step": 846
+ },
+ {
+ "epoch": 4.2784810126582276,
+ "grad_norm": 0.035842880606651306,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.018688444048166275,
+ "step": 847
+ },
+ {
+ "epoch": 4.283544303797468,
+ "grad_norm": 0.041631679981946945,
+ "learning_rate": 6.358024691358025e-05,
+ "loss": 0.028953872621059418,
+ "step": 848
+ },
+ {
+ "epoch": 4.288607594936709,
+ "grad_norm": 0.02474270947277546,
+ "learning_rate": 6.352413019079686e-05,
+ "loss": 0.02291303500533104,
+ "step": 849
+ },
+ {
+ "epoch": 4.293670886075949,
+ "grad_norm": 0.0414784699678421,
+ "learning_rate": 6.346801346801347e-05,
+ "loss": 0.0197298601269722,
+ "step": 850
+ },
+ {
+ "epoch": 4.29873417721519,
+ "grad_norm": 0.022596480324864388,
+ "learning_rate": 6.341189674523008e-05,
+ "loss": 0.022477108985185623,
+ "step": 851
+ },
+ {
+ "epoch": 4.30379746835443,
+ "grad_norm": 0.03707405552268028,
+ "learning_rate": 6.335578002244669e-05,
+ "loss": 0.02374342642724514,
+ "step": 852
+ },
+ {
+ "epoch": 4.308860759493671,
+ "grad_norm": 0.036069657653570175,
+ "learning_rate": 6.32996632996633e-05,
+ "loss": 0.025015011429786682,
+ "step": 853
+ },
+ {
+ "epoch": 4.313924050632911,
+ "grad_norm": 0.025126038119196892,
+ "learning_rate": 6.324354657687991e-05,
+ "loss": 0.022152241319417953,
+ "step": 854
+ },
+ {
+ "epoch": 4.318987341772152,
+ "grad_norm": 0.03695147857069969,
+ "learning_rate": 6.318742985409652e-05,
+ "loss": 0.019978618249297142,
+ "step": 855
+ },
+ {
+ "epoch": 4.324050632911392,
+ "grad_norm": 0.034860849380493164,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.01976930722594261,
+ "step": 856
+ },
+ {
+ "epoch": 4.329113924050633,
+ "grad_norm": 0.029625017195940018,
+ "learning_rate": 6.307519640852974e-05,
+ "loss": 0.024136420339345932,
+ "step": 857
+ },
+ {
+ "epoch": 4.334177215189873,
+ "grad_norm": 0.03501079976558685,
+ "learning_rate": 6.301907968574635e-05,
+ "loss": 0.020777776837348938,
+ "step": 858
+ },
+ {
+ "epoch": 4.339240506329114,
+ "grad_norm": 0.037415534257888794,
+ "learning_rate": 6.296296296296296e-05,
+ "loss": 0.016332093626260757,
+ "step": 859
+ },
+ {
+ "epoch": 4.3443037974683545,
+ "grad_norm": 0.032555654644966125,
+ "learning_rate": 6.290684624017957e-05,
+ "loss": 0.02344547212123871,
+ "step": 860
+ },
+ {
+ "epoch": 4.349367088607595,
+ "grad_norm": 0.04069099947810173,
+ "learning_rate": 6.28507295173962e-05,
+ "loss": 0.019369281828403473,
+ "step": 861
+ },
+ {
+ "epoch": 4.3544303797468356,
+ "grad_norm": 0.05188984051346779,
+ "learning_rate": 6.279461279461279e-05,
+ "loss": 0.02291448414325714,
+ "step": 862
+ },
+ {
+ "epoch": 4.359493670886076,
+ "grad_norm": 0.0357513502240181,
+ "learning_rate": 6.273849607182942e-05,
+ "loss": 0.02141542360186577,
+ "step": 863
+ },
+ {
+ "epoch": 4.364556962025317,
+ "grad_norm": 0.026472769677639008,
+ "learning_rate": 6.268237934904601e-05,
+ "loss": 0.01893937960267067,
+ "step": 864
+ },
+ {
+ "epoch": 4.369620253164557,
+ "grad_norm": 0.0498812235891819,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.021839456632733345,
+ "step": 865
+ },
+ {
+ "epoch": 4.374683544303798,
+ "grad_norm": 0.05202518403530121,
+ "learning_rate": 6.257014590347923e-05,
+ "loss": 0.023422567173838615,
+ "step": 866
+ },
+ {
+ "epoch": 4.379746835443038,
+ "grad_norm": 0.024116024374961853,
+ "learning_rate": 6.251402918069586e-05,
+ "loss": 0.018288200721144676,
+ "step": 867
+ },
+ {
+ "epoch": 4.384810126582279,
+ "grad_norm": 0.02667090855538845,
+ "learning_rate": 6.245791245791247e-05,
+ "loss": 0.022375311702489853,
+ "step": 868
+ },
+ {
+ "epoch": 4.389873417721519,
+ "grad_norm": 0.02306467480957508,
+ "learning_rate": 6.240179573512908e-05,
+ "loss": 0.017447657883167267,
+ "step": 869
+ },
+ {
+ "epoch": 4.39493670886076,
+ "grad_norm": 0.031131602823734283,
+ "learning_rate": 6.234567901234569e-05,
+ "loss": 0.021768944337964058,
+ "step": 870
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.05789825692772865,
+ "learning_rate": 6.22895622895623e-05,
+ "loss": 0.02762719616293907,
+ "step": 871
+ },
+ {
+ "epoch": 4.405063291139241,
+ "grad_norm": 0.03830523043870926,
+ "learning_rate": 6.22334455667789e-05,
+ "loss": 0.023558061569929123,
+ "step": 872
+ },
+ {
+ "epoch": 4.410126582278481,
+ "grad_norm": 0.025961998850107193,
+ "learning_rate": 6.21773288439955e-05,
+ "loss": 0.022518256679177284,
+ "step": 873
+ },
+ {
+ "epoch": 4.415189873417722,
+ "grad_norm": 0.025299636647105217,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.018432877957820892,
+ "step": 874
+ },
+ {
+ "epoch": 4.4202531645569625,
+ "grad_norm": 0.027106614783406258,
+ "learning_rate": 6.206509539842874e-05,
+ "loss": 0.01614236831665039,
+ "step": 875
+ },
+ {
+ "epoch": 4.425316455696202,
+ "grad_norm": 0.04538397118449211,
+ "learning_rate": 6.200897867564535e-05,
+ "loss": 0.027474530041217804,
+ "step": 876
+ },
+ {
+ "epoch": 4.430379746835443,
+ "grad_norm": 0.041059643030166626,
+ "learning_rate": 6.195286195286196e-05,
+ "loss": 0.030840855091810226,
+ "step": 877
+ },
+ {
+ "epoch": 4.435443037974683,
+ "grad_norm": 0.055599089711904526,
+ "learning_rate": 6.189674523007857e-05,
+ "loss": 0.02877015620470047,
+ "step": 878
+ },
+ {
+ "epoch": 4.440506329113924,
+ "grad_norm": 0.023808903992176056,
+ "learning_rate": 6.184062850729518e-05,
+ "loss": 0.018071971833705902,
+ "step": 879
+ },
+ {
+ "epoch": 4.445569620253164,
+ "grad_norm": 0.04098769649863243,
+ "learning_rate": 6.178451178451179e-05,
+ "loss": 0.019321631640195847,
+ "step": 880
+ },
+ {
+ "epoch": 4.450632911392405,
+ "grad_norm": 0.0329279750585556,
+ "learning_rate": 6.17283950617284e-05,
+ "loss": 0.023013390600681305,
+ "step": 881
+ },
+ {
+ "epoch": 4.455696202531645,
+ "grad_norm": 0.030751917511224747,
+ "learning_rate": 6.1672278338945e-05,
+ "loss": 0.018062159419059753,
+ "step": 882
+ },
+ {
+ "epoch": 4.460759493670886,
+ "grad_norm": 0.025446373969316483,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.020532462745904922,
+ "step": 883
+ },
+ {
+ "epoch": 4.465822784810126,
+ "grad_norm": 0.037997085601091385,
+ "learning_rate": 6.156004489337823e-05,
+ "loss": 0.024340521544218063,
+ "step": 884
+ },
+ {
+ "epoch": 4.470886075949367,
+ "grad_norm": 0.021509790793061256,
+ "learning_rate": 6.150392817059484e-05,
+ "loss": 0.018887734040617943,
+ "step": 885
+ },
+ {
+ "epoch": 4.4759493670886075,
+ "grad_norm": 0.027931779623031616,
+ "learning_rate": 6.144781144781146e-05,
+ "loss": 0.02148054540157318,
+ "step": 886
+ },
+ {
+ "epoch": 4.481012658227848,
+ "grad_norm": 0.035554565489292145,
+ "learning_rate": 6.139169472502806e-05,
+ "loss": 0.019528254866600037,
+ "step": 887
+ },
+ {
+ "epoch": 4.4860759493670885,
+ "grad_norm": 0.02668517455458641,
+ "learning_rate": 6.133557800224468e-05,
+ "loss": 0.022182706743478775,
+ "step": 888
+ },
+ {
+ "epoch": 4.491139240506329,
+ "grad_norm": 0.0376712940633297,
+ "learning_rate": 6.127946127946128e-05,
+ "loss": 0.026006314903497696,
+ "step": 889
+ },
+ {
+ "epoch": 4.49620253164557,
+ "grad_norm": 0.02952289767563343,
+ "learning_rate": 6.12233445566779e-05,
+ "loss": 0.022582251578569412,
+ "step": 890
+ },
+ {
+ "epoch": 4.50126582278481,
+ "grad_norm": 0.05064458027482033,
+ "learning_rate": 6.11672278338945e-05,
+ "loss": 0.021709535270929337,
+ "step": 891
+ },
+ {
+ "epoch": 4.506329113924051,
+ "grad_norm": 0.021470079198479652,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.015116477385163307,
+ "step": 892
+ },
+ {
+ "epoch": 4.511392405063291,
+ "grad_norm": 0.04210078716278076,
+ "learning_rate": 6.105499438832773e-05,
+ "loss": 0.030057771131396294,
+ "step": 893
+ },
+ {
+ "epoch": 4.516455696202532,
+ "grad_norm": 0.20027652382850647,
+ "learning_rate": 6.099887766554434e-05,
+ "loss": 0.02081073820590973,
+ "step": 894
+ },
+ {
+ "epoch": 4.521518987341772,
+ "grad_norm": 0.03083370067179203,
+ "learning_rate": 6.0942760942760944e-05,
+ "loss": 0.020705904811620712,
+ "step": 895
+ },
+ {
+ "epoch": 4.526582278481013,
+ "grad_norm": 0.05921618640422821,
+ "learning_rate": 6.0886644219977554e-05,
+ "loss": 0.020449915900826454,
+ "step": 896
+ },
+ {
+ "epoch": 4.531645569620253,
+ "grad_norm": 0.02304214984178543,
+ "learning_rate": 6.0830527497194164e-05,
+ "loss": 0.01927848532795906,
+ "step": 897
+ },
+ {
+ "epoch": 4.536708860759494,
+ "grad_norm": 0.03946949169039726,
+ "learning_rate": 6.0774410774410774e-05,
+ "loss": 0.026231423020362854,
+ "step": 898
+ },
+ {
+ "epoch": 4.541772151898734,
+ "grad_norm": 0.027822930365800858,
+ "learning_rate": 6.071829405162739e-05,
+ "loss": 0.022259924560785294,
+ "step": 899
+ },
+ {
+ "epoch": 4.546835443037975,
+ "grad_norm": 0.029135817661881447,
+ "learning_rate": 6.0662177328843995e-05,
+ "loss": 0.019272884353995323,
+ "step": 900
+ },
+ {
+ "epoch": 4.5518987341772155,
+ "grad_norm": 0.03746713697910309,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.022191740572452545,
+ "step": 901
+ },
+ {
+ "epoch": 4.556962025316456,
+ "grad_norm": 0.027378680184483528,
+ "learning_rate": 6.0549943883277215e-05,
+ "loss": 0.023043492808938026,
+ "step": 902
+ },
+ {
+ "epoch": 4.5620253164556965,
+ "grad_norm": 0.047497715801000595,
+ "learning_rate": 6.049382716049383e-05,
+ "loss": 0.023993097245693207,
+ "step": 903
+ },
+ {
+ "epoch": 4.567088607594937,
+ "grad_norm": 0.02557055652141571,
+ "learning_rate": 6.0437710437710435e-05,
+ "loss": 0.020033126696944237,
+ "step": 904
+ },
+ {
+ "epoch": 4.572151898734178,
+ "grad_norm": 0.08165695518255234,
+ "learning_rate": 6.038159371492705e-05,
+ "loss": 0.02415328472852707,
+ "step": 905
+ },
+ {
+ "epoch": 4.577215189873417,
+ "grad_norm": 0.03633309155702591,
+ "learning_rate": 6.032547699214366e-05,
+ "loss": 0.02082585170865059,
+ "step": 906
+ },
+ {
+ "epoch": 4.582278481012658,
+ "grad_norm": 0.03273358196020126,
+ "learning_rate": 6.026936026936028e-05,
+ "loss": 0.020049303770065308,
+ "step": 907
+ },
+ {
+ "epoch": 4.587341772151898,
+ "grad_norm": 0.040032029151916504,
+ "learning_rate": 6.021324354657688e-05,
+ "loss": 0.02167242392897606,
+ "step": 908
+ },
+ {
+ "epoch": 4.592405063291139,
+ "grad_norm": 0.02789166197180748,
+ "learning_rate": 6.01571268237935e-05,
+ "loss": 0.01964012160897255,
+ "step": 909
+ },
+ {
+ "epoch": 4.597468354430379,
+ "grad_norm": 0.03285825625061989,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.024942882359027863,
+ "step": 910
+ },
+ {
+ "epoch": 4.60253164556962,
+ "grad_norm": 0.02894079126417637,
+ "learning_rate": 6.004489337822672e-05,
+ "loss": 0.022012561559677124,
+ "step": 911
+ },
+ {
+ "epoch": 4.6075949367088604,
+ "grad_norm": 0.03291299566626549,
+ "learning_rate": 5.998877665544332e-05,
+ "loss": 0.02291432023048401,
+ "step": 912
+ },
+ {
+ "epoch": 4.612658227848101,
+ "grad_norm": 0.05124634876847267,
+ "learning_rate": 5.993265993265994e-05,
+ "loss": 0.017874885350465775,
+ "step": 913
+ },
+ {
+ "epoch": 4.6177215189873415,
+ "grad_norm": 0.042412169277668,
+ "learning_rate": 5.987654320987654e-05,
+ "loss": 0.0233401320874691,
+ "step": 914
+ },
+ {
+ "epoch": 4.622784810126582,
+ "grad_norm": 0.03447306156158447,
+ "learning_rate": 5.982042648709316e-05,
+ "loss": 0.022503826767206192,
+ "step": 915
+ },
+ {
+ "epoch": 4.627848101265823,
+ "grad_norm": 0.022415662184357643,
+ "learning_rate": 5.976430976430977e-05,
+ "loss": 0.01659448817372322,
+ "step": 916
+ },
+ {
+ "epoch": 4.632911392405063,
+ "grad_norm": 0.04882103577256203,
+ "learning_rate": 5.970819304152637e-05,
+ "loss": 0.02342696487903595,
+ "step": 917
+ },
+ {
+ "epoch": 4.637974683544304,
+ "grad_norm": 0.0341666042804718,
+ "learning_rate": 5.965207631874299e-05,
+ "loss": 0.026119260117411613,
+ "step": 918
+ },
+ {
+ "epoch": 4.643037974683544,
+ "grad_norm": 0.03507097065448761,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.022042831405997276,
+ "step": 919
+ },
+ {
+ "epoch": 4.648101265822785,
+ "grad_norm": 0.04078570008277893,
+ "learning_rate": 5.953984287317621e-05,
+ "loss": 0.01978793554008007,
+ "step": 920
+ },
+ {
+ "epoch": 4.653164556962025,
+ "grad_norm": 0.03481799736618996,
+ "learning_rate": 5.948372615039281e-05,
+ "loss": 0.02518302947282791,
+ "step": 921
+ },
+ {
+ "epoch": 4.658227848101266,
+ "grad_norm": 0.0456753633916378,
+ "learning_rate": 5.942760942760943e-05,
+ "loss": 0.027814291417598724,
+ "step": 922
+ },
+ {
+ "epoch": 4.663291139240506,
+ "grad_norm": 0.026144322007894516,
+ "learning_rate": 5.937149270482604e-05,
+ "loss": 0.020842768251895905,
+ "step": 923
+ },
+ {
+ "epoch": 4.668354430379747,
+ "grad_norm": 0.027078162878751755,
+ "learning_rate": 5.9315375982042657e-05,
+ "loss": 0.026818346232175827,
+ "step": 924
+ },
+ {
+ "epoch": 4.673417721518987,
+ "grad_norm": 0.04505958408117294,
+ "learning_rate": 5.925925925925926e-05,
+ "loss": 0.01925778016448021,
+ "step": 925
+ },
+ {
+ "epoch": 4.678481012658228,
+ "grad_norm": 0.028921643272042274,
+ "learning_rate": 5.920314253647588e-05,
+ "loss": 0.017857741564512253,
+ "step": 926
+ },
+ {
+ "epoch": 4.6835443037974684,
+ "grad_norm": 0.021489476785063744,
+ "learning_rate": 5.914702581369248e-05,
+ "loss": 0.018585946410894394,
+ "step": 927
+ },
+ {
+ "epoch": 4.688607594936709,
+ "grad_norm": 0.02885374240577221,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.023486338555812836,
+ "step": 928
+ },
+ {
+ "epoch": 4.6936708860759495,
+ "grad_norm": 0.037063464522361755,
+ "learning_rate": 5.90347923681257e-05,
+ "loss": 0.02569335326552391,
+ "step": 929
+ },
+ {
+ "epoch": 4.69873417721519,
+ "grad_norm": 0.02460661344230175,
+ "learning_rate": 5.897867564534232e-05,
+ "loss": 0.01580418087542057,
+ "step": 930
+ },
+ {
+ "epoch": 4.703797468354431,
+ "grad_norm": 0.030016187578439713,
+ "learning_rate": 5.892255892255892e-05,
+ "loss": 0.01811431720852852,
+ "step": 931
+ },
+ {
+ "epoch": 4.708860759493671,
+ "grad_norm": 0.030638013035058975,
+ "learning_rate": 5.886644219977554e-05,
+ "loss": 0.02380264922976494,
+ "step": 932
+ },
+ {
+ "epoch": 4.713924050632912,
+ "grad_norm": 0.022593742236495018,
+ "learning_rate": 5.881032547699215e-05,
+ "loss": 0.017498169094324112,
+ "step": 933
+ },
+ {
+ "epoch": 4.718987341772152,
+ "grad_norm": 0.026072485372424126,
+ "learning_rate": 5.8754208754208764e-05,
+ "loss": 0.020261723548173904,
+ "step": 934
+ },
+ {
+ "epoch": 4.724050632911393,
+ "grad_norm": 0.020842554047703743,
+ "learning_rate": 5.869809203142537e-05,
+ "loss": 0.018765904009342194,
+ "step": 935
+ },
+ {
+ "epoch": 4.729113924050633,
+ "grad_norm": 0.02724885568022728,
+ "learning_rate": 5.8641975308641984e-05,
+ "loss": 0.01877676695585251,
+ "step": 936
+ },
+ {
+ "epoch": 4.734177215189874,
+ "grad_norm": 0.037401214241981506,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.026435203850269318,
+ "step": 937
+ },
+ {
+ "epoch": 4.739240506329114,
+ "grad_norm": 0.06131114065647125,
+ "learning_rate": 5.852974186307519e-05,
+ "loss": 0.023247163742780685,
+ "step": 938
+ },
+ {
+ "epoch": 4.744303797468355,
+ "grad_norm": 0.04543917998671532,
+ "learning_rate": 5.847362514029181e-05,
+ "loss": 0.024184830486774445,
+ "step": 939
+ },
+ {
+ "epoch": 4.749367088607595,
+ "grad_norm": 0.03184051439166069,
+ "learning_rate": 5.841750841750842e-05,
+ "loss": 0.02176564559340477,
+ "step": 940
+ },
+ {
+ "epoch": 4.754430379746836,
+ "grad_norm": 0.0309689249843359,
+ "learning_rate": 5.8361391694725034e-05,
+ "loss": 0.023136526346206665,
+ "step": 941
+ },
+ {
+ "epoch": 4.759493670886076,
+ "grad_norm": 0.024972833693027496,
+ "learning_rate": 5.830527497194164e-05,
+ "loss": 0.017270661890506744,
+ "step": 942
+ },
+ {
+ "epoch": 4.764556962025316,
+ "grad_norm": 0.03733127936720848,
+ "learning_rate": 5.8249158249158255e-05,
+ "loss": 0.022722383961081505,
+ "step": 943
+ },
+ {
+ "epoch": 4.769620253164557,
+ "grad_norm": 0.04425952583551407,
+ "learning_rate": 5.819304152637486e-05,
+ "loss": 0.02506185881793499,
+ "step": 944
+ },
+ {
+ "epoch": 4.774683544303797,
+ "grad_norm": 0.022625036537647247,
+ "learning_rate": 5.8136924803591475e-05,
+ "loss": 0.017418090254068375,
+ "step": 945
+ },
+ {
+ "epoch": 4.779746835443038,
+ "grad_norm": 0.02716260775923729,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.022329077124595642,
+ "step": 946
+ },
+ {
+ "epoch": 4.784810126582278,
+ "grad_norm": 0.03288663551211357,
+ "learning_rate": 5.8024691358024695e-05,
+ "loss": 0.02051950991153717,
+ "step": 947
+ },
+ {
+ "epoch": 4.789873417721519,
+ "grad_norm": 0.03347448632121086,
+ "learning_rate": 5.7968574635241305e-05,
+ "loss": 0.01883091777563095,
+ "step": 948
+ },
+ {
+ "epoch": 4.794936708860759,
+ "grad_norm": 0.036814238876104355,
+ "learning_rate": 5.7912457912457915e-05,
+ "loss": 0.02320999652147293,
+ "step": 949
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.030795598402619362,
+ "learning_rate": 5.7856341189674525e-05,
+ "loss": 0.01819070428609848,
+ "step": 950
+ },
+ {
+ "epoch": 4.80506329113924,
+ "grad_norm": 0.03846567124128342,
+ "learning_rate": 5.780022446689114e-05,
+ "loss": 0.01933719590306282,
+ "step": 951
+ },
+ {
+ "epoch": 4.810126582278481,
+ "grad_norm": 0.029248127713799477,
+ "learning_rate": 5.7744107744107745e-05,
+ "loss": 0.01642131432890892,
+ "step": 952
+ },
+ {
+ "epoch": 4.815189873417721,
+ "grad_norm": 0.025749213993549347,
+ "learning_rate": 5.768799102132436e-05,
+ "loss": 0.017750587314367294,
+ "step": 953
+ },
+ {
+ "epoch": 4.820253164556962,
+ "grad_norm": 0.043794333934783936,
+ "learning_rate": 5.7631874298540965e-05,
+ "loss": 0.02561376616358757,
+ "step": 954
+ },
+ {
+ "epoch": 4.8253164556962025,
+ "grad_norm": 0.04074554517865181,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.023251589387655258,
+ "step": 955
+ },
+ {
+ "epoch": 4.830379746835443,
+ "grad_norm": 0.043594326823949814,
+ "learning_rate": 5.7519640852974186e-05,
+ "loss": 0.025138206779956818,
+ "step": 956
+ },
+ {
+ "epoch": 4.8354430379746836,
+ "grad_norm": 0.05410498008131981,
+ "learning_rate": 5.74635241301908e-05,
+ "loss": 0.023706410080194473,
+ "step": 957
+ },
+ {
+ "epoch": 4.840506329113924,
+ "grad_norm": 0.0299235749989748,
+ "learning_rate": 5.740740740740741e-05,
+ "loss": 0.01801147311925888,
+ "step": 958
+ },
+ {
+ "epoch": 4.845569620253165,
+ "grad_norm": 0.02982177399098873,
+ "learning_rate": 5.735129068462403e-05,
+ "loss": 0.021112898364663124,
+ "step": 959
+ },
+ {
+ "epoch": 4.850632911392405,
+ "grad_norm": 0.04181864112615585,
+ "learning_rate": 5.729517396184063e-05,
+ "loss": 0.02110268548130989,
+ "step": 960
+ },
+ {
+ "epoch": 4.855696202531646,
+ "grad_norm": 0.040301334112882614,
+ "learning_rate": 5.7239057239057236e-05,
+ "loss": 0.020649928599596024,
+ "step": 961
+ },
+ {
+ "epoch": 4.860759493670886,
+ "grad_norm": 0.03669300675392151,
+ "learning_rate": 5.718294051627385e-05,
+ "loss": 0.023078542202711105,
+ "step": 962
+ },
+ {
+ "epoch": 4.865822784810127,
+ "grad_norm": 0.023378873243927956,
+ "learning_rate": 5.7126823793490456e-05,
+ "loss": 0.01759505085647106,
+ "step": 963
+ },
+ {
+ "epoch": 4.870886075949367,
+ "grad_norm": 0.044835980981588364,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.023342810571193695,
+ "step": 964
+ },
+ {
+ "epoch": 4.875949367088608,
+ "grad_norm": 0.03264521807432175,
+ "learning_rate": 5.701459034792368e-05,
+ "loss": 0.021122846752405167,
+ "step": 965
+ },
+ {
+ "epoch": 4.881012658227848,
+ "grad_norm": 0.036651868373155594,
+ "learning_rate": 5.695847362514029e-05,
+ "loss": 0.026279672980308533,
+ "step": 966
+ },
+ {
+ "epoch": 4.886075949367089,
+ "grad_norm": 0.023810314014554024,
+ "learning_rate": 5.69023569023569e-05,
+ "loss": 0.020299838855862617,
+ "step": 967
+ },
+ {
+ "epoch": 4.891139240506329,
+ "grad_norm": 0.028432384133338928,
+ "learning_rate": 5.684624017957352e-05,
+ "loss": 0.019828233867883682,
+ "step": 968
+ },
+ {
+ "epoch": 4.89620253164557,
+ "grad_norm": 0.02499561943113804,
+ "learning_rate": 5.679012345679012e-05,
+ "loss": 0.023105870932340622,
+ "step": 969
+ },
+ {
+ "epoch": 4.9012658227848105,
+ "grad_norm": 0.0340624563395977,
+ "learning_rate": 5.673400673400674e-05,
+ "loss": 0.023707572370767593,
+ "step": 970
+ },
+ {
+ "epoch": 4.90632911392405,
+ "grad_norm": 0.02945004589855671,
+ "learning_rate": 5.667789001122334e-05,
+ "loss": 0.019038598984479904,
+ "step": 971
+ },
+ {
+ "epoch": 4.911392405063291,
+ "grad_norm": 0.034173011779785156,
+ "learning_rate": 5.662177328843996e-05,
+ "loss": 0.02678484097123146,
+ "step": 972
+ },
+ {
+ "epoch": 4.916455696202531,
+ "grad_norm": 0.0515705943107605,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.02983126789331436,
+ "step": 973
+ },
+ {
+ "epoch": 4.921518987341772,
+ "grad_norm": 0.024027375504374504,
+ "learning_rate": 5.650953984287318e-05,
+ "loss": 0.021375803276896477,
+ "step": 974
+ },
+ {
+ "epoch": 4.926582278481012,
+ "grad_norm": 0.03331667557358742,
+ "learning_rate": 5.645342312008979e-05,
+ "loss": 0.021600808948278427,
+ "step": 975
+ },
+ {
+ "epoch": 4.931645569620253,
+ "grad_norm": 0.029174596071243286,
+ "learning_rate": 5.639730639730641e-05,
+ "loss": 0.022452034056186676,
+ "step": 976
+ },
+ {
+ "epoch": 4.936708860759493,
+ "grad_norm": 0.03323808312416077,
+ "learning_rate": 5.634118967452301e-05,
+ "loss": 0.02531963586807251,
+ "step": 977
+ },
+ {
+ "epoch": 4.941772151898734,
+ "grad_norm": 0.02238641493022442,
+ "learning_rate": 5.628507295173963e-05,
+ "loss": 0.01655597612261772,
+ "step": 978
+ },
+ {
+ "epoch": 4.946835443037974,
+ "grad_norm": 0.03279856964945793,
+ "learning_rate": 5.622895622895623e-05,
+ "loss": 0.02232341095805168,
+ "step": 979
+ },
+ {
+ "epoch": 4.951898734177215,
+ "grad_norm": 0.03852152079343796,
+ "learning_rate": 5.617283950617285e-05,
+ "loss": 0.025721147656440735,
+ "step": 980
+ },
+ {
+ "epoch": 4.9569620253164555,
+ "grad_norm": 0.039974186569452286,
+ "learning_rate": 5.611672278338945e-05,
+ "loss": 0.015438543632626534,
+ "step": 981
+ },
+ {
+ "epoch": 4.962025316455696,
+ "grad_norm": 0.0348355695605278,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.021361682564020157,
+ "step": 982
+ },
+ {
+ "epoch": 4.9670886075949365,
+ "grad_norm": 0.02576221525669098,
+ "learning_rate": 5.600448933782267e-05,
+ "loss": 0.02103075385093689,
+ "step": 983
+ },
+ {
+ "epoch": 4.972151898734177,
+ "grad_norm": 0.039421118795871735,
+ "learning_rate": 5.594837261503928e-05,
+ "loss": 0.026340002194046974,
+ "step": 984
+ },
+ {
+ "epoch": 4.977215189873418,
+ "grad_norm": 0.02953593246638775,
+ "learning_rate": 5.58922558922559e-05,
+ "loss": 0.020818116143345833,
+ "step": 985
+ },
+ {
+ "epoch": 4.982278481012658,
+ "grad_norm": 0.033213913440704346,
+ "learning_rate": 5.58361391694725e-05,
+ "loss": 0.020878788083791733,
+ "step": 986
+ },
+ {
+ "epoch": 4.987341772151899,
+ "grad_norm": 0.04450162872672081,
+ "learning_rate": 5.578002244668912e-05,
+ "loss": 0.02208695001900196,
+ "step": 987
+ },
+ {
+ "epoch": 4.992405063291139,
+ "grad_norm": 0.04752403125166893,
+ "learning_rate": 5.572390572390572e-05,
+ "loss": 0.021128743886947632,
+ "step": 988
+ },
+ {
+ "epoch": 4.99746835443038,
+ "grad_norm": 0.03401600942015648,
+ "learning_rate": 5.566778900112234e-05,
+ "loss": 0.020553182810544968,
+ "step": 989
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.031174728646874428,
+ "learning_rate": 5.561167227833894e-05,
+ "loss": 0.01929999701678753,
+ "step": 990
+ },
+ {
+ "epoch": 5.0050632911392405,
+ "grad_norm": 0.056407660245895386,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.024739203974604607,
+ "step": 991
+ },
+ {
+ "epoch": 5.010126582278481,
+ "grad_norm": 0.019481178373098373,
+ "learning_rate": 5.549943883277217e-05,
+ "loss": 0.016404341906309128,
+ "step": 992
+ },
+ {
+ "epoch": 5.015189873417722,
+ "grad_norm": 0.029707469046115875,
+ "learning_rate": 5.5443322109988785e-05,
+ "loss": 0.017014270648360252,
+ "step": 993
+ },
+ {
+ "epoch": 5.020253164556962,
+ "grad_norm": 0.039400286972522736,
+ "learning_rate": 5.538720538720539e-05,
+ "loss": 0.016073700040578842,
+ "step": 994
+ },
+ {
+ "epoch": 5.025316455696203,
+ "grad_norm": 0.047592055052518845,
+ "learning_rate": 5.5331088664422005e-05,
+ "loss": 0.02021213248372078,
+ "step": 995
+ },
+ {
+ "epoch": 5.030379746835443,
+ "grad_norm": 0.054195769131183624,
+ "learning_rate": 5.527497194163861e-05,
+ "loss": 0.027454158291220665,
+ "step": 996
+ },
+ {
+ "epoch": 5.035443037974684,
+ "grad_norm": 0.02753913588821888,
+ "learning_rate": 5.5218855218855225e-05,
+ "loss": 0.01993582770228386,
+ "step": 997
+ },
+ {
+ "epoch": 5.040506329113924,
+ "grad_norm": 0.038280900567770004,
+ "learning_rate": 5.516273849607183e-05,
+ "loss": 0.017832420766353607,
+ "step": 998
+ },
+ {
+ "epoch": 5.045569620253165,
+ "grad_norm": 0.0289705079048872,
+ "learning_rate": 5.5106621773288446e-05,
+ "loss": 0.019040051847696304,
+ "step": 999
+ },
+ {
+ "epoch": 5.050632911392405,
+ "grad_norm": 0.030929062515497208,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.02529517561197281,
+ "step": 1000
+ },
+ {
+ "epoch": 5.055696202531646,
+ "grad_norm": 0.039416536688804626,
+ "learning_rate": 5.4994388327721666e-05,
+ "loss": 0.017563793808221817,
+ "step": 1001
+ },
+ {
+ "epoch": 5.060759493670886,
+ "grad_norm": 0.039831917732954025,
+ "learning_rate": 5.4938271604938276e-05,
+ "loss": 0.022547172382473946,
+ "step": 1002
+ },
+ {
+ "epoch": 5.065822784810127,
+ "grad_norm": 0.02979891747236252,
+ "learning_rate": 5.488215488215489e-05,
+ "loss": 0.019676152616739273,
+ "step": 1003
+ },
+ {
+ "epoch": 5.0708860759493675,
+ "grad_norm": 0.025752373039722443,
+ "learning_rate": 5.4826038159371496e-05,
+ "loss": 0.016172030940651894,
+ "step": 1004
+ },
+ {
+ "epoch": 5.075949367088608,
+ "grad_norm": 0.03433040529489517,
+ "learning_rate": 5.47699214365881e-05,
+ "loss": 0.022616712376475334,
+ "step": 1005
+ },
+ {
+ "epoch": 5.0810126582278485,
+ "grad_norm": 0.04834216088056564,
+ "learning_rate": 5.4713804713804716e-05,
+ "loss": 0.02641037292778492,
+ "step": 1006
+ },
+ {
+ "epoch": 5.086075949367088,
+ "grad_norm": 0.03748583421111107,
+ "learning_rate": 5.465768799102132e-05,
+ "loss": 0.02212962508201599,
+ "step": 1007
+ },
+ {
+ "epoch": 5.091139240506329,
+ "grad_norm": 0.03406492620706558,
+ "learning_rate": 5.4601571268237936e-05,
+ "loss": 0.022490520030260086,
+ "step": 1008
+ },
+ {
+ "epoch": 5.096202531645569,
+ "grad_norm": 0.025412574410438538,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.018286626785993576,
+ "step": 1009
+ },
+ {
+ "epoch": 5.10126582278481,
+ "grad_norm": 0.030613059177994728,
+ "learning_rate": 5.448933782267116e-05,
+ "loss": 0.018090849742293358,
+ "step": 1010
+ },
+ {
+ "epoch": 5.10632911392405,
+ "grad_norm": 0.032511018216609955,
+ "learning_rate": 5.4433221099887766e-05,
+ "loss": 0.019871044903993607,
+ "step": 1011
+ },
+ {
+ "epoch": 5.111392405063291,
+ "grad_norm": 0.041535500437021255,
+ "learning_rate": 5.437710437710438e-05,
+ "loss": 0.02880081906914711,
+ "step": 1012
+ },
+ {
+ "epoch": 5.116455696202531,
+ "grad_norm": 0.053748298436403275,
+ "learning_rate": 5.4320987654320986e-05,
+ "loss": 0.024350278079509735,
+ "step": 1013
+ },
+ {
+ "epoch": 5.121518987341772,
+ "grad_norm": 0.03045419417321682,
+ "learning_rate": 5.42648709315376e-05,
+ "loss": 0.026830779388546944,
+ "step": 1014
+ },
+ {
+ "epoch": 5.1265822784810124,
+ "grad_norm": 0.02704838663339615,
+ "learning_rate": 5.420875420875421e-05,
+ "loss": 0.019440406933426857,
+ "step": 1015
+ },
+ {
+ "epoch": 5.131645569620253,
+ "grad_norm": 0.037976089864969254,
+ "learning_rate": 5.4152637485970823e-05,
+ "loss": 0.02016528509557247,
+ "step": 1016
+ },
+ {
+ "epoch": 5.1367088607594935,
+ "grad_norm": 0.04055245593190193,
+ "learning_rate": 5.4096520763187434e-05,
+ "loss": 0.021118413656949997,
+ "step": 1017
+ },
+ {
+ "epoch": 5.141772151898734,
+ "grad_norm": 0.02943083830177784,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.01882058009505272,
+ "step": 1018
+ },
+ {
+ "epoch": 5.146835443037975,
+ "grad_norm": 0.03773244097828865,
+ "learning_rate": 5.3984287317620654e-05,
+ "loss": 0.025017477571964264,
+ "step": 1019
+ },
+ {
+ "epoch": 5.151898734177215,
+ "grad_norm": 0.026969652622938156,
+ "learning_rate": 5.392817059483727e-05,
+ "loss": 0.018443236127495766,
+ "step": 1020
+ },
+ {
+ "epoch": 5.156962025316456,
+ "grad_norm": 0.032142024487257004,
+ "learning_rate": 5.3872053872053874e-05,
+ "loss": 0.02332904376089573,
+ "step": 1021
+ },
+ {
+ "epoch": 5.162025316455696,
+ "grad_norm": 0.06372297555208206,
+ "learning_rate": 5.381593714927049e-05,
+ "loss": 0.027975570410490036,
+ "step": 1022
+ },
+ {
+ "epoch": 5.167088607594937,
+ "grad_norm": 0.03120330721139908,
+ "learning_rate": 5.3759820426487094e-05,
+ "loss": 0.023697681725025177,
+ "step": 1023
+ },
+ {
+ "epoch": 5.172151898734177,
+ "grad_norm": 0.029094889760017395,
+ "learning_rate": 5.370370370370371e-05,
+ "loss": 0.01727498322725296,
+ "step": 1024
+ },
+ {
+ "epoch": 5.177215189873418,
+ "grad_norm": 0.03791336342692375,
+ "learning_rate": 5.3647586980920314e-05,
+ "loss": 0.02156408131122589,
+ "step": 1025
+ },
+ {
+ "epoch": 5.182278481012658,
+ "grad_norm": 0.028603199869394302,
+ "learning_rate": 5.3591470258136924e-05,
+ "loss": 0.01781666837632656,
+ "step": 1026
+ },
+ {
+ "epoch": 5.187341772151899,
+ "grad_norm": 0.034254368394613266,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.023422224447131157,
+ "step": 1027
+ },
+ {
+ "epoch": 5.192405063291139,
+ "grad_norm": 0.025661299005150795,
+ "learning_rate": 5.3479236812570144e-05,
+ "loss": 0.017852213233709335,
+ "step": 1028
+ },
+ {
+ "epoch": 5.19746835443038,
+ "grad_norm": 0.03156711906194687,
+ "learning_rate": 5.342312008978676e-05,
+ "loss": 0.022492870688438416,
+ "step": 1029
+ },
+ {
+ "epoch": 5.2025316455696204,
+ "grad_norm": 0.0222217608243227,
+ "learning_rate": 5.3367003367003364e-05,
+ "loss": 0.015568151138722897,
+ "step": 1030
+ },
+ {
+ "epoch": 5.207594936708861,
+ "grad_norm": 0.04563366249203682,
+ "learning_rate": 5.331088664421998e-05,
+ "loss": 0.022124778479337692,
+ "step": 1031
+ },
+ {
+ "epoch": 5.2126582278481015,
+ "grad_norm": 0.04612975940108299,
+ "learning_rate": 5.3254769921436585e-05,
+ "loss": 0.027084846049547195,
+ "step": 1032
+ },
+ {
+ "epoch": 5.217721518987342,
+ "grad_norm": 0.047278422862291336,
+ "learning_rate": 5.31986531986532e-05,
+ "loss": 0.022641438990831375,
+ "step": 1033
+ },
+ {
+ "epoch": 5.222784810126583,
+ "grad_norm": 0.030134575441479683,
+ "learning_rate": 5.314253647586981e-05,
+ "loss": 0.01842697337269783,
+ "step": 1034
+ },
+ {
+ "epoch": 5.227848101265823,
+ "grad_norm": 0.019028518348932266,
+ "learning_rate": 5.308641975308642e-05,
+ "loss": 0.017543386667966843,
+ "step": 1035
+ },
+ {
+ "epoch": 5.232911392405064,
+ "grad_norm": 0.04117404296994209,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.02185094729065895,
+ "step": 1036
+ },
+ {
+ "epoch": 5.237974683544304,
+ "grad_norm": 0.0310111902654171,
+ "learning_rate": 5.297418630751965e-05,
+ "loss": 0.02418985590338707,
+ "step": 1037
+ },
+ {
+ "epoch": 5.243037974683545,
+ "grad_norm": 0.034619491547346115,
+ "learning_rate": 5.291806958473625e-05,
+ "loss": 0.02162736840546131,
+ "step": 1038
+ },
+ {
+ "epoch": 5.248101265822784,
+ "grad_norm": 0.04028276726603508,
+ "learning_rate": 5.286195286195287e-05,
+ "loss": 0.02554975263774395,
+ "step": 1039
+ },
+ {
+ "epoch": 5.253164556962025,
+ "grad_norm": 0.0336519293487072,
+ "learning_rate": 5.280583613916947e-05,
+ "loss": 0.019465651363134384,
+ "step": 1040
+ },
+ {
+ "epoch": 5.258227848101265,
+ "grad_norm": 0.033565767109394073,
+ "learning_rate": 5.274971941638609e-05,
+ "loss": 0.020889155566692352,
+ "step": 1041
+ },
+ {
+ "epoch": 5.263291139240506,
+ "grad_norm": 0.02902410738170147,
+ "learning_rate": 5.269360269360269e-05,
+ "loss": 0.02131371572613716,
+ "step": 1042
+ },
+ {
+ "epoch": 5.2683544303797465,
+ "grad_norm": 0.03622325137257576,
+ "learning_rate": 5.263748597081931e-05,
+ "loss": 0.017162127420306206,
+ "step": 1043
+ },
+ {
+ "epoch": 5.273417721518987,
+ "grad_norm": 0.039386410266160965,
+ "learning_rate": 5.258136924803592e-05,
+ "loss": 0.016598902642726898,
+ "step": 1044
+ },
+ {
+ "epoch": 5.2784810126582276,
+ "grad_norm": 0.035566773265600204,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.022860797122120857,
+ "step": 1045
+ },
+ {
+ "epoch": 5.283544303797468,
+ "grad_norm": 0.04470687359571457,
+ "learning_rate": 5.246913580246914e-05,
+ "loss": 0.020824994891881943,
+ "step": 1046
+ },
+ {
+ "epoch": 5.288607594936709,
+ "grad_norm": 0.03889680653810501,
+ "learning_rate": 5.241301907968574e-05,
+ "loss": 0.017250075936317444,
+ "step": 1047
+ },
+ {
+ "epoch": 5.293670886075949,
+ "grad_norm": 0.02681683376431465,
+ "learning_rate": 5.235690235690236e-05,
+ "loss": 0.0191829651594162,
+ "step": 1048
+ },
+ {
+ "epoch": 5.29873417721519,
+ "grad_norm": 0.018965722993016243,
+ "learning_rate": 5.230078563411896e-05,
+ "loss": 0.02007337100803852,
+ "step": 1049
+ },
+ {
+ "epoch": 5.30379746835443,
+ "grad_norm": 0.023910261690616608,
+ "learning_rate": 5.224466891133558e-05,
+ "loss": 0.02189997211098671,
+ "step": 1050
+ },
+ {
+ "epoch": 5.308860759493671,
+ "grad_norm": 0.03607999160885811,
+ "learning_rate": 5.218855218855219e-05,
+ "loss": 0.023346582427620888,
+ "step": 1051
+ },
+ {
+ "epoch": 5.313924050632911,
+ "grad_norm": 0.02490268088877201,
+ "learning_rate": 5.2132435465768806e-05,
+ "loss": 0.017453521490097046,
+ "step": 1052
+ },
+ {
+ "epoch": 5.318987341772152,
+ "grad_norm": 0.04894902557134628,
+ "learning_rate": 5.207631874298541e-05,
+ "loss": 0.023999422788619995,
+ "step": 1053
+ },
+ {
+ "epoch": 5.324050632911392,
+ "grad_norm": 0.01724478043615818,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.013751897029578686,
+ "step": 1054
+ },
+ {
+ "epoch": 5.329113924050633,
+ "grad_norm": 0.05506094545125961,
+ "learning_rate": 5.196408529741863e-05,
+ "loss": 0.02599490061402321,
+ "step": 1055
+ },
+ {
+ "epoch": 5.334177215189873,
+ "grad_norm": 0.030050745233893394,
+ "learning_rate": 5.1907968574635247e-05,
+ "loss": 0.022996244952082634,
+ "step": 1056
+ },
+ {
+ "epoch": 5.339240506329114,
+ "grad_norm": 0.028648901730775833,
+ "learning_rate": 5.185185185185185e-05,
+ "loss": 0.024319645017385483,
+ "step": 1057
+ },
+ {
+ "epoch": 5.3443037974683545,
+ "grad_norm": 0.04159106686711311,
+ "learning_rate": 5.179573512906847e-05,
+ "loss": 0.02485204115509987,
+ "step": 1058
+ },
+ {
+ "epoch": 5.349367088607595,
+ "grad_norm": 0.04454904422163963,
+ "learning_rate": 5.173961840628507e-05,
+ "loss": 0.018921498209238052,
+ "step": 1059
+ },
+ {
+ "epoch": 5.3544303797468356,
+ "grad_norm": 0.05850376933813095,
+ "learning_rate": 5.168350168350169e-05,
+ "loss": 0.02758260816335678,
+ "step": 1060
+ },
+ {
+ "epoch": 5.359493670886076,
+ "grad_norm": 0.03319580852985382,
+ "learning_rate": 5.16273849607183e-05,
+ "loss": 0.02180345356464386,
+ "step": 1061
+ },
+ {
+ "epoch": 5.364556962025317,
+ "grad_norm": 0.046812329441308975,
+ "learning_rate": 5.1571268237934914e-05,
+ "loss": 0.021682530641555786,
+ "step": 1062
+ },
+ {
+ "epoch": 5.369620253164557,
+ "grad_norm": 0.028218183666467667,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.019677158445119858,
+ "step": 1063
+ },
+ {
+ "epoch": 5.374683544303798,
+ "grad_norm": 0.04918216913938522,
+ "learning_rate": 5.1459034792368134e-05,
+ "loss": 0.019348308444023132,
+ "step": 1064
+ },
+ {
+ "epoch": 5.379746835443038,
+ "grad_norm": 0.041713107377290726,
+ "learning_rate": 5.140291806958474e-05,
+ "loss": 0.01728012040257454,
+ "step": 1065
+ },
+ {
+ "epoch": 5.384810126582279,
+ "grad_norm": 0.034068260341882706,
+ "learning_rate": 5.1346801346801354e-05,
+ "loss": 0.020487628877162933,
+ "step": 1066
+ },
+ {
+ "epoch": 5.389873417721519,
+ "grad_norm": 0.028666919097304344,
+ "learning_rate": 5.129068462401796e-05,
+ "loss": 0.015318546444177628,
+ "step": 1067
+ },
+ {
+ "epoch": 5.39493670886076,
+ "grad_norm": 0.03828604146838188,
+ "learning_rate": 5.1234567901234574e-05,
+ "loss": 0.028930973261594772,
+ "step": 1068
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.01870056800544262,
+ "learning_rate": 5.1178451178451184e-05,
+ "loss": 0.015031076967716217,
+ "step": 1069
+ },
+ {
+ "epoch": 5.405063291139241,
+ "grad_norm": 0.02219143882393837,
+ "learning_rate": 5.112233445566779e-05,
+ "loss": 0.019569698721170425,
+ "step": 1070
+ },
+ {
+ "epoch": 5.410126582278481,
+ "grad_norm": 0.04418749734759331,
+ "learning_rate": 5.1066217732884404e-05,
+ "loss": 0.025913581252098083,
+ "step": 1071
+ },
+ {
+ "epoch": 5.415189873417722,
+ "grad_norm": 0.05946826562285423,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.03080957755446434,
+ "step": 1072
+ },
+ {
+ "epoch": 5.4202531645569625,
+ "grad_norm": 0.032025255262851715,
+ "learning_rate": 5.0953984287317624e-05,
+ "loss": 0.017155487090349197,
+ "step": 1073
+ },
+ {
+ "epoch": 5.425316455696202,
+ "grad_norm": 0.033507514744997025,
+ "learning_rate": 5.089786756453423e-05,
+ "loss": 0.022324759513139725,
+ "step": 1074
+ },
+ {
+ "epoch": 5.430379746835443,
+ "grad_norm": 0.025624485686421394,
+ "learning_rate": 5.0841750841750845e-05,
+ "loss": 0.021772298961877823,
+ "step": 1075
+ },
+ {
+ "epoch": 5.435443037974683,
+ "grad_norm": 0.055580489337444305,
+ "learning_rate": 5.078563411896745e-05,
+ "loss": 0.01938481442630291,
+ "step": 1076
+ },
+ {
+ "epoch": 5.440506329113924,
+ "grad_norm": 0.04581330716609955,
+ "learning_rate": 5.0729517396184065e-05,
+ "loss": 0.019239529967308044,
+ "step": 1077
+ },
+ {
+ "epoch": 5.445569620253164,
+ "grad_norm": 0.06254621595144272,
+ "learning_rate": 5.0673400673400675e-05,
+ "loss": 0.027182448655366898,
+ "step": 1078
+ },
+ {
+ "epoch": 5.450632911392405,
+ "grad_norm": 0.036759812384843826,
+ "learning_rate": 5.061728395061729e-05,
+ "loss": 0.027131710201501846,
+ "step": 1079
+ },
+ {
+ "epoch": 5.455696202531645,
+ "grad_norm": 0.03190915286540985,
+ "learning_rate": 5.0561167227833895e-05,
+ "loss": 0.0259249284863472,
+ "step": 1080
+ },
+ {
+ "epoch": 5.460759493670886,
+ "grad_norm": 0.03208916634321213,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.02531026303768158,
+ "step": 1081
+ },
+ {
+ "epoch": 5.465822784810126,
+ "grad_norm": 0.06676970422267914,
+ "learning_rate": 5.0448933782267115e-05,
+ "loss": 0.022145366296172142,
+ "step": 1082
+ },
+ {
+ "epoch": 5.470886075949367,
+ "grad_norm": 0.027604084461927414,
+ "learning_rate": 5.039281705948373e-05,
+ "loss": 0.018208740279078484,
+ "step": 1083
+ },
+ {
+ "epoch": 5.4759493670886075,
+ "grad_norm": 0.03812532126903534,
+ "learning_rate": 5.0336700336700335e-05,
+ "loss": 0.024251334369182587,
+ "step": 1084
+ },
+ {
+ "epoch": 5.481012658227848,
+ "grad_norm": 0.03016139566898346,
+ "learning_rate": 5.028058361391695e-05,
+ "loss": 0.02196047455072403,
+ "step": 1085
+ },
+ {
+ "epoch": 5.4860759493670885,
+ "grad_norm": 0.017749929800629616,
+ "learning_rate": 5.022446689113356e-05,
+ "loss": 0.01607266068458557,
+ "step": 1086
+ },
+ {
+ "epoch": 5.491139240506329,
+ "grad_norm": 0.023184901103377342,
+ "learning_rate": 5.016835016835017e-05,
+ "loss": 0.021226245909929276,
+ "step": 1087
+ },
+ {
+ "epoch": 5.49620253164557,
+ "grad_norm": 0.024662092328071594,
+ "learning_rate": 5.011223344556678e-05,
+ "loss": 0.019691254943609238,
+ "step": 1088
+ },
+ {
+ "epoch": 5.50126582278481,
+ "grad_norm": 0.05883142724633217,
+ "learning_rate": 5.00561167227834e-05,
+ "loss": 0.03039814904332161,
+ "step": 1089
+ },
+ {
+ "epoch": 5.506329113924051,
+ "grad_norm": 0.029918279498815536,
+ "learning_rate": 5e-05,
+ "loss": 0.022806301712989807,
+ "step": 1090
+ },
+ {
+ "epoch": 5.511392405063291,
+ "grad_norm": 0.023451462388038635,
+ "learning_rate": 4.994388327721661e-05,
+ "loss": 0.018920207396149635,
+ "step": 1091
+ },
+ {
+ "epoch": 5.516455696202532,
+ "grad_norm": 0.030591748654842377,
+ "learning_rate": 4.988776655443322e-05,
+ "loss": 0.024741975590586662,
+ "step": 1092
+ },
+ {
+ "epoch": 5.521518987341772,
+ "grad_norm": 0.020344361662864685,
+ "learning_rate": 4.983164983164983e-05,
+ "loss": 0.018007446080446243,
+ "step": 1093
+ },
+ {
+ "epoch": 5.526582278481013,
+ "grad_norm": 0.029899192973971367,
+ "learning_rate": 4.977553310886644e-05,
+ "loss": 0.02196051925420761,
+ "step": 1094
+ },
+ {
+ "epoch": 5.531645569620253,
+ "grad_norm": 0.030987054109573364,
+ "learning_rate": 4.971941638608306e-05,
+ "loss": 0.018726475536823273,
+ "step": 1095
+ },
+ {
+ "epoch": 5.536708860759494,
+ "grad_norm": 0.031603869050741196,
+ "learning_rate": 4.966329966329967e-05,
+ "loss": 0.027497179806232452,
+ "step": 1096
+ },
+ {
+ "epoch": 5.541772151898734,
+ "grad_norm": 0.041930630803108215,
+ "learning_rate": 4.960718294051628e-05,
+ "loss": 0.0274939127266407,
+ "step": 1097
+ },
+ {
+ "epoch": 5.546835443037975,
+ "grad_norm": 0.020828744396567345,
+ "learning_rate": 4.955106621773289e-05,
+ "loss": 0.020464252680540085,
+ "step": 1098
+ },
+ {
+ "epoch": 5.5518987341772155,
+ "grad_norm": 0.03408589959144592,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.024826694279909134,
+ "step": 1099
+ },
+ {
+ "epoch": 5.556962025316456,
+ "grad_norm": 0.03565233200788498,
+ "learning_rate": 4.943883277216611e-05,
+ "loss": 0.0297713503241539,
+ "step": 1100
+ },
+ {
+ "epoch": 5.5620253164556965,
+ "grad_norm": 0.03275191783905029,
+ "learning_rate": 4.938271604938271e-05,
+ "loss": 0.022985238581895828,
+ "step": 1101
+ },
+ {
+ "epoch": 5.567088607594937,
+ "grad_norm": 0.04215894266963005,
+ "learning_rate": 4.932659932659932e-05,
+ "loss": 0.020872686058282852,
+ "step": 1102
+ },
+ {
+ "epoch": 5.572151898734178,
+ "grad_norm": 0.03496193513274193,
+ "learning_rate": 4.927048260381594e-05,
+ "loss": 0.020619090646505356,
+ "step": 1103
+ },
+ {
+ "epoch": 5.577215189873417,
+ "grad_norm": 0.020121701061725616,
+ "learning_rate": 4.921436588103255e-05,
+ "loss": 0.017047466710209846,
+ "step": 1104
+ },
+ {
+ "epoch": 5.582278481012658,
+ "grad_norm": 0.02406349778175354,
+ "learning_rate": 4.915824915824916e-05,
+ "loss": 0.01753303036093712,
+ "step": 1105
+ },
+ {
+ "epoch": 5.587341772151898,
+ "grad_norm": 0.03804773837327957,
+ "learning_rate": 4.910213243546577e-05,
+ "loss": 0.026075419038534164,
+ "step": 1106
+ },
+ {
+ "epoch": 5.592405063291139,
+ "grad_norm": 0.024065209552645683,
+ "learning_rate": 4.904601571268238e-05,
+ "loss": 0.02253042347729206,
+ "step": 1107
+ },
+ {
+ "epoch": 5.597468354430379,
+ "grad_norm": 0.024677708745002747,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.02093282900750637,
+ "step": 1108
+ },
+ {
+ "epoch": 5.60253164556962,
+ "grad_norm": 0.022487351670861244,
+ "learning_rate": 4.89337822671156e-05,
+ "loss": 0.019194334745407104,
+ "step": 1109
+ },
+ {
+ "epoch": 5.6075949367088604,
+ "grad_norm": 0.023981913924217224,
+ "learning_rate": 4.887766554433221e-05,
+ "loss": 0.019715486094355583,
+ "step": 1110
+ },
+ {
+ "epoch": 5.612658227848101,
+ "grad_norm": 0.49088963866233826,
+ "learning_rate": 4.882154882154882e-05,
+ "loss": 0.01954624056816101,
+ "step": 1111
+ },
+ {
+ "epoch": 5.6177215189873415,
+ "grad_norm": 0.020698007196187973,
+ "learning_rate": 4.876543209876544e-05,
+ "loss": 0.0198826901614666,
+ "step": 1112
+ },
+ {
+ "epoch": 5.622784810126582,
+ "grad_norm": 0.030978364869952202,
+ "learning_rate": 4.870931537598205e-05,
+ "loss": 0.022201407700777054,
+ "step": 1113
+ },
+ {
+ "epoch": 5.627848101265823,
+ "grad_norm": 0.03610600158572197,
+ "learning_rate": 4.865319865319866e-05,
+ "loss": 0.020692896097898483,
+ "step": 1114
+ },
+ {
+ "epoch": 5.632911392405063,
+ "grad_norm": 0.03503869101405144,
+ "learning_rate": 4.859708193041527e-05,
+ "loss": 0.024315977469086647,
+ "step": 1115
+ },
+ {
+ "epoch": 5.637974683544304,
+ "grad_norm": 0.038263533264398575,
+ "learning_rate": 4.854096520763188e-05,
+ "loss": 0.02289794571697712,
+ "step": 1116
+ },
+ {
+ "epoch": 5.643037974683544,
+ "grad_norm": 0.06627792865037918,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.016900356858968735,
+ "step": 1117
+ },
+ {
+ "epoch": 5.648101265822785,
+ "grad_norm": 0.04108016937971115,
+ "learning_rate": 4.84287317620651e-05,
+ "loss": 0.026155930012464523,
+ "step": 1118
+ },
+ {
+ "epoch": 5.653164556962025,
+ "grad_norm": 0.027791379019618034,
+ "learning_rate": 4.837261503928171e-05,
+ "loss": 0.018122777342796326,
+ "step": 1119
+ },
+ {
+ "epoch": 5.658227848101266,
+ "grad_norm": 0.06097861006855965,
+ "learning_rate": 4.831649831649832e-05,
+ "loss": 0.022645950317382812,
+ "step": 1120
+ },
+ {
+ "epoch": 5.663291139240506,
+ "grad_norm": 0.06343472748994827,
+ "learning_rate": 4.8260381593714935e-05,
+ "loss": 0.029537659138441086,
+ "step": 1121
+ },
+ {
+ "epoch": 5.668354430379747,
+ "grad_norm": 0.05996944010257721,
+ "learning_rate": 4.8204264870931545e-05,
+ "loss": 0.02282993122935295,
+ "step": 1122
+ },
+ {
+ "epoch": 5.673417721518987,
+ "grad_norm": 0.030753644183278084,
+ "learning_rate": 4.814814814814815e-05,
+ "loss": 0.01835070736706257,
+ "step": 1123
+ },
+ {
+ "epoch": 5.678481012658228,
+ "grad_norm": 0.0284577663987875,
+ "learning_rate": 4.809203142536476e-05,
+ "loss": 0.019698038697242737,
+ "step": 1124
+ },
+ {
+ "epoch": 5.6835443037974684,
+ "grad_norm": 0.03136469051241875,
+ "learning_rate": 4.803591470258137e-05,
+ "loss": 0.018538501113653183,
+ "step": 1125
+ },
+ {
+ "epoch": 5.688607594936709,
+ "grad_norm": 0.042034219950437546,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.01609296351671219,
+ "step": 1126
+ },
+ {
+ "epoch": 5.6936708860759495,
+ "grad_norm": 0.04704117774963379,
+ "learning_rate": 4.792368125701459e-05,
+ "loss": 0.017442524433135986,
+ "step": 1127
+ },
+ {
+ "epoch": 5.69873417721519,
+ "grad_norm": 0.04261549562215805,
+ "learning_rate": 4.78675645342312e-05,
+ "loss": 0.022896092385053635,
+ "step": 1128
+ },
+ {
+ "epoch": 5.703797468354431,
+ "grad_norm": 0.035263415426015854,
+ "learning_rate": 4.7811447811447815e-05,
+ "loss": 0.02376401424407959,
+ "step": 1129
+ },
+ {
+ "epoch": 5.708860759493671,
+ "grad_norm": 0.029153654351830482,
+ "learning_rate": 4.7755331088664425e-05,
+ "loss": 0.019103601574897766,
+ "step": 1130
+ },
+ {
+ "epoch": 5.713924050632912,
+ "grad_norm": 0.024728860706090927,
+ "learning_rate": 4.7699214365881036e-05,
+ "loss": 0.019203007221221924,
+ "step": 1131
+ },
+ {
+ "epoch": 5.718987341772152,
+ "grad_norm": 0.0682872086763382,
+ "learning_rate": 4.7643097643097646e-05,
+ "loss": 0.023789528757333755,
+ "step": 1132
+ },
+ {
+ "epoch": 5.724050632911393,
+ "grad_norm": 0.03475257009267807,
+ "learning_rate": 4.7586980920314256e-05,
+ "loss": 0.01748424954712391,
+ "step": 1133
+ },
+ {
+ "epoch": 5.729113924050633,
+ "grad_norm": 0.03768116980791092,
+ "learning_rate": 4.7530864197530866e-05,
+ "loss": 0.019674118608236313,
+ "step": 1134
+ },
+ {
+ "epoch": 5.734177215189874,
+ "grad_norm": 0.06546973437070847,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.02400730922818184,
+ "step": 1135
+ },
+ {
+ "epoch": 5.739240506329114,
+ "grad_norm": 0.03348927944898605,
+ "learning_rate": 4.7418630751964086e-05,
+ "loss": 0.027110135182738304,
+ "step": 1136
+ },
+ {
+ "epoch": 5.744303797468355,
+ "grad_norm": 0.041038379073143005,
+ "learning_rate": 4.7362514029180696e-05,
+ "loss": 0.025943022221326828,
+ "step": 1137
+ },
+ {
+ "epoch": 5.749367088607595,
+ "grad_norm": 0.03094886802136898,
+ "learning_rate": 4.730639730639731e-05,
+ "loss": 0.018898673355579376,
+ "step": 1138
+ },
+ {
+ "epoch": 5.754430379746836,
+ "grad_norm": 0.03637633100152016,
+ "learning_rate": 4.725028058361392e-05,
+ "loss": 0.02247396484017372,
+ "step": 1139
+ },
+ {
+ "epoch": 5.759493670886076,
+ "grad_norm": 0.03672393038868904,
+ "learning_rate": 4.719416386083053e-05,
+ "loss": 0.02294430509209633,
+ "step": 1140
+ },
+ {
+ "epoch": 5.764556962025316,
+ "grad_norm": 0.03434748202562332,
+ "learning_rate": 4.713804713804714e-05,
+ "loss": 0.021498121321201324,
+ "step": 1141
+ },
+ {
+ "epoch": 5.769620253164557,
+ "grad_norm": 0.032241202890872955,
+ "learning_rate": 4.708193041526375e-05,
+ "loss": 0.02623910829424858,
+ "step": 1142
+ },
+ {
+ "epoch": 5.774683544303797,
+ "grad_norm": 0.028173472732305527,
+ "learning_rate": 4.702581369248036e-05,
+ "loss": 0.018390003591775894,
+ "step": 1143
+ },
+ {
+ "epoch": 5.779746835443038,
+ "grad_norm": 0.033768974244594574,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.022890064865350723,
+ "step": 1144
+ },
+ {
+ "epoch": 5.784810126582278,
+ "grad_norm": 0.03199310600757599,
+ "learning_rate": 4.691358024691358e-05,
+ "loss": 0.018634604290127754,
+ "step": 1145
+ },
+ {
+ "epoch": 5.789873417721519,
+ "grad_norm": 0.02942977100610733,
+ "learning_rate": 4.685746352413019e-05,
+ "loss": 0.021336350589990616,
+ "step": 1146
+ },
+ {
+ "epoch": 5.794936708860759,
+ "grad_norm": 0.026747260242700577,
+ "learning_rate": 4.68013468013468e-05,
+ "loss": 0.017634060233831406,
+ "step": 1147
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.052395813167095184,
+ "learning_rate": 4.6745230078563413e-05,
+ "loss": 0.019521519541740417,
+ "step": 1148
+ },
+ {
+ "epoch": 5.80506329113924,
+ "grad_norm": 0.07997749745845795,
+ "learning_rate": 4.6689113355780024e-05,
+ "loss": 0.027218502014875412,
+ "step": 1149
+ },
+ {
+ "epoch": 5.810126582278481,
+ "grad_norm": 0.04570790380239487,
+ "learning_rate": 4.6632996632996634e-05,
+ "loss": 0.027033157646656036,
+ "step": 1150
+ },
+ {
+ "epoch": 5.815189873417721,
+ "grad_norm": 0.05992640554904938,
+ "learning_rate": 4.6576879910213244e-05,
+ "loss": 0.020755816251039505,
+ "step": 1151
+ },
+ {
+ "epoch": 5.820253164556962,
+ "grad_norm": 0.03377217426896095,
+ "learning_rate": 4.6520763187429854e-05,
+ "loss": 0.019246265292167664,
+ "step": 1152
+ },
+ {
+ "epoch": 5.8253164556962025,
+ "grad_norm": 0.026675008237361908,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.019907813519239426,
+ "step": 1153
+ },
+ {
+ "epoch": 5.830379746835443,
+ "grad_norm": 0.04007306694984436,
+ "learning_rate": 4.6408529741863074e-05,
+ "loss": 0.02621765062212944,
+ "step": 1154
+ },
+ {
+ "epoch": 5.8354430379746836,
+ "grad_norm": 0.05345958471298218,
+ "learning_rate": 4.635241301907969e-05,
+ "loss": 0.021677743643522263,
+ "step": 1155
+ },
+ {
+ "epoch": 5.840506329113924,
+ "grad_norm": 0.03231236711144447,
+ "learning_rate": 4.62962962962963e-05,
+ "loss": 0.01898232102394104,
+ "step": 1156
+ },
+ {
+ "epoch": 5.845569620253165,
+ "grad_norm": 0.06332266330718994,
+ "learning_rate": 4.624017957351291e-05,
+ "loss": 0.022123044356703758,
+ "step": 1157
+ },
+ {
+ "epoch": 5.850632911392405,
+ "grad_norm": 0.017904918640851974,
+ "learning_rate": 4.618406285072952e-05,
+ "loss": 0.016008764505386353,
+ "step": 1158
+ },
+ {
+ "epoch": 5.855696202531646,
+ "grad_norm": 0.032957062125205994,
+ "learning_rate": 4.612794612794613e-05,
+ "loss": 0.026430988684296608,
+ "step": 1159
+ },
+ {
+ "epoch": 5.860759493670886,
+ "grad_norm": 0.02764013037085533,
+ "learning_rate": 4.607182940516274e-05,
+ "loss": 0.01749669760465622,
+ "step": 1160
+ },
+ {
+ "epoch": 5.865822784810127,
+ "grad_norm": 0.031616635620594025,
+ "learning_rate": 4.601571268237935e-05,
+ "loss": 0.022402513772249222,
+ "step": 1161
+ },
+ {
+ "epoch": 5.870886075949367,
+ "grad_norm": 0.026803012937307358,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.02391771227121353,
+ "step": 1162
+ },
+ {
+ "epoch": 5.875949367088608,
+ "grad_norm": 0.039992235600948334,
+ "learning_rate": 4.590347923681257e-05,
+ "loss": 0.0186441782861948,
+ "step": 1163
+ },
+ {
+ "epoch": 5.881012658227848,
+ "grad_norm": 0.034594062715768814,
+ "learning_rate": 4.584736251402919e-05,
+ "loss": 0.020437058061361313,
+ "step": 1164
+ },
+ {
+ "epoch": 5.886075949367089,
+ "grad_norm": 0.01877710409462452,
+ "learning_rate": 4.57912457912458e-05,
+ "loss": 0.01517703477293253,
+ "step": 1165
+ },
+ {
+ "epoch": 5.891139240506329,
+ "grad_norm": 0.021410809829831123,
+ "learning_rate": 4.573512906846241e-05,
+ "loss": 0.021264132112264633,
+ "step": 1166
+ },
+ {
+ "epoch": 5.89620253164557,
+ "grad_norm": 0.04017850384116173,
+ "learning_rate": 4.567901234567901e-05,
+ "loss": 0.024904146790504456,
+ "step": 1167
+ },
+ {
+ "epoch": 5.9012658227848105,
+ "grad_norm": 0.030386412516236305,
+ "learning_rate": 4.562289562289562e-05,
+ "loss": 0.02334582805633545,
+ "step": 1168
+ },
+ {
+ "epoch": 5.90632911392405,
+ "grad_norm": 0.043996457010507584,
+ "learning_rate": 4.556677890011223e-05,
+ "loss": 0.02326396480202675,
+ "step": 1169
+ },
+ {
+ "epoch": 5.911392405063291,
+ "grad_norm": 0.028154531493782997,
+ "learning_rate": 4.551066217732884e-05,
+ "loss": 0.019153760746121407,
+ "step": 1170
+ },
+ {
+ "epoch": 5.916455696202531,
+ "grad_norm": 0.02629070170223713,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.02149396575987339,
+ "step": 1171
+ },
+ {
+ "epoch": 5.921518987341772,
+ "grad_norm": 0.024712109938263893,
+ "learning_rate": 4.539842873176207e-05,
+ "loss": 0.01731209270656109,
+ "step": 1172
+ },
+ {
+ "epoch": 5.926582278481012,
+ "grad_norm": 0.027591124176979065,
+ "learning_rate": 4.534231200897868e-05,
+ "loss": 0.018549319356679916,
+ "step": 1173
+ },
+ {
+ "epoch": 5.931645569620253,
+ "grad_norm": 0.025680841878056526,
+ "learning_rate": 4.528619528619529e-05,
+ "loss": 0.019339032471179962,
+ "step": 1174
+ },
+ {
+ "epoch": 5.936708860759493,
+ "grad_norm": 0.0393349826335907,
+ "learning_rate": 4.52300785634119e-05,
+ "loss": 0.026176627725362778,
+ "step": 1175
+ },
+ {
+ "epoch": 5.941772151898734,
+ "grad_norm": 0.028960758820176125,
+ "learning_rate": 4.517396184062851e-05,
+ "loss": 0.020635023713111877,
+ "step": 1176
+ },
+ {
+ "epoch": 5.946835443037974,
+ "grad_norm": 0.038171909749507904,
+ "learning_rate": 4.511784511784512e-05,
+ "loss": 0.025552934035658836,
+ "step": 1177
+ },
+ {
+ "epoch": 5.951898734177215,
+ "grad_norm": 0.0229384396225214,
+ "learning_rate": 4.506172839506173e-05,
+ "loss": 0.016696415841579437,
+ "step": 1178
+ },
+ {
+ "epoch": 5.9569620253164555,
+ "grad_norm": 0.03247852623462677,
+ "learning_rate": 4.500561167227834e-05,
+ "loss": 0.020189210772514343,
+ "step": 1179
+ },
+ {
+ "epoch": 5.962025316455696,
+ "grad_norm": 0.09168937802314758,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.02350265346467495,
+ "step": 1180
+ },
+ {
+ "epoch": 5.9670886075949365,
+ "grad_norm": 0.0498431995511055,
+ "learning_rate": 4.4893378226711566e-05,
+ "loss": 0.025292757898569107,
+ "step": 1181
+ },
+ {
+ "epoch": 5.972151898734177,
+ "grad_norm": 0.027248093858361244,
+ "learning_rate": 4.4837261503928176e-05,
+ "loss": 0.022255534306168556,
+ "step": 1182
+ },
+ {
+ "epoch": 5.977215189873418,
+ "grad_norm": 0.0405442975461483,
+ "learning_rate": 4.4781144781144786e-05,
+ "loss": 0.029488639906048775,
+ "step": 1183
+ },
+ {
+ "epoch": 5.982278481012658,
+ "grad_norm": 0.032689113169908524,
+ "learning_rate": 4.4725028058361396e-05,
+ "loss": 0.02393949031829834,
+ "step": 1184
+ },
+ {
+ "epoch": 5.987341772151899,
+ "grad_norm": 0.0387105718255043,
+ "learning_rate": 4.4668911335578006e-05,
+ "loss": 0.02393876016139984,
+ "step": 1185
+ },
+ {
+ "epoch": 5.992405063291139,
+ "grad_norm": 0.03787006437778473,
+ "learning_rate": 4.4612794612794616e-05,
+ "loss": 0.019787393510341644,
+ "step": 1186
+ },
+ {
+ "epoch": 5.99746835443038,
+ "grad_norm": 0.07046152651309967,
+ "learning_rate": 4.4556677890011226e-05,
+ "loss": 0.02120082452893257,
+ "step": 1187
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.04410094395279884,
+ "learning_rate": 4.4500561167227837e-05,
+ "loss": 0.01791391335427761,
+ "step": 1188
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 1980,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 7.564953347905536e+16,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-1188/training_args.bin b/checkpoint-1188/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ce6b9228ad6cf155da5af64a370f864d5fe04e56
--- /dev/null
+++ b/checkpoint-1188/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3a4d7936dc7001e3baf6e9cead308b6188ace221538f9d436668bdf0b1d43a1
+size 5777
diff --git a/checkpoint-125/README.md b/checkpoint-125/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-125/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-125/adapter_config.json b/checkpoint-125/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-125/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-125/adapter_model.safetensors b/checkpoint-125/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..5f149a91e345e57e1b3e8515507697b29be1e38a
--- /dev/null
+++ b/checkpoint-125/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:242313e95b5a7939514d301b71943e8374ea993acdf0324ffc4e8347a804c311
+size 132187888
diff --git a/checkpoint-125/chat_template.jinja b/checkpoint-125/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-125/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-125/optimizer.pt b/checkpoint-125/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ecad21b68b862b037b9e609d84407019ffb71858
--- /dev/null
+++ b/checkpoint-125/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3dc175652372e818c54684c9d40a8239dd7fa21f954cd6d9f29dbaa1d2a724f0
+size 67688197
diff --git a/checkpoint-125/rng_state.pth b/checkpoint-125/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..ecd5163c23b56be6c4d0a107794dc7b316f940a1
--- /dev/null
+++ b/checkpoint-125/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89645f9f6a2a8823b334e0748e4f5ea683a27b3d02632f0a241397db55d82fad
+size 14645
diff --git a/checkpoint-125/scheduler.pt b/checkpoint-125/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..96f9c6ba3d08da801feb911c0b6f94a2a525e35f
--- /dev/null
+++ b/checkpoint-125/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eabd3c4ba8b41a4398f5c870775638a0746fd8357f2d7e0cbcf4970578c9f246
+size 1465
diff --git a/checkpoint-125/tokenizer.json b/checkpoint-125/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-125/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-125/tokenizer_config.json b/checkpoint-125/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-125/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-125/trainer_state.json b/checkpoint-125/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..d69920765925040639922f39ab3491ec28310b1d
--- /dev/null
+++ b/checkpoint-125/trainer_state.json
@@ -0,0 +1,909 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 5.0,
+ "eval_steps": 500,
+ "global_step": 125,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ },
+ {
+ "epoch": 1.04,
+ "grad_norm": 0.36699211597442627,
+ "learning_rate": 0.0001,
+ "loss": 0.4363247752189636,
+ "step": 26
+ },
+ {
+ "epoch": 1.08,
+ "grad_norm": 0.3731786608695984,
+ "learning_rate": 9.955555555555556e-05,
+ "loss": 0.4297473430633545,
+ "step": 27
+ },
+ {
+ "epoch": 1.12,
+ "grad_norm": 0.3378784954547882,
+ "learning_rate": 9.911111111111112e-05,
+ "loss": 0.35973912477493286,
+ "step": 28
+ },
+ {
+ "epoch": 1.16,
+ "grad_norm": 0.36273664236068726,
+ "learning_rate": 9.866666666666668e-05,
+ "loss": 0.34903788566589355,
+ "step": 29
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 0.362885981798172,
+ "learning_rate": 9.822222222222223e-05,
+ "loss": 0.3119792342185974,
+ "step": 30
+ },
+ {
+ "epoch": 1.24,
+ "grad_norm": 0.3790324032306671,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 0.29530155658721924,
+ "step": 31
+ },
+ {
+ "epoch": 1.28,
+ "grad_norm": 0.37333837151527405,
+ "learning_rate": 9.733333333333335e-05,
+ "loss": 0.2653456926345825,
+ "step": 32
+ },
+ {
+ "epoch": 1.32,
+ "grad_norm": 0.32163503766059875,
+ "learning_rate": 9.68888888888889e-05,
+ "loss": 0.19654956459999084,
+ "step": 33
+ },
+ {
+ "epoch": 1.3599999999999999,
+ "grad_norm": 0.5297159552574158,
+ "learning_rate": 9.644444444444445e-05,
+ "loss": 0.23580318689346313,
+ "step": 34
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.4474238455295563,
+ "learning_rate": 9.6e-05,
+ "loss": 0.18798796832561493,
+ "step": 35
+ },
+ {
+ "epoch": 1.44,
+ "grad_norm": 0.31346794962882996,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 0.12066371738910675,
+ "step": 36
+ },
+ {
+ "epoch": 1.48,
+ "grad_norm": 0.3099532723426819,
+ "learning_rate": 9.511111111111112e-05,
+ "loss": 0.08859007060527802,
+ "step": 37
+ },
+ {
+ "epoch": 1.52,
+ "grad_norm": 0.3490828275680542,
+ "learning_rate": 9.466666666666667e-05,
+ "loss": 0.07878822088241577,
+ "step": 38
+ },
+ {
+ "epoch": 1.56,
+ "grad_norm": 0.32395538687705994,
+ "learning_rate": 9.422222222222223e-05,
+ "loss": 0.06694570928812027,
+ "step": 39
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 0.20870603621006012,
+ "learning_rate": 9.377777777777779e-05,
+ "loss": 0.04379018768668175,
+ "step": 40
+ },
+ {
+ "epoch": 1.6400000000000001,
+ "grad_norm": 0.3310009837150574,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.048647329211235046,
+ "step": 41
+ },
+ {
+ "epoch": 1.6800000000000002,
+ "grad_norm": 0.26949432492256165,
+ "learning_rate": 9.28888888888889e-05,
+ "loss": 0.039286017417907715,
+ "step": 42
+ },
+ {
+ "epoch": 1.72,
+ "grad_norm": 0.11029712855815887,
+ "learning_rate": 9.244444444444445e-05,
+ "loss": 0.029231950640678406,
+ "step": 43
+ },
+ {
+ "epoch": 1.76,
+ "grad_norm": 0.1476302146911621,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.027003085240721703,
+ "step": 44
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.18617521226406097,
+ "learning_rate": 9.155555555555557e-05,
+ "loss": 0.025106143206357956,
+ "step": 45
+ },
+ {
+ "epoch": 1.8399999999999999,
+ "grad_norm": 0.13198262453079224,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.025741657242178917,
+ "step": 46
+ },
+ {
+ "epoch": 1.88,
+ "grad_norm": 0.26712384819984436,
+ "learning_rate": 9.066666666666667e-05,
+ "loss": 0.035036977380514145,
+ "step": 47
+ },
+ {
+ "epoch": 1.92,
+ "grad_norm": 0.3569182753562927,
+ "learning_rate": 9.022222222222224e-05,
+ "loss": 0.04259534925222397,
+ "step": 48
+ },
+ {
+ "epoch": 1.96,
+ "grad_norm": 0.1843830794095993,
+ "learning_rate": 8.977777777777779e-05,
+ "loss": 0.03471647948026657,
+ "step": 49
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.1248057410120964,
+ "learning_rate": 8.933333333333334e-05,
+ "loss": 0.030936148017644882,
+ "step": 50
+ },
+ {
+ "epoch": 2.04,
+ "grad_norm": 0.12060711532831192,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.032452136278152466,
+ "step": 51
+ },
+ {
+ "epoch": 2.08,
+ "grad_norm": 0.2026030570268631,
+ "learning_rate": 8.844444444444445e-05,
+ "loss": 0.03268110007047653,
+ "step": 52
+ },
+ {
+ "epoch": 2.12,
+ "grad_norm": 0.21289987862110138,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.03406357392668724,
+ "step": 53
+ },
+ {
+ "epoch": 2.16,
+ "grad_norm": 0.14732478559017181,
+ "learning_rate": 8.755555555555556e-05,
+ "loss": 0.02936721034348011,
+ "step": 54
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.10120426118373871,
+ "learning_rate": 8.711111111111112e-05,
+ "loss": 0.02511693350970745,
+ "step": 55
+ },
+ {
+ "epoch": 2.24,
+ "grad_norm": 0.08917918056249619,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.025877539068460464,
+ "step": 56
+ },
+ {
+ "epoch": 2.2800000000000002,
+ "grad_norm": 0.08735086023807526,
+ "learning_rate": 8.622222222222222e-05,
+ "loss": 0.02145460993051529,
+ "step": 57
+ },
+ {
+ "epoch": 2.32,
+ "grad_norm": 0.07835431396961212,
+ "learning_rate": 8.577777777777777e-05,
+ "loss": 0.021244943141937256,
+ "step": 58
+ },
+ {
+ "epoch": 2.36,
+ "grad_norm": 0.06953317672014236,
+ "learning_rate": 8.533333333333334e-05,
+ "loss": 0.02279437705874443,
+ "step": 59
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.0854259729385376,
+ "learning_rate": 8.488888888888889e-05,
+ "loss": 0.023704543709754944,
+ "step": 60
+ },
+ {
+ "epoch": 2.44,
+ "grad_norm": 0.17068363726139069,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.035272784531116486,
+ "step": 61
+ },
+ {
+ "epoch": 2.48,
+ "grad_norm": 0.11971863359212875,
+ "learning_rate": 8.4e-05,
+ "loss": 0.02707826718688011,
+ "step": 62
+ },
+ {
+ "epoch": 2.52,
+ "grad_norm": 0.05303095281124115,
+ "learning_rate": 8.355555555555556e-05,
+ "loss": 0.01696968823671341,
+ "step": 63
+ },
+ {
+ "epoch": 2.56,
+ "grad_norm": 0.06503961980342865,
+ "learning_rate": 8.311111111111111e-05,
+ "loss": 0.018413860350847244,
+ "step": 64
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.05390244349837303,
+ "learning_rate": 8.266666666666667e-05,
+ "loss": 0.01641814410686493,
+ "step": 65
+ },
+ {
+ "epoch": 2.64,
+ "grad_norm": 0.07149611413478851,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.020658448338508606,
+ "step": 66
+ },
+ {
+ "epoch": 2.68,
+ "grad_norm": 0.09244706481695175,
+ "learning_rate": 8.177777777777778e-05,
+ "loss": 0.022394295781850815,
+ "step": 67
+ },
+ {
+ "epoch": 2.7199999999999998,
+ "grad_norm": 0.11381954699754715,
+ "learning_rate": 8.133333333333334e-05,
+ "loss": 0.028476765379309654,
+ "step": 68
+ },
+ {
+ "epoch": 2.76,
+ "grad_norm": 0.07354001700878143,
+ "learning_rate": 8.088888888888889e-05,
+ "loss": 0.019497834146022797,
+ "step": 69
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.06727641820907593,
+ "learning_rate": 8.044444444444444e-05,
+ "loss": 0.014356930740177631,
+ "step": 70
+ },
+ {
+ "epoch": 2.84,
+ "grad_norm": 0.07417713105678558,
+ "learning_rate": 8e-05,
+ "loss": 0.01823577657341957,
+ "step": 71
+ },
+ {
+ "epoch": 2.88,
+ "grad_norm": 0.09163317829370499,
+ "learning_rate": 7.955555555555556e-05,
+ "loss": 0.02139071188867092,
+ "step": 72
+ },
+ {
+ "epoch": 2.92,
+ "grad_norm": 0.08178975433111191,
+ "learning_rate": 7.911111111111111e-05,
+ "loss": 0.018335483968257904,
+ "step": 73
+ },
+ {
+ "epoch": 2.96,
+ "grad_norm": 0.08015220612287521,
+ "learning_rate": 7.866666666666666e-05,
+ "loss": 0.016001513227820396,
+ "step": 74
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.08509402722120285,
+ "learning_rate": 7.822222222222223e-05,
+ "loss": 0.017747700214385986,
+ "step": 75
+ },
+ {
+ "epoch": 3.04,
+ "grad_norm": 0.07863253355026245,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.015054607763886452,
+ "step": 76
+ },
+ {
+ "epoch": 3.08,
+ "grad_norm": 0.09398715198040009,
+ "learning_rate": 7.733333333333333e-05,
+ "loss": 0.01887289062142372,
+ "step": 77
+ },
+ {
+ "epoch": 3.12,
+ "grad_norm": 0.12165197730064392,
+ "learning_rate": 7.688888888888889e-05,
+ "loss": 0.020169202238321304,
+ "step": 78
+ },
+ {
+ "epoch": 3.16,
+ "grad_norm": 0.07627179473638535,
+ "learning_rate": 7.644444444444445e-05,
+ "loss": 0.012153002433478832,
+ "step": 79
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.0885142832994461,
+ "learning_rate": 7.6e-05,
+ "loss": 0.015390444546937943,
+ "step": 80
+ },
+ {
+ "epoch": 3.24,
+ "grad_norm": 0.11557707190513611,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.019245222210884094,
+ "step": 81
+ },
+ {
+ "epoch": 3.2800000000000002,
+ "grad_norm": 0.0976581946015358,
+ "learning_rate": 7.511111111111111e-05,
+ "loss": 0.014158917590975761,
+ "step": 82
+ },
+ {
+ "epoch": 3.32,
+ "grad_norm": 0.09829393774271011,
+ "learning_rate": 7.466666666666667e-05,
+ "loss": 0.013099931180477142,
+ "step": 83
+ },
+ {
+ "epoch": 3.36,
+ "grad_norm": 0.10063999146223068,
+ "learning_rate": 7.422222222222223e-05,
+ "loss": 0.013834481127560139,
+ "step": 84
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.09943496435880661,
+ "learning_rate": 7.377777777777778e-05,
+ "loss": 0.012920765206217766,
+ "step": 85
+ },
+ {
+ "epoch": 3.44,
+ "grad_norm": 0.1093878448009491,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.013458158820867538,
+ "step": 86
+ },
+ {
+ "epoch": 3.48,
+ "grad_norm": 0.1128634586930275,
+ "learning_rate": 7.28888888888889e-05,
+ "loss": 0.013067865744233131,
+ "step": 87
+ },
+ {
+ "epoch": 3.52,
+ "grad_norm": 0.11049138009548187,
+ "learning_rate": 7.244444444444445e-05,
+ "loss": 0.01237843930721283,
+ "step": 88
+ },
+ {
+ "epoch": 3.56,
+ "grad_norm": 0.1535821557044983,
+ "learning_rate": 7.2e-05,
+ "loss": 0.015146344900131226,
+ "step": 89
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.10436677187681198,
+ "learning_rate": 7.155555555555555e-05,
+ "loss": 0.00996164046227932,
+ "step": 90
+ },
+ {
+ "epoch": 3.64,
+ "grad_norm": 0.14084051549434662,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.013795388862490654,
+ "step": 91
+ },
+ {
+ "epoch": 3.68,
+ "grad_norm": 0.12718933820724487,
+ "learning_rate": 7.066666666666667e-05,
+ "loss": 0.011878985911607742,
+ "step": 92
+ },
+ {
+ "epoch": 3.7199999999999998,
+ "grad_norm": 0.1412353217601776,
+ "learning_rate": 7.022222222222222e-05,
+ "loss": 0.010964864864945412,
+ "step": 93
+ },
+ {
+ "epoch": 3.76,
+ "grad_norm": 0.11453556269407272,
+ "learning_rate": 6.977777777777779e-05,
+ "loss": 0.008170144632458687,
+ "step": 94
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.16155096888542175,
+ "learning_rate": 6.933333333333334e-05,
+ "loss": 0.011488870717585087,
+ "step": 95
+ },
+ {
+ "epoch": 3.84,
+ "grad_norm": 0.11969174444675446,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.007895090617239475,
+ "step": 96
+ },
+ {
+ "epoch": 3.88,
+ "grad_norm": 0.22626101970672607,
+ "learning_rate": 6.844444444444445e-05,
+ "loss": 0.01467936858534813,
+ "step": 97
+ },
+ {
+ "epoch": 3.92,
+ "grad_norm": 0.21040032804012299,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.010772328823804855,
+ "step": 98
+ },
+ {
+ "epoch": 3.96,
+ "grad_norm": 0.19558775424957275,
+ "learning_rate": 6.755555555555557e-05,
+ "loss": 0.009220557287335396,
+ "step": 99
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.18061381578445435,
+ "learning_rate": 6.711111111111112e-05,
+ "loss": 0.006471008062362671,
+ "step": 100
+ },
+ {
+ "epoch": 4.04,
+ "grad_norm": 0.12179632484912872,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.0057976702228188515,
+ "step": 101
+ },
+ {
+ "epoch": 4.08,
+ "grad_norm": 0.12671399116516113,
+ "learning_rate": 6.622222222222224e-05,
+ "loss": 0.006621541455388069,
+ "step": 102
+ },
+ {
+ "epoch": 4.12,
+ "grad_norm": 0.11084511876106262,
+ "learning_rate": 6.577777777777779e-05,
+ "loss": 0.006054866127669811,
+ "step": 103
+ },
+ {
+ "epoch": 4.16,
+ "grad_norm": 0.12502190470695496,
+ "learning_rate": 6.533333333333334e-05,
+ "loss": 0.00817898940294981,
+ "step": 104
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.09107036888599396,
+ "learning_rate": 6.488888888888889e-05,
+ "loss": 0.006295117549598217,
+ "step": 105
+ },
+ {
+ "epoch": 4.24,
+ "grad_norm": 0.07194884121417999,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.006192575674504042,
+ "step": 106
+ },
+ {
+ "epoch": 4.28,
+ "grad_norm": 0.03464571759104729,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.003843494923785329,
+ "step": 107
+ },
+ {
+ "epoch": 4.32,
+ "grad_norm": 0.10040883719921112,
+ "learning_rate": 6.355555555555556e-05,
+ "loss": 0.006318099796772003,
+ "step": 108
+ },
+ {
+ "epoch": 4.36,
+ "grad_norm": 0.07303845882415771,
+ "learning_rate": 6.311111111111112e-05,
+ "loss": 0.0047858962789177895,
+ "step": 109
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.03440818190574646,
+ "learning_rate": 6.266666666666667e-05,
+ "loss": 0.004050814546644688,
+ "step": 110
+ },
+ {
+ "epoch": 4.44,
+ "grad_norm": 0.046613194048404694,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.0035898215137422085,
+ "step": 111
+ },
+ {
+ "epoch": 4.48,
+ "grad_norm": 0.02108742855489254,
+ "learning_rate": 6.177777777777779e-05,
+ "loss": 0.003291932400316,
+ "step": 112
+ },
+ {
+ "epoch": 4.52,
+ "grad_norm": 0.04408564418554306,
+ "learning_rate": 6.133333333333334e-05,
+ "loss": 0.0033779453951865435,
+ "step": 113
+ },
+ {
+ "epoch": 4.5600000000000005,
+ "grad_norm": 0.022311383858323097,
+ "learning_rate": 6.08888888888889e-05,
+ "loss": 0.0038345090579241514,
+ "step": 114
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.026365282014012337,
+ "learning_rate": 6.044444444444445e-05,
+ "loss": 0.004205222241580486,
+ "step": 115
+ },
+ {
+ "epoch": 4.64,
+ "grad_norm": 0.04582115262746811,
+ "learning_rate": 6e-05,
+ "loss": 0.005077291280031204,
+ "step": 116
+ },
+ {
+ "epoch": 4.68,
+ "grad_norm": 0.05057913810014725,
+ "learning_rate": 5.9555555555555554e-05,
+ "loss": 0.004747368395328522,
+ "step": 117
+ },
+ {
+ "epoch": 4.72,
+ "grad_norm": 0.04699229821562767,
+ "learning_rate": 5.911111111111112e-05,
+ "loss": 0.00538603262975812,
+ "step": 118
+ },
+ {
+ "epoch": 4.76,
+ "grad_norm": 0.026704438030719757,
+ "learning_rate": 5.866666666666667e-05,
+ "loss": 0.0041087716817855835,
+ "step": 119
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.04175629839301109,
+ "learning_rate": 5.8222222222222224e-05,
+ "loss": 0.004437651485204697,
+ "step": 120
+ },
+ {
+ "epoch": 4.84,
+ "grad_norm": 0.032657600939273834,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.003728377167135477,
+ "step": 121
+ },
+ {
+ "epoch": 4.88,
+ "grad_norm": 0.03405195474624634,
+ "learning_rate": 5.7333333333333336e-05,
+ "loss": 0.005017922259867191,
+ "step": 122
+ },
+ {
+ "epoch": 4.92,
+ "grad_norm": 0.02600262127816677,
+ "learning_rate": 5.6888888888888895e-05,
+ "loss": 0.003841507714241743,
+ "step": 123
+ },
+ {
+ "epoch": 4.96,
+ "grad_norm": 0.03402233496308327,
+ "learning_rate": 5.644444444444445e-05,
+ "loss": 0.002483899937942624,
+ "step": 124
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.03151554986834526,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 0.0036559500731527805,
+ "step": 125
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 6131631651225600.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-125/training_args.bin b/checkpoint-125/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-125/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-1386/README.md b/checkpoint-1386/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-1386/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-1386/adapter_config.json b/checkpoint-1386/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..879d59d17cdb2aff2a9fcb7e4537a4f740bf19f5
--- /dev/null
+++ b/checkpoint-1386/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "o_proj",
+ "up_proj",
+ "down_proj",
+ "v_proj",
+ "k_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-1386/adapter_model.safetensors b/checkpoint-1386/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..f5c103a56a3f14effe7015a0f4f15af061a65a45
--- /dev/null
+++ b/checkpoint-1386/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:942803e6b3908e3c6887a1bdea9d0da098703e4534e1ca18b3a16b65204880b8
+size 132187888
diff --git a/checkpoint-1386/chat_template.jinja b/checkpoint-1386/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-1386/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-1386/optimizer.pt b/checkpoint-1386/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..de43437f8078cb8f905dc6d05ba2a90c2f0b242c
--- /dev/null
+++ b/checkpoint-1386/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c211f1c806993609fff1f5cf8d54be65e1d0699fff23ed56f0e8e1813ad0fd40
+size 67688645
diff --git a/checkpoint-1386/rng_state.pth b/checkpoint-1386/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..f8402b2586fcee7b5a43887ca285370521ba5f1e
--- /dev/null
+++ b/checkpoint-1386/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2922886dc37f9211a4affea61093cbe4db90c0a37e91e7edac63ec0cf7b13d45
+size 14645
diff --git a/checkpoint-1386/scheduler.pt b/checkpoint-1386/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..89c200b2ac636115d3a4c7d02cb11b543dedfe40
--- /dev/null
+++ b/checkpoint-1386/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aa32835df75d25242ea0a5eb16f267657bd580d63f017cdba1f76372883fe073
+size 1465
diff --git a/checkpoint-1386/tokenizer.json b/checkpoint-1386/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-1386/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-1386/tokenizer_config.json b/checkpoint-1386/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-1386/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-1386/trainer_state.json b/checkpoint-1386/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..4018feb4d4708e7385fe56390fc4246ebafb83ed
--- /dev/null
+++ b/checkpoint-1386/trainer_state.json
@@ -0,0 +1,9736 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 7.0,
+ "eval_steps": 500,
+ "global_step": 1386,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.54137122631073,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279057860374451,
+ "learning_rate": 5.050505050505052e-07,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.7017749547958374,
+ "learning_rate": 1.0101010101010103e-06,
+ "loss": 1.0435928106307983,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6033008098602295,
+ "learning_rate": 1.5151515151515152e-06,
+ "loss": 0.8843490481376648,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5495544672012329,
+ "learning_rate": 2.0202020202020206e-06,
+ "loss": 0.8034592866897583,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.802371621131897,
+ "learning_rate": 2.5252525252525253e-06,
+ "loss": 1.1588364839553833,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8238587975502014,
+ "learning_rate": 3.0303030303030305e-06,
+ "loss": 1.228503942489624,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6073964238166809,
+ "learning_rate": 3.5353535353535352e-06,
+ "loss": 0.8989433646202087,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 0.6492345333099365,
+ "learning_rate": 4.040404040404041e-06,
+ "loss": 0.9615614414215088,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.6880183815956116,
+ "learning_rate": 4.5454545454545455e-06,
+ "loss": 0.9233697652816772,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.470304012298584,
+ "learning_rate": 5.050505050505051e-06,
+ "loss": 0.7186562418937683,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6361913681030273,
+ "learning_rate": 5.555555555555556e-06,
+ "loss": 0.9312829375267029,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5554782152175903,
+ "learning_rate": 6.060606060606061e-06,
+ "loss": 0.8529565334320068,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5414550304412842,
+ "learning_rate": 6.565656565656567e-06,
+ "loss": 0.8071130514144897,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9267164468765259,
+ "learning_rate": 7.0707070707070704e-06,
+ "loss": 1.3577998876571655,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.6104046106338501,
+ "learning_rate": 7.5757575757575764e-06,
+ "loss": 0.923499345779419,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.7241935133934021,
+ "learning_rate": 8.080808080808082e-06,
+ "loss": 1.0400190353393555,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.6026384830474854,
+ "learning_rate": 8.585858585858587e-06,
+ "loss": 0.8413939476013184,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.7690514922142029,
+ "learning_rate": 9.090909090909091e-06,
+ "loss": 1.0870859622955322,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.5940403342247009,
+ "learning_rate": 9.595959595959595e-06,
+ "loss": 0.8468416929244995,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.669230580329895,
+ "learning_rate": 1.0101010101010101e-05,
+ "loss": 0.9340983629226685,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.5750640034675598,
+ "learning_rate": 1.0606060606060607e-05,
+ "loss": 0.8230171799659729,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.6579262614250183,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.9293508529663086,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.5956451296806335,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.8316305875778198,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.7270558476448059,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.9129499197006226,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.7505611777305603,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 1.0138367414474487,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.6870062947273254,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.901283860206604,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.7679643630981445,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.9833810329437256,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.866938591003418,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.8958402872085571,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.8687500357627869,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 1.1289801597595215,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 4.008030891418457,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 1.2739044427871704,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.7689681053161621,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.8514111638069153,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.7880434393882751,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.8862775564193726,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.6183183789253235,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.7857811450958252,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.6437809467315674,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.7093011736869812,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.5481512546539307,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.7350327968597412,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.4838634729385376,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.6584650874137878,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.523994505405426,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.7211161851882935,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.6523379683494568,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.9044773578643799,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.4274725615978241,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.568337082862854,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.5060272812843323,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.7201821208000183,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.3760877251625061,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.5880123376846313,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.3715391457080841,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.5693179368972778,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.4332570731639862,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.7277271151542664,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.38201987743377686,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.6458995938301086,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.4358846843242645,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.7559939026832581,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.4566098749637604,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.7792297601699829,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.3864676356315613,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.6894873380661011,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.31187522411346436,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.545581579208374,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.3325943350791931,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.5917496085166931,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.6410307884216309,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.44281136989593506,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.36323168873786926,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.6426926851272583,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.31924113631248474,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.5482619404792786,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.3632371723651886,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.6188253164291382,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.375381201505661,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.5487836003303528,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.3163473606109619,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.5367064476013184,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.42646294832229614,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.41221165657043457,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.41622766852378845,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.5274936556816101,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.30204030871391296,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.44855833053588867,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.3178975582122803,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.4036139249801636,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.2893930673599243,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.39234185218811035,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.2833489775657654,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.37406405806541443,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.3216562867164612,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.3938276767730713,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.26721706986427307,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.30402088165283203,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.3702670931816101,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.30594947934150696,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.2632184326648712,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.2691727876663208,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.36898860335350037,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.33992528915405273,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.2976086735725403,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.27603086829185486,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.32201430201530457,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.25665703415870667,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.35001808404922485,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.24190445244312286,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.5106059908866882,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.3093336820602417,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.3261374831199646,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.18783289194107056,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.38757652044296265,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.19549766182899475,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.4723363518714905,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.15751558542251587,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.36796173453330994,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.14514681696891785,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.3855208456516266,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.14030519127845764,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.5906668305397034,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.1478388011455536,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.2658001780509949,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.13253600895404816,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.33554506301879883,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.12156252562999725,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.2643960416316986,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.1089208647608757,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.19129537045955658,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.08515600860118866,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.22168858349323273,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.09310197830200195,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.16676382720470428,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.07711787521839142,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.23891882598400116,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.09763285517692566,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.28446146845817566,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.08980057388544083,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.146108940243721,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.06573648750782013,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.2007656991481781,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.0699995830655098,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.3082621395587921,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.0885838121175766,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.1624963879585266,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.06935172528028488,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.1562737673521042,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.07147250324487686,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.1660323292016983,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.0672944188117981,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.21427564322948456,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.07051930576562881,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.16495929658412933,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.05429624393582344,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.1978198140859604,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.07144488394260406,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.15077605843544006,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.055798254907131195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.2806876301765442,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.06058178097009659,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.1219187006354332,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.05044667422771454,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10286939144134521,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.048498690128326416,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.12813609838485718,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.06252863258123398,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10565406829118729,
+ "learning_rate": 5e-05,
+ "loss": 0.051401108503341675,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.09147113561630249,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.047376491129398346,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.08723224699497223,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.039745647460222244,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.16071128845214844,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.058398712426424026,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.1370300054550171,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.05132289230823517,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.19449608027935028,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.06682188808917999,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.13085028529167175,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.049861155450344086,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.1768050193786621,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.055694688111543655,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.2819313704967499,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.062391363084316254,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.10738537460565567,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.05093343183398247,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.11759619414806366,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.044827841222286224,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.21941131353378296,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.05238347500562668,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.1697252243757248,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.04869212955236435,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.19701889157295227,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.04484856128692627,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.11779771000146866,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.04135368764400482,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.19823911786079407,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.05097956955432892,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.17355702817440033,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.05781872197985649,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.13029292225837708,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.041528262197971344,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.1292058229446411,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.0442211888730526,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10058800131082535,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.03813612461090088,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.22936487197875977,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.056090980768203735,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.13063806295394897,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.04347142577171326,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.167104110121727,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.04442849010229111,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.11942817270755768,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.03964124619960785,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.17906631529331207,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.04372458904981613,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.13760331273078918,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.03980286419391632,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.18043340742588043,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.05500294268131256,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.31386223435401917,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.04253799840807915,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.1428707093000412,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.047894880175590515,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.11010178923606873,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.04534825310111046,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.10444525629281998,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.041347943246364594,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.18076039850711823,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.04535853862762451,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.19424672424793243,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.05037602037191391,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.1457783728837967,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.047546930611133575,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.1189681887626648,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.03254905715584755,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.18887822329998016,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.04018670320510864,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.12217189371585846,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.03981504589319229,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.10866257548332214,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.04322533681988716,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.15904399752616882,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.04488902539014816,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.12598516047000885,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.04718853533267975,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.22092872858047485,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.03646199405193329,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.1717238426208496,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.04607801511883736,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.16268078982830048,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.04759417474269867,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.19621087610721588,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.051741112023591995,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.15362979471683502,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.04363569617271423,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.1404130607843399,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.045428819954395294,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.12262272834777832,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.03828439861536026,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.10626570880413055,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.03420639410614967,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.12686072289943695,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.03474457561969757,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.153709277510643,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.03174472972750664,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.13035084307193756,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.02982976846396923,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.12288431823253632,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.03588784486055374,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.19307470321655273,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.04750734567642212,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.0996781438589096,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.027098631486296654,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.16898290812969208,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.040447790175676346,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.10996036231517792,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.02525201067328453,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.16161896288394928,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.04199359938502312,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.1536172777414322,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.02943507581949234,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.18457260727882385,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.04093889892101288,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.11232347041368484,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.029609719291329384,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.19080978631973267,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.0357801653444767,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.16634301841259003,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02980419248342514,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.28601372241973877,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.032849978655576706,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.1359848529100418,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.0230826735496521,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.11285015195608139,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.02447221614420414,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.14712421596050262,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.022657420486211777,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.18246804177761078,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.035991013050079346,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.143621563911438,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.024444863200187683,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.12458691000938416,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.039701592177152634,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05614984780550003,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.029840555042028427,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.06097931042313576,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.027426715940237045,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.09883654862642288,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031690437346696854,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.0700431764125824,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.024079838767647743,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.05957406386733055,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.02303817868232727,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.14374858140945435,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.031183632090687752,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.09187919646501541,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.031176958233118057,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.0540630929172039,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.024949276819825172,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06875574588775635,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.02890622243285179,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.10081329196691513,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.03019360452890396,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.11833225935697556,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.020365778356790543,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.08700298517942429,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.027046984061598778,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.08660133928060532,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.027088070288300514,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.06983930617570877,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.019332535564899445,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.09463227540254593,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.02780212089419365,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.10251298546791077,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.026878856122493744,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.15963847935199738,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.03437665104866028,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.11342372000217438,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.02877948433160782,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.0937543660402298,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.02759186364710331,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.07137084752321243,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.02941890060901642,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.3511611819267273,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.024331524968147278,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.12344356626272202,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.0348694771528244,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.07144290208816528,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.021711278706789017,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.09835992008447647,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.03408564254641533,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.4978399872779846,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.03810017928481102,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.06314591318368912,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.0201277956366539,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.07504695653915405,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.025770913809537888,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.1028534397482872,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.02469150349497795,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.09341974556446075,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.036506302654743195,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09348680078983307,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02507903426885605,
+ "step": 198
+ },
+ {
+ "epoch": 1.0050632911392405,
+ "grad_norm": 0.06890113651752472,
+ "learning_rate": 0.0001,
+ "loss": 0.028374083340168,
+ "step": 199
+ },
+ {
+ "epoch": 1.010126582278481,
+ "grad_norm": 0.051041170954704285,
+ "learning_rate": 9.994388327721661e-05,
+ "loss": 0.022860335186123848,
+ "step": 200
+ },
+ {
+ "epoch": 1.0151898734177216,
+ "grad_norm": 0.10253743082284927,
+ "learning_rate": 9.988776655443322e-05,
+ "loss": 0.02864072285592556,
+ "step": 201
+ },
+ {
+ "epoch": 1.0202531645569621,
+ "grad_norm": 0.08295776695013046,
+ "learning_rate": 9.983164983164983e-05,
+ "loss": 0.0327395498752594,
+ "step": 202
+ },
+ {
+ "epoch": 1.0253164556962024,
+ "grad_norm": 0.07240694016218185,
+ "learning_rate": 9.977553310886645e-05,
+ "loss": 0.029215697199106216,
+ "step": 203
+ },
+ {
+ "epoch": 1.030379746835443,
+ "grad_norm": 0.0688897892832756,
+ "learning_rate": 9.971941638608306e-05,
+ "loss": 0.027594968676567078,
+ "step": 204
+ },
+ {
+ "epoch": 1.0354430379746835,
+ "grad_norm": 0.08463896065950394,
+ "learning_rate": 9.966329966329967e-05,
+ "loss": 0.02292536199092865,
+ "step": 205
+ },
+ {
+ "epoch": 1.040506329113924,
+ "grad_norm": 0.062013301998376846,
+ "learning_rate": 9.960718294051628e-05,
+ "loss": 0.023678191006183624,
+ "step": 206
+ },
+ {
+ "epoch": 1.0455696202531646,
+ "grad_norm": 0.08735264092683792,
+ "learning_rate": 9.955106621773289e-05,
+ "loss": 0.022060325369238853,
+ "step": 207
+ },
+ {
+ "epoch": 1.0506329113924051,
+ "grad_norm": 0.07634295523166656,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02764434739947319,
+ "step": 208
+ },
+ {
+ "epoch": 1.0556962025316456,
+ "grad_norm": 0.09735682606697083,
+ "learning_rate": 9.943883277216612e-05,
+ "loss": 0.03304428607225418,
+ "step": 209
+ },
+ {
+ "epoch": 1.0607594936708862,
+ "grad_norm": 0.06860044598579407,
+ "learning_rate": 9.938271604938272e-05,
+ "loss": 0.0340178906917572,
+ "step": 210
+ },
+ {
+ "epoch": 1.0658227848101265,
+ "grad_norm": 0.3715139627456665,
+ "learning_rate": 9.932659932659934e-05,
+ "loss": 0.02541016787290573,
+ "step": 211
+ },
+ {
+ "epoch": 1.070886075949367,
+ "grad_norm": 0.07673332840204239,
+ "learning_rate": 9.927048260381594e-05,
+ "loss": 0.025950253009796143,
+ "step": 212
+ },
+ {
+ "epoch": 1.0759493670886076,
+ "grad_norm": 0.07359500974416733,
+ "learning_rate": 9.921436588103256e-05,
+ "loss": 0.024356549605727196,
+ "step": 213
+ },
+ {
+ "epoch": 1.081012658227848,
+ "grad_norm": 0.07760954648256302,
+ "learning_rate": 9.915824915824916e-05,
+ "loss": 0.02338298037648201,
+ "step": 214
+ },
+ {
+ "epoch": 1.0860759493670886,
+ "grad_norm": 0.09183681756258011,
+ "learning_rate": 9.910213243546578e-05,
+ "loss": 0.020955465734004974,
+ "step": 215
+ },
+ {
+ "epoch": 1.0911392405063292,
+ "grad_norm": 0.21278677880764008,
+ "learning_rate": 9.904601571268239e-05,
+ "loss": 0.028164055198431015,
+ "step": 216
+ },
+ {
+ "epoch": 1.0962025316455697,
+ "grad_norm": 0.22437937557697296,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.03543347865343094,
+ "step": 217
+ },
+ {
+ "epoch": 1.1012658227848102,
+ "grad_norm": 0.08677598088979721,
+ "learning_rate": 9.893378226711561e-05,
+ "loss": 0.031265974044799805,
+ "step": 218
+ },
+ {
+ "epoch": 1.1063291139240505,
+ "grad_norm": 0.09595583379268646,
+ "learning_rate": 9.887766554433222e-05,
+ "loss": 0.02384507656097412,
+ "step": 219
+ },
+ {
+ "epoch": 1.111392405063291,
+ "grad_norm": 0.08256062865257263,
+ "learning_rate": 9.882154882154883e-05,
+ "loss": 0.022209012880921364,
+ "step": 220
+ },
+ {
+ "epoch": 1.1164556962025316,
+ "grad_norm": 0.07712455838918686,
+ "learning_rate": 9.876543209876543e-05,
+ "loss": 0.025278344750404358,
+ "step": 221
+ },
+ {
+ "epoch": 1.1215189873417721,
+ "grad_norm": 0.09704182296991348,
+ "learning_rate": 9.870931537598205e-05,
+ "loss": 0.024904735386371613,
+ "step": 222
+ },
+ {
+ "epoch": 1.1265822784810127,
+ "grad_norm": 0.09094078838825226,
+ "learning_rate": 9.865319865319865e-05,
+ "loss": 0.0280012097209692,
+ "step": 223
+ },
+ {
+ "epoch": 1.1316455696202532,
+ "grad_norm": 0.07607442885637283,
+ "learning_rate": 9.859708193041527e-05,
+ "loss": 0.026181645691394806,
+ "step": 224
+ },
+ {
+ "epoch": 1.1367088607594937,
+ "grad_norm": 0.06568697839975357,
+ "learning_rate": 9.854096520763188e-05,
+ "loss": 0.02883346565067768,
+ "step": 225
+ },
+ {
+ "epoch": 1.1417721518987343,
+ "grad_norm": 0.07192376255989075,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.027345171198248863,
+ "step": 226
+ },
+ {
+ "epoch": 1.1468354430379746,
+ "grad_norm": 0.1464017778635025,
+ "learning_rate": 9.84287317620651e-05,
+ "loss": 0.03213154152035713,
+ "step": 227
+ },
+ {
+ "epoch": 1.1518987341772151,
+ "grad_norm": 0.06766578555107117,
+ "learning_rate": 9.837261503928171e-05,
+ "loss": 0.02554963156580925,
+ "step": 228
+ },
+ {
+ "epoch": 1.1569620253164556,
+ "grad_norm": 0.09428609162569046,
+ "learning_rate": 9.831649831649832e-05,
+ "loss": 0.02484097331762314,
+ "step": 229
+ },
+ {
+ "epoch": 1.1620253164556962,
+ "grad_norm": 0.1648297905921936,
+ "learning_rate": 9.826038159371493e-05,
+ "loss": 0.03450813889503479,
+ "step": 230
+ },
+ {
+ "epoch": 1.1670886075949367,
+ "grad_norm": 0.06389904767274857,
+ "learning_rate": 9.820426487093154e-05,
+ "loss": 0.02957337349653244,
+ "step": 231
+ },
+ {
+ "epoch": 1.1721518987341772,
+ "grad_norm": 0.11517420411109924,
+ "learning_rate": 9.814814814814815e-05,
+ "loss": 0.024299729615449905,
+ "step": 232
+ },
+ {
+ "epoch": 1.1772151898734178,
+ "grad_norm": 0.06960142403841019,
+ "learning_rate": 9.809203142536476e-05,
+ "loss": 0.025762220844626427,
+ "step": 233
+ },
+ {
+ "epoch": 1.1822784810126583,
+ "grad_norm": 0.11682946234941483,
+ "learning_rate": 9.803591470258137e-05,
+ "loss": 0.02457268163561821,
+ "step": 234
+ },
+ {
+ "epoch": 1.1873417721518988,
+ "grad_norm": 0.07964848726987839,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.027285631746053696,
+ "step": 235
+ },
+ {
+ "epoch": 1.1924050632911392,
+ "grad_norm": 0.053044773638248444,
+ "learning_rate": 9.79236812570146e-05,
+ "loss": 0.020997609943151474,
+ "step": 236
+ },
+ {
+ "epoch": 1.1974683544303797,
+ "grad_norm": 0.13531149923801422,
+ "learning_rate": 9.78675645342312e-05,
+ "loss": 0.02474522590637207,
+ "step": 237
+ },
+ {
+ "epoch": 1.2025316455696202,
+ "grad_norm": 0.0774424746632576,
+ "learning_rate": 9.781144781144782e-05,
+ "loss": 0.025272740051150322,
+ "step": 238
+ },
+ {
+ "epoch": 1.2075949367088608,
+ "grad_norm": 0.042708419263362885,
+ "learning_rate": 9.775533108866442e-05,
+ "loss": 0.019522909075021744,
+ "step": 239
+ },
+ {
+ "epoch": 1.2126582278481013,
+ "grad_norm": 0.10364090651273727,
+ "learning_rate": 9.769921436588104e-05,
+ "loss": 0.02728935517370701,
+ "step": 240
+ },
+ {
+ "epoch": 1.2177215189873418,
+ "grad_norm": 0.0756702646613121,
+ "learning_rate": 9.764309764309764e-05,
+ "loss": 0.02659972943365574,
+ "step": 241
+ },
+ {
+ "epoch": 1.2227848101265824,
+ "grad_norm": 0.07232004404067993,
+ "learning_rate": 9.758698092031426e-05,
+ "loss": 0.017723949626088142,
+ "step": 242
+ },
+ {
+ "epoch": 1.2278481012658227,
+ "grad_norm": 0.058345306664705276,
+ "learning_rate": 9.753086419753087e-05,
+ "loss": 0.019348861649632454,
+ "step": 243
+ },
+ {
+ "epoch": 1.2329113924050632,
+ "grad_norm": 0.14832371473312378,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.03227488696575165,
+ "step": 244
+ },
+ {
+ "epoch": 1.2379746835443037,
+ "grad_norm": 0.05343412607908249,
+ "learning_rate": 9.74186307519641e-05,
+ "loss": 0.0210015457123518,
+ "step": 245
+ },
+ {
+ "epoch": 1.2430379746835443,
+ "grad_norm": 0.054104797542095184,
+ "learning_rate": 9.736251402918069e-05,
+ "loss": 0.02430287003517151,
+ "step": 246
+ },
+ {
+ "epoch": 1.2481012658227848,
+ "grad_norm": 0.11686044931411743,
+ "learning_rate": 9.730639730639732e-05,
+ "loss": 0.029372017830610275,
+ "step": 247
+ },
+ {
+ "epoch": 1.2531645569620253,
+ "grad_norm": 0.05970177799463272,
+ "learning_rate": 9.725028058361391e-05,
+ "loss": 0.024995045736432076,
+ "step": 248
+ },
+ {
+ "epoch": 1.2582278481012659,
+ "grad_norm": 0.06506923586130142,
+ "learning_rate": 9.719416386083054e-05,
+ "loss": 0.024779727682471275,
+ "step": 249
+ },
+ {
+ "epoch": 1.2632911392405064,
+ "grad_norm": 0.12711220979690552,
+ "learning_rate": 9.713804713804715e-05,
+ "loss": 0.026196476072072983,
+ "step": 250
+ },
+ {
+ "epoch": 1.268354430379747,
+ "grad_norm": 0.056023694574832916,
+ "learning_rate": 9.708193041526376e-05,
+ "loss": 0.01813146471977234,
+ "step": 251
+ },
+ {
+ "epoch": 1.2734177215189875,
+ "grad_norm": 0.04508040472865105,
+ "learning_rate": 9.702581369248037e-05,
+ "loss": 0.019225183874368668,
+ "step": 252
+ },
+ {
+ "epoch": 1.2784810126582278,
+ "grad_norm": 0.10354425758123398,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.02940209209918976,
+ "step": 253
+ },
+ {
+ "epoch": 1.2835443037974683,
+ "grad_norm": 0.06974297761917114,
+ "learning_rate": 9.691358024691359e-05,
+ "loss": 0.02482295036315918,
+ "step": 254
+ },
+ {
+ "epoch": 1.2886075949367088,
+ "grad_norm": 0.06940010190010071,
+ "learning_rate": 9.68574635241302e-05,
+ "loss": 0.020605089142918587,
+ "step": 255
+ },
+ {
+ "epoch": 1.2936708860759494,
+ "grad_norm": 0.09167850762605667,
+ "learning_rate": 9.68013468013468e-05,
+ "loss": 0.02429921180009842,
+ "step": 256
+ },
+ {
+ "epoch": 1.29873417721519,
+ "grad_norm": 0.048866868019104004,
+ "learning_rate": 9.674523007856342e-05,
+ "loss": 0.021776504814624786,
+ "step": 257
+ },
+ {
+ "epoch": 1.3037974683544304,
+ "grad_norm": 0.06977155059576035,
+ "learning_rate": 9.668911335578003e-05,
+ "loss": 0.02758147194981575,
+ "step": 258
+ },
+ {
+ "epoch": 1.3088607594936708,
+ "grad_norm": 0.17602303624153137,
+ "learning_rate": 9.663299663299664e-05,
+ "loss": 0.026518259197473526,
+ "step": 259
+ },
+ {
+ "epoch": 1.3139240506329113,
+ "grad_norm": 0.08011946082115173,
+ "learning_rate": 9.657687991021325e-05,
+ "loss": 0.026240577921271324,
+ "step": 260
+ },
+ {
+ "epoch": 1.3189873417721518,
+ "grad_norm": 0.06296376883983612,
+ "learning_rate": 9.652076318742987e-05,
+ "loss": 0.03159455955028534,
+ "step": 261
+ },
+ {
+ "epoch": 1.3240506329113924,
+ "grad_norm": 0.04424722492694855,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.024151435121893883,
+ "step": 262
+ },
+ {
+ "epoch": 1.3291139240506329,
+ "grad_norm": 0.045779623091220856,
+ "learning_rate": 9.640852974186309e-05,
+ "loss": 0.018655993044376373,
+ "step": 263
+ },
+ {
+ "epoch": 1.3341772151898734,
+ "grad_norm": 0.06355931609869003,
+ "learning_rate": 9.635241301907969e-05,
+ "loss": 0.01999380812048912,
+ "step": 264
+ },
+ {
+ "epoch": 1.339240506329114,
+ "grad_norm": 0.04477616026997566,
+ "learning_rate": 9.62962962962963e-05,
+ "loss": 0.021614115685224533,
+ "step": 265
+ },
+ {
+ "epoch": 1.3443037974683545,
+ "grad_norm": 0.05851180478930473,
+ "learning_rate": 9.62401795735129e-05,
+ "loss": 0.023495908826589584,
+ "step": 266
+ },
+ {
+ "epoch": 1.349367088607595,
+ "grad_norm": 0.04724022373557091,
+ "learning_rate": 9.618406285072952e-05,
+ "loss": 0.02053767442703247,
+ "step": 267
+ },
+ {
+ "epoch": 1.3544303797468356,
+ "grad_norm": 0.12757639586925507,
+ "learning_rate": 9.612794612794614e-05,
+ "loss": 0.030612681061029434,
+ "step": 268
+ },
+ {
+ "epoch": 1.3594936708860759,
+ "grad_norm": 0.18316853046417236,
+ "learning_rate": 9.607182940516274e-05,
+ "loss": 0.039485104382038116,
+ "step": 269
+ },
+ {
+ "epoch": 1.3645569620253164,
+ "grad_norm": 0.09149223566055298,
+ "learning_rate": 9.601571268237936e-05,
+ "loss": 0.031156456097960472,
+ "step": 270
+ },
+ {
+ "epoch": 1.369620253164557,
+ "grad_norm": 0.07885908335447311,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.026395633816719055,
+ "step": 271
+ },
+ {
+ "epoch": 1.3746835443037975,
+ "grad_norm": 0.0984397754073143,
+ "learning_rate": 9.590347923681258e-05,
+ "loss": 0.02990398183465004,
+ "step": 272
+ },
+ {
+ "epoch": 1.379746835443038,
+ "grad_norm": 0.08566205203533173,
+ "learning_rate": 9.584736251402918e-05,
+ "loss": 0.024353420361876488,
+ "step": 273
+ },
+ {
+ "epoch": 1.3848101265822785,
+ "grad_norm": 0.16623689234256744,
+ "learning_rate": 9.57912457912458e-05,
+ "loss": 0.03626095876097679,
+ "step": 274
+ },
+ {
+ "epoch": 1.389873417721519,
+ "grad_norm": 0.07134243100881577,
+ "learning_rate": 9.57351290684624e-05,
+ "loss": 0.026036158204078674,
+ "step": 275
+ },
+ {
+ "epoch": 1.3949367088607594,
+ "grad_norm": 0.07753578573465347,
+ "learning_rate": 9.567901234567902e-05,
+ "loss": 0.03266923502087593,
+ "step": 276
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.07113673537969589,
+ "learning_rate": 9.562289562289563e-05,
+ "loss": 0.024128902703523636,
+ "step": 277
+ },
+ {
+ "epoch": 1.4050632911392404,
+ "grad_norm": 0.0954187884926796,
+ "learning_rate": 9.556677890011224e-05,
+ "loss": 0.03310588374733925,
+ "step": 278
+ },
+ {
+ "epoch": 1.410126582278481,
+ "grad_norm": 0.08755122870206833,
+ "learning_rate": 9.551066217732885e-05,
+ "loss": 0.030977975577116013,
+ "step": 279
+ },
+ {
+ "epoch": 1.4151898734177215,
+ "grad_norm": 0.06839736551046371,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.029557062312960625,
+ "step": 280
+ },
+ {
+ "epoch": 1.420253164556962,
+ "grad_norm": 0.051050763577222824,
+ "learning_rate": 9.539842873176207e-05,
+ "loss": 0.022091392427682877,
+ "step": 281
+ },
+ {
+ "epoch": 1.4253164556962026,
+ "grad_norm": 0.05898132920265198,
+ "learning_rate": 9.534231200897868e-05,
+ "loss": 0.024804875254631042,
+ "step": 282
+ },
+ {
+ "epoch": 1.4303797468354431,
+ "grad_norm": 0.04517035931348801,
+ "learning_rate": 9.528619528619529e-05,
+ "loss": 0.024234894663095474,
+ "step": 283
+ },
+ {
+ "epoch": 1.4354430379746836,
+ "grad_norm": 0.05625253543257713,
+ "learning_rate": 9.52300785634119e-05,
+ "loss": 0.02342807501554489,
+ "step": 284
+ },
+ {
+ "epoch": 1.4405063291139242,
+ "grad_norm": 0.047006960958242416,
+ "learning_rate": 9.517396184062851e-05,
+ "loss": 0.021819880232214928,
+ "step": 285
+ },
+ {
+ "epoch": 1.4455696202531645,
+ "grad_norm": 0.051774390041828156,
+ "learning_rate": 9.511784511784512e-05,
+ "loss": 0.020575571805238724,
+ "step": 286
+ },
+ {
+ "epoch": 1.450632911392405,
+ "grad_norm": 0.0684620812535286,
+ "learning_rate": 9.506172839506173e-05,
+ "loss": 0.025043494999408722,
+ "step": 287
+ },
+ {
+ "epoch": 1.4556962025316456,
+ "grad_norm": 0.05345604941248894,
+ "learning_rate": 9.500561167227834e-05,
+ "loss": 0.020829960703849792,
+ "step": 288
+ },
+ {
+ "epoch": 1.460759493670886,
+ "grad_norm": 0.07588688284158707,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.02842051535844803,
+ "step": 289
+ },
+ {
+ "epoch": 1.4658227848101266,
+ "grad_norm": 0.0371188148856163,
+ "learning_rate": 9.489337822671156e-05,
+ "loss": 0.020213091745972633,
+ "step": 290
+ },
+ {
+ "epoch": 1.4708860759493672,
+ "grad_norm": 0.03922685980796814,
+ "learning_rate": 9.483726150392817e-05,
+ "loss": 0.020665431395173073,
+ "step": 291
+ },
+ {
+ "epoch": 1.4759493670886075,
+ "grad_norm": 0.10213606059551239,
+ "learning_rate": 9.478114478114478e-05,
+ "loss": 0.024979032576084137,
+ "step": 292
+ },
+ {
+ "epoch": 1.481012658227848,
+ "grad_norm": 0.04574638605117798,
+ "learning_rate": 9.472502805836139e-05,
+ "loss": 0.0215127132833004,
+ "step": 293
+ },
+ {
+ "epoch": 1.4860759493670885,
+ "grad_norm": 0.0829704999923706,
+ "learning_rate": 9.4668911335578e-05,
+ "loss": 0.023608818650245667,
+ "step": 294
+ },
+ {
+ "epoch": 1.491139240506329,
+ "grad_norm": 0.036335594952106476,
+ "learning_rate": 9.461279461279463e-05,
+ "loss": 0.01993970200419426,
+ "step": 295
+ },
+ {
+ "epoch": 1.4962025316455696,
+ "grad_norm": 0.08291227370500565,
+ "learning_rate": 9.455667789001122e-05,
+ "loss": 0.02223093807697296,
+ "step": 296
+ },
+ {
+ "epoch": 1.5012658227848101,
+ "grad_norm": 0.048284996300935745,
+ "learning_rate": 9.450056116722785e-05,
+ "loss": 0.019440360367298126,
+ "step": 297
+ },
+ {
+ "epoch": 1.5063291139240507,
+ "grad_norm": 0.25126877427101135,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.030357610434293747,
+ "step": 298
+ },
+ {
+ "epoch": 1.5113924050632912,
+ "grad_norm": 0.08812759816646576,
+ "learning_rate": 9.438832772166107e-05,
+ "loss": 0.025407828390598297,
+ "step": 299
+ },
+ {
+ "epoch": 1.5164556962025317,
+ "grad_norm": 0.09417422115802765,
+ "learning_rate": 9.433221099887766e-05,
+ "loss": 0.028768496587872505,
+ "step": 300
+ },
+ {
+ "epoch": 1.5215189873417723,
+ "grad_norm": 0.10820329934358597,
+ "learning_rate": 9.427609427609429e-05,
+ "loss": 0.03250410035252571,
+ "step": 301
+ },
+ {
+ "epoch": 1.5265822784810128,
+ "grad_norm": 0.06633433699607849,
+ "learning_rate": 9.42199775533109e-05,
+ "loss": 0.019816454499959946,
+ "step": 302
+ },
+ {
+ "epoch": 1.5316455696202531,
+ "grad_norm": 0.05545264482498169,
+ "learning_rate": 9.41638608305275e-05,
+ "loss": 0.020919661968946457,
+ "step": 303
+ },
+ {
+ "epoch": 1.5367088607594936,
+ "grad_norm": 0.08201726526021957,
+ "learning_rate": 9.410774410774412e-05,
+ "loss": 0.0309453085064888,
+ "step": 304
+ },
+ {
+ "epoch": 1.5417721518987342,
+ "grad_norm": 0.047229036688804626,
+ "learning_rate": 9.405162738496073e-05,
+ "loss": 0.02079029008746147,
+ "step": 305
+ },
+ {
+ "epoch": 1.5468354430379747,
+ "grad_norm": 0.04493536427617073,
+ "learning_rate": 9.399551066217734e-05,
+ "loss": 0.020319776609539986,
+ "step": 306
+ },
+ {
+ "epoch": 1.5518987341772152,
+ "grad_norm": 0.07935966551303864,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.03144281357526779,
+ "step": 307
+ },
+ {
+ "epoch": 1.5569620253164556,
+ "grad_norm": 0.10108500719070435,
+ "learning_rate": 9.388327721661056e-05,
+ "loss": 0.029823362827301025,
+ "step": 308
+ },
+ {
+ "epoch": 1.562025316455696,
+ "grad_norm": 0.05187584087252617,
+ "learning_rate": 9.382716049382717e-05,
+ "loss": 0.029090257361531258,
+ "step": 309
+ },
+ {
+ "epoch": 1.5670886075949366,
+ "grad_norm": 0.09131086617708206,
+ "learning_rate": 9.377104377104378e-05,
+ "loss": 0.020090997219085693,
+ "step": 310
+ },
+ {
+ "epoch": 1.5721518987341772,
+ "grad_norm": 0.06874370574951172,
+ "learning_rate": 9.371492704826039e-05,
+ "loss": 0.022118568420410156,
+ "step": 311
+ },
+ {
+ "epoch": 1.5772151898734177,
+ "grad_norm": 0.07480651885271072,
+ "learning_rate": 9.3658810325477e-05,
+ "loss": 0.030924849212169647,
+ "step": 312
+ },
+ {
+ "epoch": 1.5822784810126582,
+ "grad_norm": 0.04049983248114586,
+ "learning_rate": 9.36026936026936e-05,
+ "loss": 0.02086808532476425,
+ "step": 313
+ },
+ {
+ "epoch": 1.5873417721518988,
+ "grad_norm": 0.037067580968141556,
+ "learning_rate": 9.354657687991022e-05,
+ "loss": 0.022019919008016586,
+ "step": 314
+ },
+ {
+ "epoch": 1.5924050632911393,
+ "grad_norm": 0.0599038302898407,
+ "learning_rate": 9.349046015712683e-05,
+ "loss": 0.02305535599589348,
+ "step": 315
+ },
+ {
+ "epoch": 1.5974683544303798,
+ "grad_norm": 0.056727997958660126,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.025360889732837677,
+ "step": 316
+ },
+ {
+ "epoch": 1.6025316455696204,
+ "grad_norm": 0.06659650057554245,
+ "learning_rate": 9.337822671156005e-05,
+ "loss": 0.02528395690023899,
+ "step": 317
+ },
+ {
+ "epoch": 1.6075949367088609,
+ "grad_norm": 0.06213822215795517,
+ "learning_rate": 9.332210998877666e-05,
+ "loss": 0.028841618448495865,
+ "step": 318
+ },
+ {
+ "epoch": 1.6126582278481014,
+ "grad_norm": 0.03757556155323982,
+ "learning_rate": 9.326599326599327e-05,
+ "loss": 0.02282278798520565,
+ "step": 319
+ },
+ {
+ "epoch": 1.6177215189873417,
+ "grad_norm": 0.061945486813783646,
+ "learning_rate": 9.320987654320989e-05,
+ "loss": 0.02733437530696392,
+ "step": 320
+ },
+ {
+ "epoch": 1.6227848101265823,
+ "grad_norm": 0.07904566079378128,
+ "learning_rate": 9.315375982042649e-05,
+ "loss": 0.02630138024687767,
+ "step": 321
+ },
+ {
+ "epoch": 1.6278481012658228,
+ "grad_norm": 0.07157077640295029,
+ "learning_rate": 9.309764309764311e-05,
+ "loss": 0.023403439670801163,
+ "step": 322
+ },
+ {
+ "epoch": 1.6329113924050633,
+ "grad_norm": 0.03518318012356758,
+ "learning_rate": 9.304152637485971e-05,
+ "loss": 0.021487422287464142,
+ "step": 323
+ },
+ {
+ "epoch": 1.6379746835443036,
+ "grad_norm": 0.11178159713745117,
+ "learning_rate": 9.298540965207633e-05,
+ "loss": 0.03142111003398895,
+ "step": 324
+ },
+ {
+ "epoch": 1.6430379746835442,
+ "grad_norm": 0.05046987161040306,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.020960725843906403,
+ "step": 325
+ },
+ {
+ "epoch": 1.6481012658227847,
+ "grad_norm": 0.05356504023075104,
+ "learning_rate": 9.287317620650955e-05,
+ "loss": 0.01934133842587471,
+ "step": 326
+ },
+ {
+ "epoch": 1.6531645569620252,
+ "grad_norm": 0.07995260506868362,
+ "learning_rate": 9.281705948372615e-05,
+ "loss": 0.0248265378177166,
+ "step": 327
+ },
+ {
+ "epoch": 1.6582278481012658,
+ "grad_norm": 0.08783978968858719,
+ "learning_rate": 9.276094276094277e-05,
+ "loss": 0.024171534925699234,
+ "step": 328
+ },
+ {
+ "epoch": 1.6632911392405063,
+ "grad_norm": 0.043143950402736664,
+ "learning_rate": 9.270482603815938e-05,
+ "loss": 0.021554211154580116,
+ "step": 329
+ },
+ {
+ "epoch": 1.6683544303797468,
+ "grad_norm": 0.05635169520974159,
+ "learning_rate": 9.264870931537598e-05,
+ "loss": 0.025942442938685417,
+ "step": 330
+ },
+ {
+ "epoch": 1.6734177215189874,
+ "grad_norm": 0.042691316455602646,
+ "learning_rate": 9.25925925925926e-05,
+ "loss": 0.021898634731769562,
+ "step": 331
+ },
+ {
+ "epoch": 1.678481012658228,
+ "grad_norm": 0.07666946202516556,
+ "learning_rate": 9.25364758698092e-05,
+ "loss": 0.02928568609058857,
+ "step": 332
+ },
+ {
+ "epoch": 1.6835443037974684,
+ "grad_norm": 0.04230545833706856,
+ "learning_rate": 9.248035914702582e-05,
+ "loss": 0.020812246948480606,
+ "step": 333
+ },
+ {
+ "epoch": 1.688607594936709,
+ "grad_norm": 0.1077270656824112,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.025568369776010513,
+ "step": 334
+ },
+ {
+ "epoch": 1.6936708860759495,
+ "grad_norm": 0.04277936369180679,
+ "learning_rate": 9.236812570145904e-05,
+ "loss": 0.018935058265924454,
+ "step": 335
+ },
+ {
+ "epoch": 1.6987341772151898,
+ "grad_norm": 0.04454135522246361,
+ "learning_rate": 9.231200897867565e-05,
+ "loss": 0.01933746598660946,
+ "step": 336
+ },
+ {
+ "epoch": 1.7037974683544304,
+ "grad_norm": 0.0674893856048584,
+ "learning_rate": 9.225589225589226e-05,
+ "loss": 0.021518435329198837,
+ "step": 337
+ },
+ {
+ "epoch": 1.7088607594936709,
+ "grad_norm": 0.06007042154669762,
+ "learning_rate": 9.219977553310887e-05,
+ "loss": 0.019427424296736717,
+ "step": 338
+ },
+ {
+ "epoch": 1.7139240506329114,
+ "grad_norm": 0.09564489126205444,
+ "learning_rate": 9.214365881032548e-05,
+ "loss": 0.027250545099377632,
+ "step": 339
+ },
+ {
+ "epoch": 1.7189873417721517,
+ "grad_norm": 0.053655482828617096,
+ "learning_rate": 9.208754208754209e-05,
+ "loss": 0.020125389099121094,
+ "step": 340
+ },
+ {
+ "epoch": 1.7240506329113923,
+ "grad_norm": 0.038283221423625946,
+ "learning_rate": 9.20314253647587e-05,
+ "loss": 0.017948098480701447,
+ "step": 341
+ },
+ {
+ "epoch": 1.7291139240506328,
+ "grad_norm": 0.04724166542291641,
+ "learning_rate": 9.197530864197531e-05,
+ "loss": 0.02523602545261383,
+ "step": 342
+ },
+ {
+ "epoch": 1.7341772151898733,
+ "grad_norm": 0.10365224629640579,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.035696640610694885,
+ "step": 343
+ },
+ {
+ "epoch": 1.7392405063291139,
+ "grad_norm": 0.07362233102321625,
+ "learning_rate": 9.186307519640853e-05,
+ "loss": 0.026104427874088287,
+ "step": 344
+ },
+ {
+ "epoch": 1.7443037974683544,
+ "grad_norm": 0.05976846069097519,
+ "learning_rate": 9.180695847362514e-05,
+ "loss": 0.026634451001882553,
+ "step": 345
+ },
+ {
+ "epoch": 1.749367088607595,
+ "grad_norm": 0.07387223839759827,
+ "learning_rate": 9.175084175084175e-05,
+ "loss": 0.025733446702361107,
+ "step": 346
+ },
+ {
+ "epoch": 1.7544303797468355,
+ "grad_norm": 0.04727378115057945,
+ "learning_rate": 9.169472502805838e-05,
+ "loss": 0.01889938861131668,
+ "step": 347
+ },
+ {
+ "epoch": 1.759493670886076,
+ "grad_norm": 0.10614906996488571,
+ "learning_rate": 9.163860830527497e-05,
+ "loss": 0.02275039628148079,
+ "step": 348
+ },
+ {
+ "epoch": 1.7645569620253165,
+ "grad_norm": 0.04877970367670059,
+ "learning_rate": 9.15824915824916e-05,
+ "loss": 0.022580452263355255,
+ "step": 349
+ },
+ {
+ "epoch": 1.769620253164557,
+ "grad_norm": 0.18825598061084747,
+ "learning_rate": 9.152637485970819e-05,
+ "loss": 0.03054988384246826,
+ "step": 350
+ },
+ {
+ "epoch": 1.7746835443037976,
+ "grad_norm": 0.06315254420042038,
+ "learning_rate": 9.147025813692482e-05,
+ "loss": 0.025584843009710312,
+ "step": 351
+ },
+ {
+ "epoch": 1.7797468354430381,
+ "grad_norm": 0.04519108682870865,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.0214737206697464,
+ "step": 352
+ },
+ {
+ "epoch": 1.7848101265822784,
+ "grad_norm": 0.07401937246322632,
+ "learning_rate": 9.135802469135802e-05,
+ "loss": 0.02984039857983589,
+ "step": 353
+ },
+ {
+ "epoch": 1.789873417721519,
+ "grad_norm": 0.05138625577092171,
+ "learning_rate": 9.130190796857465e-05,
+ "loss": 0.024221282452344894,
+ "step": 354
+ },
+ {
+ "epoch": 1.7949367088607595,
+ "grad_norm": 0.10182037204504013,
+ "learning_rate": 9.124579124579124e-05,
+ "loss": 0.0237903892993927,
+ "step": 355
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.056737013161182404,
+ "learning_rate": 9.118967452300787e-05,
+ "loss": 0.026514701545238495,
+ "step": 356
+ },
+ {
+ "epoch": 1.8050632911392404,
+ "grad_norm": 0.04826146364212036,
+ "learning_rate": 9.113355780022446e-05,
+ "loss": 0.021808844059705734,
+ "step": 357
+ },
+ {
+ "epoch": 1.810126582278481,
+ "grad_norm": 0.07099983841180801,
+ "learning_rate": 9.107744107744109e-05,
+ "loss": 0.028031716123223305,
+ "step": 358
+ },
+ {
+ "epoch": 1.8151898734177214,
+ "grad_norm": 0.04242753982543945,
+ "learning_rate": 9.102132435465768e-05,
+ "loss": 0.018858186900615692,
+ "step": 359
+ },
+ {
+ "epoch": 1.820253164556962,
+ "grad_norm": 0.053701240569353104,
+ "learning_rate": 9.096520763187431e-05,
+ "loss": 0.025603849440813065,
+ "step": 360
+ },
+ {
+ "epoch": 1.8253164556962025,
+ "grad_norm": 0.05277755856513977,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.021214714273810387,
+ "step": 361
+ },
+ {
+ "epoch": 1.830379746835443,
+ "grad_norm": 0.048843637108802795,
+ "learning_rate": 9.085297418630753e-05,
+ "loss": 0.024215007200837135,
+ "step": 362
+ },
+ {
+ "epoch": 1.8354430379746836,
+ "grad_norm": 0.04203329607844353,
+ "learning_rate": 9.079685746352414e-05,
+ "loss": 0.022748971357941628,
+ "step": 363
+ },
+ {
+ "epoch": 1.840506329113924,
+ "grad_norm": 0.04655196890234947,
+ "learning_rate": 9.074074074074075e-05,
+ "loss": 0.019658325240015984,
+ "step": 364
+ },
+ {
+ "epoch": 1.8455696202531646,
+ "grad_norm": 0.10654491931200027,
+ "learning_rate": 9.068462401795736e-05,
+ "loss": 0.03210999816656113,
+ "step": 365
+ },
+ {
+ "epoch": 1.8506329113924052,
+ "grad_norm": 0.04377336800098419,
+ "learning_rate": 9.062850729517397e-05,
+ "loss": 0.01867927983403206,
+ "step": 366
+ },
+ {
+ "epoch": 1.8556962025316457,
+ "grad_norm": 0.04619381204247475,
+ "learning_rate": 9.057239057239058e-05,
+ "loss": 0.01952965185046196,
+ "step": 367
+ },
+ {
+ "epoch": 1.8607594936708862,
+ "grad_norm": 0.04015986621379852,
+ "learning_rate": 9.051627384960719e-05,
+ "loss": 0.017353296279907227,
+ "step": 368
+ },
+ {
+ "epoch": 1.8658227848101265,
+ "grad_norm": 0.11403095722198486,
+ "learning_rate": 9.04601571268238e-05,
+ "loss": 0.02238992229104042,
+ "step": 369
+ },
+ {
+ "epoch": 1.870886075949367,
+ "grad_norm": 0.043767284601926804,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.02202833816409111,
+ "step": 370
+ },
+ {
+ "epoch": 1.8759493670886076,
+ "grad_norm": 0.053445883095264435,
+ "learning_rate": 9.034792368125702e-05,
+ "loss": 0.023765750229358673,
+ "step": 371
+ },
+ {
+ "epoch": 1.8810126582278481,
+ "grad_norm": 0.05750055983662605,
+ "learning_rate": 9.029180695847364e-05,
+ "loss": 0.026259474456310272,
+ "step": 372
+ },
+ {
+ "epoch": 1.8860759493670884,
+ "grad_norm": 0.04525497183203697,
+ "learning_rate": 9.023569023569024e-05,
+ "loss": 0.024194583296775818,
+ "step": 373
+ },
+ {
+ "epoch": 1.891139240506329,
+ "grad_norm": 0.04918856918811798,
+ "learning_rate": 9.017957351290685e-05,
+ "loss": 0.020951319485902786,
+ "step": 374
+ },
+ {
+ "epoch": 1.8962025316455695,
+ "grad_norm": 0.08538687229156494,
+ "learning_rate": 9.012345679012346e-05,
+ "loss": 0.022266045212745667,
+ "step": 375
+ },
+ {
+ "epoch": 1.90126582278481,
+ "grad_norm": 0.07101748883724213,
+ "learning_rate": 9.006734006734007e-05,
+ "loss": 0.028090521693229675,
+ "step": 376
+ },
+ {
+ "epoch": 1.9063291139240506,
+ "grad_norm": 0.06256446987390518,
+ "learning_rate": 9.001122334455668e-05,
+ "loss": 0.027174800634384155,
+ "step": 377
+ },
+ {
+ "epoch": 1.9113924050632911,
+ "grad_norm": 0.07588270306587219,
+ "learning_rate": 8.995510662177329e-05,
+ "loss": 0.028438206762075424,
+ "step": 378
+ },
+ {
+ "epoch": 1.9164556962025316,
+ "grad_norm": 5.8829851150512695,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.01749270409345627,
+ "step": 379
+ },
+ {
+ "epoch": 1.9215189873417722,
+ "grad_norm": 0.038905344903469086,
+ "learning_rate": 8.984287317620651e-05,
+ "loss": 0.019571108743548393,
+ "step": 380
+ },
+ {
+ "epoch": 1.9265822784810127,
+ "grad_norm": 0.05960959196090698,
+ "learning_rate": 8.978675645342313e-05,
+ "loss": 0.024591946974396706,
+ "step": 381
+ },
+ {
+ "epoch": 1.9316455696202532,
+ "grad_norm": 0.07935867458581924,
+ "learning_rate": 8.973063973063973e-05,
+ "loss": 0.020205039530992508,
+ "step": 382
+ },
+ {
+ "epoch": 1.9367088607594938,
+ "grad_norm": 0.08682888746261597,
+ "learning_rate": 8.967452300785635e-05,
+ "loss": 0.023299653083086014,
+ "step": 383
+ },
+ {
+ "epoch": 1.9417721518987343,
+ "grad_norm": 0.07220255583524704,
+ "learning_rate": 8.961840628507295e-05,
+ "loss": 0.025364618748426437,
+ "step": 384
+ },
+ {
+ "epoch": 1.9468354430379748,
+ "grad_norm": 0.08230294287204742,
+ "learning_rate": 8.956228956228957e-05,
+ "loss": 0.023587457835674286,
+ "step": 385
+ },
+ {
+ "epoch": 1.9518987341772152,
+ "grad_norm": 0.05176795646548271,
+ "learning_rate": 8.950617283950617e-05,
+ "loss": 0.018942706286907196,
+ "step": 386
+ },
+ {
+ "epoch": 1.9569620253164557,
+ "grad_norm": 0.04784144088625908,
+ "learning_rate": 8.945005611672279e-05,
+ "loss": 0.020134730264544487,
+ "step": 387
+ },
+ {
+ "epoch": 1.9620253164556962,
+ "grad_norm": 0.04668115824460983,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.022084465250372887,
+ "step": 388
+ },
+ {
+ "epoch": 1.9670886075949368,
+ "grad_norm": 0.05892647057771683,
+ "learning_rate": 8.933782267115601e-05,
+ "loss": 0.02586008608341217,
+ "step": 389
+ },
+ {
+ "epoch": 1.972151898734177,
+ "grad_norm": 0.048669006675481796,
+ "learning_rate": 8.928170594837262e-05,
+ "loss": 0.020011097192764282,
+ "step": 390
+ },
+ {
+ "epoch": 1.9772151898734176,
+ "grad_norm": 0.0973723903298378,
+ "learning_rate": 8.922558922558923e-05,
+ "loss": 0.030240919440984726,
+ "step": 391
+ },
+ {
+ "epoch": 1.9822784810126581,
+ "grad_norm": 0.090507872402668,
+ "learning_rate": 8.916947250280584e-05,
+ "loss": 0.028250183910131454,
+ "step": 392
+ },
+ {
+ "epoch": 1.9873417721518987,
+ "grad_norm": 0.03921318054199219,
+ "learning_rate": 8.911335578002245e-05,
+ "loss": 0.02076716348528862,
+ "step": 393
+ },
+ {
+ "epoch": 1.9924050632911392,
+ "grad_norm": 0.04830043017864227,
+ "learning_rate": 8.905723905723906e-05,
+ "loss": 0.02241525426506996,
+ "step": 394
+ },
+ {
+ "epoch": 1.9974683544303797,
+ "grad_norm": 0.04455797001719475,
+ "learning_rate": 8.900112233445567e-05,
+ "loss": 0.026035301387310028,
+ "step": 395
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.10931648313999176,
+ "learning_rate": 8.894500561167228e-05,
+ "loss": 0.03514251485466957,
+ "step": 396
+ },
+ {
+ "epoch": 2.0050632911392405,
+ "grad_norm": 0.07531362026929855,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.021771814674139023,
+ "step": 397
+ },
+ {
+ "epoch": 2.010126582278481,
+ "grad_norm": 0.0649140477180481,
+ "learning_rate": 8.88327721661055e-05,
+ "loss": 0.02932022325694561,
+ "step": 398
+ },
+ {
+ "epoch": 2.0151898734177216,
+ "grad_norm": 0.07461163401603699,
+ "learning_rate": 8.877665544332211e-05,
+ "loss": 0.023864082992076874,
+ "step": 399
+ },
+ {
+ "epoch": 2.020253164556962,
+ "grad_norm": 0.054510265588760376,
+ "learning_rate": 8.872053872053872e-05,
+ "loss": 0.027578316628932953,
+ "step": 400
+ },
+ {
+ "epoch": 2.0253164556962027,
+ "grad_norm": 0.04434451460838318,
+ "learning_rate": 8.866442199775533e-05,
+ "loss": 0.022873830050230026,
+ "step": 401
+ },
+ {
+ "epoch": 2.030379746835443,
+ "grad_norm": 0.052791960537433624,
+ "learning_rate": 8.860830527497194e-05,
+ "loss": 0.021092431619763374,
+ "step": 402
+ },
+ {
+ "epoch": 2.0354430379746837,
+ "grad_norm": 0.04550998657941818,
+ "learning_rate": 8.855218855218855e-05,
+ "loss": 0.022475749254226685,
+ "step": 403
+ },
+ {
+ "epoch": 2.0405063291139243,
+ "grad_norm": 0.2512972354888916,
+ "learning_rate": 8.849607182940516e-05,
+ "loss": 0.02201610803604126,
+ "step": 404
+ },
+ {
+ "epoch": 2.0455696202531644,
+ "grad_norm": 0.04554569348692894,
+ "learning_rate": 8.843995510662177e-05,
+ "loss": 0.02180359698832035,
+ "step": 405
+ },
+ {
+ "epoch": 2.050632911392405,
+ "grad_norm": 0.04094229266047478,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.01960112899541855,
+ "step": 406
+ },
+ {
+ "epoch": 2.0556962025316454,
+ "grad_norm": 0.07398641109466553,
+ "learning_rate": 8.8327721661055e-05,
+ "loss": 0.02206597849726677,
+ "step": 407
+ },
+ {
+ "epoch": 2.060759493670886,
+ "grad_norm": 0.07659231871366501,
+ "learning_rate": 8.827160493827162e-05,
+ "loss": 0.019660351797938347,
+ "step": 408
+ },
+ {
+ "epoch": 2.0658227848101265,
+ "grad_norm": 0.05986466258764267,
+ "learning_rate": 8.821548821548821e-05,
+ "loss": 0.027121691033244133,
+ "step": 409
+ },
+ {
+ "epoch": 2.070886075949367,
+ "grad_norm": 0.03376661241054535,
+ "learning_rate": 8.815937149270484e-05,
+ "loss": 0.021059338003396988,
+ "step": 410
+ },
+ {
+ "epoch": 2.0759493670886076,
+ "grad_norm": 0.081104576587677,
+ "learning_rate": 8.810325476992143e-05,
+ "loss": 0.031228341162204742,
+ "step": 411
+ },
+ {
+ "epoch": 2.081012658227848,
+ "grad_norm": 0.04295242205262184,
+ "learning_rate": 8.804713804713806e-05,
+ "loss": 0.020738180726766586,
+ "step": 412
+ },
+ {
+ "epoch": 2.0860759493670886,
+ "grad_norm": 0.03715268895030022,
+ "learning_rate": 8.799102132435467e-05,
+ "loss": 0.018579209223389626,
+ "step": 413
+ },
+ {
+ "epoch": 2.091139240506329,
+ "grad_norm": 0.06769359856843948,
+ "learning_rate": 8.793490460157128e-05,
+ "loss": 0.026761794462800026,
+ "step": 414
+ },
+ {
+ "epoch": 2.0962025316455697,
+ "grad_norm": 0.03715744614601135,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.022879980504512787,
+ "step": 415
+ },
+ {
+ "epoch": 2.1012658227848102,
+ "grad_norm": 0.04305677488446236,
+ "learning_rate": 8.78226711560045e-05,
+ "loss": 0.022773049771785736,
+ "step": 416
+ },
+ {
+ "epoch": 2.1063291139240508,
+ "grad_norm": 0.0449112169444561,
+ "learning_rate": 8.776655443322111e-05,
+ "loss": 0.022499293088912964,
+ "step": 417
+ },
+ {
+ "epoch": 2.1113924050632913,
+ "grad_norm": 0.0457427054643631,
+ "learning_rate": 8.77104377104377e-05,
+ "loss": 0.024978693574666977,
+ "step": 418
+ },
+ {
+ "epoch": 2.116455696202532,
+ "grad_norm": 0.04705161228775978,
+ "learning_rate": 8.765432098765433e-05,
+ "loss": 0.024807877838611603,
+ "step": 419
+ },
+ {
+ "epoch": 2.1215189873417724,
+ "grad_norm": 0.04377812147140503,
+ "learning_rate": 8.759820426487092e-05,
+ "loss": 0.025857431814074516,
+ "step": 420
+ },
+ {
+ "epoch": 2.1265822784810124,
+ "grad_norm": 0.08598720282316208,
+ "learning_rate": 8.754208754208755e-05,
+ "loss": 0.021972455084323883,
+ "step": 421
+ },
+ {
+ "epoch": 2.131645569620253,
+ "grad_norm": 0.4669632017612457,
+ "learning_rate": 8.748597081930416e-05,
+ "loss": 0.02055199444293976,
+ "step": 422
+ },
+ {
+ "epoch": 2.1367088607594935,
+ "grad_norm": 0.05292733013629913,
+ "learning_rate": 8.742985409652077e-05,
+ "loss": 0.020852137356996536,
+ "step": 423
+ },
+ {
+ "epoch": 2.141772151898734,
+ "grad_norm": 0.05878116562962532,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.02444305270910263,
+ "step": 424
+ },
+ {
+ "epoch": 2.1468354430379746,
+ "grad_norm": 0.05234210565686226,
+ "learning_rate": 8.731762065095399e-05,
+ "loss": 0.02202335000038147,
+ "step": 425
+ },
+ {
+ "epoch": 2.151898734177215,
+ "grad_norm": 0.04706348851323128,
+ "learning_rate": 8.72615039281706e-05,
+ "loss": 0.019998187199234962,
+ "step": 426
+ },
+ {
+ "epoch": 2.1569620253164556,
+ "grad_norm": 0.05263376981019974,
+ "learning_rate": 8.720538720538721e-05,
+ "loss": 0.028126951307058334,
+ "step": 427
+ },
+ {
+ "epoch": 2.162025316455696,
+ "grad_norm": 0.062016960233449936,
+ "learning_rate": 8.714927048260382e-05,
+ "loss": 0.0286184661090374,
+ "step": 428
+ },
+ {
+ "epoch": 2.1670886075949367,
+ "grad_norm": 0.13798244297504425,
+ "learning_rate": 8.709315375982043e-05,
+ "loss": 0.026699248701334,
+ "step": 429
+ },
+ {
+ "epoch": 2.1721518987341772,
+ "grad_norm": 0.09159042686223984,
+ "learning_rate": 8.703703703703704e-05,
+ "loss": 0.025515643879771233,
+ "step": 430
+ },
+ {
+ "epoch": 2.1772151898734178,
+ "grad_norm": 0.0828855037689209,
+ "learning_rate": 8.698092031425365e-05,
+ "loss": 0.025481123477220535,
+ "step": 431
+ },
+ {
+ "epoch": 2.1822784810126583,
+ "grad_norm": 0.09840776771306992,
+ "learning_rate": 8.692480359147026e-05,
+ "loss": 0.020968927070498466,
+ "step": 432
+ },
+ {
+ "epoch": 2.187341772151899,
+ "grad_norm": 0.10999752581119537,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.028588412329554558,
+ "step": 433
+ },
+ {
+ "epoch": 2.1924050632911394,
+ "grad_norm": 0.06938561797142029,
+ "learning_rate": 8.681257014590348e-05,
+ "loss": 0.024119220674037933,
+ "step": 434
+ },
+ {
+ "epoch": 2.19746835443038,
+ "grad_norm": 0.054689887911081314,
+ "learning_rate": 8.67564534231201e-05,
+ "loss": 0.02173299714922905,
+ "step": 435
+ },
+ {
+ "epoch": 2.2025316455696204,
+ "grad_norm": 0.09605880081653595,
+ "learning_rate": 8.67003367003367e-05,
+ "loss": 0.02312455326318741,
+ "step": 436
+ },
+ {
+ "epoch": 2.207594936708861,
+ "grad_norm": 0.06863043457269669,
+ "learning_rate": 8.664421997755332e-05,
+ "loss": 0.020868321880698204,
+ "step": 437
+ },
+ {
+ "epoch": 2.212658227848101,
+ "grad_norm": 0.11743242293596268,
+ "learning_rate": 8.658810325476992e-05,
+ "loss": 0.029748965054750443,
+ "step": 438
+ },
+ {
+ "epoch": 2.2177215189873416,
+ "grad_norm": 0.08399086445569992,
+ "learning_rate": 8.653198653198653e-05,
+ "loss": 0.02379520982503891,
+ "step": 439
+ },
+ {
+ "epoch": 2.222784810126582,
+ "grad_norm": 0.052164461463689804,
+ "learning_rate": 8.647586980920315e-05,
+ "loss": 0.02010851353406906,
+ "step": 440
+ },
+ {
+ "epoch": 2.2278481012658227,
+ "grad_norm": 0.11834696680307388,
+ "learning_rate": 8.641975308641975e-05,
+ "loss": 0.02748255990445614,
+ "step": 441
+ },
+ {
+ "epoch": 2.232911392405063,
+ "grad_norm": 0.06718999892473221,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.026828233152627945,
+ "step": 442
+ },
+ {
+ "epoch": 2.2379746835443037,
+ "grad_norm": 0.042458854615688324,
+ "learning_rate": 8.630751964085297e-05,
+ "loss": 0.021280258893966675,
+ "step": 443
+ },
+ {
+ "epoch": 2.2430379746835443,
+ "grad_norm": 0.036516617983579636,
+ "learning_rate": 8.62514029180696e-05,
+ "loss": 0.021773381158709526,
+ "step": 444
+ },
+ {
+ "epoch": 2.248101265822785,
+ "grad_norm": 0.04317261651158333,
+ "learning_rate": 8.619528619528619e-05,
+ "loss": 0.022671079263091087,
+ "step": 445
+ },
+ {
+ "epoch": 2.2531645569620253,
+ "grad_norm": 0.08610037714242935,
+ "learning_rate": 8.613916947250281e-05,
+ "loss": 0.02425701916217804,
+ "step": 446
+ },
+ {
+ "epoch": 2.258227848101266,
+ "grad_norm": 0.03478290140628815,
+ "learning_rate": 8.608305274971942e-05,
+ "loss": 0.022291556000709534,
+ "step": 447
+ },
+ {
+ "epoch": 2.2632911392405064,
+ "grad_norm": 0.04682233929634094,
+ "learning_rate": 8.602693602693603e-05,
+ "loss": 0.02036888152360916,
+ "step": 448
+ },
+ {
+ "epoch": 2.268354430379747,
+ "grad_norm": 0.0808606892824173,
+ "learning_rate": 8.597081930415264e-05,
+ "loss": 0.025470012798905373,
+ "step": 449
+ },
+ {
+ "epoch": 2.2734177215189875,
+ "grad_norm": 0.042830612510442734,
+ "learning_rate": 8.591470258136925e-05,
+ "loss": 0.020565971732139587,
+ "step": 450
+ },
+ {
+ "epoch": 2.278481012658228,
+ "grad_norm": 0.06374406069517136,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031990330666303635,
+ "step": 451
+ },
+ {
+ "epoch": 2.2835443037974685,
+ "grad_norm": 0.05716697871685028,
+ "learning_rate": 8.580246913580247e-05,
+ "loss": 0.024125374853610992,
+ "step": 452
+ },
+ {
+ "epoch": 2.2886075949367086,
+ "grad_norm": 0.04057484492659569,
+ "learning_rate": 8.574635241301908e-05,
+ "loss": 0.021739482879638672,
+ "step": 453
+ },
+ {
+ "epoch": 2.293670886075949,
+ "grad_norm": 0.07754945009946823,
+ "learning_rate": 8.56902356902357e-05,
+ "loss": 0.02694481424987316,
+ "step": 454
+ },
+ {
+ "epoch": 2.2987341772151897,
+ "grad_norm": 0.06022442877292633,
+ "learning_rate": 8.56341189674523e-05,
+ "loss": 0.021221034228801727,
+ "step": 455
+ },
+ {
+ "epoch": 2.3037974683544302,
+ "grad_norm": 0.06909896433353424,
+ "learning_rate": 8.557800224466891e-05,
+ "loss": 0.02247895672917366,
+ "step": 456
+ },
+ {
+ "epoch": 2.3088607594936708,
+ "grad_norm": 0.05362236499786377,
+ "learning_rate": 8.552188552188552e-05,
+ "loss": 0.020700538530945778,
+ "step": 457
+ },
+ {
+ "epoch": 2.3139240506329113,
+ "grad_norm": 0.09836408495903015,
+ "learning_rate": 8.546576879910215e-05,
+ "loss": 0.02611887827515602,
+ "step": 458
+ },
+ {
+ "epoch": 2.318987341772152,
+ "grad_norm": 0.036625102162361145,
+ "learning_rate": 8.540965207631874e-05,
+ "loss": 0.0196938905864954,
+ "step": 459
+ },
+ {
+ "epoch": 2.3240506329113924,
+ "grad_norm": 0.07372298091650009,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.020545657724142075,
+ "step": 460
+ },
+ {
+ "epoch": 2.329113924050633,
+ "grad_norm": 0.20502988994121552,
+ "learning_rate": 8.529741863075196e-05,
+ "loss": 0.02884715050458908,
+ "step": 461
+ },
+ {
+ "epoch": 2.3341772151898734,
+ "grad_norm": 0.04867224395275116,
+ "learning_rate": 8.524130190796857e-05,
+ "loss": 0.019854716956615448,
+ "step": 462
+ },
+ {
+ "epoch": 2.339240506329114,
+ "grad_norm": 0.029550092294812202,
+ "learning_rate": 8.518518518518518e-05,
+ "loss": 0.01884104311466217,
+ "step": 463
+ },
+ {
+ "epoch": 2.3443037974683545,
+ "grad_norm": 0.04299351945519447,
+ "learning_rate": 8.51290684624018e-05,
+ "loss": 0.01954217068850994,
+ "step": 464
+ },
+ {
+ "epoch": 2.349367088607595,
+ "grad_norm": 0.043467242270708084,
+ "learning_rate": 8.507295173961842e-05,
+ "loss": 0.024274462834000587,
+ "step": 465
+ },
+ {
+ "epoch": 2.3544303797468356,
+ "grad_norm": 0.05131510645151138,
+ "learning_rate": 8.501683501683501e-05,
+ "loss": 0.026246599853038788,
+ "step": 466
+ },
+ {
+ "epoch": 2.359493670886076,
+ "grad_norm": 0.06280570477247238,
+ "learning_rate": 8.496071829405164e-05,
+ "loss": 0.024986159056425095,
+ "step": 467
+ },
+ {
+ "epoch": 2.3645569620253166,
+ "grad_norm": 0.04968208447098732,
+ "learning_rate": 8.490460157126824e-05,
+ "loss": 0.02912936732172966,
+ "step": 468
+ },
+ {
+ "epoch": 2.369620253164557,
+ "grad_norm": 0.08504039794206619,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.027097277343273163,
+ "step": 469
+ },
+ {
+ "epoch": 2.3746835443037977,
+ "grad_norm": 0.18385924398899078,
+ "learning_rate": 8.479236812570146e-05,
+ "loss": 0.02459462732076645,
+ "step": 470
+ },
+ {
+ "epoch": 2.379746835443038,
+ "grad_norm": 0.0663745328783989,
+ "learning_rate": 8.473625140291808e-05,
+ "loss": 0.020224973559379578,
+ "step": 471
+ },
+ {
+ "epoch": 2.3848101265822783,
+ "grad_norm": 0.04759671539068222,
+ "learning_rate": 8.468013468013468e-05,
+ "loss": 0.02591642364859581,
+ "step": 472
+ },
+ {
+ "epoch": 2.389873417721519,
+ "grad_norm": 0.044010091572999954,
+ "learning_rate": 8.46240179573513e-05,
+ "loss": 0.025122515857219696,
+ "step": 473
+ },
+ {
+ "epoch": 2.3949367088607594,
+ "grad_norm": 0.035054467618465424,
+ "learning_rate": 8.456790123456791e-05,
+ "loss": 0.019854065030813217,
+ "step": 474
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.03171153366565704,
+ "learning_rate": 8.451178451178452e-05,
+ "loss": 0.02009584940969944,
+ "step": 475
+ },
+ {
+ "epoch": 2.4050632911392404,
+ "grad_norm": 0.17388089001178741,
+ "learning_rate": 8.445566778900113e-05,
+ "loss": 0.02714207023382187,
+ "step": 476
+ },
+ {
+ "epoch": 2.410126582278481,
+ "grad_norm": 0.038392502814531326,
+ "learning_rate": 8.439955106621774e-05,
+ "loss": 0.020382478833198547,
+ "step": 477
+ },
+ {
+ "epoch": 2.4151898734177215,
+ "grad_norm": 0.04264051839709282,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.022726822644472122,
+ "step": 478
+ },
+ {
+ "epoch": 2.420253164556962,
+ "grad_norm": 0.046432014554739,
+ "learning_rate": 8.428731762065096e-05,
+ "loss": 0.021431483328342438,
+ "step": 479
+ },
+ {
+ "epoch": 2.4253164556962026,
+ "grad_norm": 0.07288242876529694,
+ "learning_rate": 8.423120089786757e-05,
+ "loss": 0.026229504495859146,
+ "step": 480
+ },
+ {
+ "epoch": 2.430379746835443,
+ "grad_norm": 0.04801097884774208,
+ "learning_rate": 8.417508417508418e-05,
+ "loss": 0.020924456417560577,
+ "step": 481
+ },
+ {
+ "epoch": 2.4354430379746836,
+ "grad_norm": 0.11201190203428268,
+ "learning_rate": 8.411896745230079e-05,
+ "loss": 0.022652529180049896,
+ "step": 482
+ },
+ {
+ "epoch": 2.440506329113924,
+ "grad_norm": 0.06151285395026207,
+ "learning_rate": 8.40628507295174e-05,
+ "loss": 0.02416859194636345,
+ "step": 483
+ },
+ {
+ "epoch": 2.4455696202531647,
+ "grad_norm": 0.04006446525454521,
+ "learning_rate": 8.400673400673401e-05,
+ "loss": 0.02390255406498909,
+ "step": 484
+ },
+ {
+ "epoch": 2.4506329113924052,
+ "grad_norm": 0.027193108573555946,
+ "learning_rate": 8.395061728395062e-05,
+ "loss": 0.015282701700925827,
+ "step": 485
+ },
+ {
+ "epoch": 2.4556962025316453,
+ "grad_norm": 0.05453994497656822,
+ "learning_rate": 8.389450056116723e-05,
+ "loss": 0.025738034397363663,
+ "step": 486
+ },
+ {
+ "epoch": 2.460759493670886,
+ "grad_norm": 0.03226681798696518,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.02111941948533058,
+ "step": 487
+ },
+ {
+ "epoch": 2.4658227848101264,
+ "grad_norm": 0.0451083667576313,
+ "learning_rate": 8.378226711560045e-05,
+ "loss": 0.020694585517048836,
+ "step": 488
+ },
+ {
+ "epoch": 2.470886075949367,
+ "grad_norm": 0.0390113927423954,
+ "learning_rate": 8.372615039281706e-05,
+ "loss": 0.022557765245437622,
+ "step": 489
+ },
+ {
+ "epoch": 2.4759493670886075,
+ "grad_norm": 0.05983779951930046,
+ "learning_rate": 8.367003367003367e-05,
+ "loss": 0.02489873766899109,
+ "step": 490
+ },
+ {
+ "epoch": 2.481012658227848,
+ "grad_norm": 0.03961458057165146,
+ "learning_rate": 8.361391694725028e-05,
+ "loss": 0.021655399352312088,
+ "step": 491
+ },
+ {
+ "epoch": 2.4860759493670885,
+ "grad_norm": 0.03814523667097092,
+ "learning_rate": 8.35578002244669e-05,
+ "loss": 0.02217719703912735,
+ "step": 492
+ },
+ {
+ "epoch": 2.491139240506329,
+ "grad_norm": 0.030563514679670334,
+ "learning_rate": 8.35016835016835e-05,
+ "loss": 0.01679009571671486,
+ "step": 493
+ },
+ {
+ "epoch": 2.4962025316455696,
+ "grad_norm": 0.04566824436187744,
+ "learning_rate": 8.344556677890012e-05,
+ "loss": 0.019699417054653168,
+ "step": 494
+ },
+ {
+ "epoch": 2.50126582278481,
+ "grad_norm": 0.06117499992251396,
+ "learning_rate": 8.338945005611672e-05,
+ "loss": 0.028571851551532745,
+ "step": 495
+ },
+ {
+ "epoch": 2.5063291139240507,
+ "grad_norm": 0.03510760888457298,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.023387223482131958,
+ "step": 496
+ },
+ {
+ "epoch": 2.511392405063291,
+ "grad_norm": 0.028878437355160713,
+ "learning_rate": 8.327721661054994e-05,
+ "loss": 0.023329850286245346,
+ "step": 497
+ },
+ {
+ "epoch": 2.5164556962025317,
+ "grad_norm": 0.02818676456809044,
+ "learning_rate": 8.322109988776656e-05,
+ "loss": 0.017786618322134018,
+ "step": 498
+ },
+ {
+ "epoch": 2.5215189873417723,
+ "grad_norm": 0.06660276651382446,
+ "learning_rate": 8.316498316498317e-05,
+ "loss": 0.023636367172002792,
+ "step": 499
+ },
+ {
+ "epoch": 2.526582278481013,
+ "grad_norm": 0.05663186311721802,
+ "learning_rate": 8.310886644219978e-05,
+ "loss": 0.02607567049562931,
+ "step": 500
+ },
+ {
+ "epoch": 2.5316455696202533,
+ "grad_norm": 0.04156090319156647,
+ "learning_rate": 8.30527497194164e-05,
+ "loss": 0.024936942383646965,
+ "step": 501
+ },
+ {
+ "epoch": 2.536708860759494,
+ "grad_norm": 0.036135219037532806,
+ "learning_rate": 8.2996632996633e-05,
+ "loss": 0.023583384230732918,
+ "step": 502
+ },
+ {
+ "epoch": 2.5417721518987344,
+ "grad_norm": 0.052026644349098206,
+ "learning_rate": 8.294051627384961e-05,
+ "loss": 0.02324807643890381,
+ "step": 503
+ },
+ {
+ "epoch": 2.546835443037975,
+ "grad_norm": 0.03599514439702034,
+ "learning_rate": 8.288439955106621e-05,
+ "loss": 0.01879853755235672,
+ "step": 504
+ },
+ {
+ "epoch": 2.5518987341772155,
+ "grad_norm": 0.03505280241370201,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.017342131584882736,
+ "step": 505
+ },
+ {
+ "epoch": 2.5569620253164556,
+ "grad_norm": 0.0403706431388855,
+ "learning_rate": 8.277216610549943e-05,
+ "loss": 0.02082991972565651,
+ "step": 506
+ },
+ {
+ "epoch": 2.562025316455696,
+ "grad_norm": 0.031072309240698814,
+ "learning_rate": 8.271604938271605e-05,
+ "loss": 0.01711331121623516,
+ "step": 507
+ },
+ {
+ "epoch": 2.5670886075949366,
+ "grad_norm": 0.04118587449193001,
+ "learning_rate": 8.265993265993266e-05,
+ "loss": 0.01940922439098358,
+ "step": 508
+ },
+ {
+ "epoch": 2.572151898734177,
+ "grad_norm": 0.039908040314912796,
+ "learning_rate": 8.260381593714927e-05,
+ "loss": 0.021229952573776245,
+ "step": 509
+ },
+ {
+ "epoch": 2.5772151898734177,
+ "grad_norm": 0.02886618860065937,
+ "learning_rate": 8.254769921436589e-05,
+ "loss": 0.02004890888929367,
+ "step": 510
+ },
+ {
+ "epoch": 2.5822784810126582,
+ "grad_norm": 0.04229263588786125,
+ "learning_rate": 8.24915824915825e-05,
+ "loss": 0.019512392580509186,
+ "step": 511
+ },
+ {
+ "epoch": 2.5873417721518988,
+ "grad_norm": 0.030951635912060738,
+ "learning_rate": 8.24354657687991e-05,
+ "loss": 0.01836536079645157,
+ "step": 512
+ },
+ {
+ "epoch": 2.5924050632911393,
+ "grad_norm": 0.057054903358221054,
+ "learning_rate": 8.237934904601572e-05,
+ "loss": 0.028897594660520554,
+ "step": 513
+ },
+ {
+ "epoch": 2.59746835443038,
+ "grad_norm": 0.10734204202890396,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.024986904114484787,
+ "step": 514
+ },
+ {
+ "epoch": 2.6025316455696204,
+ "grad_norm": 0.029653102159500122,
+ "learning_rate": 8.226711560044894e-05,
+ "loss": 0.02242947742342949,
+ "step": 515
+ },
+ {
+ "epoch": 2.607594936708861,
+ "grad_norm": 0.05601462349295616,
+ "learning_rate": 8.221099887766555e-05,
+ "loss": 0.020091768354177475,
+ "step": 516
+ },
+ {
+ "epoch": 2.6126582278481014,
+ "grad_norm": 0.04170191287994385,
+ "learning_rate": 8.215488215488217e-05,
+ "loss": 0.021796470507979393,
+ "step": 517
+ },
+ {
+ "epoch": 2.6177215189873415,
+ "grad_norm": 0.06347091495990753,
+ "learning_rate": 8.209876543209877e-05,
+ "loss": 0.024338826537132263,
+ "step": 518
+ },
+ {
+ "epoch": 2.622784810126582,
+ "grad_norm": 0.06084204465150833,
+ "learning_rate": 8.204264870931539e-05,
+ "loss": 0.02493124082684517,
+ "step": 519
+ },
+ {
+ "epoch": 2.6278481012658226,
+ "grad_norm": 0.03094005584716797,
+ "learning_rate": 8.198653198653199e-05,
+ "loss": 0.021345658227801323,
+ "step": 520
+ },
+ {
+ "epoch": 2.632911392405063,
+ "grad_norm": 0.04017730429768562,
+ "learning_rate": 8.193041526374861e-05,
+ "loss": 0.019823770970106125,
+ "step": 521
+ },
+ {
+ "epoch": 2.6379746835443036,
+ "grad_norm": 0.045351576060056686,
+ "learning_rate": 8.18742985409652e-05,
+ "loss": 0.02385132387280464,
+ "step": 522
+ },
+ {
+ "epoch": 2.643037974683544,
+ "grad_norm": 0.04823896288871765,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.021753432229161263,
+ "step": 523
+ },
+ {
+ "epoch": 2.6481012658227847,
+ "grad_norm": 0.0442446693778038,
+ "learning_rate": 8.176206509539843e-05,
+ "loss": 0.022134695202112198,
+ "step": 524
+ },
+ {
+ "epoch": 2.6531645569620252,
+ "grad_norm": 0.07998359203338623,
+ "learning_rate": 8.170594837261504e-05,
+ "loss": 0.021159570664167404,
+ "step": 525
+ },
+ {
+ "epoch": 2.6582278481012658,
+ "grad_norm": 0.07844395190477371,
+ "learning_rate": 8.164983164983166e-05,
+ "loss": 0.023695990443229675,
+ "step": 526
+ },
+ {
+ "epoch": 2.6632911392405063,
+ "grad_norm": 0.025296518579125404,
+ "learning_rate": 8.159371492704826e-05,
+ "loss": 0.020914766937494278,
+ "step": 527
+ },
+ {
+ "epoch": 2.668354430379747,
+ "grad_norm": 0.337454617023468,
+ "learning_rate": 8.153759820426488e-05,
+ "loss": 0.02948678657412529,
+ "step": 528
+ },
+ {
+ "epoch": 2.6734177215189874,
+ "grad_norm": 0.03531114012002945,
+ "learning_rate": 8.148148148148148e-05,
+ "loss": 0.020608587190508842,
+ "step": 529
+ },
+ {
+ "epoch": 2.678481012658228,
+ "grad_norm": 0.0496559739112854,
+ "learning_rate": 8.14253647586981e-05,
+ "loss": 0.023600757122039795,
+ "step": 530
+ },
+ {
+ "epoch": 2.6835443037974684,
+ "grad_norm": 0.04093128815293312,
+ "learning_rate": 8.13692480359147e-05,
+ "loss": 0.022392068058252335,
+ "step": 531
+ },
+ {
+ "epoch": 2.688607594936709,
+ "grad_norm": 0.05343819782137871,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.01882098615169525,
+ "step": 532
+ },
+ {
+ "epoch": 2.6936708860759495,
+ "grad_norm": 0.0334453359246254,
+ "learning_rate": 8.125701459034793e-05,
+ "loss": 0.020492104813456535,
+ "step": 533
+ },
+ {
+ "epoch": 2.69873417721519,
+ "grad_norm": 0.045540470629930496,
+ "learning_rate": 8.120089786756454e-05,
+ "loss": 0.021309707313776016,
+ "step": 534
+ },
+ {
+ "epoch": 2.7037974683544306,
+ "grad_norm": 0.03238926827907562,
+ "learning_rate": 8.114478114478115e-05,
+ "loss": 0.01929772086441517,
+ "step": 535
+ },
+ {
+ "epoch": 2.708860759493671,
+ "grad_norm": 0.10985280573368073,
+ "learning_rate": 8.108866442199776e-05,
+ "loss": 0.02431013062596321,
+ "step": 536
+ },
+ {
+ "epoch": 2.7139240506329116,
+ "grad_norm": 0.039785534143447876,
+ "learning_rate": 8.103254769921437e-05,
+ "loss": 0.022708022966980934,
+ "step": 537
+ },
+ {
+ "epoch": 2.7189873417721517,
+ "grad_norm": 0.06239910051226616,
+ "learning_rate": 8.097643097643098e-05,
+ "loss": 0.02715257555246353,
+ "step": 538
+ },
+ {
+ "epoch": 2.7240506329113923,
+ "grad_norm": 0.03662843257188797,
+ "learning_rate": 8.092031425364759e-05,
+ "loss": 0.024876421317458153,
+ "step": 539
+ },
+ {
+ "epoch": 2.729113924050633,
+ "grad_norm": 0.05869411304593086,
+ "learning_rate": 8.08641975308642e-05,
+ "loss": 0.022937750443816185,
+ "step": 540
+ },
+ {
+ "epoch": 2.7341772151898733,
+ "grad_norm": 0.07220412790775299,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02227093279361725,
+ "step": 541
+ },
+ {
+ "epoch": 2.739240506329114,
+ "grad_norm": 0.03881363570690155,
+ "learning_rate": 8.075196408529742e-05,
+ "loss": 0.020784813910722733,
+ "step": 542
+ },
+ {
+ "epoch": 2.7443037974683544,
+ "grad_norm": 0.04756273329257965,
+ "learning_rate": 8.069584736251403e-05,
+ "loss": 0.02334344945847988,
+ "step": 543
+ },
+ {
+ "epoch": 2.749367088607595,
+ "grad_norm": 0.05327540263533592,
+ "learning_rate": 8.063973063973065e-05,
+ "loss": 0.026313351467251778,
+ "step": 544
+ },
+ {
+ "epoch": 2.7544303797468355,
+ "grad_norm": 0.1605764925479889,
+ "learning_rate": 8.058361391694725e-05,
+ "loss": 0.02474561519920826,
+ "step": 545
+ },
+ {
+ "epoch": 2.759493670886076,
+ "grad_norm": 0.044486165046691895,
+ "learning_rate": 8.052749719416387e-05,
+ "loss": 0.023557808250188828,
+ "step": 546
+ },
+ {
+ "epoch": 2.7645569620253165,
+ "grad_norm": 0.04645116999745369,
+ "learning_rate": 8.047138047138047e-05,
+ "loss": 0.017340417951345444,
+ "step": 547
+ },
+ {
+ "epoch": 2.769620253164557,
+ "grad_norm": 0.04009381681680679,
+ "learning_rate": 8.041526374859708e-05,
+ "loss": 0.018324140459299088,
+ "step": 548
+ },
+ {
+ "epoch": 2.7746835443037976,
+ "grad_norm": 0.12476589530706406,
+ "learning_rate": 8.035914702581369e-05,
+ "loss": 0.023337965831160545,
+ "step": 549
+ },
+ {
+ "epoch": 2.779746835443038,
+ "grad_norm": 0.04257349297404289,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.021878249943256378,
+ "step": 550
+ },
+ {
+ "epoch": 2.7848101265822782,
+ "grad_norm": 0.044377341866493225,
+ "learning_rate": 8.024691358024692e-05,
+ "loss": 0.019643619656562805,
+ "step": 551
+ },
+ {
+ "epoch": 2.7898734177215188,
+ "grad_norm": 0.0801771879196167,
+ "learning_rate": 8.019079685746352e-05,
+ "loss": 0.021452955901622772,
+ "step": 552
+ },
+ {
+ "epoch": 2.7949367088607593,
+ "grad_norm": 0.04462383687496185,
+ "learning_rate": 8.013468013468015e-05,
+ "loss": 0.02363801747560501,
+ "step": 553
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.05768737941980362,
+ "learning_rate": 8.007856341189674e-05,
+ "loss": 0.03572218120098114,
+ "step": 554
+ },
+ {
+ "epoch": 2.8050632911392404,
+ "grad_norm": 0.03812364116311073,
+ "learning_rate": 8.002244668911337e-05,
+ "loss": 0.01964751072227955,
+ "step": 555
+ },
+ {
+ "epoch": 2.810126582278481,
+ "grad_norm": 0.03297588974237442,
+ "learning_rate": 7.996632996632996e-05,
+ "loss": 0.019139982759952545,
+ "step": 556
+ },
+ {
+ "epoch": 2.8151898734177214,
+ "grad_norm": 0.024627596139907837,
+ "learning_rate": 7.991021324354659e-05,
+ "loss": 0.021029513329267502,
+ "step": 557
+ },
+ {
+ "epoch": 2.820253164556962,
+ "grad_norm": 0.058927983045578,
+ "learning_rate": 7.985409652076318e-05,
+ "loss": 0.03308084234595299,
+ "step": 558
+ },
+ {
+ "epoch": 2.8253164556962025,
+ "grad_norm": 0.11811497062444687,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.028271127492189407,
+ "step": 559
+ },
+ {
+ "epoch": 2.830379746835443,
+ "grad_norm": 0.043665409088134766,
+ "learning_rate": 7.974186307519642e-05,
+ "loss": 0.02708129584789276,
+ "step": 560
+ },
+ {
+ "epoch": 2.8354430379746836,
+ "grad_norm": 0.034729309380054474,
+ "learning_rate": 7.968574635241303e-05,
+ "loss": 0.023845072835683823,
+ "step": 561
+ },
+ {
+ "epoch": 2.840506329113924,
+ "grad_norm": 0.028991155326366425,
+ "learning_rate": 7.962962962962964e-05,
+ "loss": 0.018426496535539627,
+ "step": 562
+ },
+ {
+ "epoch": 2.8455696202531646,
+ "grad_norm": 0.04660327732563019,
+ "learning_rate": 7.957351290684625e-05,
+ "loss": 0.02610144019126892,
+ "step": 563
+ },
+ {
+ "epoch": 2.850632911392405,
+ "grad_norm": 0.03947063535451889,
+ "learning_rate": 7.951739618406286e-05,
+ "loss": 0.025909483432769775,
+ "step": 564
+ },
+ {
+ "epoch": 2.8556962025316457,
+ "grad_norm": 0.06056501716375351,
+ "learning_rate": 7.946127946127947e-05,
+ "loss": 0.030405592173337936,
+ "step": 565
+ },
+ {
+ "epoch": 2.8607594936708862,
+ "grad_norm": 0.03398960456252098,
+ "learning_rate": 7.940516273849608e-05,
+ "loss": 0.02486085705459118,
+ "step": 566
+ },
+ {
+ "epoch": 2.8658227848101268,
+ "grad_norm": 0.03136906027793884,
+ "learning_rate": 7.934904601571269e-05,
+ "loss": 0.020573778077960014,
+ "step": 567
+ },
+ {
+ "epoch": 2.8708860759493673,
+ "grad_norm": 0.03404523804783821,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.021034879609942436,
+ "step": 568
+ },
+ {
+ "epoch": 2.875949367088608,
+ "grad_norm": 0.02937588468194008,
+ "learning_rate": 7.92368125701459e-05,
+ "loss": 0.02275373972952366,
+ "step": 569
+ },
+ {
+ "epoch": 2.8810126582278484,
+ "grad_norm": 0.03971172124147415,
+ "learning_rate": 7.918069584736252e-05,
+ "loss": 0.021558552980422974,
+ "step": 570
+ },
+ {
+ "epoch": 2.8860759493670884,
+ "grad_norm": 0.05636494606733322,
+ "learning_rate": 7.912457912457913e-05,
+ "loss": 0.025583568960428238,
+ "step": 571
+ },
+ {
+ "epoch": 2.891139240506329,
+ "grad_norm": 0.2013683319091797,
+ "learning_rate": 7.906846240179574e-05,
+ "loss": 0.025386696681380272,
+ "step": 572
+ },
+ {
+ "epoch": 2.8962025316455695,
+ "grad_norm": 0.05875328183174133,
+ "learning_rate": 7.901234567901235e-05,
+ "loss": 0.023778585717082024,
+ "step": 573
+ },
+ {
+ "epoch": 2.90126582278481,
+ "grad_norm": 0.031178263947367668,
+ "learning_rate": 7.895622895622896e-05,
+ "loss": 0.02130977436900139,
+ "step": 574
+ },
+ {
+ "epoch": 2.9063291139240506,
+ "grad_norm": 0.028125282377004623,
+ "learning_rate": 7.890011223344557e-05,
+ "loss": 0.023941578343510628,
+ "step": 575
+ },
+ {
+ "epoch": 2.911392405063291,
+ "grad_norm": 0.03701331466436386,
+ "learning_rate": 7.884399551066218e-05,
+ "loss": 0.01856887713074684,
+ "step": 576
+ },
+ {
+ "epoch": 2.9164556962025316,
+ "grad_norm": 0.05281993746757507,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.023393619805574417,
+ "step": 577
+ },
+ {
+ "epoch": 2.921518987341772,
+ "grad_norm": 0.03958812728524208,
+ "learning_rate": 7.873176206509541e-05,
+ "loss": 0.019871000200510025,
+ "step": 578
+ },
+ {
+ "epoch": 2.9265822784810127,
+ "grad_norm": 0.0439714752137661,
+ "learning_rate": 7.867564534231201e-05,
+ "loss": 0.025316016748547554,
+ "step": 579
+ },
+ {
+ "epoch": 2.9316455696202532,
+ "grad_norm": 0.03543296083807945,
+ "learning_rate": 7.861952861952863e-05,
+ "loss": 0.022549735382199287,
+ "step": 580
+ },
+ {
+ "epoch": 2.9367088607594938,
+ "grad_norm": 0.05503656715154648,
+ "learning_rate": 7.856341189674523e-05,
+ "loss": 0.02716357260942459,
+ "step": 581
+ },
+ {
+ "epoch": 2.9417721518987343,
+ "grad_norm": 0.03273561969399452,
+ "learning_rate": 7.850729517396185e-05,
+ "loss": 0.017606684938073158,
+ "step": 582
+ },
+ {
+ "epoch": 2.946835443037975,
+ "grad_norm": 0.04668378457427025,
+ "learning_rate": 7.845117845117845e-05,
+ "loss": 0.022529952228069305,
+ "step": 583
+ },
+ {
+ "epoch": 2.951898734177215,
+ "grad_norm": 0.034348756074905396,
+ "learning_rate": 7.839506172839507e-05,
+ "loss": 0.02549612522125244,
+ "step": 584
+ },
+ {
+ "epoch": 2.9569620253164555,
+ "grad_norm": 0.03485729172825813,
+ "learning_rate": 7.833894500561168e-05,
+ "loss": 0.019362375140190125,
+ "step": 585
+ },
+ {
+ "epoch": 2.962025316455696,
+ "grad_norm": 0.034695904701948166,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.023550841957330704,
+ "step": 586
+ },
+ {
+ "epoch": 2.9670886075949365,
+ "grad_norm": 0.02703205682337284,
+ "learning_rate": 7.82267115600449e-05,
+ "loss": 0.016860410571098328,
+ "step": 587
+ },
+ {
+ "epoch": 2.972151898734177,
+ "grad_norm": 0.0694100558757782,
+ "learning_rate": 7.817059483726151e-05,
+ "loss": 0.02669605240225792,
+ "step": 588
+ },
+ {
+ "epoch": 2.9772151898734176,
+ "grad_norm": 0.02641797810792923,
+ "learning_rate": 7.811447811447812e-05,
+ "loss": 0.019620027393102646,
+ "step": 589
+ },
+ {
+ "epoch": 2.982278481012658,
+ "grad_norm": 0.03643452376127243,
+ "learning_rate": 7.805836139169473e-05,
+ "loss": 0.018797604367136955,
+ "step": 590
+ },
+ {
+ "epoch": 2.9873417721518987,
+ "grad_norm": 0.04125158116221428,
+ "learning_rate": 7.800224466891134e-05,
+ "loss": 0.020387161523103714,
+ "step": 591
+ },
+ {
+ "epoch": 2.992405063291139,
+ "grad_norm": 0.037161167711019516,
+ "learning_rate": 7.794612794612795e-05,
+ "loss": 0.02484878897666931,
+ "step": 592
+ },
+ {
+ "epoch": 2.9974683544303797,
+ "grad_norm": 0.03352266550064087,
+ "learning_rate": 7.789001122334456e-05,
+ "loss": 0.022045889869332314,
+ "step": 593
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.07333379238843918,
+ "learning_rate": 7.783389450056117e-05,
+ "loss": 0.025806350633502007,
+ "step": 594
+ },
+ {
+ "epoch": 3.0050632911392405,
+ "grad_norm": 0.05492037162184715,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.025387149304151535,
+ "step": 595
+ },
+ {
+ "epoch": 3.010126582278481,
+ "grad_norm": 0.03932039067149162,
+ "learning_rate": 7.772166105499439e-05,
+ "loss": 0.020961906760931015,
+ "step": 596
+ },
+ {
+ "epoch": 3.0151898734177216,
+ "grad_norm": 0.03346814960241318,
+ "learning_rate": 7.7665544332211e-05,
+ "loss": 0.018602946773171425,
+ "step": 597
+ },
+ {
+ "epoch": 3.020253164556962,
+ "grad_norm": 0.041588157415390015,
+ "learning_rate": 7.760942760942761e-05,
+ "loss": 0.02350936457514763,
+ "step": 598
+ },
+ {
+ "epoch": 3.0253164556962027,
+ "grad_norm": 0.0634593740105629,
+ "learning_rate": 7.755331088664422e-05,
+ "loss": 0.02807607129216194,
+ "step": 599
+ },
+ {
+ "epoch": 3.030379746835443,
+ "grad_norm": 0.037369582802057266,
+ "learning_rate": 7.749719416386083e-05,
+ "loss": 0.01987743005156517,
+ "step": 600
+ },
+ {
+ "epoch": 3.0354430379746837,
+ "grad_norm": 0.051795534789562225,
+ "learning_rate": 7.744107744107744e-05,
+ "loss": 0.02273828536272049,
+ "step": 601
+ },
+ {
+ "epoch": 3.0405063291139243,
+ "grad_norm": 0.06508016586303711,
+ "learning_rate": 7.738496071829405e-05,
+ "loss": 0.022526375949382782,
+ "step": 602
+ },
+ {
+ "epoch": 3.0455696202531644,
+ "grad_norm": 0.05076521635055542,
+ "learning_rate": 7.732884399551068e-05,
+ "loss": 0.030540699139237404,
+ "step": 603
+ },
+ {
+ "epoch": 3.050632911392405,
+ "grad_norm": 0.05223327502608299,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.025222979485988617,
+ "step": 604
+ },
+ {
+ "epoch": 3.0556962025316454,
+ "grad_norm": 0.040298622101545334,
+ "learning_rate": 7.72166105499439e-05,
+ "loss": 0.024349395185709,
+ "step": 605
+ },
+ {
+ "epoch": 3.060759493670886,
+ "grad_norm": 0.031546592712402344,
+ "learning_rate": 7.716049382716049e-05,
+ "loss": 0.022118842229247093,
+ "step": 606
+ },
+ {
+ "epoch": 3.0658227848101265,
+ "grad_norm": 0.03639276325702667,
+ "learning_rate": 7.710437710437712e-05,
+ "loss": 0.019809089601039886,
+ "step": 607
+ },
+ {
+ "epoch": 3.070886075949367,
+ "grad_norm": 0.03702636435627937,
+ "learning_rate": 7.704826038159371e-05,
+ "loss": 0.023927533999085426,
+ "step": 608
+ },
+ {
+ "epoch": 3.0759493670886076,
+ "grad_norm": 0.027585966512560844,
+ "learning_rate": 7.699214365881034e-05,
+ "loss": 0.017853228375315666,
+ "step": 609
+ },
+ {
+ "epoch": 3.081012658227848,
+ "grad_norm": 0.036372315138578415,
+ "learning_rate": 7.693602693602693e-05,
+ "loss": 0.027036674320697784,
+ "step": 610
+ },
+ {
+ "epoch": 3.0860759493670886,
+ "grad_norm": 0.03734718635678291,
+ "learning_rate": 7.687991021324356e-05,
+ "loss": 0.021930409595370293,
+ "step": 611
+ },
+ {
+ "epoch": 3.091139240506329,
+ "grad_norm": 0.04167135804891586,
+ "learning_rate": 7.682379349046017e-05,
+ "loss": 0.02211524173617363,
+ "step": 612
+ },
+ {
+ "epoch": 3.0962025316455697,
+ "grad_norm": 0.06541049480438232,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.02102654054760933,
+ "step": 613
+ },
+ {
+ "epoch": 3.1012658227848102,
+ "grad_norm": 0.03505360335111618,
+ "learning_rate": 7.671156004489339e-05,
+ "loss": 0.021799035370349884,
+ "step": 614
+ },
+ {
+ "epoch": 3.1063291139240508,
+ "grad_norm": 0.038781505078077316,
+ "learning_rate": 7.665544332210998e-05,
+ "loss": 0.020275672897696495,
+ "step": 615
+ },
+ {
+ "epoch": 3.1113924050632913,
+ "grad_norm": 0.05527551844716072,
+ "learning_rate": 7.65993265993266e-05,
+ "loss": 0.02752656675875187,
+ "step": 616
+ },
+ {
+ "epoch": 3.116455696202532,
+ "grad_norm": 0.092417873442173,
+ "learning_rate": 7.65432098765432e-05,
+ "loss": 0.034416262060403824,
+ "step": 617
+ },
+ {
+ "epoch": 3.1215189873417724,
+ "grad_norm": 0.04619184136390686,
+ "learning_rate": 7.648709315375983e-05,
+ "loss": 0.028675489127635956,
+ "step": 618
+ },
+ {
+ "epoch": 3.1265822784810124,
+ "grad_norm": 0.027103425934910774,
+ "learning_rate": 7.643097643097644e-05,
+ "loss": 0.01944906637072563,
+ "step": 619
+ },
+ {
+ "epoch": 3.131645569620253,
+ "grad_norm": 0.062025271356105804,
+ "learning_rate": 7.637485970819305e-05,
+ "loss": 0.030966270714998245,
+ "step": 620
+ },
+ {
+ "epoch": 3.1367088607594935,
+ "grad_norm": 0.029828928411006927,
+ "learning_rate": 7.631874298540966e-05,
+ "loss": 0.02199825644493103,
+ "step": 621
+ },
+ {
+ "epoch": 3.141772151898734,
+ "grad_norm": 0.029867300763726234,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.02649630233645439,
+ "step": 622
+ },
+ {
+ "epoch": 3.1468354430379746,
+ "grad_norm": 0.055938251316547394,
+ "learning_rate": 7.620650953984288e-05,
+ "loss": 0.03135379031300545,
+ "step": 623
+ },
+ {
+ "epoch": 3.151898734177215,
+ "grad_norm": 0.035160645842552185,
+ "learning_rate": 7.615039281705949e-05,
+ "loss": 0.025492198765277863,
+ "step": 624
+ },
+ {
+ "epoch": 3.1569620253164556,
+ "grad_norm": 0.0550227165222168,
+ "learning_rate": 7.60942760942761e-05,
+ "loss": 0.024527709931135178,
+ "step": 625
+ },
+ {
+ "epoch": 3.162025316455696,
+ "grad_norm": 0.045406773686409,
+ "learning_rate": 7.603815937149271e-05,
+ "loss": 0.021749500185251236,
+ "step": 626
+ },
+ {
+ "epoch": 3.1670886075949367,
+ "grad_norm": 0.03407207131385803,
+ "learning_rate": 7.598204264870932e-05,
+ "loss": 0.022218957543373108,
+ "step": 627
+ },
+ {
+ "epoch": 3.1721518987341772,
+ "grad_norm": 0.07292751222848892,
+ "learning_rate": 7.592592592592593e-05,
+ "loss": 0.027731608599424362,
+ "step": 628
+ },
+ {
+ "epoch": 3.1772151898734178,
+ "grad_norm": 0.05087915435433388,
+ "learning_rate": 7.586980920314254e-05,
+ "loss": 0.025174522772431374,
+ "step": 629
+ },
+ {
+ "epoch": 3.1822784810126583,
+ "grad_norm": 0.03146078437566757,
+ "learning_rate": 7.581369248035916e-05,
+ "loss": 0.023854102939367294,
+ "step": 630
+ },
+ {
+ "epoch": 3.187341772151899,
+ "grad_norm": 0.03517632558941841,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.021264635026454926,
+ "step": 631
+ },
+ {
+ "epoch": 3.1924050632911394,
+ "grad_norm": 0.0355447381734848,
+ "learning_rate": 7.570145903479238e-05,
+ "loss": 0.023219801485538483,
+ "step": 632
+ },
+ {
+ "epoch": 3.19746835443038,
+ "grad_norm": 0.03751067817211151,
+ "learning_rate": 7.564534231200898e-05,
+ "loss": 0.02329118922352791,
+ "step": 633
+ },
+ {
+ "epoch": 3.2025316455696204,
+ "grad_norm": 0.03923696279525757,
+ "learning_rate": 7.558922558922559e-05,
+ "loss": 0.025390561670064926,
+ "step": 634
+ },
+ {
+ "epoch": 3.207594936708861,
+ "grad_norm": 0.03601266071200371,
+ "learning_rate": 7.55331088664422e-05,
+ "loss": 0.02001899480819702,
+ "step": 635
+ },
+ {
+ "epoch": 3.212658227848101,
+ "grad_norm": 0.032203998416662216,
+ "learning_rate": 7.547699214365881e-05,
+ "loss": 0.022725094109773636,
+ "step": 636
+ },
+ {
+ "epoch": 3.2177215189873416,
+ "grad_norm": 0.040842000395059586,
+ "learning_rate": 7.542087542087543e-05,
+ "loss": 0.021683380007743835,
+ "step": 637
+ },
+ {
+ "epoch": 3.222784810126582,
+ "grad_norm": 0.03078434057533741,
+ "learning_rate": 7.536475869809203e-05,
+ "loss": 0.02051977440714836,
+ "step": 638
+ },
+ {
+ "epoch": 3.2278481012658227,
+ "grad_norm": 0.025937417522072792,
+ "learning_rate": 7.530864197530865e-05,
+ "loss": 0.01884596049785614,
+ "step": 639
+ },
+ {
+ "epoch": 3.232911392405063,
+ "grad_norm": 0.0464826263487339,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.018389636650681496,
+ "step": 640
+ },
+ {
+ "epoch": 3.2379746835443037,
+ "grad_norm": 0.04150732606649399,
+ "learning_rate": 7.519640852974187e-05,
+ "loss": 0.020952530205249786,
+ "step": 641
+ },
+ {
+ "epoch": 3.2430379746835443,
+ "grad_norm": 0.04317227005958557,
+ "learning_rate": 7.514029180695847e-05,
+ "loss": 0.024093877524137497,
+ "step": 642
+ },
+ {
+ "epoch": 3.248101265822785,
+ "grad_norm": 0.04621734470129013,
+ "learning_rate": 7.508417508417509e-05,
+ "loss": 0.029940858483314514,
+ "step": 643
+ },
+ {
+ "epoch": 3.2531645569620253,
+ "grad_norm": 0.03514556586742401,
+ "learning_rate": 7.50280583613917e-05,
+ "loss": 0.022350966930389404,
+ "step": 644
+ },
+ {
+ "epoch": 3.258227848101266,
+ "grad_norm": 0.025245223194360733,
+ "learning_rate": 7.497194163860831e-05,
+ "loss": 0.018291346728801727,
+ "step": 645
+ },
+ {
+ "epoch": 3.2632911392405064,
+ "grad_norm": 0.02498617395758629,
+ "learning_rate": 7.491582491582492e-05,
+ "loss": 0.01909235306084156,
+ "step": 646
+ },
+ {
+ "epoch": 3.268354430379747,
+ "grad_norm": 0.022831663489341736,
+ "learning_rate": 7.485970819304153e-05,
+ "loss": 0.01462332159280777,
+ "step": 647
+ },
+ {
+ "epoch": 3.2734177215189875,
+ "grad_norm": 0.03779070824384689,
+ "learning_rate": 7.480359147025814e-05,
+ "loss": 0.019472766667604446,
+ "step": 648
+ },
+ {
+ "epoch": 3.278481012658228,
+ "grad_norm": 0.030341917648911476,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.018727967515587807,
+ "step": 649
+ },
+ {
+ "epoch": 3.2835443037974685,
+ "grad_norm": 0.045589644461870193,
+ "learning_rate": 7.469135802469136e-05,
+ "loss": 0.023640938103199005,
+ "step": 650
+ },
+ {
+ "epoch": 3.2886075949367086,
+ "grad_norm": 0.023883633315563202,
+ "learning_rate": 7.463524130190797e-05,
+ "loss": 0.019227800890803337,
+ "step": 651
+ },
+ {
+ "epoch": 3.293670886075949,
+ "grad_norm": 0.03794898837804794,
+ "learning_rate": 7.457912457912458e-05,
+ "loss": 0.02445095032453537,
+ "step": 652
+ },
+ {
+ "epoch": 3.2987341772151897,
+ "grad_norm": 0.1442285180091858,
+ "learning_rate": 7.452300785634119e-05,
+ "loss": 0.023129010573029518,
+ "step": 653
+ },
+ {
+ "epoch": 3.3037974683544302,
+ "grad_norm": 0.03197013959288597,
+ "learning_rate": 7.44668911335578e-05,
+ "loss": 0.02768155373632908,
+ "step": 654
+ },
+ {
+ "epoch": 3.3088607594936708,
+ "grad_norm": 0.0434270016849041,
+ "learning_rate": 7.441077441077443e-05,
+ "loss": 0.02330004796385765,
+ "step": 655
+ },
+ {
+ "epoch": 3.3139240506329113,
+ "grad_norm": 0.03878983482718468,
+ "learning_rate": 7.435465768799102e-05,
+ "loss": 0.028383342549204826,
+ "step": 656
+ },
+ {
+ "epoch": 3.318987341772152,
+ "grad_norm": 0.035334642976522446,
+ "learning_rate": 7.429854096520763e-05,
+ "loss": 0.02583262138068676,
+ "step": 657
+ },
+ {
+ "epoch": 3.3240506329113924,
+ "grad_norm": 0.0473608672618866,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.030471306294202805,
+ "step": 658
+ },
+ {
+ "epoch": 3.329113924050633,
+ "grad_norm": 0.04193368926644325,
+ "learning_rate": 7.418630751964085e-05,
+ "loss": 0.016215423122048378,
+ "step": 659
+ },
+ {
+ "epoch": 3.3341772151898734,
+ "grad_norm": 0.023891586810350418,
+ "learning_rate": 7.413019079685746e-05,
+ "loss": 0.021040987223386765,
+ "step": 660
+ },
+ {
+ "epoch": 3.339240506329114,
+ "grad_norm": 0.029971614480018616,
+ "learning_rate": 7.407407407407407e-05,
+ "loss": 0.022258542478084564,
+ "step": 661
+ },
+ {
+ "epoch": 3.3443037974683545,
+ "grad_norm": 0.035308364778757095,
+ "learning_rate": 7.401795735129068e-05,
+ "loss": 0.02215534821152687,
+ "step": 662
+ },
+ {
+ "epoch": 3.349367088607595,
+ "grad_norm": 0.036979664117097855,
+ "learning_rate": 7.39618406285073e-05,
+ "loss": 0.027577020227909088,
+ "step": 663
+ },
+ {
+ "epoch": 3.3544303797468356,
+ "grad_norm": 0.03403281047940254,
+ "learning_rate": 7.390572390572392e-05,
+ "loss": 0.024540117010474205,
+ "step": 664
+ },
+ {
+ "epoch": 3.359493670886076,
+ "grad_norm": 0.04739405959844589,
+ "learning_rate": 7.384960718294051e-05,
+ "loss": 0.01647120714187622,
+ "step": 665
+ },
+ {
+ "epoch": 3.3645569620253166,
+ "grad_norm": 0.036933764815330505,
+ "learning_rate": 7.379349046015714e-05,
+ "loss": 0.02817656472325325,
+ "step": 666
+ },
+ {
+ "epoch": 3.369620253164557,
+ "grad_norm": 0.05966564640402794,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.028103439137339592,
+ "step": 667
+ },
+ {
+ "epoch": 3.3746835443037977,
+ "grad_norm": 0.09403033554553986,
+ "learning_rate": 7.368125701459036e-05,
+ "loss": 0.024899154901504517,
+ "step": 668
+ },
+ {
+ "epoch": 3.379746835443038,
+ "grad_norm": 0.056374453008174896,
+ "learning_rate": 7.362514029180695e-05,
+ "loss": 0.025570789352059364,
+ "step": 669
+ },
+ {
+ "epoch": 3.3848101265822783,
+ "grad_norm": 0.056454673409461975,
+ "learning_rate": 7.356902356902358e-05,
+ "loss": 0.02471453696489334,
+ "step": 670
+ },
+ {
+ "epoch": 3.389873417721519,
+ "grad_norm": 0.04115903005003929,
+ "learning_rate": 7.351290684624019e-05,
+ "loss": 0.017306309193372726,
+ "step": 671
+ },
+ {
+ "epoch": 3.3949367088607594,
+ "grad_norm": 0.030604340136051178,
+ "learning_rate": 7.34567901234568e-05,
+ "loss": 0.019510511308908463,
+ "step": 672
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.059018854051828384,
+ "learning_rate": 7.340067340067341e-05,
+ "loss": 0.02810611203312874,
+ "step": 673
+ },
+ {
+ "epoch": 3.4050632911392404,
+ "grad_norm": 0.026413513347506523,
+ "learning_rate": 7.334455667789002e-05,
+ "loss": 0.018966296687722206,
+ "step": 674
+ },
+ {
+ "epoch": 3.410126582278481,
+ "grad_norm": 0.03285476937890053,
+ "learning_rate": 7.328843995510663e-05,
+ "loss": 0.026708189398050308,
+ "step": 675
+ },
+ {
+ "epoch": 3.4151898734177215,
+ "grad_norm": 0.0392388291656971,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.022320115938782692,
+ "step": 676
+ },
+ {
+ "epoch": 3.420253164556962,
+ "grad_norm": 0.0305775236338377,
+ "learning_rate": 7.317620650953985e-05,
+ "loss": 0.018710114061832428,
+ "step": 677
+ },
+ {
+ "epoch": 3.4253164556962026,
+ "grad_norm": 0.033393554389476776,
+ "learning_rate": 7.312008978675646e-05,
+ "loss": 0.018753021955490112,
+ "step": 678
+ },
+ {
+ "epoch": 3.430379746835443,
+ "grad_norm": 0.02704286389052868,
+ "learning_rate": 7.306397306397307e-05,
+ "loss": 0.01539788581430912,
+ "step": 679
+ },
+ {
+ "epoch": 3.4354430379746836,
+ "grad_norm": 0.038779884576797485,
+ "learning_rate": 7.300785634118968e-05,
+ "loss": 0.024458929896354675,
+ "step": 680
+ },
+ {
+ "epoch": 3.440506329113924,
+ "grad_norm": 0.061135295778512955,
+ "learning_rate": 7.295173961840629e-05,
+ "loss": 0.021106259897351265,
+ "step": 681
+ },
+ {
+ "epoch": 3.4455696202531647,
+ "grad_norm": 0.02436748333275318,
+ "learning_rate": 7.28956228956229e-05,
+ "loss": 0.019037332385778427,
+ "step": 682
+ },
+ {
+ "epoch": 3.4506329113924052,
+ "grad_norm": 0.037567682564258575,
+ "learning_rate": 7.283950617283951e-05,
+ "loss": 0.02065495029091835,
+ "step": 683
+ },
+ {
+ "epoch": 3.4556962025316453,
+ "grad_norm": 0.03743781894445419,
+ "learning_rate": 7.278338945005612e-05,
+ "loss": 0.02559451386332512,
+ "step": 684
+ },
+ {
+ "epoch": 3.460759493670886,
+ "grad_norm": 0.04715351387858391,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.021420618519186974,
+ "step": 685
+ },
+ {
+ "epoch": 3.4658227848101264,
+ "grad_norm": 0.02502383477985859,
+ "learning_rate": 7.267115600448934e-05,
+ "loss": 0.019398193806409836,
+ "step": 686
+ },
+ {
+ "epoch": 3.470886075949367,
+ "grad_norm": 0.02199714072048664,
+ "learning_rate": 7.261503928170595e-05,
+ "loss": 0.019068796187639236,
+ "step": 687
+ },
+ {
+ "epoch": 3.4759493670886075,
+ "grad_norm": 0.034711211919784546,
+ "learning_rate": 7.255892255892256e-05,
+ "loss": 0.021794648841023445,
+ "step": 688
+ },
+ {
+ "epoch": 3.481012658227848,
+ "grad_norm": 0.040784433484077454,
+ "learning_rate": 7.250280583613918e-05,
+ "loss": 0.022812314331531525,
+ "step": 689
+ },
+ {
+ "epoch": 3.4860759493670885,
+ "grad_norm": 0.035993628203868866,
+ "learning_rate": 7.244668911335578e-05,
+ "loss": 0.026385463774204254,
+ "step": 690
+ },
+ {
+ "epoch": 3.491139240506329,
+ "grad_norm": 0.031834330409765244,
+ "learning_rate": 7.23905723905724e-05,
+ "loss": 0.022114556282758713,
+ "step": 691
+ },
+ {
+ "epoch": 3.4962025316455696,
+ "grad_norm": 0.025820165872573853,
+ "learning_rate": 7.2334455667789e-05,
+ "loss": 0.01813361421227455,
+ "step": 692
+ },
+ {
+ "epoch": 3.50126582278481,
+ "grad_norm": 0.04998617246747017,
+ "learning_rate": 7.227833894500562e-05,
+ "loss": 0.022573690861463547,
+ "step": 693
+ },
+ {
+ "epoch": 3.5063291139240507,
+ "grad_norm": 0.04184528812766075,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.026092834770679474,
+ "step": 694
+ },
+ {
+ "epoch": 3.511392405063291,
+ "grad_norm": 0.050683457404375076,
+ "learning_rate": 7.216610549943884e-05,
+ "loss": 0.021743692457675934,
+ "step": 695
+ },
+ {
+ "epoch": 3.5164556962025317,
+ "grad_norm": 0.07393304258584976,
+ "learning_rate": 7.210998877665545e-05,
+ "loss": 0.024253465235233307,
+ "step": 696
+ },
+ {
+ "epoch": 3.5215189873417723,
+ "grad_norm": 0.02564188838005066,
+ "learning_rate": 7.205387205387206e-05,
+ "loss": 0.019201550632715225,
+ "step": 697
+ },
+ {
+ "epoch": 3.526582278481013,
+ "grad_norm": 0.035527680069208145,
+ "learning_rate": 7.199775533108867e-05,
+ "loss": 0.02153913676738739,
+ "step": 698
+ },
+ {
+ "epoch": 3.5316455696202533,
+ "grad_norm": 0.036737874150276184,
+ "learning_rate": 7.194163860830527e-05,
+ "loss": 0.025572702288627625,
+ "step": 699
+ },
+ {
+ "epoch": 3.536708860759494,
+ "grad_norm": 0.03383871540427208,
+ "learning_rate": 7.188552188552189e-05,
+ "loss": 0.017153475433588028,
+ "step": 700
+ },
+ {
+ "epoch": 3.5417721518987344,
+ "grad_norm": 0.0350637212395668,
+ "learning_rate": 7.182940516273849e-05,
+ "loss": 0.018297579139471054,
+ "step": 701
+ },
+ {
+ "epoch": 3.546835443037975,
+ "grad_norm": 0.029637211933732033,
+ "learning_rate": 7.177328843995511e-05,
+ "loss": 0.017981912940740585,
+ "step": 702
+ },
+ {
+ "epoch": 3.5518987341772155,
+ "grad_norm": 0.03611799329519272,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.02710491605103016,
+ "step": 703
+ },
+ {
+ "epoch": 3.5569620253164556,
+ "grad_norm": 0.02008277364075184,
+ "learning_rate": 7.166105499438833e-05,
+ "loss": 0.02035117708146572,
+ "step": 704
+ },
+ {
+ "epoch": 3.562025316455696,
+ "grad_norm": 0.026698170229792595,
+ "learning_rate": 7.160493827160494e-05,
+ "loss": 0.017481079325079918,
+ "step": 705
+ },
+ {
+ "epoch": 3.5670886075949366,
+ "grad_norm": 0.036382947117090225,
+ "learning_rate": 7.154882154882155e-05,
+ "loss": 0.019109399989247322,
+ "step": 706
+ },
+ {
+ "epoch": 3.572151898734177,
+ "grad_norm": 0.04591331630945206,
+ "learning_rate": 7.149270482603816e-05,
+ "loss": 0.023143479600548744,
+ "step": 707
+ },
+ {
+ "epoch": 3.5772151898734177,
+ "grad_norm": 0.04864713177084923,
+ "learning_rate": 7.143658810325477e-05,
+ "loss": 0.022374317049980164,
+ "step": 708
+ },
+ {
+ "epoch": 3.5822784810126582,
+ "grad_norm": 0.03528938442468643,
+ "learning_rate": 7.138047138047138e-05,
+ "loss": 0.021928273141384125,
+ "step": 709
+ },
+ {
+ "epoch": 3.5873417721518988,
+ "grad_norm": 0.03548784181475639,
+ "learning_rate": 7.1324354657688e-05,
+ "loss": 0.02179766446352005,
+ "step": 710
+ },
+ {
+ "epoch": 3.5924050632911393,
+ "grad_norm": 0.041786350309848785,
+ "learning_rate": 7.12682379349046e-05,
+ "loss": 0.028576329350471497,
+ "step": 711
+ },
+ {
+ "epoch": 3.59746835443038,
+ "grad_norm": 0.03197047486901283,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.018731534481048584,
+ "step": 712
+ },
+ {
+ "epoch": 3.6025316455696204,
+ "grad_norm": 0.04037933051586151,
+ "learning_rate": 7.115600448933782e-05,
+ "loss": 0.024375513195991516,
+ "step": 713
+ },
+ {
+ "epoch": 3.607594936708861,
+ "grad_norm": 0.032266534864902496,
+ "learning_rate": 7.109988776655443e-05,
+ "loss": 0.016232451424002647,
+ "step": 714
+ },
+ {
+ "epoch": 3.6126582278481014,
+ "grad_norm": 0.02890392392873764,
+ "learning_rate": 7.104377104377104e-05,
+ "loss": 0.018303632736206055,
+ "step": 715
+ },
+ {
+ "epoch": 3.6177215189873415,
+ "grad_norm": 0.032750677317380905,
+ "learning_rate": 7.098765432098767e-05,
+ "loss": 0.021466076374053955,
+ "step": 716
+ },
+ {
+ "epoch": 3.622784810126582,
+ "grad_norm": 0.05076618492603302,
+ "learning_rate": 7.093153759820426e-05,
+ "loss": 0.022349126636981964,
+ "step": 717
+ },
+ {
+ "epoch": 3.6278481012658226,
+ "grad_norm": 0.034143563359975815,
+ "learning_rate": 7.087542087542089e-05,
+ "loss": 0.02274998091161251,
+ "step": 718
+ },
+ {
+ "epoch": 3.632911392405063,
+ "grad_norm": 0.025406064465641975,
+ "learning_rate": 7.081930415263748e-05,
+ "loss": 0.016980832442641258,
+ "step": 719
+ },
+ {
+ "epoch": 3.6379746835443036,
+ "grad_norm": 0.031938597559928894,
+ "learning_rate": 7.076318742985411e-05,
+ "loss": 0.023153938353061676,
+ "step": 720
+ },
+ {
+ "epoch": 3.643037974683544,
+ "grad_norm": 0.03354712948203087,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.018384695053100586,
+ "step": 721
+ },
+ {
+ "epoch": 3.6481012658227847,
+ "grad_norm": 0.028671689331531525,
+ "learning_rate": 7.065095398428731e-05,
+ "loss": 0.021795600652694702,
+ "step": 722
+ },
+ {
+ "epoch": 3.6531645569620252,
+ "grad_norm": 0.057982735335826874,
+ "learning_rate": 7.059483726150394e-05,
+ "loss": 0.026870068162679672,
+ "step": 723
+ },
+ {
+ "epoch": 3.6582278481012658,
+ "grad_norm": 0.036460306495428085,
+ "learning_rate": 7.053872053872053e-05,
+ "loss": 0.019742611795663834,
+ "step": 724
+ },
+ {
+ "epoch": 3.6632911392405063,
+ "grad_norm": 0.06633497029542923,
+ "learning_rate": 7.048260381593716e-05,
+ "loss": 0.01737678050994873,
+ "step": 725
+ },
+ {
+ "epoch": 3.668354430379747,
+ "grad_norm": 0.0410747192800045,
+ "learning_rate": 7.042648709315375e-05,
+ "loss": 0.023570548743009567,
+ "step": 726
+ },
+ {
+ "epoch": 3.6734177215189874,
+ "grad_norm": 0.04499414190649986,
+ "learning_rate": 7.037037037037038e-05,
+ "loss": 0.024305228143930435,
+ "step": 727
+ },
+ {
+ "epoch": 3.678481012658228,
+ "grad_norm": 0.024429699406027794,
+ "learning_rate": 7.031425364758697e-05,
+ "loss": 0.018056385219097137,
+ "step": 728
+ },
+ {
+ "epoch": 3.6835443037974684,
+ "grad_norm": 0.03042393922805786,
+ "learning_rate": 7.02581369248036e-05,
+ "loss": 0.019678741693496704,
+ "step": 729
+ },
+ {
+ "epoch": 3.688607594936709,
+ "grad_norm": 0.04088849946856499,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.026466136798262596,
+ "step": 730
+ },
+ {
+ "epoch": 3.6936708860759495,
+ "grad_norm": 0.03353559225797653,
+ "learning_rate": 7.014590347923682e-05,
+ "loss": 0.021056771278381348,
+ "step": 731
+ },
+ {
+ "epoch": 3.69873417721519,
+ "grad_norm": 0.03120904415845871,
+ "learning_rate": 7.008978675645343e-05,
+ "loss": 0.020675398409366608,
+ "step": 732
+ },
+ {
+ "epoch": 3.7037974683544306,
+ "grad_norm": 0.05723356828093529,
+ "learning_rate": 7.003367003367004e-05,
+ "loss": 0.033802516758441925,
+ "step": 733
+ },
+ {
+ "epoch": 3.708860759493671,
+ "grad_norm": 0.03580084443092346,
+ "learning_rate": 6.997755331088665e-05,
+ "loss": 0.026392754167318344,
+ "step": 734
+ },
+ {
+ "epoch": 3.7139240506329116,
+ "grad_norm": 0.05164967477321625,
+ "learning_rate": 6.992143658810326e-05,
+ "loss": 0.0241309255361557,
+ "step": 735
+ },
+ {
+ "epoch": 3.7189873417721517,
+ "grad_norm": 0.02190530300140381,
+ "learning_rate": 6.986531986531987e-05,
+ "loss": 0.018209822475910187,
+ "step": 736
+ },
+ {
+ "epoch": 3.7240506329113923,
+ "grad_norm": 0.027256503701210022,
+ "learning_rate": 6.980920314253648e-05,
+ "loss": 0.022063471376895905,
+ "step": 737
+ },
+ {
+ "epoch": 3.729113924050633,
+ "grad_norm": 0.03337831795215607,
+ "learning_rate": 6.975308641975309e-05,
+ "loss": 0.018506363034248352,
+ "step": 738
+ },
+ {
+ "epoch": 3.7341772151898733,
+ "grad_norm": 0.025730784982442856,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.016883976757526398,
+ "step": 739
+ },
+ {
+ "epoch": 3.739240506329114,
+ "grad_norm": 0.026203135028481483,
+ "learning_rate": 6.964085297418631e-05,
+ "loss": 0.023329125717282295,
+ "step": 740
+ },
+ {
+ "epoch": 3.7443037974683544,
+ "grad_norm": 0.02676830254495144,
+ "learning_rate": 6.958473625140293e-05,
+ "loss": 0.020962664857506752,
+ "step": 741
+ },
+ {
+ "epoch": 3.749367088607595,
+ "grad_norm": 0.019974667578935623,
+ "learning_rate": 6.952861952861953e-05,
+ "loss": 0.018353454768657684,
+ "step": 742
+ },
+ {
+ "epoch": 3.7544303797468355,
+ "grad_norm": 0.02399631030857563,
+ "learning_rate": 6.947250280583614e-05,
+ "loss": 0.01820143684744835,
+ "step": 743
+ },
+ {
+ "epoch": 3.759493670886076,
+ "grad_norm": 0.02083951234817505,
+ "learning_rate": 6.941638608305275e-05,
+ "loss": 0.02312408946454525,
+ "step": 744
+ },
+ {
+ "epoch": 3.7645569620253165,
+ "grad_norm": 0.025636207312345505,
+ "learning_rate": 6.936026936026936e-05,
+ "loss": 0.01757936365902424,
+ "step": 745
+ },
+ {
+ "epoch": 3.769620253164557,
+ "grad_norm": 0.036856744438409805,
+ "learning_rate": 6.930415263748597e-05,
+ "loss": 0.028933756053447723,
+ "step": 746
+ },
+ {
+ "epoch": 3.7746835443037976,
+ "grad_norm": 0.037415456026792526,
+ "learning_rate": 6.924803591470258e-05,
+ "loss": 0.022136090323328972,
+ "step": 747
+ },
+ {
+ "epoch": 3.779746835443038,
+ "grad_norm": 0.027949288487434387,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.022943630814552307,
+ "step": 748
+ },
+ {
+ "epoch": 3.7848101265822782,
+ "grad_norm": 0.037508148699998856,
+ "learning_rate": 6.91358024691358e-05,
+ "loss": 0.020460065454244614,
+ "step": 749
+ },
+ {
+ "epoch": 3.7898734177215188,
+ "grad_norm": 0.037965189665555954,
+ "learning_rate": 6.907968574635242e-05,
+ "loss": 0.024793215095996857,
+ "step": 750
+ },
+ {
+ "epoch": 3.7949367088607593,
+ "grad_norm": 0.027956753969192505,
+ "learning_rate": 6.902356902356902e-05,
+ "loss": 0.02188705839216709,
+ "step": 751
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.027417965233325958,
+ "learning_rate": 6.896745230078564e-05,
+ "loss": 0.01465995516628027,
+ "step": 752
+ },
+ {
+ "epoch": 3.8050632911392404,
+ "grad_norm": 0.036644525825977325,
+ "learning_rate": 6.891133557800224e-05,
+ "loss": 0.020246809348464012,
+ "step": 753
+ },
+ {
+ "epoch": 3.810126582278481,
+ "grad_norm": 0.027043674141168594,
+ "learning_rate": 6.885521885521886e-05,
+ "loss": 0.02293788641691208,
+ "step": 754
+ },
+ {
+ "epoch": 3.8151898734177214,
+ "grad_norm": 0.033968694508075714,
+ "learning_rate": 6.879910213243546e-05,
+ "loss": 0.024979766458272934,
+ "step": 755
+ },
+ {
+ "epoch": 3.820253164556962,
+ "grad_norm": 0.022790739312767982,
+ "learning_rate": 6.874298540965208e-05,
+ "loss": 0.019254112616181374,
+ "step": 756
+ },
+ {
+ "epoch": 3.8253164556962025,
+ "grad_norm": 0.028349611908197403,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.018624842166900635,
+ "step": 757
+ },
+ {
+ "epoch": 3.830379746835443,
+ "grad_norm": 0.034140367060899734,
+ "learning_rate": 6.86307519640853e-05,
+ "loss": 0.01691599376499653,
+ "step": 758
+ },
+ {
+ "epoch": 3.8354430379746836,
+ "grad_norm": 0.03422265127301216,
+ "learning_rate": 6.857463524130191e-05,
+ "loss": 0.01864086464047432,
+ "step": 759
+ },
+ {
+ "epoch": 3.840506329113924,
+ "grad_norm": 0.037322208285331726,
+ "learning_rate": 6.851851851851852e-05,
+ "loss": 0.024382904171943665,
+ "step": 760
+ },
+ {
+ "epoch": 3.8455696202531646,
+ "grad_norm": 0.022540392354130745,
+ "learning_rate": 6.846240179573513e-05,
+ "loss": 0.017390096560120583,
+ "step": 761
+ },
+ {
+ "epoch": 3.850632911392405,
+ "grad_norm": 0.035701289772987366,
+ "learning_rate": 6.840628507295174e-05,
+ "loss": 0.01928594335913658,
+ "step": 762
+ },
+ {
+ "epoch": 3.8556962025316457,
+ "grad_norm": 0.047425150871276855,
+ "learning_rate": 6.835016835016835e-05,
+ "loss": 0.026818927377462387,
+ "step": 763
+ },
+ {
+ "epoch": 3.8607594936708862,
+ "grad_norm": 0.0244912076741457,
+ "learning_rate": 6.829405162738496e-05,
+ "loss": 0.01811584085226059,
+ "step": 764
+ },
+ {
+ "epoch": 3.8658227848101268,
+ "grad_norm": 0.03282126039266586,
+ "learning_rate": 6.823793490460157e-05,
+ "loss": 0.01521163061261177,
+ "step": 765
+ },
+ {
+ "epoch": 3.8708860759493673,
+ "grad_norm": 0.030519530177116394,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.023735523223876953,
+ "step": 766
+ },
+ {
+ "epoch": 3.875949367088608,
+ "grad_norm": 0.03829387575387955,
+ "learning_rate": 6.81257014590348e-05,
+ "loss": 0.02391430363059044,
+ "step": 767
+ },
+ {
+ "epoch": 3.8810126582278484,
+ "grad_norm": 0.03133988752961159,
+ "learning_rate": 6.80695847362514e-05,
+ "loss": 0.022026970982551575,
+ "step": 768
+ },
+ {
+ "epoch": 3.8860759493670884,
+ "grad_norm": 0.036327920854091644,
+ "learning_rate": 6.801346801346801e-05,
+ "loss": 0.01740797609090805,
+ "step": 769
+ },
+ {
+ "epoch": 3.891139240506329,
+ "grad_norm": 0.06766671687364578,
+ "learning_rate": 6.795735129068462e-05,
+ "loss": 0.02804078534245491,
+ "step": 770
+ },
+ {
+ "epoch": 3.8962025316455695,
+ "grad_norm": 0.06390757858753204,
+ "learning_rate": 6.790123456790123e-05,
+ "loss": 0.032084181904792786,
+ "step": 771
+ },
+ {
+ "epoch": 3.90126582278481,
+ "grad_norm": 0.03238178789615631,
+ "learning_rate": 6.784511784511784e-05,
+ "loss": 0.02189403772354126,
+ "step": 772
+ },
+ {
+ "epoch": 3.9063291139240506,
+ "grad_norm": 0.03206197917461395,
+ "learning_rate": 6.778900112233445e-05,
+ "loss": 0.022829271852970123,
+ "step": 773
+ },
+ {
+ "epoch": 3.911392405063291,
+ "grad_norm": 0.030897945165634155,
+ "learning_rate": 6.773288439955107e-05,
+ "loss": 0.021807631477713585,
+ "step": 774
+ },
+ {
+ "epoch": 3.9164556962025316,
+ "grad_norm": 0.04285162314772606,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.023028545081615448,
+ "step": 775
+ },
+ {
+ "epoch": 3.921518987341772,
+ "grad_norm": 0.02819208987057209,
+ "learning_rate": 6.762065095398429e-05,
+ "loss": 0.02110828459262848,
+ "step": 776
+ },
+ {
+ "epoch": 3.9265822784810127,
+ "grad_norm": 0.03159799054265022,
+ "learning_rate": 6.756453423120091e-05,
+ "loss": 0.02116553671658039,
+ "step": 777
+ },
+ {
+ "epoch": 3.9316455696202532,
+ "grad_norm": 0.028514137491583824,
+ "learning_rate": 6.75084175084175e-05,
+ "loss": 0.020262988284230232,
+ "step": 778
+ },
+ {
+ "epoch": 3.9367088607594938,
+ "grad_norm": 0.03610249608755112,
+ "learning_rate": 6.745230078563413e-05,
+ "loss": 0.016928158700466156,
+ "step": 779
+ },
+ {
+ "epoch": 3.9417721518987343,
+ "grad_norm": 0.02753387950360775,
+ "learning_rate": 6.739618406285073e-05,
+ "loss": 0.022629719227552414,
+ "step": 780
+ },
+ {
+ "epoch": 3.946835443037975,
+ "grad_norm": 0.026071136817336082,
+ "learning_rate": 6.734006734006735e-05,
+ "loss": 0.020297978073358536,
+ "step": 781
+ },
+ {
+ "epoch": 3.951898734177215,
+ "grad_norm": 0.04774617776274681,
+ "learning_rate": 6.728395061728396e-05,
+ "loss": 0.01858438178896904,
+ "step": 782
+ },
+ {
+ "epoch": 3.9569620253164555,
+ "grad_norm": 0.03666248545050621,
+ "learning_rate": 6.722783389450057e-05,
+ "loss": 0.024037979543209076,
+ "step": 783
+ },
+ {
+ "epoch": 3.962025316455696,
+ "grad_norm": 0.04990983009338379,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.027675451710820198,
+ "step": 784
+ },
+ {
+ "epoch": 3.9670886075949365,
+ "grad_norm": 0.04734862968325615,
+ "learning_rate": 6.711560044893379e-05,
+ "loss": 0.02003151923418045,
+ "step": 785
+ },
+ {
+ "epoch": 3.972151898734177,
+ "grad_norm": 0.031911976635456085,
+ "learning_rate": 6.70594837261504e-05,
+ "loss": 0.02302616462111473,
+ "step": 786
+ },
+ {
+ "epoch": 3.9772151898734176,
+ "grad_norm": 0.03199504688382149,
+ "learning_rate": 6.7003367003367e-05,
+ "loss": 0.020066704601049423,
+ "step": 787
+ },
+ {
+ "epoch": 3.982278481012658,
+ "grad_norm": 0.02664150856435299,
+ "learning_rate": 6.694725028058362e-05,
+ "loss": 0.01888475939631462,
+ "step": 788
+ },
+ {
+ "epoch": 3.9873417721518987,
+ "grad_norm": 0.03886157646775246,
+ "learning_rate": 6.689113355780023e-05,
+ "loss": 0.016029106453061104,
+ "step": 789
+ },
+ {
+ "epoch": 3.992405063291139,
+ "grad_norm": 0.025033561512827873,
+ "learning_rate": 6.683501683501684e-05,
+ "loss": 0.01627909578382969,
+ "step": 790
+ },
+ {
+ "epoch": 3.9974683544303797,
+ "grad_norm": 0.04991500452160835,
+ "learning_rate": 6.677890011223345e-05,
+ "loss": 0.02633330039680004,
+ "step": 791
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.0552835538983345,
+ "learning_rate": 6.672278338945006e-05,
+ "loss": 0.025268658995628357,
+ "step": 792
+ },
+ {
+ "epoch": 4.0050632911392405,
+ "grad_norm": 0.04223925992846489,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.023410093039274216,
+ "step": 793
+ },
+ {
+ "epoch": 4.010126582278481,
+ "grad_norm": 0.03191488981246948,
+ "learning_rate": 6.661054994388328e-05,
+ "loss": 0.01913982629776001,
+ "step": 794
+ },
+ {
+ "epoch": 4.015189873417722,
+ "grad_norm": 0.03535325452685356,
+ "learning_rate": 6.655443322109989e-05,
+ "loss": 0.020550835877656937,
+ "step": 795
+ },
+ {
+ "epoch": 4.020253164556962,
+ "grad_norm": 0.027277838438749313,
+ "learning_rate": 6.64983164983165e-05,
+ "loss": 0.02178161032497883,
+ "step": 796
+ },
+ {
+ "epoch": 4.025316455696203,
+ "grad_norm": 0.03889140114188194,
+ "learning_rate": 6.644219977553311e-05,
+ "loss": 0.02359630912542343,
+ "step": 797
+ },
+ {
+ "epoch": 4.030379746835443,
+ "grad_norm": 0.03794289380311966,
+ "learning_rate": 6.638608305274972e-05,
+ "loss": 0.02135687693953514,
+ "step": 798
+ },
+ {
+ "epoch": 4.035443037974684,
+ "grad_norm": 0.030842013657093048,
+ "learning_rate": 6.632996632996633e-05,
+ "loss": 0.026881888508796692,
+ "step": 799
+ },
+ {
+ "epoch": 4.040506329113924,
+ "grad_norm": 0.036720771342515945,
+ "learning_rate": 6.627384960718295e-05,
+ "loss": 0.017526758834719658,
+ "step": 800
+ },
+ {
+ "epoch": 4.045569620253165,
+ "grad_norm": 0.04940621554851532,
+ "learning_rate": 6.621773288439955e-05,
+ "loss": 0.023458952084183693,
+ "step": 801
+ },
+ {
+ "epoch": 4.050632911392405,
+ "grad_norm": 0.0228698942810297,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.017165549099445343,
+ "step": 802
+ },
+ {
+ "epoch": 4.055696202531646,
+ "grad_norm": 0.0323697030544281,
+ "learning_rate": 6.610549943883277e-05,
+ "loss": 0.020573658868670464,
+ "step": 803
+ },
+ {
+ "epoch": 4.060759493670886,
+ "grad_norm": 0.03041171282529831,
+ "learning_rate": 6.60493827160494e-05,
+ "loss": 0.022557582706212997,
+ "step": 804
+ },
+ {
+ "epoch": 4.065822784810127,
+ "grad_norm": 0.030996058136224747,
+ "learning_rate": 6.599326599326599e-05,
+ "loss": 0.024344075471162796,
+ "step": 805
+ },
+ {
+ "epoch": 4.0708860759493675,
+ "grad_norm": 0.02448248863220215,
+ "learning_rate": 6.593714927048261e-05,
+ "loss": 0.018718231469392776,
+ "step": 806
+ },
+ {
+ "epoch": 4.075949367088608,
+ "grad_norm": 0.03839370980858803,
+ "learning_rate": 6.588103254769921e-05,
+ "loss": 0.02680569887161255,
+ "step": 807
+ },
+ {
+ "epoch": 4.0810126582278485,
+ "grad_norm": 0.029364196583628654,
+ "learning_rate": 6.582491582491582e-05,
+ "loss": 0.01946680247783661,
+ "step": 808
+ },
+ {
+ "epoch": 4.086075949367088,
+ "grad_norm": 0.02478131465613842,
+ "learning_rate": 6.576879910213244e-05,
+ "loss": 0.021097835153341293,
+ "step": 809
+ },
+ {
+ "epoch": 4.091139240506329,
+ "grad_norm": 0.030616244301199913,
+ "learning_rate": 6.571268237934904e-05,
+ "loss": 0.021518010646104813,
+ "step": 810
+ },
+ {
+ "epoch": 4.096202531645569,
+ "grad_norm": 0.02732054330408573,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.02008533477783203,
+ "step": 811
+ },
+ {
+ "epoch": 4.10126582278481,
+ "grad_norm": 0.0323524996638298,
+ "learning_rate": 6.560044893378226e-05,
+ "loss": 0.025486933067440987,
+ "step": 812
+ },
+ {
+ "epoch": 4.10632911392405,
+ "grad_norm": 0.026200806722044945,
+ "learning_rate": 6.554433221099888e-05,
+ "loss": 0.019320383667945862,
+ "step": 813
+ },
+ {
+ "epoch": 4.111392405063291,
+ "grad_norm": 0.03883595019578934,
+ "learning_rate": 6.548821548821548e-05,
+ "loss": 0.021837443113327026,
+ "step": 814
+ },
+ {
+ "epoch": 4.116455696202531,
+ "grad_norm": 0.037654533982276917,
+ "learning_rate": 6.54320987654321e-05,
+ "loss": 0.024574559181928635,
+ "step": 815
+ },
+ {
+ "epoch": 4.121518987341772,
+ "grad_norm": 0.04923658072948456,
+ "learning_rate": 6.537598204264871e-05,
+ "loss": 0.01940765418112278,
+ "step": 816
+ },
+ {
+ "epoch": 4.1265822784810124,
+ "grad_norm": 0.02900642342865467,
+ "learning_rate": 6.531986531986533e-05,
+ "loss": 0.019193468615412712,
+ "step": 817
+ },
+ {
+ "epoch": 4.131645569620253,
+ "grad_norm": 0.03798971325159073,
+ "learning_rate": 6.526374859708194e-05,
+ "loss": 0.022473281249403954,
+ "step": 818
+ },
+ {
+ "epoch": 4.1367088607594935,
+ "grad_norm": 0.05821327865123749,
+ "learning_rate": 6.520763187429855e-05,
+ "loss": 0.025292381644248962,
+ "step": 819
+ },
+ {
+ "epoch": 4.141772151898734,
+ "grad_norm": 0.02774794027209282,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.021283335983753204,
+ "step": 820
+ },
+ {
+ "epoch": 4.146835443037975,
+ "grad_norm": 0.03002094104886055,
+ "learning_rate": 6.509539842873177e-05,
+ "loss": 0.020336506888270378,
+ "step": 821
+ },
+ {
+ "epoch": 4.151898734177215,
+ "grad_norm": 0.02205439656972885,
+ "learning_rate": 6.503928170594838e-05,
+ "loss": 0.01669773831963539,
+ "step": 822
+ },
+ {
+ "epoch": 4.156962025316456,
+ "grad_norm": 0.023610664531588554,
+ "learning_rate": 6.498316498316499e-05,
+ "loss": 0.016195815056562424,
+ "step": 823
+ },
+ {
+ "epoch": 4.162025316455696,
+ "grad_norm": 0.02679222822189331,
+ "learning_rate": 6.49270482603816e-05,
+ "loss": 0.020671207457780838,
+ "step": 824
+ },
+ {
+ "epoch": 4.167088607594937,
+ "grad_norm": 0.043805427849292755,
+ "learning_rate": 6.48709315375982e-05,
+ "loss": 0.029262011870741844,
+ "step": 825
+ },
+ {
+ "epoch": 4.172151898734177,
+ "grad_norm": 0.024075932800769806,
+ "learning_rate": 6.481481481481482e-05,
+ "loss": 0.0180169977247715,
+ "step": 826
+ },
+ {
+ "epoch": 4.177215189873418,
+ "grad_norm": 0.027496427297592163,
+ "learning_rate": 6.475869809203144e-05,
+ "loss": 0.01985255442559719,
+ "step": 827
+ },
+ {
+ "epoch": 4.182278481012658,
+ "grad_norm": 0.028868619352579117,
+ "learning_rate": 6.470258136924804e-05,
+ "loss": 0.02416200190782547,
+ "step": 828
+ },
+ {
+ "epoch": 4.187341772151899,
+ "grad_norm": 0.026004688814282417,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.01904168725013733,
+ "step": 829
+ },
+ {
+ "epoch": 4.192405063291139,
+ "grad_norm": 0.04274019971489906,
+ "learning_rate": 6.459034792368126e-05,
+ "loss": 0.02680842950940132,
+ "step": 830
+ },
+ {
+ "epoch": 4.19746835443038,
+ "grad_norm": 0.024735039100050926,
+ "learning_rate": 6.453423120089787e-05,
+ "loss": 0.016491729766130447,
+ "step": 831
+ },
+ {
+ "epoch": 4.2025316455696204,
+ "grad_norm": 0.04336397722363472,
+ "learning_rate": 6.447811447811448e-05,
+ "loss": 0.02140970341861248,
+ "step": 832
+ },
+ {
+ "epoch": 4.207594936708861,
+ "grad_norm": 0.025922754779458046,
+ "learning_rate": 6.442199775533109e-05,
+ "loss": 0.017252741381525993,
+ "step": 833
+ },
+ {
+ "epoch": 4.2126582278481015,
+ "grad_norm": 0.0322343185544014,
+ "learning_rate": 6.436588103254771e-05,
+ "loss": 0.015862349420785904,
+ "step": 834
+ },
+ {
+ "epoch": 4.217721518987342,
+ "grad_norm": 0.033133670687675476,
+ "learning_rate": 6.43097643097643e-05,
+ "loss": 0.02029406651854515,
+ "step": 835
+ },
+ {
+ "epoch": 4.222784810126583,
+ "grad_norm": 0.044879183173179626,
+ "learning_rate": 6.425364758698093e-05,
+ "loss": 0.021223746240139008,
+ "step": 836
+ },
+ {
+ "epoch": 4.227848101265823,
+ "grad_norm": 0.031861864030361176,
+ "learning_rate": 6.419753086419753e-05,
+ "loss": 0.023331837728619576,
+ "step": 837
+ },
+ {
+ "epoch": 4.232911392405064,
+ "grad_norm": 0.03642997145652771,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.025932632386684418,
+ "step": 838
+ },
+ {
+ "epoch": 4.237974683544304,
+ "grad_norm": 0.025531062856316566,
+ "learning_rate": 6.408529741863075e-05,
+ "loss": 0.019921796396374702,
+ "step": 839
+ },
+ {
+ "epoch": 4.243037974683545,
+ "grad_norm": 0.025292333215475082,
+ "learning_rate": 6.402918069584737e-05,
+ "loss": 0.017363781109452248,
+ "step": 840
+ },
+ {
+ "epoch": 4.248101265822784,
+ "grad_norm": 0.03679105266928673,
+ "learning_rate": 6.397306397306398e-05,
+ "loss": 0.026451613754034042,
+ "step": 841
+ },
+ {
+ "epoch": 4.253164556962025,
+ "grad_norm": 0.029125263914465904,
+ "learning_rate": 6.391694725028059e-05,
+ "loss": 0.018277600407600403,
+ "step": 842
+ },
+ {
+ "epoch": 4.258227848101265,
+ "grad_norm": 0.03969479724764824,
+ "learning_rate": 6.38608305274972e-05,
+ "loss": 0.026814289391040802,
+ "step": 843
+ },
+ {
+ "epoch": 4.263291139240506,
+ "grad_norm": 0.03083009086549282,
+ "learning_rate": 6.380471380471381e-05,
+ "loss": 0.01898398995399475,
+ "step": 844
+ },
+ {
+ "epoch": 4.2683544303797465,
+ "grad_norm": 0.04128425940871239,
+ "learning_rate": 6.374859708193042e-05,
+ "loss": 0.02890118584036827,
+ "step": 845
+ },
+ {
+ "epoch": 4.273417721518987,
+ "grad_norm": 0.03675759211182594,
+ "learning_rate": 6.369248035914703e-05,
+ "loss": 0.0232902429997921,
+ "step": 846
+ },
+ {
+ "epoch": 4.2784810126582276,
+ "grad_norm": 0.035842880606651306,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.018688444048166275,
+ "step": 847
+ },
+ {
+ "epoch": 4.283544303797468,
+ "grad_norm": 0.041631679981946945,
+ "learning_rate": 6.358024691358025e-05,
+ "loss": 0.028953872621059418,
+ "step": 848
+ },
+ {
+ "epoch": 4.288607594936709,
+ "grad_norm": 0.02474270947277546,
+ "learning_rate": 6.352413019079686e-05,
+ "loss": 0.02291303500533104,
+ "step": 849
+ },
+ {
+ "epoch": 4.293670886075949,
+ "grad_norm": 0.0414784699678421,
+ "learning_rate": 6.346801346801347e-05,
+ "loss": 0.0197298601269722,
+ "step": 850
+ },
+ {
+ "epoch": 4.29873417721519,
+ "grad_norm": 0.022596480324864388,
+ "learning_rate": 6.341189674523008e-05,
+ "loss": 0.022477108985185623,
+ "step": 851
+ },
+ {
+ "epoch": 4.30379746835443,
+ "grad_norm": 0.03707405552268028,
+ "learning_rate": 6.335578002244669e-05,
+ "loss": 0.02374342642724514,
+ "step": 852
+ },
+ {
+ "epoch": 4.308860759493671,
+ "grad_norm": 0.036069657653570175,
+ "learning_rate": 6.32996632996633e-05,
+ "loss": 0.025015011429786682,
+ "step": 853
+ },
+ {
+ "epoch": 4.313924050632911,
+ "grad_norm": 0.025126038119196892,
+ "learning_rate": 6.324354657687991e-05,
+ "loss": 0.022152241319417953,
+ "step": 854
+ },
+ {
+ "epoch": 4.318987341772152,
+ "grad_norm": 0.03695147857069969,
+ "learning_rate": 6.318742985409652e-05,
+ "loss": 0.019978618249297142,
+ "step": 855
+ },
+ {
+ "epoch": 4.324050632911392,
+ "grad_norm": 0.034860849380493164,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.01976930722594261,
+ "step": 856
+ },
+ {
+ "epoch": 4.329113924050633,
+ "grad_norm": 0.029625017195940018,
+ "learning_rate": 6.307519640852974e-05,
+ "loss": 0.024136420339345932,
+ "step": 857
+ },
+ {
+ "epoch": 4.334177215189873,
+ "grad_norm": 0.03501079976558685,
+ "learning_rate": 6.301907968574635e-05,
+ "loss": 0.020777776837348938,
+ "step": 858
+ },
+ {
+ "epoch": 4.339240506329114,
+ "grad_norm": 0.037415534257888794,
+ "learning_rate": 6.296296296296296e-05,
+ "loss": 0.016332093626260757,
+ "step": 859
+ },
+ {
+ "epoch": 4.3443037974683545,
+ "grad_norm": 0.032555654644966125,
+ "learning_rate": 6.290684624017957e-05,
+ "loss": 0.02344547212123871,
+ "step": 860
+ },
+ {
+ "epoch": 4.349367088607595,
+ "grad_norm": 0.04069099947810173,
+ "learning_rate": 6.28507295173962e-05,
+ "loss": 0.019369281828403473,
+ "step": 861
+ },
+ {
+ "epoch": 4.3544303797468356,
+ "grad_norm": 0.05188984051346779,
+ "learning_rate": 6.279461279461279e-05,
+ "loss": 0.02291448414325714,
+ "step": 862
+ },
+ {
+ "epoch": 4.359493670886076,
+ "grad_norm": 0.0357513502240181,
+ "learning_rate": 6.273849607182942e-05,
+ "loss": 0.02141542360186577,
+ "step": 863
+ },
+ {
+ "epoch": 4.364556962025317,
+ "grad_norm": 0.026472769677639008,
+ "learning_rate": 6.268237934904601e-05,
+ "loss": 0.01893937960267067,
+ "step": 864
+ },
+ {
+ "epoch": 4.369620253164557,
+ "grad_norm": 0.0498812235891819,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.021839456632733345,
+ "step": 865
+ },
+ {
+ "epoch": 4.374683544303798,
+ "grad_norm": 0.05202518403530121,
+ "learning_rate": 6.257014590347923e-05,
+ "loss": 0.023422567173838615,
+ "step": 866
+ },
+ {
+ "epoch": 4.379746835443038,
+ "grad_norm": 0.024116024374961853,
+ "learning_rate": 6.251402918069586e-05,
+ "loss": 0.018288200721144676,
+ "step": 867
+ },
+ {
+ "epoch": 4.384810126582279,
+ "grad_norm": 0.02667090855538845,
+ "learning_rate": 6.245791245791247e-05,
+ "loss": 0.022375311702489853,
+ "step": 868
+ },
+ {
+ "epoch": 4.389873417721519,
+ "grad_norm": 0.02306467480957508,
+ "learning_rate": 6.240179573512908e-05,
+ "loss": 0.017447657883167267,
+ "step": 869
+ },
+ {
+ "epoch": 4.39493670886076,
+ "grad_norm": 0.031131602823734283,
+ "learning_rate": 6.234567901234569e-05,
+ "loss": 0.021768944337964058,
+ "step": 870
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.05789825692772865,
+ "learning_rate": 6.22895622895623e-05,
+ "loss": 0.02762719616293907,
+ "step": 871
+ },
+ {
+ "epoch": 4.405063291139241,
+ "grad_norm": 0.03830523043870926,
+ "learning_rate": 6.22334455667789e-05,
+ "loss": 0.023558061569929123,
+ "step": 872
+ },
+ {
+ "epoch": 4.410126582278481,
+ "grad_norm": 0.025961998850107193,
+ "learning_rate": 6.21773288439955e-05,
+ "loss": 0.022518256679177284,
+ "step": 873
+ },
+ {
+ "epoch": 4.415189873417722,
+ "grad_norm": 0.025299636647105217,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.018432877957820892,
+ "step": 874
+ },
+ {
+ "epoch": 4.4202531645569625,
+ "grad_norm": 0.027106614783406258,
+ "learning_rate": 6.206509539842874e-05,
+ "loss": 0.01614236831665039,
+ "step": 875
+ },
+ {
+ "epoch": 4.425316455696202,
+ "grad_norm": 0.04538397118449211,
+ "learning_rate": 6.200897867564535e-05,
+ "loss": 0.027474530041217804,
+ "step": 876
+ },
+ {
+ "epoch": 4.430379746835443,
+ "grad_norm": 0.041059643030166626,
+ "learning_rate": 6.195286195286196e-05,
+ "loss": 0.030840855091810226,
+ "step": 877
+ },
+ {
+ "epoch": 4.435443037974683,
+ "grad_norm": 0.055599089711904526,
+ "learning_rate": 6.189674523007857e-05,
+ "loss": 0.02877015620470047,
+ "step": 878
+ },
+ {
+ "epoch": 4.440506329113924,
+ "grad_norm": 0.023808903992176056,
+ "learning_rate": 6.184062850729518e-05,
+ "loss": 0.018071971833705902,
+ "step": 879
+ },
+ {
+ "epoch": 4.445569620253164,
+ "grad_norm": 0.04098769649863243,
+ "learning_rate": 6.178451178451179e-05,
+ "loss": 0.019321631640195847,
+ "step": 880
+ },
+ {
+ "epoch": 4.450632911392405,
+ "grad_norm": 0.0329279750585556,
+ "learning_rate": 6.17283950617284e-05,
+ "loss": 0.023013390600681305,
+ "step": 881
+ },
+ {
+ "epoch": 4.455696202531645,
+ "grad_norm": 0.030751917511224747,
+ "learning_rate": 6.1672278338945e-05,
+ "loss": 0.018062159419059753,
+ "step": 882
+ },
+ {
+ "epoch": 4.460759493670886,
+ "grad_norm": 0.025446373969316483,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.020532462745904922,
+ "step": 883
+ },
+ {
+ "epoch": 4.465822784810126,
+ "grad_norm": 0.037997085601091385,
+ "learning_rate": 6.156004489337823e-05,
+ "loss": 0.024340521544218063,
+ "step": 884
+ },
+ {
+ "epoch": 4.470886075949367,
+ "grad_norm": 0.021509790793061256,
+ "learning_rate": 6.150392817059484e-05,
+ "loss": 0.018887734040617943,
+ "step": 885
+ },
+ {
+ "epoch": 4.4759493670886075,
+ "grad_norm": 0.027931779623031616,
+ "learning_rate": 6.144781144781146e-05,
+ "loss": 0.02148054540157318,
+ "step": 886
+ },
+ {
+ "epoch": 4.481012658227848,
+ "grad_norm": 0.035554565489292145,
+ "learning_rate": 6.139169472502806e-05,
+ "loss": 0.019528254866600037,
+ "step": 887
+ },
+ {
+ "epoch": 4.4860759493670885,
+ "grad_norm": 0.02668517455458641,
+ "learning_rate": 6.133557800224468e-05,
+ "loss": 0.022182706743478775,
+ "step": 888
+ },
+ {
+ "epoch": 4.491139240506329,
+ "grad_norm": 0.0376712940633297,
+ "learning_rate": 6.127946127946128e-05,
+ "loss": 0.026006314903497696,
+ "step": 889
+ },
+ {
+ "epoch": 4.49620253164557,
+ "grad_norm": 0.02952289767563343,
+ "learning_rate": 6.12233445566779e-05,
+ "loss": 0.022582251578569412,
+ "step": 890
+ },
+ {
+ "epoch": 4.50126582278481,
+ "grad_norm": 0.05064458027482033,
+ "learning_rate": 6.11672278338945e-05,
+ "loss": 0.021709535270929337,
+ "step": 891
+ },
+ {
+ "epoch": 4.506329113924051,
+ "grad_norm": 0.021470079198479652,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.015116477385163307,
+ "step": 892
+ },
+ {
+ "epoch": 4.511392405063291,
+ "grad_norm": 0.04210078716278076,
+ "learning_rate": 6.105499438832773e-05,
+ "loss": 0.030057771131396294,
+ "step": 893
+ },
+ {
+ "epoch": 4.516455696202532,
+ "grad_norm": 0.20027652382850647,
+ "learning_rate": 6.099887766554434e-05,
+ "loss": 0.02081073820590973,
+ "step": 894
+ },
+ {
+ "epoch": 4.521518987341772,
+ "grad_norm": 0.03083370067179203,
+ "learning_rate": 6.0942760942760944e-05,
+ "loss": 0.020705904811620712,
+ "step": 895
+ },
+ {
+ "epoch": 4.526582278481013,
+ "grad_norm": 0.05921618640422821,
+ "learning_rate": 6.0886644219977554e-05,
+ "loss": 0.020449915900826454,
+ "step": 896
+ },
+ {
+ "epoch": 4.531645569620253,
+ "grad_norm": 0.02304214984178543,
+ "learning_rate": 6.0830527497194164e-05,
+ "loss": 0.01927848532795906,
+ "step": 897
+ },
+ {
+ "epoch": 4.536708860759494,
+ "grad_norm": 0.03946949169039726,
+ "learning_rate": 6.0774410774410774e-05,
+ "loss": 0.026231423020362854,
+ "step": 898
+ },
+ {
+ "epoch": 4.541772151898734,
+ "grad_norm": 0.027822930365800858,
+ "learning_rate": 6.071829405162739e-05,
+ "loss": 0.022259924560785294,
+ "step": 899
+ },
+ {
+ "epoch": 4.546835443037975,
+ "grad_norm": 0.029135817661881447,
+ "learning_rate": 6.0662177328843995e-05,
+ "loss": 0.019272884353995323,
+ "step": 900
+ },
+ {
+ "epoch": 4.5518987341772155,
+ "grad_norm": 0.03746713697910309,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.022191740572452545,
+ "step": 901
+ },
+ {
+ "epoch": 4.556962025316456,
+ "grad_norm": 0.027378680184483528,
+ "learning_rate": 6.0549943883277215e-05,
+ "loss": 0.023043492808938026,
+ "step": 902
+ },
+ {
+ "epoch": 4.5620253164556965,
+ "grad_norm": 0.047497715801000595,
+ "learning_rate": 6.049382716049383e-05,
+ "loss": 0.023993097245693207,
+ "step": 903
+ },
+ {
+ "epoch": 4.567088607594937,
+ "grad_norm": 0.02557055652141571,
+ "learning_rate": 6.0437710437710435e-05,
+ "loss": 0.020033126696944237,
+ "step": 904
+ },
+ {
+ "epoch": 4.572151898734178,
+ "grad_norm": 0.08165695518255234,
+ "learning_rate": 6.038159371492705e-05,
+ "loss": 0.02415328472852707,
+ "step": 905
+ },
+ {
+ "epoch": 4.577215189873417,
+ "grad_norm": 0.03633309155702591,
+ "learning_rate": 6.032547699214366e-05,
+ "loss": 0.02082585170865059,
+ "step": 906
+ },
+ {
+ "epoch": 4.582278481012658,
+ "grad_norm": 0.03273358196020126,
+ "learning_rate": 6.026936026936028e-05,
+ "loss": 0.020049303770065308,
+ "step": 907
+ },
+ {
+ "epoch": 4.587341772151898,
+ "grad_norm": 0.040032029151916504,
+ "learning_rate": 6.021324354657688e-05,
+ "loss": 0.02167242392897606,
+ "step": 908
+ },
+ {
+ "epoch": 4.592405063291139,
+ "grad_norm": 0.02789166197180748,
+ "learning_rate": 6.01571268237935e-05,
+ "loss": 0.01964012160897255,
+ "step": 909
+ },
+ {
+ "epoch": 4.597468354430379,
+ "grad_norm": 0.03285825625061989,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.024942882359027863,
+ "step": 910
+ },
+ {
+ "epoch": 4.60253164556962,
+ "grad_norm": 0.02894079126417637,
+ "learning_rate": 6.004489337822672e-05,
+ "loss": 0.022012561559677124,
+ "step": 911
+ },
+ {
+ "epoch": 4.6075949367088604,
+ "grad_norm": 0.03291299566626549,
+ "learning_rate": 5.998877665544332e-05,
+ "loss": 0.02291432023048401,
+ "step": 912
+ },
+ {
+ "epoch": 4.612658227848101,
+ "grad_norm": 0.05124634876847267,
+ "learning_rate": 5.993265993265994e-05,
+ "loss": 0.017874885350465775,
+ "step": 913
+ },
+ {
+ "epoch": 4.6177215189873415,
+ "grad_norm": 0.042412169277668,
+ "learning_rate": 5.987654320987654e-05,
+ "loss": 0.0233401320874691,
+ "step": 914
+ },
+ {
+ "epoch": 4.622784810126582,
+ "grad_norm": 0.03447306156158447,
+ "learning_rate": 5.982042648709316e-05,
+ "loss": 0.022503826767206192,
+ "step": 915
+ },
+ {
+ "epoch": 4.627848101265823,
+ "grad_norm": 0.022415662184357643,
+ "learning_rate": 5.976430976430977e-05,
+ "loss": 0.01659448817372322,
+ "step": 916
+ },
+ {
+ "epoch": 4.632911392405063,
+ "grad_norm": 0.04882103577256203,
+ "learning_rate": 5.970819304152637e-05,
+ "loss": 0.02342696487903595,
+ "step": 917
+ },
+ {
+ "epoch": 4.637974683544304,
+ "grad_norm": 0.0341666042804718,
+ "learning_rate": 5.965207631874299e-05,
+ "loss": 0.026119260117411613,
+ "step": 918
+ },
+ {
+ "epoch": 4.643037974683544,
+ "grad_norm": 0.03507097065448761,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.022042831405997276,
+ "step": 919
+ },
+ {
+ "epoch": 4.648101265822785,
+ "grad_norm": 0.04078570008277893,
+ "learning_rate": 5.953984287317621e-05,
+ "loss": 0.01978793554008007,
+ "step": 920
+ },
+ {
+ "epoch": 4.653164556962025,
+ "grad_norm": 0.03481799736618996,
+ "learning_rate": 5.948372615039281e-05,
+ "loss": 0.02518302947282791,
+ "step": 921
+ },
+ {
+ "epoch": 4.658227848101266,
+ "grad_norm": 0.0456753633916378,
+ "learning_rate": 5.942760942760943e-05,
+ "loss": 0.027814291417598724,
+ "step": 922
+ },
+ {
+ "epoch": 4.663291139240506,
+ "grad_norm": 0.026144322007894516,
+ "learning_rate": 5.937149270482604e-05,
+ "loss": 0.020842768251895905,
+ "step": 923
+ },
+ {
+ "epoch": 4.668354430379747,
+ "grad_norm": 0.027078162878751755,
+ "learning_rate": 5.9315375982042657e-05,
+ "loss": 0.026818346232175827,
+ "step": 924
+ },
+ {
+ "epoch": 4.673417721518987,
+ "grad_norm": 0.04505958408117294,
+ "learning_rate": 5.925925925925926e-05,
+ "loss": 0.01925778016448021,
+ "step": 925
+ },
+ {
+ "epoch": 4.678481012658228,
+ "grad_norm": 0.028921643272042274,
+ "learning_rate": 5.920314253647588e-05,
+ "loss": 0.017857741564512253,
+ "step": 926
+ },
+ {
+ "epoch": 4.6835443037974684,
+ "grad_norm": 0.021489476785063744,
+ "learning_rate": 5.914702581369248e-05,
+ "loss": 0.018585946410894394,
+ "step": 927
+ },
+ {
+ "epoch": 4.688607594936709,
+ "grad_norm": 0.02885374240577221,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.023486338555812836,
+ "step": 928
+ },
+ {
+ "epoch": 4.6936708860759495,
+ "grad_norm": 0.037063464522361755,
+ "learning_rate": 5.90347923681257e-05,
+ "loss": 0.02569335326552391,
+ "step": 929
+ },
+ {
+ "epoch": 4.69873417721519,
+ "grad_norm": 0.02460661344230175,
+ "learning_rate": 5.897867564534232e-05,
+ "loss": 0.01580418087542057,
+ "step": 930
+ },
+ {
+ "epoch": 4.703797468354431,
+ "grad_norm": 0.030016187578439713,
+ "learning_rate": 5.892255892255892e-05,
+ "loss": 0.01811431720852852,
+ "step": 931
+ },
+ {
+ "epoch": 4.708860759493671,
+ "grad_norm": 0.030638013035058975,
+ "learning_rate": 5.886644219977554e-05,
+ "loss": 0.02380264922976494,
+ "step": 932
+ },
+ {
+ "epoch": 4.713924050632912,
+ "grad_norm": 0.022593742236495018,
+ "learning_rate": 5.881032547699215e-05,
+ "loss": 0.017498169094324112,
+ "step": 933
+ },
+ {
+ "epoch": 4.718987341772152,
+ "grad_norm": 0.026072485372424126,
+ "learning_rate": 5.8754208754208764e-05,
+ "loss": 0.020261723548173904,
+ "step": 934
+ },
+ {
+ "epoch": 4.724050632911393,
+ "grad_norm": 0.020842554047703743,
+ "learning_rate": 5.869809203142537e-05,
+ "loss": 0.018765904009342194,
+ "step": 935
+ },
+ {
+ "epoch": 4.729113924050633,
+ "grad_norm": 0.02724885568022728,
+ "learning_rate": 5.8641975308641984e-05,
+ "loss": 0.01877676695585251,
+ "step": 936
+ },
+ {
+ "epoch": 4.734177215189874,
+ "grad_norm": 0.037401214241981506,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.026435203850269318,
+ "step": 937
+ },
+ {
+ "epoch": 4.739240506329114,
+ "grad_norm": 0.06131114065647125,
+ "learning_rate": 5.852974186307519e-05,
+ "loss": 0.023247163742780685,
+ "step": 938
+ },
+ {
+ "epoch": 4.744303797468355,
+ "grad_norm": 0.04543917998671532,
+ "learning_rate": 5.847362514029181e-05,
+ "loss": 0.024184830486774445,
+ "step": 939
+ },
+ {
+ "epoch": 4.749367088607595,
+ "grad_norm": 0.03184051439166069,
+ "learning_rate": 5.841750841750842e-05,
+ "loss": 0.02176564559340477,
+ "step": 940
+ },
+ {
+ "epoch": 4.754430379746836,
+ "grad_norm": 0.0309689249843359,
+ "learning_rate": 5.8361391694725034e-05,
+ "loss": 0.023136526346206665,
+ "step": 941
+ },
+ {
+ "epoch": 4.759493670886076,
+ "grad_norm": 0.024972833693027496,
+ "learning_rate": 5.830527497194164e-05,
+ "loss": 0.017270661890506744,
+ "step": 942
+ },
+ {
+ "epoch": 4.764556962025316,
+ "grad_norm": 0.03733127936720848,
+ "learning_rate": 5.8249158249158255e-05,
+ "loss": 0.022722383961081505,
+ "step": 943
+ },
+ {
+ "epoch": 4.769620253164557,
+ "grad_norm": 0.04425952583551407,
+ "learning_rate": 5.819304152637486e-05,
+ "loss": 0.02506185881793499,
+ "step": 944
+ },
+ {
+ "epoch": 4.774683544303797,
+ "grad_norm": 0.022625036537647247,
+ "learning_rate": 5.8136924803591475e-05,
+ "loss": 0.017418090254068375,
+ "step": 945
+ },
+ {
+ "epoch": 4.779746835443038,
+ "grad_norm": 0.02716260775923729,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.022329077124595642,
+ "step": 946
+ },
+ {
+ "epoch": 4.784810126582278,
+ "grad_norm": 0.03288663551211357,
+ "learning_rate": 5.8024691358024695e-05,
+ "loss": 0.02051950991153717,
+ "step": 947
+ },
+ {
+ "epoch": 4.789873417721519,
+ "grad_norm": 0.03347448632121086,
+ "learning_rate": 5.7968574635241305e-05,
+ "loss": 0.01883091777563095,
+ "step": 948
+ },
+ {
+ "epoch": 4.794936708860759,
+ "grad_norm": 0.036814238876104355,
+ "learning_rate": 5.7912457912457915e-05,
+ "loss": 0.02320999652147293,
+ "step": 949
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.030795598402619362,
+ "learning_rate": 5.7856341189674525e-05,
+ "loss": 0.01819070428609848,
+ "step": 950
+ },
+ {
+ "epoch": 4.80506329113924,
+ "grad_norm": 0.03846567124128342,
+ "learning_rate": 5.780022446689114e-05,
+ "loss": 0.01933719590306282,
+ "step": 951
+ },
+ {
+ "epoch": 4.810126582278481,
+ "grad_norm": 0.029248127713799477,
+ "learning_rate": 5.7744107744107745e-05,
+ "loss": 0.01642131432890892,
+ "step": 952
+ },
+ {
+ "epoch": 4.815189873417721,
+ "grad_norm": 0.025749213993549347,
+ "learning_rate": 5.768799102132436e-05,
+ "loss": 0.017750587314367294,
+ "step": 953
+ },
+ {
+ "epoch": 4.820253164556962,
+ "grad_norm": 0.043794333934783936,
+ "learning_rate": 5.7631874298540965e-05,
+ "loss": 0.02561376616358757,
+ "step": 954
+ },
+ {
+ "epoch": 4.8253164556962025,
+ "grad_norm": 0.04074554517865181,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.023251589387655258,
+ "step": 955
+ },
+ {
+ "epoch": 4.830379746835443,
+ "grad_norm": 0.043594326823949814,
+ "learning_rate": 5.7519640852974186e-05,
+ "loss": 0.025138206779956818,
+ "step": 956
+ },
+ {
+ "epoch": 4.8354430379746836,
+ "grad_norm": 0.05410498008131981,
+ "learning_rate": 5.74635241301908e-05,
+ "loss": 0.023706410080194473,
+ "step": 957
+ },
+ {
+ "epoch": 4.840506329113924,
+ "grad_norm": 0.0299235749989748,
+ "learning_rate": 5.740740740740741e-05,
+ "loss": 0.01801147311925888,
+ "step": 958
+ },
+ {
+ "epoch": 4.845569620253165,
+ "grad_norm": 0.02982177399098873,
+ "learning_rate": 5.735129068462403e-05,
+ "loss": 0.021112898364663124,
+ "step": 959
+ },
+ {
+ "epoch": 4.850632911392405,
+ "grad_norm": 0.04181864112615585,
+ "learning_rate": 5.729517396184063e-05,
+ "loss": 0.02110268548130989,
+ "step": 960
+ },
+ {
+ "epoch": 4.855696202531646,
+ "grad_norm": 0.040301334112882614,
+ "learning_rate": 5.7239057239057236e-05,
+ "loss": 0.020649928599596024,
+ "step": 961
+ },
+ {
+ "epoch": 4.860759493670886,
+ "grad_norm": 0.03669300675392151,
+ "learning_rate": 5.718294051627385e-05,
+ "loss": 0.023078542202711105,
+ "step": 962
+ },
+ {
+ "epoch": 4.865822784810127,
+ "grad_norm": 0.023378873243927956,
+ "learning_rate": 5.7126823793490456e-05,
+ "loss": 0.01759505085647106,
+ "step": 963
+ },
+ {
+ "epoch": 4.870886075949367,
+ "grad_norm": 0.044835980981588364,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.023342810571193695,
+ "step": 964
+ },
+ {
+ "epoch": 4.875949367088608,
+ "grad_norm": 0.03264521807432175,
+ "learning_rate": 5.701459034792368e-05,
+ "loss": 0.021122846752405167,
+ "step": 965
+ },
+ {
+ "epoch": 4.881012658227848,
+ "grad_norm": 0.036651868373155594,
+ "learning_rate": 5.695847362514029e-05,
+ "loss": 0.026279672980308533,
+ "step": 966
+ },
+ {
+ "epoch": 4.886075949367089,
+ "grad_norm": 0.023810314014554024,
+ "learning_rate": 5.69023569023569e-05,
+ "loss": 0.020299838855862617,
+ "step": 967
+ },
+ {
+ "epoch": 4.891139240506329,
+ "grad_norm": 0.028432384133338928,
+ "learning_rate": 5.684624017957352e-05,
+ "loss": 0.019828233867883682,
+ "step": 968
+ },
+ {
+ "epoch": 4.89620253164557,
+ "grad_norm": 0.02499561943113804,
+ "learning_rate": 5.679012345679012e-05,
+ "loss": 0.023105870932340622,
+ "step": 969
+ },
+ {
+ "epoch": 4.9012658227848105,
+ "grad_norm": 0.0340624563395977,
+ "learning_rate": 5.673400673400674e-05,
+ "loss": 0.023707572370767593,
+ "step": 970
+ },
+ {
+ "epoch": 4.90632911392405,
+ "grad_norm": 0.02945004589855671,
+ "learning_rate": 5.667789001122334e-05,
+ "loss": 0.019038598984479904,
+ "step": 971
+ },
+ {
+ "epoch": 4.911392405063291,
+ "grad_norm": 0.034173011779785156,
+ "learning_rate": 5.662177328843996e-05,
+ "loss": 0.02678484097123146,
+ "step": 972
+ },
+ {
+ "epoch": 4.916455696202531,
+ "grad_norm": 0.0515705943107605,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.02983126789331436,
+ "step": 973
+ },
+ {
+ "epoch": 4.921518987341772,
+ "grad_norm": 0.024027375504374504,
+ "learning_rate": 5.650953984287318e-05,
+ "loss": 0.021375803276896477,
+ "step": 974
+ },
+ {
+ "epoch": 4.926582278481012,
+ "grad_norm": 0.03331667557358742,
+ "learning_rate": 5.645342312008979e-05,
+ "loss": 0.021600808948278427,
+ "step": 975
+ },
+ {
+ "epoch": 4.931645569620253,
+ "grad_norm": 0.029174596071243286,
+ "learning_rate": 5.639730639730641e-05,
+ "loss": 0.022452034056186676,
+ "step": 976
+ },
+ {
+ "epoch": 4.936708860759493,
+ "grad_norm": 0.03323808312416077,
+ "learning_rate": 5.634118967452301e-05,
+ "loss": 0.02531963586807251,
+ "step": 977
+ },
+ {
+ "epoch": 4.941772151898734,
+ "grad_norm": 0.02238641493022442,
+ "learning_rate": 5.628507295173963e-05,
+ "loss": 0.01655597612261772,
+ "step": 978
+ },
+ {
+ "epoch": 4.946835443037974,
+ "grad_norm": 0.03279856964945793,
+ "learning_rate": 5.622895622895623e-05,
+ "loss": 0.02232341095805168,
+ "step": 979
+ },
+ {
+ "epoch": 4.951898734177215,
+ "grad_norm": 0.03852152079343796,
+ "learning_rate": 5.617283950617285e-05,
+ "loss": 0.025721147656440735,
+ "step": 980
+ },
+ {
+ "epoch": 4.9569620253164555,
+ "grad_norm": 0.039974186569452286,
+ "learning_rate": 5.611672278338945e-05,
+ "loss": 0.015438543632626534,
+ "step": 981
+ },
+ {
+ "epoch": 4.962025316455696,
+ "grad_norm": 0.0348355695605278,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.021361682564020157,
+ "step": 982
+ },
+ {
+ "epoch": 4.9670886075949365,
+ "grad_norm": 0.02576221525669098,
+ "learning_rate": 5.600448933782267e-05,
+ "loss": 0.02103075385093689,
+ "step": 983
+ },
+ {
+ "epoch": 4.972151898734177,
+ "grad_norm": 0.039421118795871735,
+ "learning_rate": 5.594837261503928e-05,
+ "loss": 0.026340002194046974,
+ "step": 984
+ },
+ {
+ "epoch": 4.977215189873418,
+ "grad_norm": 0.02953593246638775,
+ "learning_rate": 5.58922558922559e-05,
+ "loss": 0.020818116143345833,
+ "step": 985
+ },
+ {
+ "epoch": 4.982278481012658,
+ "grad_norm": 0.033213913440704346,
+ "learning_rate": 5.58361391694725e-05,
+ "loss": 0.020878788083791733,
+ "step": 986
+ },
+ {
+ "epoch": 4.987341772151899,
+ "grad_norm": 0.04450162872672081,
+ "learning_rate": 5.578002244668912e-05,
+ "loss": 0.02208695001900196,
+ "step": 987
+ },
+ {
+ "epoch": 4.992405063291139,
+ "grad_norm": 0.04752403125166893,
+ "learning_rate": 5.572390572390572e-05,
+ "loss": 0.021128743886947632,
+ "step": 988
+ },
+ {
+ "epoch": 4.99746835443038,
+ "grad_norm": 0.03401600942015648,
+ "learning_rate": 5.566778900112234e-05,
+ "loss": 0.020553182810544968,
+ "step": 989
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.031174728646874428,
+ "learning_rate": 5.561167227833894e-05,
+ "loss": 0.01929999701678753,
+ "step": 990
+ },
+ {
+ "epoch": 5.0050632911392405,
+ "grad_norm": 0.056407660245895386,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.024739203974604607,
+ "step": 991
+ },
+ {
+ "epoch": 5.010126582278481,
+ "grad_norm": 0.019481178373098373,
+ "learning_rate": 5.549943883277217e-05,
+ "loss": 0.016404341906309128,
+ "step": 992
+ },
+ {
+ "epoch": 5.015189873417722,
+ "grad_norm": 0.029707469046115875,
+ "learning_rate": 5.5443322109988785e-05,
+ "loss": 0.017014270648360252,
+ "step": 993
+ },
+ {
+ "epoch": 5.020253164556962,
+ "grad_norm": 0.039400286972522736,
+ "learning_rate": 5.538720538720539e-05,
+ "loss": 0.016073700040578842,
+ "step": 994
+ },
+ {
+ "epoch": 5.025316455696203,
+ "grad_norm": 0.047592055052518845,
+ "learning_rate": 5.5331088664422005e-05,
+ "loss": 0.02021213248372078,
+ "step": 995
+ },
+ {
+ "epoch": 5.030379746835443,
+ "grad_norm": 0.054195769131183624,
+ "learning_rate": 5.527497194163861e-05,
+ "loss": 0.027454158291220665,
+ "step": 996
+ },
+ {
+ "epoch": 5.035443037974684,
+ "grad_norm": 0.02753913588821888,
+ "learning_rate": 5.5218855218855225e-05,
+ "loss": 0.01993582770228386,
+ "step": 997
+ },
+ {
+ "epoch": 5.040506329113924,
+ "grad_norm": 0.038280900567770004,
+ "learning_rate": 5.516273849607183e-05,
+ "loss": 0.017832420766353607,
+ "step": 998
+ },
+ {
+ "epoch": 5.045569620253165,
+ "grad_norm": 0.0289705079048872,
+ "learning_rate": 5.5106621773288446e-05,
+ "loss": 0.019040051847696304,
+ "step": 999
+ },
+ {
+ "epoch": 5.050632911392405,
+ "grad_norm": 0.030929062515497208,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.02529517561197281,
+ "step": 1000
+ },
+ {
+ "epoch": 5.055696202531646,
+ "grad_norm": 0.039416536688804626,
+ "learning_rate": 5.4994388327721666e-05,
+ "loss": 0.017563793808221817,
+ "step": 1001
+ },
+ {
+ "epoch": 5.060759493670886,
+ "grad_norm": 0.039831917732954025,
+ "learning_rate": 5.4938271604938276e-05,
+ "loss": 0.022547172382473946,
+ "step": 1002
+ },
+ {
+ "epoch": 5.065822784810127,
+ "grad_norm": 0.02979891747236252,
+ "learning_rate": 5.488215488215489e-05,
+ "loss": 0.019676152616739273,
+ "step": 1003
+ },
+ {
+ "epoch": 5.0708860759493675,
+ "grad_norm": 0.025752373039722443,
+ "learning_rate": 5.4826038159371496e-05,
+ "loss": 0.016172030940651894,
+ "step": 1004
+ },
+ {
+ "epoch": 5.075949367088608,
+ "grad_norm": 0.03433040529489517,
+ "learning_rate": 5.47699214365881e-05,
+ "loss": 0.022616712376475334,
+ "step": 1005
+ },
+ {
+ "epoch": 5.0810126582278485,
+ "grad_norm": 0.04834216088056564,
+ "learning_rate": 5.4713804713804716e-05,
+ "loss": 0.02641037292778492,
+ "step": 1006
+ },
+ {
+ "epoch": 5.086075949367088,
+ "grad_norm": 0.03748583421111107,
+ "learning_rate": 5.465768799102132e-05,
+ "loss": 0.02212962508201599,
+ "step": 1007
+ },
+ {
+ "epoch": 5.091139240506329,
+ "grad_norm": 0.03406492620706558,
+ "learning_rate": 5.4601571268237936e-05,
+ "loss": 0.022490520030260086,
+ "step": 1008
+ },
+ {
+ "epoch": 5.096202531645569,
+ "grad_norm": 0.025412574410438538,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.018286626785993576,
+ "step": 1009
+ },
+ {
+ "epoch": 5.10126582278481,
+ "grad_norm": 0.030613059177994728,
+ "learning_rate": 5.448933782267116e-05,
+ "loss": 0.018090849742293358,
+ "step": 1010
+ },
+ {
+ "epoch": 5.10632911392405,
+ "grad_norm": 0.032511018216609955,
+ "learning_rate": 5.4433221099887766e-05,
+ "loss": 0.019871044903993607,
+ "step": 1011
+ },
+ {
+ "epoch": 5.111392405063291,
+ "grad_norm": 0.041535500437021255,
+ "learning_rate": 5.437710437710438e-05,
+ "loss": 0.02880081906914711,
+ "step": 1012
+ },
+ {
+ "epoch": 5.116455696202531,
+ "grad_norm": 0.053748298436403275,
+ "learning_rate": 5.4320987654320986e-05,
+ "loss": 0.024350278079509735,
+ "step": 1013
+ },
+ {
+ "epoch": 5.121518987341772,
+ "grad_norm": 0.03045419417321682,
+ "learning_rate": 5.42648709315376e-05,
+ "loss": 0.026830779388546944,
+ "step": 1014
+ },
+ {
+ "epoch": 5.1265822784810124,
+ "grad_norm": 0.02704838663339615,
+ "learning_rate": 5.420875420875421e-05,
+ "loss": 0.019440406933426857,
+ "step": 1015
+ },
+ {
+ "epoch": 5.131645569620253,
+ "grad_norm": 0.037976089864969254,
+ "learning_rate": 5.4152637485970823e-05,
+ "loss": 0.02016528509557247,
+ "step": 1016
+ },
+ {
+ "epoch": 5.1367088607594935,
+ "grad_norm": 0.04055245593190193,
+ "learning_rate": 5.4096520763187434e-05,
+ "loss": 0.021118413656949997,
+ "step": 1017
+ },
+ {
+ "epoch": 5.141772151898734,
+ "grad_norm": 0.02943083830177784,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.01882058009505272,
+ "step": 1018
+ },
+ {
+ "epoch": 5.146835443037975,
+ "grad_norm": 0.03773244097828865,
+ "learning_rate": 5.3984287317620654e-05,
+ "loss": 0.025017477571964264,
+ "step": 1019
+ },
+ {
+ "epoch": 5.151898734177215,
+ "grad_norm": 0.026969652622938156,
+ "learning_rate": 5.392817059483727e-05,
+ "loss": 0.018443236127495766,
+ "step": 1020
+ },
+ {
+ "epoch": 5.156962025316456,
+ "grad_norm": 0.032142024487257004,
+ "learning_rate": 5.3872053872053874e-05,
+ "loss": 0.02332904376089573,
+ "step": 1021
+ },
+ {
+ "epoch": 5.162025316455696,
+ "grad_norm": 0.06372297555208206,
+ "learning_rate": 5.381593714927049e-05,
+ "loss": 0.027975570410490036,
+ "step": 1022
+ },
+ {
+ "epoch": 5.167088607594937,
+ "grad_norm": 0.03120330721139908,
+ "learning_rate": 5.3759820426487094e-05,
+ "loss": 0.023697681725025177,
+ "step": 1023
+ },
+ {
+ "epoch": 5.172151898734177,
+ "grad_norm": 0.029094889760017395,
+ "learning_rate": 5.370370370370371e-05,
+ "loss": 0.01727498322725296,
+ "step": 1024
+ },
+ {
+ "epoch": 5.177215189873418,
+ "grad_norm": 0.03791336342692375,
+ "learning_rate": 5.3647586980920314e-05,
+ "loss": 0.02156408131122589,
+ "step": 1025
+ },
+ {
+ "epoch": 5.182278481012658,
+ "grad_norm": 0.028603199869394302,
+ "learning_rate": 5.3591470258136924e-05,
+ "loss": 0.01781666837632656,
+ "step": 1026
+ },
+ {
+ "epoch": 5.187341772151899,
+ "grad_norm": 0.034254368394613266,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.023422224447131157,
+ "step": 1027
+ },
+ {
+ "epoch": 5.192405063291139,
+ "grad_norm": 0.025661299005150795,
+ "learning_rate": 5.3479236812570144e-05,
+ "loss": 0.017852213233709335,
+ "step": 1028
+ },
+ {
+ "epoch": 5.19746835443038,
+ "grad_norm": 0.03156711906194687,
+ "learning_rate": 5.342312008978676e-05,
+ "loss": 0.022492870688438416,
+ "step": 1029
+ },
+ {
+ "epoch": 5.2025316455696204,
+ "grad_norm": 0.0222217608243227,
+ "learning_rate": 5.3367003367003364e-05,
+ "loss": 0.015568151138722897,
+ "step": 1030
+ },
+ {
+ "epoch": 5.207594936708861,
+ "grad_norm": 0.04563366249203682,
+ "learning_rate": 5.331088664421998e-05,
+ "loss": 0.022124778479337692,
+ "step": 1031
+ },
+ {
+ "epoch": 5.2126582278481015,
+ "grad_norm": 0.04612975940108299,
+ "learning_rate": 5.3254769921436585e-05,
+ "loss": 0.027084846049547195,
+ "step": 1032
+ },
+ {
+ "epoch": 5.217721518987342,
+ "grad_norm": 0.047278422862291336,
+ "learning_rate": 5.31986531986532e-05,
+ "loss": 0.022641438990831375,
+ "step": 1033
+ },
+ {
+ "epoch": 5.222784810126583,
+ "grad_norm": 0.030134575441479683,
+ "learning_rate": 5.314253647586981e-05,
+ "loss": 0.01842697337269783,
+ "step": 1034
+ },
+ {
+ "epoch": 5.227848101265823,
+ "grad_norm": 0.019028518348932266,
+ "learning_rate": 5.308641975308642e-05,
+ "loss": 0.017543386667966843,
+ "step": 1035
+ },
+ {
+ "epoch": 5.232911392405064,
+ "grad_norm": 0.04117404296994209,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.02185094729065895,
+ "step": 1036
+ },
+ {
+ "epoch": 5.237974683544304,
+ "grad_norm": 0.0310111902654171,
+ "learning_rate": 5.297418630751965e-05,
+ "loss": 0.02418985590338707,
+ "step": 1037
+ },
+ {
+ "epoch": 5.243037974683545,
+ "grad_norm": 0.034619491547346115,
+ "learning_rate": 5.291806958473625e-05,
+ "loss": 0.02162736840546131,
+ "step": 1038
+ },
+ {
+ "epoch": 5.248101265822784,
+ "grad_norm": 0.04028276726603508,
+ "learning_rate": 5.286195286195287e-05,
+ "loss": 0.02554975263774395,
+ "step": 1039
+ },
+ {
+ "epoch": 5.253164556962025,
+ "grad_norm": 0.0336519293487072,
+ "learning_rate": 5.280583613916947e-05,
+ "loss": 0.019465651363134384,
+ "step": 1040
+ },
+ {
+ "epoch": 5.258227848101265,
+ "grad_norm": 0.033565767109394073,
+ "learning_rate": 5.274971941638609e-05,
+ "loss": 0.020889155566692352,
+ "step": 1041
+ },
+ {
+ "epoch": 5.263291139240506,
+ "grad_norm": 0.02902410738170147,
+ "learning_rate": 5.269360269360269e-05,
+ "loss": 0.02131371572613716,
+ "step": 1042
+ },
+ {
+ "epoch": 5.2683544303797465,
+ "grad_norm": 0.03622325137257576,
+ "learning_rate": 5.263748597081931e-05,
+ "loss": 0.017162127420306206,
+ "step": 1043
+ },
+ {
+ "epoch": 5.273417721518987,
+ "grad_norm": 0.039386410266160965,
+ "learning_rate": 5.258136924803592e-05,
+ "loss": 0.016598902642726898,
+ "step": 1044
+ },
+ {
+ "epoch": 5.2784810126582276,
+ "grad_norm": 0.035566773265600204,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.022860797122120857,
+ "step": 1045
+ },
+ {
+ "epoch": 5.283544303797468,
+ "grad_norm": 0.04470687359571457,
+ "learning_rate": 5.246913580246914e-05,
+ "loss": 0.020824994891881943,
+ "step": 1046
+ },
+ {
+ "epoch": 5.288607594936709,
+ "grad_norm": 0.03889680653810501,
+ "learning_rate": 5.241301907968574e-05,
+ "loss": 0.017250075936317444,
+ "step": 1047
+ },
+ {
+ "epoch": 5.293670886075949,
+ "grad_norm": 0.02681683376431465,
+ "learning_rate": 5.235690235690236e-05,
+ "loss": 0.0191829651594162,
+ "step": 1048
+ },
+ {
+ "epoch": 5.29873417721519,
+ "grad_norm": 0.018965722993016243,
+ "learning_rate": 5.230078563411896e-05,
+ "loss": 0.02007337100803852,
+ "step": 1049
+ },
+ {
+ "epoch": 5.30379746835443,
+ "grad_norm": 0.023910261690616608,
+ "learning_rate": 5.224466891133558e-05,
+ "loss": 0.02189997211098671,
+ "step": 1050
+ },
+ {
+ "epoch": 5.308860759493671,
+ "grad_norm": 0.03607999160885811,
+ "learning_rate": 5.218855218855219e-05,
+ "loss": 0.023346582427620888,
+ "step": 1051
+ },
+ {
+ "epoch": 5.313924050632911,
+ "grad_norm": 0.02490268088877201,
+ "learning_rate": 5.2132435465768806e-05,
+ "loss": 0.017453521490097046,
+ "step": 1052
+ },
+ {
+ "epoch": 5.318987341772152,
+ "grad_norm": 0.04894902557134628,
+ "learning_rate": 5.207631874298541e-05,
+ "loss": 0.023999422788619995,
+ "step": 1053
+ },
+ {
+ "epoch": 5.324050632911392,
+ "grad_norm": 0.01724478043615818,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.013751897029578686,
+ "step": 1054
+ },
+ {
+ "epoch": 5.329113924050633,
+ "grad_norm": 0.05506094545125961,
+ "learning_rate": 5.196408529741863e-05,
+ "loss": 0.02599490061402321,
+ "step": 1055
+ },
+ {
+ "epoch": 5.334177215189873,
+ "grad_norm": 0.030050745233893394,
+ "learning_rate": 5.1907968574635247e-05,
+ "loss": 0.022996244952082634,
+ "step": 1056
+ },
+ {
+ "epoch": 5.339240506329114,
+ "grad_norm": 0.028648901730775833,
+ "learning_rate": 5.185185185185185e-05,
+ "loss": 0.024319645017385483,
+ "step": 1057
+ },
+ {
+ "epoch": 5.3443037974683545,
+ "grad_norm": 0.04159106686711311,
+ "learning_rate": 5.179573512906847e-05,
+ "loss": 0.02485204115509987,
+ "step": 1058
+ },
+ {
+ "epoch": 5.349367088607595,
+ "grad_norm": 0.04454904422163963,
+ "learning_rate": 5.173961840628507e-05,
+ "loss": 0.018921498209238052,
+ "step": 1059
+ },
+ {
+ "epoch": 5.3544303797468356,
+ "grad_norm": 0.05850376933813095,
+ "learning_rate": 5.168350168350169e-05,
+ "loss": 0.02758260816335678,
+ "step": 1060
+ },
+ {
+ "epoch": 5.359493670886076,
+ "grad_norm": 0.03319580852985382,
+ "learning_rate": 5.16273849607183e-05,
+ "loss": 0.02180345356464386,
+ "step": 1061
+ },
+ {
+ "epoch": 5.364556962025317,
+ "grad_norm": 0.046812329441308975,
+ "learning_rate": 5.1571268237934914e-05,
+ "loss": 0.021682530641555786,
+ "step": 1062
+ },
+ {
+ "epoch": 5.369620253164557,
+ "grad_norm": 0.028218183666467667,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.019677158445119858,
+ "step": 1063
+ },
+ {
+ "epoch": 5.374683544303798,
+ "grad_norm": 0.04918216913938522,
+ "learning_rate": 5.1459034792368134e-05,
+ "loss": 0.019348308444023132,
+ "step": 1064
+ },
+ {
+ "epoch": 5.379746835443038,
+ "grad_norm": 0.041713107377290726,
+ "learning_rate": 5.140291806958474e-05,
+ "loss": 0.01728012040257454,
+ "step": 1065
+ },
+ {
+ "epoch": 5.384810126582279,
+ "grad_norm": 0.034068260341882706,
+ "learning_rate": 5.1346801346801354e-05,
+ "loss": 0.020487628877162933,
+ "step": 1066
+ },
+ {
+ "epoch": 5.389873417721519,
+ "grad_norm": 0.028666919097304344,
+ "learning_rate": 5.129068462401796e-05,
+ "loss": 0.015318546444177628,
+ "step": 1067
+ },
+ {
+ "epoch": 5.39493670886076,
+ "grad_norm": 0.03828604146838188,
+ "learning_rate": 5.1234567901234574e-05,
+ "loss": 0.028930973261594772,
+ "step": 1068
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.01870056800544262,
+ "learning_rate": 5.1178451178451184e-05,
+ "loss": 0.015031076967716217,
+ "step": 1069
+ },
+ {
+ "epoch": 5.405063291139241,
+ "grad_norm": 0.02219143882393837,
+ "learning_rate": 5.112233445566779e-05,
+ "loss": 0.019569698721170425,
+ "step": 1070
+ },
+ {
+ "epoch": 5.410126582278481,
+ "grad_norm": 0.04418749734759331,
+ "learning_rate": 5.1066217732884404e-05,
+ "loss": 0.025913581252098083,
+ "step": 1071
+ },
+ {
+ "epoch": 5.415189873417722,
+ "grad_norm": 0.05946826562285423,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.03080957755446434,
+ "step": 1072
+ },
+ {
+ "epoch": 5.4202531645569625,
+ "grad_norm": 0.032025255262851715,
+ "learning_rate": 5.0953984287317624e-05,
+ "loss": 0.017155487090349197,
+ "step": 1073
+ },
+ {
+ "epoch": 5.425316455696202,
+ "grad_norm": 0.033507514744997025,
+ "learning_rate": 5.089786756453423e-05,
+ "loss": 0.022324759513139725,
+ "step": 1074
+ },
+ {
+ "epoch": 5.430379746835443,
+ "grad_norm": 0.025624485686421394,
+ "learning_rate": 5.0841750841750845e-05,
+ "loss": 0.021772298961877823,
+ "step": 1075
+ },
+ {
+ "epoch": 5.435443037974683,
+ "grad_norm": 0.055580489337444305,
+ "learning_rate": 5.078563411896745e-05,
+ "loss": 0.01938481442630291,
+ "step": 1076
+ },
+ {
+ "epoch": 5.440506329113924,
+ "grad_norm": 0.04581330716609955,
+ "learning_rate": 5.0729517396184065e-05,
+ "loss": 0.019239529967308044,
+ "step": 1077
+ },
+ {
+ "epoch": 5.445569620253164,
+ "grad_norm": 0.06254621595144272,
+ "learning_rate": 5.0673400673400675e-05,
+ "loss": 0.027182448655366898,
+ "step": 1078
+ },
+ {
+ "epoch": 5.450632911392405,
+ "grad_norm": 0.036759812384843826,
+ "learning_rate": 5.061728395061729e-05,
+ "loss": 0.027131710201501846,
+ "step": 1079
+ },
+ {
+ "epoch": 5.455696202531645,
+ "grad_norm": 0.03190915286540985,
+ "learning_rate": 5.0561167227833895e-05,
+ "loss": 0.0259249284863472,
+ "step": 1080
+ },
+ {
+ "epoch": 5.460759493670886,
+ "grad_norm": 0.03208916634321213,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.02531026303768158,
+ "step": 1081
+ },
+ {
+ "epoch": 5.465822784810126,
+ "grad_norm": 0.06676970422267914,
+ "learning_rate": 5.0448933782267115e-05,
+ "loss": 0.022145366296172142,
+ "step": 1082
+ },
+ {
+ "epoch": 5.470886075949367,
+ "grad_norm": 0.027604084461927414,
+ "learning_rate": 5.039281705948373e-05,
+ "loss": 0.018208740279078484,
+ "step": 1083
+ },
+ {
+ "epoch": 5.4759493670886075,
+ "grad_norm": 0.03812532126903534,
+ "learning_rate": 5.0336700336700335e-05,
+ "loss": 0.024251334369182587,
+ "step": 1084
+ },
+ {
+ "epoch": 5.481012658227848,
+ "grad_norm": 0.03016139566898346,
+ "learning_rate": 5.028058361391695e-05,
+ "loss": 0.02196047455072403,
+ "step": 1085
+ },
+ {
+ "epoch": 5.4860759493670885,
+ "grad_norm": 0.017749929800629616,
+ "learning_rate": 5.022446689113356e-05,
+ "loss": 0.01607266068458557,
+ "step": 1086
+ },
+ {
+ "epoch": 5.491139240506329,
+ "grad_norm": 0.023184901103377342,
+ "learning_rate": 5.016835016835017e-05,
+ "loss": 0.021226245909929276,
+ "step": 1087
+ },
+ {
+ "epoch": 5.49620253164557,
+ "grad_norm": 0.024662092328071594,
+ "learning_rate": 5.011223344556678e-05,
+ "loss": 0.019691254943609238,
+ "step": 1088
+ },
+ {
+ "epoch": 5.50126582278481,
+ "grad_norm": 0.05883142724633217,
+ "learning_rate": 5.00561167227834e-05,
+ "loss": 0.03039814904332161,
+ "step": 1089
+ },
+ {
+ "epoch": 5.506329113924051,
+ "grad_norm": 0.029918279498815536,
+ "learning_rate": 5e-05,
+ "loss": 0.022806301712989807,
+ "step": 1090
+ },
+ {
+ "epoch": 5.511392405063291,
+ "grad_norm": 0.023451462388038635,
+ "learning_rate": 4.994388327721661e-05,
+ "loss": 0.018920207396149635,
+ "step": 1091
+ },
+ {
+ "epoch": 5.516455696202532,
+ "grad_norm": 0.030591748654842377,
+ "learning_rate": 4.988776655443322e-05,
+ "loss": 0.024741975590586662,
+ "step": 1092
+ },
+ {
+ "epoch": 5.521518987341772,
+ "grad_norm": 0.020344361662864685,
+ "learning_rate": 4.983164983164983e-05,
+ "loss": 0.018007446080446243,
+ "step": 1093
+ },
+ {
+ "epoch": 5.526582278481013,
+ "grad_norm": 0.029899192973971367,
+ "learning_rate": 4.977553310886644e-05,
+ "loss": 0.02196051925420761,
+ "step": 1094
+ },
+ {
+ "epoch": 5.531645569620253,
+ "grad_norm": 0.030987054109573364,
+ "learning_rate": 4.971941638608306e-05,
+ "loss": 0.018726475536823273,
+ "step": 1095
+ },
+ {
+ "epoch": 5.536708860759494,
+ "grad_norm": 0.031603869050741196,
+ "learning_rate": 4.966329966329967e-05,
+ "loss": 0.027497179806232452,
+ "step": 1096
+ },
+ {
+ "epoch": 5.541772151898734,
+ "grad_norm": 0.041930630803108215,
+ "learning_rate": 4.960718294051628e-05,
+ "loss": 0.0274939127266407,
+ "step": 1097
+ },
+ {
+ "epoch": 5.546835443037975,
+ "grad_norm": 0.020828744396567345,
+ "learning_rate": 4.955106621773289e-05,
+ "loss": 0.020464252680540085,
+ "step": 1098
+ },
+ {
+ "epoch": 5.5518987341772155,
+ "grad_norm": 0.03408589959144592,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.024826694279909134,
+ "step": 1099
+ },
+ {
+ "epoch": 5.556962025316456,
+ "grad_norm": 0.03565233200788498,
+ "learning_rate": 4.943883277216611e-05,
+ "loss": 0.0297713503241539,
+ "step": 1100
+ },
+ {
+ "epoch": 5.5620253164556965,
+ "grad_norm": 0.03275191783905029,
+ "learning_rate": 4.938271604938271e-05,
+ "loss": 0.022985238581895828,
+ "step": 1101
+ },
+ {
+ "epoch": 5.567088607594937,
+ "grad_norm": 0.04215894266963005,
+ "learning_rate": 4.932659932659932e-05,
+ "loss": 0.020872686058282852,
+ "step": 1102
+ },
+ {
+ "epoch": 5.572151898734178,
+ "grad_norm": 0.03496193513274193,
+ "learning_rate": 4.927048260381594e-05,
+ "loss": 0.020619090646505356,
+ "step": 1103
+ },
+ {
+ "epoch": 5.577215189873417,
+ "grad_norm": 0.020121701061725616,
+ "learning_rate": 4.921436588103255e-05,
+ "loss": 0.017047466710209846,
+ "step": 1104
+ },
+ {
+ "epoch": 5.582278481012658,
+ "grad_norm": 0.02406349778175354,
+ "learning_rate": 4.915824915824916e-05,
+ "loss": 0.01753303036093712,
+ "step": 1105
+ },
+ {
+ "epoch": 5.587341772151898,
+ "grad_norm": 0.03804773837327957,
+ "learning_rate": 4.910213243546577e-05,
+ "loss": 0.026075419038534164,
+ "step": 1106
+ },
+ {
+ "epoch": 5.592405063291139,
+ "grad_norm": 0.024065209552645683,
+ "learning_rate": 4.904601571268238e-05,
+ "loss": 0.02253042347729206,
+ "step": 1107
+ },
+ {
+ "epoch": 5.597468354430379,
+ "grad_norm": 0.024677708745002747,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.02093282900750637,
+ "step": 1108
+ },
+ {
+ "epoch": 5.60253164556962,
+ "grad_norm": 0.022487351670861244,
+ "learning_rate": 4.89337822671156e-05,
+ "loss": 0.019194334745407104,
+ "step": 1109
+ },
+ {
+ "epoch": 5.6075949367088604,
+ "grad_norm": 0.023981913924217224,
+ "learning_rate": 4.887766554433221e-05,
+ "loss": 0.019715486094355583,
+ "step": 1110
+ },
+ {
+ "epoch": 5.612658227848101,
+ "grad_norm": 0.49088963866233826,
+ "learning_rate": 4.882154882154882e-05,
+ "loss": 0.01954624056816101,
+ "step": 1111
+ },
+ {
+ "epoch": 5.6177215189873415,
+ "grad_norm": 0.020698007196187973,
+ "learning_rate": 4.876543209876544e-05,
+ "loss": 0.0198826901614666,
+ "step": 1112
+ },
+ {
+ "epoch": 5.622784810126582,
+ "grad_norm": 0.030978364869952202,
+ "learning_rate": 4.870931537598205e-05,
+ "loss": 0.022201407700777054,
+ "step": 1113
+ },
+ {
+ "epoch": 5.627848101265823,
+ "grad_norm": 0.03610600158572197,
+ "learning_rate": 4.865319865319866e-05,
+ "loss": 0.020692896097898483,
+ "step": 1114
+ },
+ {
+ "epoch": 5.632911392405063,
+ "grad_norm": 0.03503869101405144,
+ "learning_rate": 4.859708193041527e-05,
+ "loss": 0.024315977469086647,
+ "step": 1115
+ },
+ {
+ "epoch": 5.637974683544304,
+ "grad_norm": 0.038263533264398575,
+ "learning_rate": 4.854096520763188e-05,
+ "loss": 0.02289794571697712,
+ "step": 1116
+ },
+ {
+ "epoch": 5.643037974683544,
+ "grad_norm": 0.06627792865037918,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.016900356858968735,
+ "step": 1117
+ },
+ {
+ "epoch": 5.648101265822785,
+ "grad_norm": 0.04108016937971115,
+ "learning_rate": 4.84287317620651e-05,
+ "loss": 0.026155930012464523,
+ "step": 1118
+ },
+ {
+ "epoch": 5.653164556962025,
+ "grad_norm": 0.027791379019618034,
+ "learning_rate": 4.837261503928171e-05,
+ "loss": 0.018122777342796326,
+ "step": 1119
+ },
+ {
+ "epoch": 5.658227848101266,
+ "grad_norm": 0.06097861006855965,
+ "learning_rate": 4.831649831649832e-05,
+ "loss": 0.022645950317382812,
+ "step": 1120
+ },
+ {
+ "epoch": 5.663291139240506,
+ "grad_norm": 0.06343472748994827,
+ "learning_rate": 4.8260381593714935e-05,
+ "loss": 0.029537659138441086,
+ "step": 1121
+ },
+ {
+ "epoch": 5.668354430379747,
+ "grad_norm": 0.05996944010257721,
+ "learning_rate": 4.8204264870931545e-05,
+ "loss": 0.02282993122935295,
+ "step": 1122
+ },
+ {
+ "epoch": 5.673417721518987,
+ "grad_norm": 0.030753644183278084,
+ "learning_rate": 4.814814814814815e-05,
+ "loss": 0.01835070736706257,
+ "step": 1123
+ },
+ {
+ "epoch": 5.678481012658228,
+ "grad_norm": 0.0284577663987875,
+ "learning_rate": 4.809203142536476e-05,
+ "loss": 0.019698038697242737,
+ "step": 1124
+ },
+ {
+ "epoch": 5.6835443037974684,
+ "grad_norm": 0.03136469051241875,
+ "learning_rate": 4.803591470258137e-05,
+ "loss": 0.018538501113653183,
+ "step": 1125
+ },
+ {
+ "epoch": 5.688607594936709,
+ "grad_norm": 0.042034219950437546,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.01609296351671219,
+ "step": 1126
+ },
+ {
+ "epoch": 5.6936708860759495,
+ "grad_norm": 0.04704117774963379,
+ "learning_rate": 4.792368125701459e-05,
+ "loss": 0.017442524433135986,
+ "step": 1127
+ },
+ {
+ "epoch": 5.69873417721519,
+ "grad_norm": 0.04261549562215805,
+ "learning_rate": 4.78675645342312e-05,
+ "loss": 0.022896092385053635,
+ "step": 1128
+ },
+ {
+ "epoch": 5.703797468354431,
+ "grad_norm": 0.035263415426015854,
+ "learning_rate": 4.7811447811447815e-05,
+ "loss": 0.02376401424407959,
+ "step": 1129
+ },
+ {
+ "epoch": 5.708860759493671,
+ "grad_norm": 0.029153654351830482,
+ "learning_rate": 4.7755331088664425e-05,
+ "loss": 0.019103601574897766,
+ "step": 1130
+ },
+ {
+ "epoch": 5.713924050632912,
+ "grad_norm": 0.024728860706090927,
+ "learning_rate": 4.7699214365881036e-05,
+ "loss": 0.019203007221221924,
+ "step": 1131
+ },
+ {
+ "epoch": 5.718987341772152,
+ "grad_norm": 0.0682872086763382,
+ "learning_rate": 4.7643097643097646e-05,
+ "loss": 0.023789528757333755,
+ "step": 1132
+ },
+ {
+ "epoch": 5.724050632911393,
+ "grad_norm": 0.03475257009267807,
+ "learning_rate": 4.7586980920314256e-05,
+ "loss": 0.01748424954712391,
+ "step": 1133
+ },
+ {
+ "epoch": 5.729113924050633,
+ "grad_norm": 0.03768116980791092,
+ "learning_rate": 4.7530864197530866e-05,
+ "loss": 0.019674118608236313,
+ "step": 1134
+ },
+ {
+ "epoch": 5.734177215189874,
+ "grad_norm": 0.06546973437070847,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.02400730922818184,
+ "step": 1135
+ },
+ {
+ "epoch": 5.739240506329114,
+ "grad_norm": 0.03348927944898605,
+ "learning_rate": 4.7418630751964086e-05,
+ "loss": 0.027110135182738304,
+ "step": 1136
+ },
+ {
+ "epoch": 5.744303797468355,
+ "grad_norm": 0.041038379073143005,
+ "learning_rate": 4.7362514029180696e-05,
+ "loss": 0.025943022221326828,
+ "step": 1137
+ },
+ {
+ "epoch": 5.749367088607595,
+ "grad_norm": 0.03094886802136898,
+ "learning_rate": 4.730639730639731e-05,
+ "loss": 0.018898673355579376,
+ "step": 1138
+ },
+ {
+ "epoch": 5.754430379746836,
+ "grad_norm": 0.03637633100152016,
+ "learning_rate": 4.725028058361392e-05,
+ "loss": 0.02247396484017372,
+ "step": 1139
+ },
+ {
+ "epoch": 5.759493670886076,
+ "grad_norm": 0.03672393038868904,
+ "learning_rate": 4.719416386083053e-05,
+ "loss": 0.02294430509209633,
+ "step": 1140
+ },
+ {
+ "epoch": 5.764556962025316,
+ "grad_norm": 0.03434748202562332,
+ "learning_rate": 4.713804713804714e-05,
+ "loss": 0.021498121321201324,
+ "step": 1141
+ },
+ {
+ "epoch": 5.769620253164557,
+ "grad_norm": 0.032241202890872955,
+ "learning_rate": 4.708193041526375e-05,
+ "loss": 0.02623910829424858,
+ "step": 1142
+ },
+ {
+ "epoch": 5.774683544303797,
+ "grad_norm": 0.028173472732305527,
+ "learning_rate": 4.702581369248036e-05,
+ "loss": 0.018390003591775894,
+ "step": 1143
+ },
+ {
+ "epoch": 5.779746835443038,
+ "grad_norm": 0.033768974244594574,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.022890064865350723,
+ "step": 1144
+ },
+ {
+ "epoch": 5.784810126582278,
+ "grad_norm": 0.03199310600757599,
+ "learning_rate": 4.691358024691358e-05,
+ "loss": 0.018634604290127754,
+ "step": 1145
+ },
+ {
+ "epoch": 5.789873417721519,
+ "grad_norm": 0.02942977100610733,
+ "learning_rate": 4.685746352413019e-05,
+ "loss": 0.021336350589990616,
+ "step": 1146
+ },
+ {
+ "epoch": 5.794936708860759,
+ "grad_norm": 0.026747260242700577,
+ "learning_rate": 4.68013468013468e-05,
+ "loss": 0.017634060233831406,
+ "step": 1147
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.052395813167095184,
+ "learning_rate": 4.6745230078563413e-05,
+ "loss": 0.019521519541740417,
+ "step": 1148
+ },
+ {
+ "epoch": 5.80506329113924,
+ "grad_norm": 0.07997749745845795,
+ "learning_rate": 4.6689113355780024e-05,
+ "loss": 0.027218502014875412,
+ "step": 1149
+ },
+ {
+ "epoch": 5.810126582278481,
+ "grad_norm": 0.04570790380239487,
+ "learning_rate": 4.6632996632996634e-05,
+ "loss": 0.027033157646656036,
+ "step": 1150
+ },
+ {
+ "epoch": 5.815189873417721,
+ "grad_norm": 0.05992640554904938,
+ "learning_rate": 4.6576879910213244e-05,
+ "loss": 0.020755816251039505,
+ "step": 1151
+ },
+ {
+ "epoch": 5.820253164556962,
+ "grad_norm": 0.03377217426896095,
+ "learning_rate": 4.6520763187429854e-05,
+ "loss": 0.019246265292167664,
+ "step": 1152
+ },
+ {
+ "epoch": 5.8253164556962025,
+ "grad_norm": 0.026675008237361908,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.019907813519239426,
+ "step": 1153
+ },
+ {
+ "epoch": 5.830379746835443,
+ "grad_norm": 0.04007306694984436,
+ "learning_rate": 4.6408529741863074e-05,
+ "loss": 0.02621765062212944,
+ "step": 1154
+ },
+ {
+ "epoch": 5.8354430379746836,
+ "grad_norm": 0.05345958471298218,
+ "learning_rate": 4.635241301907969e-05,
+ "loss": 0.021677743643522263,
+ "step": 1155
+ },
+ {
+ "epoch": 5.840506329113924,
+ "grad_norm": 0.03231236711144447,
+ "learning_rate": 4.62962962962963e-05,
+ "loss": 0.01898232102394104,
+ "step": 1156
+ },
+ {
+ "epoch": 5.845569620253165,
+ "grad_norm": 0.06332266330718994,
+ "learning_rate": 4.624017957351291e-05,
+ "loss": 0.022123044356703758,
+ "step": 1157
+ },
+ {
+ "epoch": 5.850632911392405,
+ "grad_norm": 0.017904918640851974,
+ "learning_rate": 4.618406285072952e-05,
+ "loss": 0.016008764505386353,
+ "step": 1158
+ },
+ {
+ "epoch": 5.855696202531646,
+ "grad_norm": 0.032957062125205994,
+ "learning_rate": 4.612794612794613e-05,
+ "loss": 0.026430988684296608,
+ "step": 1159
+ },
+ {
+ "epoch": 5.860759493670886,
+ "grad_norm": 0.02764013037085533,
+ "learning_rate": 4.607182940516274e-05,
+ "loss": 0.01749669760465622,
+ "step": 1160
+ },
+ {
+ "epoch": 5.865822784810127,
+ "grad_norm": 0.031616635620594025,
+ "learning_rate": 4.601571268237935e-05,
+ "loss": 0.022402513772249222,
+ "step": 1161
+ },
+ {
+ "epoch": 5.870886075949367,
+ "grad_norm": 0.026803012937307358,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.02391771227121353,
+ "step": 1162
+ },
+ {
+ "epoch": 5.875949367088608,
+ "grad_norm": 0.039992235600948334,
+ "learning_rate": 4.590347923681257e-05,
+ "loss": 0.0186441782861948,
+ "step": 1163
+ },
+ {
+ "epoch": 5.881012658227848,
+ "grad_norm": 0.034594062715768814,
+ "learning_rate": 4.584736251402919e-05,
+ "loss": 0.020437058061361313,
+ "step": 1164
+ },
+ {
+ "epoch": 5.886075949367089,
+ "grad_norm": 0.01877710409462452,
+ "learning_rate": 4.57912457912458e-05,
+ "loss": 0.01517703477293253,
+ "step": 1165
+ },
+ {
+ "epoch": 5.891139240506329,
+ "grad_norm": 0.021410809829831123,
+ "learning_rate": 4.573512906846241e-05,
+ "loss": 0.021264132112264633,
+ "step": 1166
+ },
+ {
+ "epoch": 5.89620253164557,
+ "grad_norm": 0.04017850384116173,
+ "learning_rate": 4.567901234567901e-05,
+ "loss": 0.024904146790504456,
+ "step": 1167
+ },
+ {
+ "epoch": 5.9012658227848105,
+ "grad_norm": 0.030386412516236305,
+ "learning_rate": 4.562289562289562e-05,
+ "loss": 0.02334582805633545,
+ "step": 1168
+ },
+ {
+ "epoch": 5.90632911392405,
+ "grad_norm": 0.043996457010507584,
+ "learning_rate": 4.556677890011223e-05,
+ "loss": 0.02326396480202675,
+ "step": 1169
+ },
+ {
+ "epoch": 5.911392405063291,
+ "grad_norm": 0.028154531493782997,
+ "learning_rate": 4.551066217732884e-05,
+ "loss": 0.019153760746121407,
+ "step": 1170
+ },
+ {
+ "epoch": 5.916455696202531,
+ "grad_norm": 0.02629070170223713,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.02149396575987339,
+ "step": 1171
+ },
+ {
+ "epoch": 5.921518987341772,
+ "grad_norm": 0.024712109938263893,
+ "learning_rate": 4.539842873176207e-05,
+ "loss": 0.01731209270656109,
+ "step": 1172
+ },
+ {
+ "epoch": 5.926582278481012,
+ "grad_norm": 0.027591124176979065,
+ "learning_rate": 4.534231200897868e-05,
+ "loss": 0.018549319356679916,
+ "step": 1173
+ },
+ {
+ "epoch": 5.931645569620253,
+ "grad_norm": 0.025680841878056526,
+ "learning_rate": 4.528619528619529e-05,
+ "loss": 0.019339032471179962,
+ "step": 1174
+ },
+ {
+ "epoch": 5.936708860759493,
+ "grad_norm": 0.0393349826335907,
+ "learning_rate": 4.52300785634119e-05,
+ "loss": 0.026176627725362778,
+ "step": 1175
+ },
+ {
+ "epoch": 5.941772151898734,
+ "grad_norm": 0.028960758820176125,
+ "learning_rate": 4.517396184062851e-05,
+ "loss": 0.020635023713111877,
+ "step": 1176
+ },
+ {
+ "epoch": 5.946835443037974,
+ "grad_norm": 0.038171909749507904,
+ "learning_rate": 4.511784511784512e-05,
+ "loss": 0.025552934035658836,
+ "step": 1177
+ },
+ {
+ "epoch": 5.951898734177215,
+ "grad_norm": 0.0229384396225214,
+ "learning_rate": 4.506172839506173e-05,
+ "loss": 0.016696415841579437,
+ "step": 1178
+ },
+ {
+ "epoch": 5.9569620253164555,
+ "grad_norm": 0.03247852623462677,
+ "learning_rate": 4.500561167227834e-05,
+ "loss": 0.020189210772514343,
+ "step": 1179
+ },
+ {
+ "epoch": 5.962025316455696,
+ "grad_norm": 0.09168937802314758,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.02350265346467495,
+ "step": 1180
+ },
+ {
+ "epoch": 5.9670886075949365,
+ "grad_norm": 0.0498431995511055,
+ "learning_rate": 4.4893378226711566e-05,
+ "loss": 0.025292757898569107,
+ "step": 1181
+ },
+ {
+ "epoch": 5.972151898734177,
+ "grad_norm": 0.027248093858361244,
+ "learning_rate": 4.4837261503928176e-05,
+ "loss": 0.022255534306168556,
+ "step": 1182
+ },
+ {
+ "epoch": 5.977215189873418,
+ "grad_norm": 0.0405442975461483,
+ "learning_rate": 4.4781144781144786e-05,
+ "loss": 0.029488639906048775,
+ "step": 1183
+ },
+ {
+ "epoch": 5.982278481012658,
+ "grad_norm": 0.032689113169908524,
+ "learning_rate": 4.4725028058361396e-05,
+ "loss": 0.02393949031829834,
+ "step": 1184
+ },
+ {
+ "epoch": 5.987341772151899,
+ "grad_norm": 0.0387105718255043,
+ "learning_rate": 4.4668911335578006e-05,
+ "loss": 0.02393876016139984,
+ "step": 1185
+ },
+ {
+ "epoch": 5.992405063291139,
+ "grad_norm": 0.03787006437778473,
+ "learning_rate": 4.4612794612794616e-05,
+ "loss": 0.019787393510341644,
+ "step": 1186
+ },
+ {
+ "epoch": 5.99746835443038,
+ "grad_norm": 0.07046152651309967,
+ "learning_rate": 4.4556677890011226e-05,
+ "loss": 0.02120082452893257,
+ "step": 1187
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.04410094395279884,
+ "learning_rate": 4.4500561167227837e-05,
+ "loss": 0.01791391335427761,
+ "step": 1188
+ },
+ {
+ "epoch": 6.0050632911392405,
+ "grad_norm": 0.01917901448905468,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.01695849373936653,
+ "step": 1189
+ },
+ {
+ "epoch": 6.010126582278481,
+ "grad_norm": 0.036047060042619705,
+ "learning_rate": 4.438832772166106e-05,
+ "loss": 0.019642764702439308,
+ "step": 1190
+ },
+ {
+ "epoch": 6.015189873417722,
+ "grad_norm": 0.03756589815020561,
+ "learning_rate": 4.433221099887767e-05,
+ "loss": 0.01982583850622177,
+ "step": 1191
+ },
+ {
+ "epoch": 6.020253164556962,
+ "grad_norm": 0.04311134293675423,
+ "learning_rate": 4.427609427609428e-05,
+ "loss": 0.020853077992796898,
+ "step": 1192
+ },
+ {
+ "epoch": 6.025316455696203,
+ "grad_norm": 0.03493127599358559,
+ "learning_rate": 4.421997755331089e-05,
+ "loss": 0.022622421383857727,
+ "step": 1193
+ },
+ {
+ "epoch": 6.030379746835443,
+ "grad_norm": 0.05356646701693535,
+ "learning_rate": 4.41638608305275e-05,
+ "loss": 0.029369797557592392,
+ "step": 1194
+ },
+ {
+ "epoch": 6.035443037974684,
+ "grad_norm": 0.024938970804214478,
+ "learning_rate": 4.410774410774411e-05,
+ "loss": 0.02220488339662552,
+ "step": 1195
+ },
+ {
+ "epoch": 6.040506329113924,
+ "grad_norm": 0.03809231147170067,
+ "learning_rate": 4.405162738496072e-05,
+ "loss": 0.018828250467777252,
+ "step": 1196
+ },
+ {
+ "epoch": 6.045569620253165,
+ "grad_norm": 0.026176417246460915,
+ "learning_rate": 4.3995510662177334e-05,
+ "loss": 0.020378272980451584,
+ "step": 1197
+ },
+ {
+ "epoch": 6.050632911392405,
+ "grad_norm": 0.022295907139778137,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.016497395932674408,
+ "step": 1198
+ },
+ {
+ "epoch": 6.055696202531646,
+ "grad_norm": 0.03591796010732651,
+ "learning_rate": 4.3883277216610554e-05,
+ "loss": 0.01610766164958477,
+ "step": 1199
+ },
+ {
+ "epoch": 6.060759493670886,
+ "grad_norm": 0.02228034846484661,
+ "learning_rate": 4.3827160493827164e-05,
+ "loss": 0.016445940360426903,
+ "step": 1200
+ },
+ {
+ "epoch": 6.065822784810127,
+ "grad_norm": 0.046840816736221313,
+ "learning_rate": 4.3771043771043774e-05,
+ "loss": 0.025499895215034485,
+ "step": 1201
+ },
+ {
+ "epoch": 6.0708860759493675,
+ "grad_norm": 0.032549306750297546,
+ "learning_rate": 4.3714927048260384e-05,
+ "loss": 0.019290868192911148,
+ "step": 1202
+ },
+ {
+ "epoch": 6.075949367088608,
+ "grad_norm": 0.027548272162675858,
+ "learning_rate": 4.3658810325476994e-05,
+ "loss": 0.021467119455337524,
+ "step": 1203
+ },
+ {
+ "epoch": 6.0810126582278485,
+ "grad_norm": 0.04975379258394241,
+ "learning_rate": 4.3602693602693604e-05,
+ "loss": 0.025195952504873276,
+ "step": 1204
+ },
+ {
+ "epoch": 6.086075949367088,
+ "grad_norm": 0.033716000616550446,
+ "learning_rate": 4.3546576879910214e-05,
+ "loss": 0.022922039031982422,
+ "step": 1205
+ },
+ {
+ "epoch": 6.091139240506329,
+ "grad_norm": 0.0233322661370039,
+ "learning_rate": 4.3490460157126825e-05,
+ "loss": 0.016717061400413513,
+ "step": 1206
+ },
+ {
+ "epoch": 6.096202531645569,
+ "grad_norm": 0.037477824836969376,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.026978954672813416,
+ "step": 1207
+ },
+ {
+ "epoch": 6.10126582278481,
+ "grad_norm": 0.028440799564123154,
+ "learning_rate": 4.337822671156005e-05,
+ "loss": 0.02273373492062092,
+ "step": 1208
+ },
+ {
+ "epoch": 6.10632911392405,
+ "grad_norm": 0.035822827368974686,
+ "learning_rate": 4.332210998877666e-05,
+ "loss": 0.023257501423358917,
+ "step": 1209
+ },
+ {
+ "epoch": 6.111392405063291,
+ "grad_norm": 0.04019193351268768,
+ "learning_rate": 4.3265993265993265e-05,
+ "loss": 0.023539364337921143,
+ "step": 1210
+ },
+ {
+ "epoch": 6.116455696202531,
+ "grad_norm": 0.05412938818335533,
+ "learning_rate": 4.3209876543209875e-05,
+ "loss": 0.027814611792564392,
+ "step": 1211
+ },
+ {
+ "epoch": 6.121518987341772,
+ "grad_norm": 0.02482062578201294,
+ "learning_rate": 4.3153759820426485e-05,
+ "loss": 0.02218860387802124,
+ "step": 1212
+ },
+ {
+ "epoch": 6.1265822784810124,
+ "grad_norm": 0.0334421806037426,
+ "learning_rate": 4.3097643097643095e-05,
+ "loss": 0.017350582405924797,
+ "step": 1213
+ },
+ {
+ "epoch": 6.131645569620253,
+ "grad_norm": 0.056203264743089676,
+ "learning_rate": 4.304152637485971e-05,
+ "loss": 0.02287295088171959,
+ "step": 1214
+ },
+ {
+ "epoch": 6.1367088607594935,
+ "grad_norm": 0.039818573743104935,
+ "learning_rate": 4.298540965207632e-05,
+ "loss": 0.020514609292149544,
+ "step": 1215
+ },
+ {
+ "epoch": 6.141772151898734,
+ "grad_norm": 0.04640622064471245,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.024438779801130295,
+ "step": 1216
+ },
+ {
+ "epoch": 6.146835443037975,
+ "grad_norm": 0.029660161584615707,
+ "learning_rate": 4.287317620650954e-05,
+ "loss": 0.02020389772951603,
+ "step": 1217
+ },
+ {
+ "epoch": 6.151898734177215,
+ "grad_norm": 0.03027571365237236,
+ "learning_rate": 4.281705948372615e-05,
+ "loss": 0.020769162103533745,
+ "step": 1218
+ },
+ {
+ "epoch": 6.156962025316456,
+ "grad_norm": 0.03282143920660019,
+ "learning_rate": 4.276094276094276e-05,
+ "loss": 0.02164040133357048,
+ "step": 1219
+ },
+ {
+ "epoch": 6.162025316455696,
+ "grad_norm": 0.025130681693553925,
+ "learning_rate": 4.270482603815937e-05,
+ "loss": 0.01677907630801201,
+ "step": 1220
+ },
+ {
+ "epoch": 6.167088607594937,
+ "grad_norm": 0.031690534204244614,
+ "learning_rate": 4.264870931537598e-05,
+ "loss": 0.024241283535957336,
+ "step": 1221
+ },
+ {
+ "epoch": 6.172151898734177,
+ "grad_norm": 0.03872871398925781,
+ "learning_rate": 4.259259259259259e-05,
+ "loss": 0.021466728299856186,
+ "step": 1222
+ },
+ {
+ "epoch": 6.177215189873418,
+ "grad_norm": 0.025186678394675255,
+ "learning_rate": 4.253647586980921e-05,
+ "loss": 0.01849488914012909,
+ "step": 1223
+ },
+ {
+ "epoch": 6.182278481012658,
+ "grad_norm": 0.0362236425280571,
+ "learning_rate": 4.248035914702582e-05,
+ "loss": 0.023382779210805893,
+ "step": 1224
+ },
+ {
+ "epoch": 6.187341772151899,
+ "grad_norm": 0.03484080359339714,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.02402529865503311,
+ "step": 1225
+ },
+ {
+ "epoch": 6.192405063291139,
+ "grad_norm": 0.030236870050430298,
+ "learning_rate": 4.236812570145904e-05,
+ "loss": 0.02027088962495327,
+ "step": 1226
+ },
+ {
+ "epoch": 6.19746835443038,
+ "grad_norm": 0.042696740478277206,
+ "learning_rate": 4.231200897867565e-05,
+ "loss": 0.026293184608221054,
+ "step": 1227
+ },
+ {
+ "epoch": 6.2025316455696204,
+ "grad_norm": 0.033474963158369064,
+ "learning_rate": 4.225589225589226e-05,
+ "loss": 0.0192638598382473,
+ "step": 1228
+ },
+ {
+ "epoch": 6.207594936708861,
+ "grad_norm": 0.02278994210064411,
+ "learning_rate": 4.219977553310887e-05,
+ "loss": 0.016719598323106766,
+ "step": 1229
+ },
+ {
+ "epoch": 6.2126582278481015,
+ "grad_norm": 0.02794811874628067,
+ "learning_rate": 4.214365881032548e-05,
+ "loss": 0.02083922177553177,
+ "step": 1230
+ },
+ {
+ "epoch": 6.217721518987342,
+ "grad_norm": 0.036294132471084595,
+ "learning_rate": 4.208754208754209e-05,
+ "loss": 0.019131788983941078,
+ "step": 1231
+ },
+ {
+ "epoch": 6.222784810126583,
+ "grad_norm": 0.04194558039307594,
+ "learning_rate": 4.20314253647587e-05,
+ "loss": 0.02200900763273239,
+ "step": 1232
+ },
+ {
+ "epoch": 6.227848101265823,
+ "grad_norm": 0.031245706602931023,
+ "learning_rate": 4.197530864197531e-05,
+ "loss": 0.020135007798671722,
+ "step": 1233
+ },
+ {
+ "epoch": 6.232911392405064,
+ "grad_norm": 0.28146594762802124,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.028484351933002472,
+ "step": 1234
+ },
+ {
+ "epoch": 6.237974683544304,
+ "grad_norm": 0.03472084552049637,
+ "learning_rate": 4.186307519640853e-05,
+ "loss": 0.022836994379758835,
+ "step": 1235
+ },
+ {
+ "epoch": 6.243037974683545,
+ "grad_norm": 0.03993033990263939,
+ "learning_rate": 4.180695847362514e-05,
+ "loss": 0.02047956921160221,
+ "step": 1236
+ },
+ {
+ "epoch": 6.248101265822784,
+ "grad_norm": 0.04095892980694771,
+ "learning_rate": 4.175084175084175e-05,
+ "loss": 0.02556988038122654,
+ "step": 1237
+ },
+ {
+ "epoch": 6.253164556962025,
+ "grad_norm": 0.025003930553793907,
+ "learning_rate": 4.169472502805836e-05,
+ "loss": 0.02012123167514801,
+ "step": 1238
+ },
+ {
+ "epoch": 6.258227848101265,
+ "grad_norm": 0.13136205077171326,
+ "learning_rate": 4.163860830527497e-05,
+ "loss": 0.02262711711227894,
+ "step": 1239
+ },
+ {
+ "epoch": 6.263291139240506,
+ "grad_norm": 0.030299177393317223,
+ "learning_rate": 4.158249158249159e-05,
+ "loss": 0.02208639681339264,
+ "step": 1240
+ },
+ {
+ "epoch": 6.2683544303797465,
+ "grad_norm": 0.029313303530216217,
+ "learning_rate": 4.15263748597082e-05,
+ "loss": 0.01897791400551796,
+ "step": 1241
+ },
+ {
+ "epoch": 6.273417721518987,
+ "grad_norm": 0.02532120980322361,
+ "learning_rate": 4.147025813692481e-05,
+ "loss": 0.017832642421126366,
+ "step": 1242
+ },
+ {
+ "epoch": 6.2784810126582276,
+ "grad_norm": 0.03251331299543381,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.018247608095407486,
+ "step": 1243
+ },
+ {
+ "epoch": 6.283544303797468,
+ "grad_norm": 0.022575413808226585,
+ "learning_rate": 4.135802469135803e-05,
+ "loss": 0.018954705446958542,
+ "step": 1244
+ },
+ {
+ "epoch": 6.288607594936709,
+ "grad_norm": 0.039219100028276443,
+ "learning_rate": 4.130190796857464e-05,
+ "loss": 0.024930771440267563,
+ "step": 1245
+ },
+ {
+ "epoch": 6.293670886075949,
+ "grad_norm": 0.0373169481754303,
+ "learning_rate": 4.124579124579125e-05,
+ "loss": 0.01826397515833378,
+ "step": 1246
+ },
+ {
+ "epoch": 6.29873417721519,
+ "grad_norm": 0.027518540620803833,
+ "learning_rate": 4.118967452300786e-05,
+ "loss": 0.019876884296536446,
+ "step": 1247
+ },
+ {
+ "epoch": 6.30379746835443,
+ "grad_norm": 0.0396210178732872,
+ "learning_rate": 4.113355780022447e-05,
+ "loss": 0.025219090282917023,
+ "step": 1248
+ },
+ {
+ "epoch": 6.308860759493671,
+ "grad_norm": 0.08618787676095963,
+ "learning_rate": 4.1077441077441085e-05,
+ "loss": 0.023020410910248756,
+ "step": 1249
+ },
+ {
+ "epoch": 6.313924050632911,
+ "grad_norm": 0.029861560091376305,
+ "learning_rate": 4.1021324354657695e-05,
+ "loss": 0.017338024452328682,
+ "step": 1250
+ },
+ {
+ "epoch": 6.318987341772152,
+ "grad_norm": 0.02950313501060009,
+ "learning_rate": 4.0965207631874305e-05,
+ "loss": 0.02082744613289833,
+ "step": 1251
+ },
+ {
+ "epoch": 6.324050632911392,
+ "grad_norm": 0.04144814610481262,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.022624965757131577,
+ "step": 1252
+ },
+ {
+ "epoch": 6.329113924050633,
+ "grad_norm": 0.026044249534606934,
+ "learning_rate": 4.085297418630752e-05,
+ "loss": 0.021008584648370743,
+ "step": 1253
+ },
+ {
+ "epoch": 6.334177215189873,
+ "grad_norm": 0.022971170023083687,
+ "learning_rate": 4.079685746352413e-05,
+ "loss": 0.017941180616617203,
+ "step": 1254
+ },
+ {
+ "epoch": 6.339240506329114,
+ "grad_norm": 0.06906288862228394,
+ "learning_rate": 4.074074074074074e-05,
+ "loss": 0.028001971542835236,
+ "step": 1255
+ },
+ {
+ "epoch": 6.3443037974683545,
+ "grad_norm": 0.023604001849889755,
+ "learning_rate": 4.068462401795735e-05,
+ "loss": 0.01718234084546566,
+ "step": 1256
+ },
+ {
+ "epoch": 6.349367088607595,
+ "grad_norm": 0.01937725767493248,
+ "learning_rate": 4.0628507295173965e-05,
+ "loss": 0.014251970686018467,
+ "step": 1257
+ },
+ {
+ "epoch": 6.3544303797468356,
+ "grad_norm": 0.029861370101571083,
+ "learning_rate": 4.0572390572390575e-05,
+ "loss": 0.020723488181829453,
+ "step": 1258
+ },
+ {
+ "epoch": 6.359493670886076,
+ "grad_norm": 0.021436452865600586,
+ "learning_rate": 4.0516273849607185e-05,
+ "loss": 0.017737478017807007,
+ "step": 1259
+ },
+ {
+ "epoch": 6.364556962025317,
+ "grad_norm": 0.028320396319031715,
+ "learning_rate": 4.0460157126823795e-05,
+ "loss": 0.018616296350955963,
+ "step": 1260
+ },
+ {
+ "epoch": 6.369620253164557,
+ "grad_norm": 0.06868637353181839,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.021761005744338036,
+ "step": 1261
+ },
+ {
+ "epoch": 6.374683544303798,
+ "grad_norm": 0.051593340933322906,
+ "learning_rate": 4.0347923681257015e-05,
+ "loss": 0.024777185171842575,
+ "step": 1262
+ },
+ {
+ "epoch": 6.379746835443038,
+ "grad_norm": 0.03426795080304146,
+ "learning_rate": 4.0291806958473625e-05,
+ "loss": 0.018097344785928726,
+ "step": 1263
+ },
+ {
+ "epoch": 6.384810126582279,
+ "grad_norm": 0.029523326084017754,
+ "learning_rate": 4.0235690235690236e-05,
+ "loss": 0.021459240466356277,
+ "step": 1264
+ },
+ {
+ "epoch": 6.389873417721519,
+ "grad_norm": 0.0349370501935482,
+ "learning_rate": 4.0179573512906846e-05,
+ "loss": 0.02003314346075058,
+ "step": 1265
+ },
+ {
+ "epoch": 6.39493670886076,
+ "grad_norm": 0.03242987021803856,
+ "learning_rate": 4.012345679012346e-05,
+ "loss": 0.021367881447076797,
+ "step": 1266
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.024630239233374596,
+ "learning_rate": 4.006734006734007e-05,
+ "loss": 0.018102720379829407,
+ "step": 1267
+ },
+ {
+ "epoch": 6.405063291139241,
+ "grad_norm": 0.031077086925506592,
+ "learning_rate": 4.001122334455668e-05,
+ "loss": 0.018588688224554062,
+ "step": 1268
+ },
+ {
+ "epoch": 6.410126582278481,
+ "grad_norm": 0.027421677485108376,
+ "learning_rate": 3.995510662177329e-05,
+ "loss": 0.02185939997434616,
+ "step": 1269
+ },
+ {
+ "epoch": 6.415189873417722,
+ "grad_norm": 0.025877851992845535,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.014880839735269547,
+ "step": 1270
+ },
+ {
+ "epoch": 6.4202531645569625,
+ "grad_norm": 0.06078079342842102,
+ "learning_rate": 3.984287317620651e-05,
+ "loss": 0.020707489922642708,
+ "step": 1271
+ },
+ {
+ "epoch": 6.425316455696202,
+ "grad_norm": 0.037427812814712524,
+ "learning_rate": 3.978675645342312e-05,
+ "loss": 0.019588246941566467,
+ "step": 1272
+ },
+ {
+ "epoch": 6.430379746835443,
+ "grad_norm": 0.021001679822802544,
+ "learning_rate": 3.973063973063973e-05,
+ "loss": 0.01820206455886364,
+ "step": 1273
+ },
+ {
+ "epoch": 6.435443037974683,
+ "grad_norm": 0.05302223563194275,
+ "learning_rate": 3.967452300785634e-05,
+ "loss": 0.028976645320653915,
+ "step": 1274
+ },
+ {
+ "epoch": 6.440506329113924,
+ "grad_norm": 0.021593907848000526,
+ "learning_rate": 3.961840628507295e-05,
+ "loss": 0.018273863941431046,
+ "step": 1275
+ },
+ {
+ "epoch": 6.445569620253164,
+ "grad_norm": 0.05006744712591171,
+ "learning_rate": 3.956228956228956e-05,
+ "loss": 0.020786389708518982,
+ "step": 1276
+ },
+ {
+ "epoch": 6.450632911392405,
+ "grad_norm": 0.025030262768268585,
+ "learning_rate": 3.950617283950617e-05,
+ "loss": 0.017760692164301872,
+ "step": 1277
+ },
+ {
+ "epoch": 6.455696202531645,
+ "grad_norm": 0.04701874032616615,
+ "learning_rate": 3.945005611672278e-05,
+ "loss": 0.029284045100212097,
+ "step": 1278
+ },
+ {
+ "epoch": 6.460759493670886,
+ "grad_norm": 0.032726943492889404,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.02018846571445465,
+ "step": 1279
+ },
+ {
+ "epoch": 6.465822784810126,
+ "grad_norm": 0.039836980402469635,
+ "learning_rate": 3.9337822671156003e-05,
+ "loss": 0.01897161826491356,
+ "step": 1280
+ },
+ {
+ "epoch": 6.470886075949367,
+ "grad_norm": 0.033106207847595215,
+ "learning_rate": 3.9281705948372613e-05,
+ "loss": 0.01981613039970398,
+ "step": 1281
+ },
+ {
+ "epoch": 6.4759493670886075,
+ "grad_norm": 0.024439049884676933,
+ "learning_rate": 3.9225589225589224e-05,
+ "loss": 0.018410254269838333,
+ "step": 1282
+ },
+ {
+ "epoch": 6.481012658227848,
+ "grad_norm": 0.025965489447116852,
+ "learning_rate": 3.916947250280584e-05,
+ "loss": 0.02004053071141243,
+ "step": 1283
+ },
+ {
+ "epoch": 6.4860759493670885,
+ "grad_norm": 0.02710670977830887,
+ "learning_rate": 3.911335578002245e-05,
+ "loss": 0.022794827818870544,
+ "step": 1284
+ },
+ {
+ "epoch": 6.491139240506329,
+ "grad_norm": 0.04063912108540535,
+ "learning_rate": 3.905723905723906e-05,
+ "loss": 0.022095832973718643,
+ "step": 1285
+ },
+ {
+ "epoch": 6.49620253164557,
+ "grad_norm": 0.02844894304871559,
+ "learning_rate": 3.900112233445567e-05,
+ "loss": 0.02208099141716957,
+ "step": 1286
+ },
+ {
+ "epoch": 6.50126582278481,
+ "grad_norm": 0.042183391749858856,
+ "learning_rate": 3.894500561167228e-05,
+ "loss": 0.022891748696565628,
+ "step": 1287
+ },
+ {
+ "epoch": 6.506329113924051,
+ "grad_norm": 0.03206615149974823,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.01791396550834179,
+ "step": 1288
+ },
+ {
+ "epoch": 6.511392405063291,
+ "grad_norm": 0.20604346692562103,
+ "learning_rate": 3.88327721661055e-05,
+ "loss": 0.021381299942731857,
+ "step": 1289
+ },
+ {
+ "epoch": 6.516455696202532,
+ "grad_norm": 0.040892940014600754,
+ "learning_rate": 3.877665544332211e-05,
+ "loss": 0.027452345937490463,
+ "step": 1290
+ },
+ {
+ "epoch": 6.521518987341772,
+ "grad_norm": 0.036108002066612244,
+ "learning_rate": 3.872053872053872e-05,
+ "loss": 0.02328622341156006,
+ "step": 1291
+ },
+ {
+ "epoch": 6.526582278481013,
+ "grad_norm": 0.0261856522411108,
+ "learning_rate": 3.866442199775534e-05,
+ "loss": 0.019690997898578644,
+ "step": 1292
+ },
+ {
+ "epoch": 6.531645569620253,
+ "grad_norm": 0.03961426392197609,
+ "learning_rate": 3.860830527497195e-05,
+ "loss": 0.0222979336977005,
+ "step": 1293
+ },
+ {
+ "epoch": 6.536708860759494,
+ "grad_norm": 0.04051761329174042,
+ "learning_rate": 3.855218855218856e-05,
+ "loss": 0.025474993512034416,
+ "step": 1294
+ },
+ {
+ "epoch": 6.541772151898734,
+ "grad_norm": 0.02267736941576004,
+ "learning_rate": 3.849607182940517e-05,
+ "loss": 0.022006051614880562,
+ "step": 1295
+ },
+ {
+ "epoch": 6.546835443037975,
+ "grad_norm": 0.030732441693544388,
+ "learning_rate": 3.843995510662178e-05,
+ "loss": 0.019268793985247612,
+ "step": 1296
+ },
+ {
+ "epoch": 6.5518987341772155,
+ "grad_norm": 0.028448719531297684,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.022158455103635788,
+ "step": 1297
+ },
+ {
+ "epoch": 6.556962025316456,
+ "grad_norm": 0.03139292076230049,
+ "learning_rate": 3.832772166105499e-05,
+ "loss": 0.022079430520534515,
+ "step": 1298
+ },
+ {
+ "epoch": 6.5620253164556965,
+ "grad_norm": 0.031093589961528778,
+ "learning_rate": 3.82716049382716e-05,
+ "loss": 0.018232567235827446,
+ "step": 1299
+ },
+ {
+ "epoch": 6.567088607594937,
+ "grad_norm": 0.05002875253558159,
+ "learning_rate": 3.821548821548822e-05,
+ "loss": 0.025977667421102524,
+ "step": 1300
+ },
+ {
+ "epoch": 6.572151898734178,
+ "grad_norm": 0.022760825231671333,
+ "learning_rate": 3.815937149270483e-05,
+ "loss": 0.01952279731631279,
+ "step": 1301
+ },
+ {
+ "epoch": 6.577215189873417,
+ "grad_norm": 0.038710758090019226,
+ "learning_rate": 3.810325476992144e-05,
+ "loss": 0.018337469547986984,
+ "step": 1302
+ },
+ {
+ "epoch": 6.582278481012658,
+ "grad_norm": 0.03606388345360756,
+ "learning_rate": 3.804713804713805e-05,
+ "loss": 0.022117454558610916,
+ "step": 1303
+ },
+ {
+ "epoch": 6.587341772151898,
+ "grad_norm": 0.0337548591196537,
+ "learning_rate": 3.799102132435466e-05,
+ "loss": 0.021384209394454956,
+ "step": 1304
+ },
+ {
+ "epoch": 6.592405063291139,
+ "grad_norm": 0.03523571416735649,
+ "learning_rate": 3.793490460157127e-05,
+ "loss": 0.017840903252363205,
+ "step": 1305
+ },
+ {
+ "epoch": 6.597468354430379,
+ "grad_norm": 0.06067586690187454,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.024789758026599884,
+ "step": 1306
+ },
+ {
+ "epoch": 6.60253164556962,
+ "grad_norm": 0.03350597992539406,
+ "learning_rate": 3.782267115600449e-05,
+ "loss": 0.02044159173965454,
+ "step": 1307
+ },
+ {
+ "epoch": 6.6075949367088604,
+ "grad_norm": 0.027923524379730225,
+ "learning_rate": 3.77665544332211e-05,
+ "loss": 0.016555916517972946,
+ "step": 1308
+ },
+ {
+ "epoch": 6.612658227848101,
+ "grad_norm": 0.049295879900455475,
+ "learning_rate": 3.7710437710437716e-05,
+ "loss": 0.02809835597872734,
+ "step": 1309
+ },
+ {
+ "epoch": 6.6177215189873415,
+ "grad_norm": 0.0679546371102333,
+ "learning_rate": 3.7654320987654326e-05,
+ "loss": 0.02421809732913971,
+ "step": 1310
+ },
+ {
+ "epoch": 6.622784810126582,
+ "grad_norm": 0.027567917481064796,
+ "learning_rate": 3.7598204264870936e-05,
+ "loss": 0.020084332674741745,
+ "step": 1311
+ },
+ {
+ "epoch": 6.627848101265823,
+ "grad_norm": 0.04364616423845291,
+ "learning_rate": 3.7542087542087546e-05,
+ "loss": 0.024303186684846878,
+ "step": 1312
+ },
+ {
+ "epoch": 6.632911392405063,
+ "grad_norm": 0.060693949460983276,
+ "learning_rate": 3.7485970819304156e-05,
+ "loss": 0.022462837398052216,
+ "step": 1313
+ },
+ {
+ "epoch": 6.637974683544304,
+ "grad_norm": 0.05344981327652931,
+ "learning_rate": 3.7429854096520766e-05,
+ "loss": 0.02119705080986023,
+ "step": 1314
+ },
+ {
+ "epoch": 6.643037974683544,
+ "grad_norm": 0.04188868775963783,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.02262813225388527,
+ "step": 1315
+ },
+ {
+ "epoch": 6.648101265822785,
+ "grad_norm": 0.10617388039827347,
+ "learning_rate": 3.7317620650953986e-05,
+ "loss": 0.028262268751859665,
+ "step": 1316
+ },
+ {
+ "epoch": 6.653164556962025,
+ "grad_norm": 0.028918985277414322,
+ "learning_rate": 3.7261503928170596e-05,
+ "loss": 0.018603652715682983,
+ "step": 1317
+ },
+ {
+ "epoch": 6.658227848101266,
+ "grad_norm": 0.037515874952077866,
+ "learning_rate": 3.720538720538721e-05,
+ "loss": 0.024647820740938187,
+ "step": 1318
+ },
+ {
+ "epoch": 6.663291139240506,
+ "grad_norm": 0.0347459651529789,
+ "learning_rate": 3.7149270482603816e-05,
+ "loss": 0.024235039949417114,
+ "step": 1319
+ },
+ {
+ "epoch": 6.668354430379747,
+ "grad_norm": 0.04326598346233368,
+ "learning_rate": 3.7093153759820426e-05,
+ "loss": 0.02030426263809204,
+ "step": 1320
+ },
+ {
+ "epoch": 6.673417721518987,
+ "grad_norm": 0.026792412623763084,
+ "learning_rate": 3.7037037037037037e-05,
+ "loss": 0.02184079959988594,
+ "step": 1321
+ },
+ {
+ "epoch": 6.678481012658228,
+ "grad_norm": 0.033112917095422745,
+ "learning_rate": 3.698092031425365e-05,
+ "loss": 0.019945142790675163,
+ "step": 1322
+ },
+ {
+ "epoch": 6.6835443037974684,
+ "grad_norm": 0.031808555126190186,
+ "learning_rate": 3.692480359147026e-05,
+ "loss": 0.024434339255094528,
+ "step": 1323
+ },
+ {
+ "epoch": 6.688607594936709,
+ "grad_norm": 0.03284522145986557,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.017459489405155182,
+ "step": 1324
+ },
+ {
+ "epoch": 6.6936708860759495,
+ "grad_norm": 0.029303887858986855,
+ "learning_rate": 3.681257014590348e-05,
+ "loss": 0.017790818586945534,
+ "step": 1325
+ },
+ {
+ "epoch": 6.69873417721519,
+ "grad_norm": 0.028168147429823875,
+ "learning_rate": 3.6756453423120094e-05,
+ "loss": 0.022105036303400993,
+ "step": 1326
+ },
+ {
+ "epoch": 6.703797468354431,
+ "grad_norm": 0.045645441859960556,
+ "learning_rate": 3.6700336700336704e-05,
+ "loss": 0.0288691483438015,
+ "step": 1327
+ },
+ {
+ "epoch": 6.708860759493671,
+ "grad_norm": 0.02225707843899727,
+ "learning_rate": 3.6644219977553314e-05,
+ "loss": 0.016150090843439102,
+ "step": 1328
+ },
+ {
+ "epoch": 6.713924050632912,
+ "grad_norm": 0.02501208707690239,
+ "learning_rate": 3.6588103254769924e-05,
+ "loss": 0.023236583918333054,
+ "step": 1329
+ },
+ {
+ "epoch": 6.718987341772152,
+ "grad_norm": 0.038911011070013046,
+ "learning_rate": 3.6531986531986534e-05,
+ "loss": 0.025721289217472076,
+ "step": 1330
+ },
+ {
+ "epoch": 6.724050632911393,
+ "grad_norm": 0.036257173866033554,
+ "learning_rate": 3.6475869809203144e-05,
+ "loss": 0.025515632703900337,
+ "step": 1331
+ },
+ {
+ "epoch": 6.729113924050633,
+ "grad_norm": 0.03473728895187378,
+ "learning_rate": 3.6419753086419754e-05,
+ "loss": 0.02300131320953369,
+ "step": 1332
+ },
+ {
+ "epoch": 6.734177215189874,
+ "grad_norm": 0.03154155611991882,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.024625634774565697,
+ "step": 1333
+ },
+ {
+ "epoch": 6.739240506329114,
+ "grad_norm": 0.04241670295596123,
+ "learning_rate": 3.6307519640852974e-05,
+ "loss": 0.021008290350437164,
+ "step": 1334
+ },
+ {
+ "epoch": 6.744303797468355,
+ "grad_norm": 0.027151785790920258,
+ "learning_rate": 3.625140291806959e-05,
+ "loss": 0.021018799394369125,
+ "step": 1335
+ },
+ {
+ "epoch": 6.749367088607595,
+ "grad_norm": 0.026534251868724823,
+ "learning_rate": 3.61952861952862e-05,
+ "loss": 0.018448853865265846,
+ "step": 1336
+ },
+ {
+ "epoch": 6.754430379746836,
+ "grad_norm": 0.02729695476591587,
+ "learning_rate": 3.613916947250281e-05,
+ "loss": 0.022980306297540665,
+ "step": 1337
+ },
+ {
+ "epoch": 6.759493670886076,
+ "grad_norm": 0.023642007261514664,
+ "learning_rate": 3.608305274971942e-05,
+ "loss": 0.019568361341953278,
+ "step": 1338
+ },
+ {
+ "epoch": 6.764556962025316,
+ "grad_norm": 0.03455951064825058,
+ "learning_rate": 3.602693602693603e-05,
+ "loss": 0.019078724086284637,
+ "step": 1339
+ },
+ {
+ "epoch": 6.769620253164557,
+ "grad_norm": 0.02380317822098732,
+ "learning_rate": 3.5970819304152635e-05,
+ "loss": 0.01807081699371338,
+ "step": 1340
+ },
+ {
+ "epoch": 6.774683544303797,
+ "grad_norm": 0.0337495282292366,
+ "learning_rate": 3.5914702581369245e-05,
+ "loss": 0.019128164276480675,
+ "step": 1341
+ },
+ {
+ "epoch": 6.779746835443038,
+ "grad_norm": 0.041405126452445984,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.017617477104067802,
+ "step": 1342
+ },
+ {
+ "epoch": 6.784810126582278,
+ "grad_norm": 0.028542209416627884,
+ "learning_rate": 3.580246913580247e-05,
+ "loss": 0.01781628280878067,
+ "step": 1343
+ },
+ {
+ "epoch": 6.789873417721519,
+ "grad_norm": 0.038718484342098236,
+ "learning_rate": 3.574635241301908e-05,
+ "loss": 0.025421444326639175,
+ "step": 1344
+ },
+ {
+ "epoch": 6.794936708860759,
+ "grad_norm": 0.03298761323094368,
+ "learning_rate": 3.569023569023569e-05,
+ "loss": 0.01900479383766651,
+ "step": 1345
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.024823278188705444,
+ "learning_rate": 3.56341189674523e-05,
+ "loss": 0.021245522424578667,
+ "step": 1346
+ },
+ {
+ "epoch": 6.80506329113924,
+ "grad_norm": 0.0321645587682724,
+ "learning_rate": 3.557800224466891e-05,
+ "loss": 0.01712404564023018,
+ "step": 1347
+ },
+ {
+ "epoch": 6.810126582278481,
+ "grad_norm": 0.03605357185006142,
+ "learning_rate": 3.552188552188552e-05,
+ "loss": 0.02691786363720894,
+ "step": 1348
+ },
+ {
+ "epoch": 6.815189873417721,
+ "grad_norm": 0.03685377910733223,
+ "learning_rate": 3.546576879910213e-05,
+ "loss": 0.02375425398349762,
+ "step": 1349
+ },
+ {
+ "epoch": 6.820253164556962,
+ "grad_norm": 0.022712258622050285,
+ "learning_rate": 3.540965207631874e-05,
+ "loss": 0.016492441296577454,
+ "step": 1350
+ },
+ {
+ "epoch": 6.8253164556962025,
+ "grad_norm": 0.027446497231721878,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.019083943217992783,
+ "step": 1351
+ },
+ {
+ "epoch": 6.830379746835443,
+ "grad_norm": 0.060375552624464035,
+ "learning_rate": 3.529741863075197e-05,
+ "loss": 0.021610641852021217,
+ "step": 1352
+ },
+ {
+ "epoch": 6.8354430379746836,
+ "grad_norm": 0.026175983250141144,
+ "learning_rate": 3.524130190796858e-05,
+ "loss": 0.02164904959499836,
+ "step": 1353
+ },
+ {
+ "epoch": 6.840506329113924,
+ "grad_norm": 0.04348548501729965,
+ "learning_rate": 3.518518518518519e-05,
+ "loss": 0.02257148176431656,
+ "step": 1354
+ },
+ {
+ "epoch": 6.845569620253165,
+ "grad_norm": 0.051051557064056396,
+ "learning_rate": 3.51290684624018e-05,
+ "loss": 0.027986399829387665,
+ "step": 1355
+ },
+ {
+ "epoch": 6.850632911392405,
+ "grad_norm": 0.02255374938249588,
+ "learning_rate": 3.507295173961841e-05,
+ "loss": 0.017260409891605377,
+ "step": 1356
+ },
+ {
+ "epoch": 6.855696202531646,
+ "grad_norm": 0.053478825837373734,
+ "learning_rate": 3.501683501683502e-05,
+ "loss": 0.025036044418811798,
+ "step": 1357
+ },
+ {
+ "epoch": 6.860759493670886,
+ "grad_norm": 0.03688240423798561,
+ "learning_rate": 3.496071829405163e-05,
+ "loss": 0.0243881456553936,
+ "step": 1358
+ },
+ {
+ "epoch": 6.865822784810127,
+ "grad_norm": 0.03860153257846832,
+ "learning_rate": 3.490460157126824e-05,
+ "loss": 0.018570398911833763,
+ "step": 1359
+ },
+ {
+ "epoch": 6.870886075949367,
+ "grad_norm": 0.02771756984293461,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.022013407200574875,
+ "step": 1360
+ },
+ {
+ "epoch": 6.875949367088608,
+ "grad_norm": 0.03359522670507431,
+ "learning_rate": 3.4792368125701466e-05,
+ "loss": 0.024430446326732635,
+ "step": 1361
+ },
+ {
+ "epoch": 6.881012658227848,
+ "grad_norm": 0.028827447444200516,
+ "learning_rate": 3.473625140291807e-05,
+ "loss": 0.018073707818984985,
+ "step": 1362
+ },
+ {
+ "epoch": 6.886075949367089,
+ "grad_norm": 0.03537776693701744,
+ "learning_rate": 3.468013468013468e-05,
+ "loss": 0.022164030000567436,
+ "step": 1363
+ },
+ {
+ "epoch": 6.891139240506329,
+ "grad_norm": 0.029529782012104988,
+ "learning_rate": 3.462401795735129e-05,
+ "loss": 0.02529158815741539,
+ "step": 1364
+ },
+ {
+ "epoch": 6.89620253164557,
+ "grad_norm": 0.026303067803382874,
+ "learning_rate": 3.45679012345679e-05,
+ "loss": 0.019374631345272064,
+ "step": 1365
+ },
+ {
+ "epoch": 6.9012658227848105,
+ "grad_norm": 0.039471473544836044,
+ "learning_rate": 3.451178451178451e-05,
+ "loss": 0.022283609956502914,
+ "step": 1366
+ },
+ {
+ "epoch": 6.90632911392405,
+ "grad_norm": 0.03414482623338699,
+ "learning_rate": 3.445566778900112e-05,
+ "loss": 0.024151155725121498,
+ "step": 1367
+ },
+ {
+ "epoch": 6.911392405063291,
+ "grad_norm": 0.01648244820535183,
+ "learning_rate": 3.439955106621773e-05,
+ "loss": 0.01653912290930748,
+ "step": 1368
+ },
+ {
+ "epoch": 6.916455696202531,
+ "grad_norm": 0.036713164299726486,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.01961999014019966,
+ "step": 1369
+ },
+ {
+ "epoch": 6.921518987341772,
+ "grad_norm": 0.02502237819135189,
+ "learning_rate": 3.428731762065096e-05,
+ "loss": 0.019946709275245667,
+ "step": 1370
+ },
+ {
+ "epoch": 6.926582278481012,
+ "grad_norm": 0.03062540479004383,
+ "learning_rate": 3.423120089786757e-05,
+ "loss": 0.023258816450834274,
+ "step": 1371
+ },
+ {
+ "epoch": 6.931645569620253,
+ "grad_norm": 0.021536799147725105,
+ "learning_rate": 3.417508417508418e-05,
+ "loss": 0.01964723877608776,
+ "step": 1372
+ },
+ {
+ "epoch": 6.936708860759493,
+ "grad_norm": 0.035745471715927124,
+ "learning_rate": 3.411896745230079e-05,
+ "loss": 0.026319682598114014,
+ "step": 1373
+ },
+ {
+ "epoch": 6.941772151898734,
+ "grad_norm": 0.03711705282330513,
+ "learning_rate": 3.40628507295174e-05,
+ "loss": 0.022980816662311554,
+ "step": 1374
+ },
+ {
+ "epoch": 6.946835443037974,
+ "grad_norm": 0.02977835014462471,
+ "learning_rate": 3.400673400673401e-05,
+ "loss": 0.020178712904453278,
+ "step": 1375
+ },
+ {
+ "epoch": 6.951898734177215,
+ "grad_norm": 0.122103750705719,
+ "learning_rate": 3.395061728395062e-05,
+ "loss": 0.028520341962575912,
+ "step": 1376
+ },
+ {
+ "epoch": 6.9569620253164555,
+ "grad_norm": 0.046767886728048325,
+ "learning_rate": 3.389450056116723e-05,
+ "loss": 0.0207063015550375,
+ "step": 1377
+ },
+ {
+ "epoch": 6.962025316455696,
+ "grad_norm": 0.027442077174782753,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.018590064719319344,
+ "step": 1378
+ },
+ {
+ "epoch": 6.9670886075949365,
+ "grad_norm": 0.03202109411358833,
+ "learning_rate": 3.3782267115600454e-05,
+ "loss": 0.0225562434643507,
+ "step": 1379
+ },
+ {
+ "epoch": 6.972151898734177,
+ "grad_norm": 0.024545297026634216,
+ "learning_rate": 3.3726150392817064e-05,
+ "loss": 0.020356591790914536,
+ "step": 1380
+ },
+ {
+ "epoch": 6.977215189873418,
+ "grad_norm": 0.028534026816487312,
+ "learning_rate": 3.3670033670033675e-05,
+ "loss": 0.017728019505739212,
+ "step": 1381
+ },
+ {
+ "epoch": 6.982278481012658,
+ "grad_norm": 0.04066401720046997,
+ "learning_rate": 3.3613916947250285e-05,
+ "loss": 0.02500733733177185,
+ "step": 1382
+ },
+ {
+ "epoch": 6.987341772151899,
+ "grad_norm": 0.03498203679919243,
+ "learning_rate": 3.3557800224466895e-05,
+ "loss": 0.020952323451638222,
+ "step": 1383
+ },
+ {
+ "epoch": 6.992405063291139,
+ "grad_norm": 0.024813339114189148,
+ "learning_rate": 3.35016835016835e-05,
+ "loss": 0.019022852182388306,
+ "step": 1384
+ },
+ {
+ "epoch": 6.99746835443038,
+ "grad_norm": 0.02122138813138008,
+ "learning_rate": 3.3445566778900115e-05,
+ "loss": 0.019452452659606934,
+ "step": 1385
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.025631824508309364,
+ "learning_rate": 3.3389450056116725e-05,
+ "loss": 0.01880500651896,
+ "step": 1386
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 1980,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 8.825778905889792e+16,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-1386/training_args.bin b/checkpoint-1386/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ce6b9228ad6cf155da5af64a370f864d5fe04e56
--- /dev/null
+++ b/checkpoint-1386/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3a4d7936dc7001e3baf6e9cead308b6188ace221538f9d436668bdf0b1d43a1
+size 5777
diff --git a/checkpoint-15/README.md b/checkpoint-15/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..17bc522e13c6998ab7f14e4524a99f96b2e38000
--- /dev/null
+++ b/checkpoint-15/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-15/adapter_config.json b/checkpoint-15/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b01b681148ff188ab3d162c0d6bb07268b3adfca
--- /dev/null
+++ b/checkpoint-15/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-1.7B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "o_proj",
+ "v_proj",
+ "up_proj",
+ "down_proj",
+ "q_proj",
+ "gate_proj",
+ "k_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-15/adapter_model.safetensors b/checkpoint-15/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..4bd2a9069e23741bf7342ffc250cf263a3c76850
--- /dev/null
+++ b/checkpoint-15/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c36f7814340590bd69faec96a996b29579d0e42fa6a01b4c5af6e1b341f27195
+size 69782384
diff --git a/checkpoint-15/chat_template.jinja b/checkpoint-15/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-15/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-15/optimizer.pt b/checkpoint-15/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..b88a5130596ccba6d3badce35a9539023c03118e
--- /dev/null
+++ b/checkpoint-15/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d22e9a912fe13bb9a1934972c54e0256b98831d413510cdadceb58e153d29ec5
+size 35873029
diff --git a/checkpoint-15/rng_state.pth b/checkpoint-15/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..9a2f1c6718be043c8a9bbc32d83f6f90b082c4d8
--- /dev/null
+++ b/checkpoint-15/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:181c5f0270cf39930062ddfa3767a2481d0c360f120b11f8e25dbf533a1cdaba
+size 14645
diff --git a/checkpoint-15/scheduler.pt b/checkpoint-15/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..943de83cb7fe89fbf16deccc5612a85ab105319f
--- /dev/null
+++ b/checkpoint-15/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b635d71a401eb87845359c07ce8a99001140bbe73e37bec29bb76dc0d0ae126c
+size 1465
diff --git a/checkpoint-15/tokenizer.json b/checkpoint-15/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-15/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-15/tokenizer_config.json b/checkpoint-15/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-15/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-15/trainer_state.json b/checkpoint-15/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..6df9bcaf4083103e2e0e218025aaa3d15d1cd8e7
--- /dev/null
+++ b/checkpoint-15/trainer_state.json
@@ -0,0 +1,139 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 3.0,
+ "eval_steps": 500,
+ "global_step": 15,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.8728970289230347,
+ "learning_rate": 0.0,
+ "loss": 1.7144343852996826,
+ "step": 1
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.6763373613357544,
+ "learning_rate": 2e-05,
+ "loss": 1.4952771663665771,
+ "step": 2
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 1.7191307544708252,
+ "learning_rate": 4e-05,
+ "loss": 1.574378252029419,
+ "step": 3
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 1.7878174781799316,
+ "learning_rate": 6e-05,
+ "loss": 1.6600843667984009,
+ "step": 4
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 1.929695725440979,
+ "learning_rate": 8e-05,
+ "loss": 1.7657139301300049,
+ "step": 5
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 1.8718829154968262,
+ "learning_rate": 0.0001,
+ "loss": 1.6730849742889404,
+ "step": 6
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 1.7125587463378906,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 1.5219359397888184,
+ "step": 7
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 1.4176026582717896,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 1.2670559883117676,
+ "step": 8
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 1.132968544960022,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.9341962933540344,
+ "step": 9
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 1.0091828107833862,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.9576144218444824,
+ "step": 10
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.9517018795013428,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 1.0370712280273438,
+ "step": 11
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.7950196266174316,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.8810007572174072,
+ "step": 12
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.5975409150123596,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.6599255204200745,
+ "step": 13
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.670741617679596,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.7524279356002808,
+ "step": 14
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.6229442358016968,
+ "learning_rate": 8e-05,
+ "loss": 0.7022373676300049,
+ "step": 15
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 50,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 277737770446848.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-15/training_args.bin b/checkpoint-15/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-15/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-150/README.md b/checkpoint-150/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-150/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-150/adapter_config.json b/checkpoint-150/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-150/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-150/adapter_model.safetensors b/checkpoint-150/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..f182dfd7c5b6d719727793c0d9c0299b71e1bbbc
--- /dev/null
+++ b/checkpoint-150/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd40a6df5fcc5eb16f85b2c4becf54157d533375a7eb28719abff7037488db10
+size 132187888
diff --git a/checkpoint-150/chat_template.jinja b/checkpoint-150/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-150/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-150/optimizer.pt b/checkpoint-150/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..9fe95695e5883b621212fcecc559d35f21643d6e
--- /dev/null
+++ b/checkpoint-150/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e8a39c88d94f37d130e1bc47cdbdb674a617bcaebe43521a17e91a90a942d88
+size 67688197
diff --git a/checkpoint-150/rng_state.pth b/checkpoint-150/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..119a2feec6d0222b6a987748eb278f3a8baec0d9
--- /dev/null
+++ b/checkpoint-150/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d895ccae2b55d4ea213653ca4a80d00de131463e105716eab1b7022906f260bf
+size 14645
diff --git a/checkpoint-150/scheduler.pt b/checkpoint-150/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ba3aea54f0a7bbe3b272f7288ca93974cd1d2728
--- /dev/null
+++ b/checkpoint-150/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71860451716942291d414a1331f4c71d26a9712c515625fec9abe0d89afa04b0
+size 1465
diff --git a/checkpoint-150/tokenizer.json b/checkpoint-150/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-150/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-150/tokenizer_config.json b/checkpoint-150/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-150/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-150/trainer_state.json b/checkpoint-150/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..06c45965701d7d1a96624c4d70d2907e4768d0e0
--- /dev/null
+++ b/checkpoint-150/trainer_state.json
@@ -0,0 +1,1084 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 6.0,
+ "eval_steps": 500,
+ "global_step": 150,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ },
+ {
+ "epoch": 1.04,
+ "grad_norm": 0.36699211597442627,
+ "learning_rate": 0.0001,
+ "loss": 0.4363247752189636,
+ "step": 26
+ },
+ {
+ "epoch": 1.08,
+ "grad_norm": 0.3731786608695984,
+ "learning_rate": 9.955555555555556e-05,
+ "loss": 0.4297473430633545,
+ "step": 27
+ },
+ {
+ "epoch": 1.12,
+ "grad_norm": 0.3378784954547882,
+ "learning_rate": 9.911111111111112e-05,
+ "loss": 0.35973912477493286,
+ "step": 28
+ },
+ {
+ "epoch": 1.16,
+ "grad_norm": 0.36273664236068726,
+ "learning_rate": 9.866666666666668e-05,
+ "loss": 0.34903788566589355,
+ "step": 29
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 0.362885981798172,
+ "learning_rate": 9.822222222222223e-05,
+ "loss": 0.3119792342185974,
+ "step": 30
+ },
+ {
+ "epoch": 1.24,
+ "grad_norm": 0.3790324032306671,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 0.29530155658721924,
+ "step": 31
+ },
+ {
+ "epoch": 1.28,
+ "grad_norm": 0.37333837151527405,
+ "learning_rate": 9.733333333333335e-05,
+ "loss": 0.2653456926345825,
+ "step": 32
+ },
+ {
+ "epoch": 1.32,
+ "grad_norm": 0.32163503766059875,
+ "learning_rate": 9.68888888888889e-05,
+ "loss": 0.19654956459999084,
+ "step": 33
+ },
+ {
+ "epoch": 1.3599999999999999,
+ "grad_norm": 0.5297159552574158,
+ "learning_rate": 9.644444444444445e-05,
+ "loss": 0.23580318689346313,
+ "step": 34
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.4474238455295563,
+ "learning_rate": 9.6e-05,
+ "loss": 0.18798796832561493,
+ "step": 35
+ },
+ {
+ "epoch": 1.44,
+ "grad_norm": 0.31346794962882996,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 0.12066371738910675,
+ "step": 36
+ },
+ {
+ "epoch": 1.48,
+ "grad_norm": 0.3099532723426819,
+ "learning_rate": 9.511111111111112e-05,
+ "loss": 0.08859007060527802,
+ "step": 37
+ },
+ {
+ "epoch": 1.52,
+ "grad_norm": 0.3490828275680542,
+ "learning_rate": 9.466666666666667e-05,
+ "loss": 0.07878822088241577,
+ "step": 38
+ },
+ {
+ "epoch": 1.56,
+ "grad_norm": 0.32395538687705994,
+ "learning_rate": 9.422222222222223e-05,
+ "loss": 0.06694570928812027,
+ "step": 39
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 0.20870603621006012,
+ "learning_rate": 9.377777777777779e-05,
+ "loss": 0.04379018768668175,
+ "step": 40
+ },
+ {
+ "epoch": 1.6400000000000001,
+ "grad_norm": 0.3310009837150574,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.048647329211235046,
+ "step": 41
+ },
+ {
+ "epoch": 1.6800000000000002,
+ "grad_norm": 0.26949432492256165,
+ "learning_rate": 9.28888888888889e-05,
+ "loss": 0.039286017417907715,
+ "step": 42
+ },
+ {
+ "epoch": 1.72,
+ "grad_norm": 0.11029712855815887,
+ "learning_rate": 9.244444444444445e-05,
+ "loss": 0.029231950640678406,
+ "step": 43
+ },
+ {
+ "epoch": 1.76,
+ "grad_norm": 0.1476302146911621,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.027003085240721703,
+ "step": 44
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.18617521226406097,
+ "learning_rate": 9.155555555555557e-05,
+ "loss": 0.025106143206357956,
+ "step": 45
+ },
+ {
+ "epoch": 1.8399999999999999,
+ "grad_norm": 0.13198262453079224,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.025741657242178917,
+ "step": 46
+ },
+ {
+ "epoch": 1.88,
+ "grad_norm": 0.26712384819984436,
+ "learning_rate": 9.066666666666667e-05,
+ "loss": 0.035036977380514145,
+ "step": 47
+ },
+ {
+ "epoch": 1.92,
+ "grad_norm": 0.3569182753562927,
+ "learning_rate": 9.022222222222224e-05,
+ "loss": 0.04259534925222397,
+ "step": 48
+ },
+ {
+ "epoch": 1.96,
+ "grad_norm": 0.1843830794095993,
+ "learning_rate": 8.977777777777779e-05,
+ "loss": 0.03471647948026657,
+ "step": 49
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.1248057410120964,
+ "learning_rate": 8.933333333333334e-05,
+ "loss": 0.030936148017644882,
+ "step": 50
+ },
+ {
+ "epoch": 2.04,
+ "grad_norm": 0.12060711532831192,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.032452136278152466,
+ "step": 51
+ },
+ {
+ "epoch": 2.08,
+ "grad_norm": 0.2026030570268631,
+ "learning_rate": 8.844444444444445e-05,
+ "loss": 0.03268110007047653,
+ "step": 52
+ },
+ {
+ "epoch": 2.12,
+ "grad_norm": 0.21289987862110138,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.03406357392668724,
+ "step": 53
+ },
+ {
+ "epoch": 2.16,
+ "grad_norm": 0.14732478559017181,
+ "learning_rate": 8.755555555555556e-05,
+ "loss": 0.02936721034348011,
+ "step": 54
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.10120426118373871,
+ "learning_rate": 8.711111111111112e-05,
+ "loss": 0.02511693350970745,
+ "step": 55
+ },
+ {
+ "epoch": 2.24,
+ "grad_norm": 0.08917918056249619,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.025877539068460464,
+ "step": 56
+ },
+ {
+ "epoch": 2.2800000000000002,
+ "grad_norm": 0.08735086023807526,
+ "learning_rate": 8.622222222222222e-05,
+ "loss": 0.02145460993051529,
+ "step": 57
+ },
+ {
+ "epoch": 2.32,
+ "grad_norm": 0.07835431396961212,
+ "learning_rate": 8.577777777777777e-05,
+ "loss": 0.021244943141937256,
+ "step": 58
+ },
+ {
+ "epoch": 2.36,
+ "grad_norm": 0.06953317672014236,
+ "learning_rate": 8.533333333333334e-05,
+ "loss": 0.02279437705874443,
+ "step": 59
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.0854259729385376,
+ "learning_rate": 8.488888888888889e-05,
+ "loss": 0.023704543709754944,
+ "step": 60
+ },
+ {
+ "epoch": 2.44,
+ "grad_norm": 0.17068363726139069,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.035272784531116486,
+ "step": 61
+ },
+ {
+ "epoch": 2.48,
+ "grad_norm": 0.11971863359212875,
+ "learning_rate": 8.4e-05,
+ "loss": 0.02707826718688011,
+ "step": 62
+ },
+ {
+ "epoch": 2.52,
+ "grad_norm": 0.05303095281124115,
+ "learning_rate": 8.355555555555556e-05,
+ "loss": 0.01696968823671341,
+ "step": 63
+ },
+ {
+ "epoch": 2.56,
+ "grad_norm": 0.06503961980342865,
+ "learning_rate": 8.311111111111111e-05,
+ "loss": 0.018413860350847244,
+ "step": 64
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.05390244349837303,
+ "learning_rate": 8.266666666666667e-05,
+ "loss": 0.01641814410686493,
+ "step": 65
+ },
+ {
+ "epoch": 2.64,
+ "grad_norm": 0.07149611413478851,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.020658448338508606,
+ "step": 66
+ },
+ {
+ "epoch": 2.68,
+ "grad_norm": 0.09244706481695175,
+ "learning_rate": 8.177777777777778e-05,
+ "loss": 0.022394295781850815,
+ "step": 67
+ },
+ {
+ "epoch": 2.7199999999999998,
+ "grad_norm": 0.11381954699754715,
+ "learning_rate": 8.133333333333334e-05,
+ "loss": 0.028476765379309654,
+ "step": 68
+ },
+ {
+ "epoch": 2.76,
+ "grad_norm": 0.07354001700878143,
+ "learning_rate": 8.088888888888889e-05,
+ "loss": 0.019497834146022797,
+ "step": 69
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.06727641820907593,
+ "learning_rate": 8.044444444444444e-05,
+ "loss": 0.014356930740177631,
+ "step": 70
+ },
+ {
+ "epoch": 2.84,
+ "grad_norm": 0.07417713105678558,
+ "learning_rate": 8e-05,
+ "loss": 0.01823577657341957,
+ "step": 71
+ },
+ {
+ "epoch": 2.88,
+ "grad_norm": 0.09163317829370499,
+ "learning_rate": 7.955555555555556e-05,
+ "loss": 0.02139071188867092,
+ "step": 72
+ },
+ {
+ "epoch": 2.92,
+ "grad_norm": 0.08178975433111191,
+ "learning_rate": 7.911111111111111e-05,
+ "loss": 0.018335483968257904,
+ "step": 73
+ },
+ {
+ "epoch": 2.96,
+ "grad_norm": 0.08015220612287521,
+ "learning_rate": 7.866666666666666e-05,
+ "loss": 0.016001513227820396,
+ "step": 74
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.08509402722120285,
+ "learning_rate": 7.822222222222223e-05,
+ "loss": 0.017747700214385986,
+ "step": 75
+ },
+ {
+ "epoch": 3.04,
+ "grad_norm": 0.07863253355026245,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.015054607763886452,
+ "step": 76
+ },
+ {
+ "epoch": 3.08,
+ "grad_norm": 0.09398715198040009,
+ "learning_rate": 7.733333333333333e-05,
+ "loss": 0.01887289062142372,
+ "step": 77
+ },
+ {
+ "epoch": 3.12,
+ "grad_norm": 0.12165197730064392,
+ "learning_rate": 7.688888888888889e-05,
+ "loss": 0.020169202238321304,
+ "step": 78
+ },
+ {
+ "epoch": 3.16,
+ "grad_norm": 0.07627179473638535,
+ "learning_rate": 7.644444444444445e-05,
+ "loss": 0.012153002433478832,
+ "step": 79
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.0885142832994461,
+ "learning_rate": 7.6e-05,
+ "loss": 0.015390444546937943,
+ "step": 80
+ },
+ {
+ "epoch": 3.24,
+ "grad_norm": 0.11557707190513611,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.019245222210884094,
+ "step": 81
+ },
+ {
+ "epoch": 3.2800000000000002,
+ "grad_norm": 0.0976581946015358,
+ "learning_rate": 7.511111111111111e-05,
+ "loss": 0.014158917590975761,
+ "step": 82
+ },
+ {
+ "epoch": 3.32,
+ "grad_norm": 0.09829393774271011,
+ "learning_rate": 7.466666666666667e-05,
+ "loss": 0.013099931180477142,
+ "step": 83
+ },
+ {
+ "epoch": 3.36,
+ "grad_norm": 0.10063999146223068,
+ "learning_rate": 7.422222222222223e-05,
+ "loss": 0.013834481127560139,
+ "step": 84
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.09943496435880661,
+ "learning_rate": 7.377777777777778e-05,
+ "loss": 0.012920765206217766,
+ "step": 85
+ },
+ {
+ "epoch": 3.44,
+ "grad_norm": 0.1093878448009491,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.013458158820867538,
+ "step": 86
+ },
+ {
+ "epoch": 3.48,
+ "grad_norm": 0.1128634586930275,
+ "learning_rate": 7.28888888888889e-05,
+ "loss": 0.013067865744233131,
+ "step": 87
+ },
+ {
+ "epoch": 3.52,
+ "grad_norm": 0.11049138009548187,
+ "learning_rate": 7.244444444444445e-05,
+ "loss": 0.01237843930721283,
+ "step": 88
+ },
+ {
+ "epoch": 3.56,
+ "grad_norm": 0.1535821557044983,
+ "learning_rate": 7.2e-05,
+ "loss": 0.015146344900131226,
+ "step": 89
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.10436677187681198,
+ "learning_rate": 7.155555555555555e-05,
+ "loss": 0.00996164046227932,
+ "step": 90
+ },
+ {
+ "epoch": 3.64,
+ "grad_norm": 0.14084051549434662,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.013795388862490654,
+ "step": 91
+ },
+ {
+ "epoch": 3.68,
+ "grad_norm": 0.12718933820724487,
+ "learning_rate": 7.066666666666667e-05,
+ "loss": 0.011878985911607742,
+ "step": 92
+ },
+ {
+ "epoch": 3.7199999999999998,
+ "grad_norm": 0.1412353217601776,
+ "learning_rate": 7.022222222222222e-05,
+ "loss": 0.010964864864945412,
+ "step": 93
+ },
+ {
+ "epoch": 3.76,
+ "grad_norm": 0.11453556269407272,
+ "learning_rate": 6.977777777777779e-05,
+ "loss": 0.008170144632458687,
+ "step": 94
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.16155096888542175,
+ "learning_rate": 6.933333333333334e-05,
+ "loss": 0.011488870717585087,
+ "step": 95
+ },
+ {
+ "epoch": 3.84,
+ "grad_norm": 0.11969174444675446,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.007895090617239475,
+ "step": 96
+ },
+ {
+ "epoch": 3.88,
+ "grad_norm": 0.22626101970672607,
+ "learning_rate": 6.844444444444445e-05,
+ "loss": 0.01467936858534813,
+ "step": 97
+ },
+ {
+ "epoch": 3.92,
+ "grad_norm": 0.21040032804012299,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.010772328823804855,
+ "step": 98
+ },
+ {
+ "epoch": 3.96,
+ "grad_norm": 0.19558775424957275,
+ "learning_rate": 6.755555555555557e-05,
+ "loss": 0.009220557287335396,
+ "step": 99
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.18061381578445435,
+ "learning_rate": 6.711111111111112e-05,
+ "loss": 0.006471008062362671,
+ "step": 100
+ },
+ {
+ "epoch": 4.04,
+ "grad_norm": 0.12179632484912872,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.0057976702228188515,
+ "step": 101
+ },
+ {
+ "epoch": 4.08,
+ "grad_norm": 0.12671399116516113,
+ "learning_rate": 6.622222222222224e-05,
+ "loss": 0.006621541455388069,
+ "step": 102
+ },
+ {
+ "epoch": 4.12,
+ "grad_norm": 0.11084511876106262,
+ "learning_rate": 6.577777777777779e-05,
+ "loss": 0.006054866127669811,
+ "step": 103
+ },
+ {
+ "epoch": 4.16,
+ "grad_norm": 0.12502190470695496,
+ "learning_rate": 6.533333333333334e-05,
+ "loss": 0.00817898940294981,
+ "step": 104
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.09107036888599396,
+ "learning_rate": 6.488888888888889e-05,
+ "loss": 0.006295117549598217,
+ "step": 105
+ },
+ {
+ "epoch": 4.24,
+ "grad_norm": 0.07194884121417999,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.006192575674504042,
+ "step": 106
+ },
+ {
+ "epoch": 4.28,
+ "grad_norm": 0.03464571759104729,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.003843494923785329,
+ "step": 107
+ },
+ {
+ "epoch": 4.32,
+ "grad_norm": 0.10040883719921112,
+ "learning_rate": 6.355555555555556e-05,
+ "loss": 0.006318099796772003,
+ "step": 108
+ },
+ {
+ "epoch": 4.36,
+ "grad_norm": 0.07303845882415771,
+ "learning_rate": 6.311111111111112e-05,
+ "loss": 0.0047858962789177895,
+ "step": 109
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.03440818190574646,
+ "learning_rate": 6.266666666666667e-05,
+ "loss": 0.004050814546644688,
+ "step": 110
+ },
+ {
+ "epoch": 4.44,
+ "grad_norm": 0.046613194048404694,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.0035898215137422085,
+ "step": 111
+ },
+ {
+ "epoch": 4.48,
+ "grad_norm": 0.02108742855489254,
+ "learning_rate": 6.177777777777779e-05,
+ "loss": 0.003291932400316,
+ "step": 112
+ },
+ {
+ "epoch": 4.52,
+ "grad_norm": 0.04408564418554306,
+ "learning_rate": 6.133333333333334e-05,
+ "loss": 0.0033779453951865435,
+ "step": 113
+ },
+ {
+ "epoch": 4.5600000000000005,
+ "grad_norm": 0.022311383858323097,
+ "learning_rate": 6.08888888888889e-05,
+ "loss": 0.0038345090579241514,
+ "step": 114
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.026365282014012337,
+ "learning_rate": 6.044444444444445e-05,
+ "loss": 0.004205222241580486,
+ "step": 115
+ },
+ {
+ "epoch": 4.64,
+ "grad_norm": 0.04582115262746811,
+ "learning_rate": 6e-05,
+ "loss": 0.005077291280031204,
+ "step": 116
+ },
+ {
+ "epoch": 4.68,
+ "grad_norm": 0.05057913810014725,
+ "learning_rate": 5.9555555555555554e-05,
+ "loss": 0.004747368395328522,
+ "step": 117
+ },
+ {
+ "epoch": 4.72,
+ "grad_norm": 0.04699229821562767,
+ "learning_rate": 5.911111111111112e-05,
+ "loss": 0.00538603262975812,
+ "step": 118
+ },
+ {
+ "epoch": 4.76,
+ "grad_norm": 0.026704438030719757,
+ "learning_rate": 5.866666666666667e-05,
+ "loss": 0.0041087716817855835,
+ "step": 119
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.04175629839301109,
+ "learning_rate": 5.8222222222222224e-05,
+ "loss": 0.004437651485204697,
+ "step": 120
+ },
+ {
+ "epoch": 4.84,
+ "grad_norm": 0.032657600939273834,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.003728377167135477,
+ "step": 121
+ },
+ {
+ "epoch": 4.88,
+ "grad_norm": 0.03405195474624634,
+ "learning_rate": 5.7333333333333336e-05,
+ "loss": 0.005017922259867191,
+ "step": 122
+ },
+ {
+ "epoch": 4.92,
+ "grad_norm": 0.02600262127816677,
+ "learning_rate": 5.6888888888888895e-05,
+ "loss": 0.003841507714241743,
+ "step": 123
+ },
+ {
+ "epoch": 4.96,
+ "grad_norm": 0.03402233496308327,
+ "learning_rate": 5.644444444444445e-05,
+ "loss": 0.002483899937942624,
+ "step": 124
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.03151554986834526,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 0.0036559500731527805,
+ "step": 125
+ },
+ {
+ "epoch": 5.04,
+ "grad_norm": 0.03822990879416466,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.0028562736697494984,
+ "step": 126
+ },
+ {
+ "epoch": 5.08,
+ "grad_norm": 0.028356632217764854,
+ "learning_rate": 5.511111111111111e-05,
+ "loss": 0.003123738570138812,
+ "step": 127
+ },
+ {
+ "epoch": 5.12,
+ "grad_norm": 0.032560307532548904,
+ "learning_rate": 5.466666666666666e-05,
+ "loss": 0.004612874239683151,
+ "step": 128
+ },
+ {
+ "epoch": 5.16,
+ "grad_norm": 0.023662906140089035,
+ "learning_rate": 5.422222222222223e-05,
+ "loss": 0.0028404039330780506,
+ "step": 129
+ },
+ {
+ "epoch": 5.2,
+ "grad_norm": 0.03967975080013275,
+ "learning_rate": 5.377777777777778e-05,
+ "loss": 0.004116460680961609,
+ "step": 130
+ },
+ {
+ "epoch": 5.24,
+ "grad_norm": 0.02488141693174839,
+ "learning_rate": 5.333333333333333e-05,
+ "loss": 0.0041904142126441,
+ "step": 131
+ },
+ {
+ "epoch": 5.28,
+ "grad_norm": 0.011391286738216877,
+ "learning_rate": 5.2888888888888885e-05,
+ "loss": 0.002993058878928423,
+ "step": 132
+ },
+ {
+ "epoch": 5.32,
+ "grad_norm": 0.02595183439552784,
+ "learning_rate": 5.244444444444445e-05,
+ "loss": 0.00301048019900918,
+ "step": 133
+ },
+ {
+ "epoch": 5.36,
+ "grad_norm": 0.014937770552933216,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 0.003106491407379508,
+ "step": 134
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.0208111684769392,
+ "learning_rate": 5.1555555555555556e-05,
+ "loss": 0.003945561125874519,
+ "step": 135
+ },
+ {
+ "epoch": 5.44,
+ "grad_norm": 0.01186386402696371,
+ "learning_rate": 5.111111111111111e-05,
+ "loss": 0.003586095292121172,
+ "step": 136
+ },
+ {
+ "epoch": 5.48,
+ "grad_norm": 0.012205840088427067,
+ "learning_rate": 5.0666666666666674e-05,
+ "loss": 0.0032413718290627003,
+ "step": 137
+ },
+ {
+ "epoch": 5.52,
+ "grad_norm": 0.02764296717941761,
+ "learning_rate": 5.0222222222222226e-05,
+ "loss": 0.0030944915488362312,
+ "step": 138
+ },
+ {
+ "epoch": 5.5600000000000005,
+ "grad_norm": 0.023670295253396034,
+ "learning_rate": 4.977777777777778e-05,
+ "loss": 0.0030482488218694925,
+ "step": 139
+ },
+ {
+ "epoch": 5.6,
+ "grad_norm": 0.024959059432148933,
+ "learning_rate": 4.933333333333334e-05,
+ "loss": 0.002743522170931101,
+ "step": 140
+ },
+ {
+ "epoch": 5.64,
+ "grad_norm": 0.019349221140146255,
+ "learning_rate": 4.888888888888889e-05,
+ "loss": 0.002883533015847206,
+ "step": 141
+ },
+ {
+ "epoch": 5.68,
+ "grad_norm": 0.021185332909226418,
+ "learning_rate": 4.844444444444445e-05,
+ "loss": 0.0025618618819862604,
+ "step": 142
+ },
+ {
+ "epoch": 5.72,
+ "grad_norm": 0.017232399433851242,
+ "learning_rate": 4.8e-05,
+ "loss": 0.0027296345215290785,
+ "step": 143
+ },
+ {
+ "epoch": 5.76,
+ "grad_norm": 0.025460300967097282,
+ "learning_rate": 4.755555555555556e-05,
+ "loss": 0.002679885132238269,
+ "step": 144
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.021230001002550125,
+ "learning_rate": 4.711111111111111e-05,
+ "loss": 0.0037597499322146177,
+ "step": 145
+ },
+ {
+ "epoch": 5.84,
+ "grad_norm": 0.018495697528123856,
+ "learning_rate": 4.666666666666667e-05,
+ "loss": 0.0026929471641778946,
+ "step": 146
+ },
+ {
+ "epoch": 5.88,
+ "grad_norm": 0.027612268924713135,
+ "learning_rate": 4.6222222222222224e-05,
+ "loss": 0.0031238074880093336,
+ "step": 147
+ },
+ {
+ "epoch": 5.92,
+ "grad_norm": 0.039522312581539154,
+ "learning_rate": 4.577777777777778e-05,
+ "loss": 0.0035351444967091084,
+ "step": 148
+ },
+ {
+ "epoch": 5.96,
+ "grad_norm": 0.014303261414170265,
+ "learning_rate": 4.5333333333333335e-05,
+ "loss": 0.0025896867737174034,
+ "step": 149
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.03775525838136673,
+ "learning_rate": 4.4888888888888894e-05,
+ "loss": 0.0035551211331039667,
+ "step": 150
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 7357957981470720.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-150/training_args.bin b/checkpoint-150/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-150/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-1584/README.md b/checkpoint-1584/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-1584/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-1584/adapter_config.json b/checkpoint-1584/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..879d59d17cdb2aff2a9fcb7e4537a4f740bf19f5
--- /dev/null
+++ b/checkpoint-1584/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "o_proj",
+ "up_proj",
+ "down_proj",
+ "v_proj",
+ "k_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-1584/adapter_model.safetensors b/checkpoint-1584/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..87ee3f5b9e7a43664d010952c3312dcb730fb08f
--- /dev/null
+++ b/checkpoint-1584/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:218d93d41142d0fc239b7c5fefff85454f3f08ccc92686e9234129febcb40162
+size 132187888
diff --git a/checkpoint-1584/chat_template.jinja b/checkpoint-1584/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-1584/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-1584/optimizer.pt b/checkpoint-1584/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ccbdb3018ed31520f26969243e9b35f977917efd
--- /dev/null
+++ b/checkpoint-1584/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d4d0ea6b8e96ee0bbd396d5cd9056a8928bed87ed2e20750fa9d502d1c938180
+size 67688645
diff --git a/checkpoint-1584/rng_state.pth b/checkpoint-1584/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..f2b227c0cab23c835054e23d3b4f04c526244af2
--- /dev/null
+++ b/checkpoint-1584/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3f947f8aa5caa4e125266d06e9a43b5cd4aa4afba7b6e461769b4b5e73969952
+size 14645
diff --git a/checkpoint-1584/scheduler.pt b/checkpoint-1584/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..54f5444fbcc1b9823862cbef8676fc60f45706f7
--- /dev/null
+++ b/checkpoint-1584/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dc424159a4a7e7876847b8acacafa6dd4a4caa742818cb5599c386706deaad0b
+size 1465
diff --git a/checkpoint-1584/tokenizer.json b/checkpoint-1584/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-1584/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-1584/tokenizer_config.json b/checkpoint-1584/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-1584/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-1584/trainer_state.json b/checkpoint-1584/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..2b590d51949ca281515c43426eaf7996d8e46ad0
--- /dev/null
+++ b/checkpoint-1584/trainer_state.json
@@ -0,0 +1,11122 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 8.0,
+ "eval_steps": 500,
+ "global_step": 1584,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.54137122631073,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279057860374451,
+ "learning_rate": 5.050505050505052e-07,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.7017749547958374,
+ "learning_rate": 1.0101010101010103e-06,
+ "loss": 1.0435928106307983,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6033008098602295,
+ "learning_rate": 1.5151515151515152e-06,
+ "loss": 0.8843490481376648,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5495544672012329,
+ "learning_rate": 2.0202020202020206e-06,
+ "loss": 0.8034592866897583,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.802371621131897,
+ "learning_rate": 2.5252525252525253e-06,
+ "loss": 1.1588364839553833,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8238587975502014,
+ "learning_rate": 3.0303030303030305e-06,
+ "loss": 1.228503942489624,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6073964238166809,
+ "learning_rate": 3.5353535353535352e-06,
+ "loss": 0.8989433646202087,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 0.6492345333099365,
+ "learning_rate": 4.040404040404041e-06,
+ "loss": 0.9615614414215088,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.6880183815956116,
+ "learning_rate": 4.5454545454545455e-06,
+ "loss": 0.9233697652816772,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.470304012298584,
+ "learning_rate": 5.050505050505051e-06,
+ "loss": 0.7186562418937683,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6361913681030273,
+ "learning_rate": 5.555555555555556e-06,
+ "loss": 0.9312829375267029,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5554782152175903,
+ "learning_rate": 6.060606060606061e-06,
+ "loss": 0.8529565334320068,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5414550304412842,
+ "learning_rate": 6.565656565656567e-06,
+ "loss": 0.8071130514144897,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9267164468765259,
+ "learning_rate": 7.0707070707070704e-06,
+ "loss": 1.3577998876571655,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.6104046106338501,
+ "learning_rate": 7.5757575757575764e-06,
+ "loss": 0.923499345779419,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.7241935133934021,
+ "learning_rate": 8.080808080808082e-06,
+ "loss": 1.0400190353393555,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.6026384830474854,
+ "learning_rate": 8.585858585858587e-06,
+ "loss": 0.8413939476013184,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.7690514922142029,
+ "learning_rate": 9.090909090909091e-06,
+ "loss": 1.0870859622955322,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.5940403342247009,
+ "learning_rate": 9.595959595959595e-06,
+ "loss": 0.8468416929244995,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.669230580329895,
+ "learning_rate": 1.0101010101010101e-05,
+ "loss": 0.9340983629226685,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.5750640034675598,
+ "learning_rate": 1.0606060606060607e-05,
+ "loss": 0.8230171799659729,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.6579262614250183,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.9293508529663086,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.5956451296806335,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.8316305875778198,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.7270558476448059,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.9129499197006226,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.7505611777305603,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 1.0138367414474487,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.6870062947273254,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.901283860206604,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.7679643630981445,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.9833810329437256,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.866938591003418,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.8958402872085571,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.8687500357627869,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 1.1289801597595215,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 4.008030891418457,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 1.2739044427871704,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.7689681053161621,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.8514111638069153,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.7880434393882751,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.8862775564193726,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.6183183789253235,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.7857811450958252,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.6437809467315674,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.7093011736869812,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.5481512546539307,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.7350327968597412,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.4838634729385376,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.6584650874137878,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.523994505405426,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.7211161851882935,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.6523379683494568,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.9044773578643799,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.4274725615978241,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.568337082862854,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.5060272812843323,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.7201821208000183,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.3760877251625061,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.5880123376846313,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.3715391457080841,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.5693179368972778,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.4332570731639862,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.7277271151542664,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.38201987743377686,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.6458995938301086,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.4358846843242645,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.7559939026832581,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.4566098749637604,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.7792297601699829,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.3864676356315613,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.6894873380661011,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.31187522411346436,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.545581579208374,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.3325943350791931,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.5917496085166931,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.6410307884216309,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.44281136989593506,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.36323168873786926,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.6426926851272583,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.31924113631248474,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.5482619404792786,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.3632371723651886,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.6188253164291382,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.375381201505661,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.5487836003303528,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.3163473606109619,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.5367064476013184,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.42646294832229614,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.41221165657043457,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.41622766852378845,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.5274936556816101,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.30204030871391296,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.44855833053588867,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.3178975582122803,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.4036139249801636,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.2893930673599243,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.39234185218811035,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.2833489775657654,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.37406405806541443,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.3216562867164612,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.3938276767730713,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.26721706986427307,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.30402088165283203,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.3702670931816101,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.30594947934150696,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.2632184326648712,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.2691727876663208,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.36898860335350037,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.33992528915405273,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.2976086735725403,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.27603086829185486,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.32201430201530457,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.25665703415870667,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.35001808404922485,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.24190445244312286,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.5106059908866882,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.3093336820602417,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.3261374831199646,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.18783289194107056,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.38757652044296265,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.19549766182899475,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.4723363518714905,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.15751558542251587,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.36796173453330994,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.14514681696891785,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.3855208456516266,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.14030519127845764,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.5906668305397034,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.1478388011455536,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.2658001780509949,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.13253600895404816,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.33554506301879883,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.12156252562999725,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.2643960416316986,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.1089208647608757,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.19129537045955658,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.08515600860118866,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.22168858349323273,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.09310197830200195,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.16676382720470428,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.07711787521839142,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.23891882598400116,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.09763285517692566,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.28446146845817566,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.08980057388544083,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.146108940243721,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.06573648750782013,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.2007656991481781,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.0699995830655098,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.3082621395587921,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.0885838121175766,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.1624963879585266,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.06935172528028488,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.1562737673521042,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.07147250324487686,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.1660323292016983,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.0672944188117981,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.21427564322948456,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.07051930576562881,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.16495929658412933,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.05429624393582344,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.1978198140859604,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.07144488394260406,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.15077605843544006,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.055798254907131195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.2806876301765442,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.06058178097009659,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.1219187006354332,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.05044667422771454,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10286939144134521,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.048498690128326416,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.12813609838485718,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.06252863258123398,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10565406829118729,
+ "learning_rate": 5e-05,
+ "loss": 0.051401108503341675,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.09147113561630249,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.047376491129398346,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.08723224699497223,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.039745647460222244,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.16071128845214844,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.058398712426424026,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.1370300054550171,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.05132289230823517,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.19449608027935028,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.06682188808917999,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.13085028529167175,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.049861155450344086,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.1768050193786621,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.055694688111543655,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.2819313704967499,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.062391363084316254,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.10738537460565567,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.05093343183398247,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.11759619414806366,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.044827841222286224,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.21941131353378296,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.05238347500562668,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.1697252243757248,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.04869212955236435,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.19701889157295227,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.04484856128692627,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.11779771000146866,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.04135368764400482,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.19823911786079407,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.05097956955432892,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.17355702817440033,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.05781872197985649,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.13029292225837708,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.041528262197971344,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.1292058229446411,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.0442211888730526,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10058800131082535,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.03813612461090088,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.22936487197875977,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.056090980768203735,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.13063806295394897,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.04347142577171326,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.167104110121727,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.04442849010229111,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.11942817270755768,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.03964124619960785,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.17906631529331207,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.04372458904981613,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.13760331273078918,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.03980286419391632,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.18043340742588043,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.05500294268131256,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.31386223435401917,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.04253799840807915,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.1428707093000412,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.047894880175590515,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.11010178923606873,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.04534825310111046,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.10444525629281998,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.041347943246364594,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.18076039850711823,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.04535853862762451,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.19424672424793243,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.05037602037191391,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.1457783728837967,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.047546930611133575,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.1189681887626648,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.03254905715584755,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.18887822329998016,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.04018670320510864,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.12217189371585846,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.03981504589319229,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.10866257548332214,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.04322533681988716,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.15904399752616882,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.04488902539014816,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.12598516047000885,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.04718853533267975,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.22092872858047485,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.03646199405193329,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.1717238426208496,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.04607801511883736,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.16268078982830048,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.04759417474269867,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.19621087610721588,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.051741112023591995,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.15362979471683502,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.04363569617271423,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.1404130607843399,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.045428819954395294,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.12262272834777832,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.03828439861536026,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.10626570880413055,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.03420639410614967,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.12686072289943695,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.03474457561969757,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.153709277510643,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.03174472972750664,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.13035084307193756,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.02982976846396923,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.12288431823253632,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.03588784486055374,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.19307470321655273,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.04750734567642212,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.0996781438589096,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.027098631486296654,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.16898290812969208,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.040447790175676346,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.10996036231517792,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.02525201067328453,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.16161896288394928,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.04199359938502312,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.1536172777414322,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.02943507581949234,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.18457260727882385,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.04093889892101288,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.11232347041368484,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.029609719291329384,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.19080978631973267,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.0357801653444767,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.16634301841259003,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02980419248342514,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.28601372241973877,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.032849978655576706,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.1359848529100418,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.0230826735496521,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.11285015195608139,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.02447221614420414,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.14712421596050262,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.022657420486211777,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.18246804177761078,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.035991013050079346,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.143621563911438,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.024444863200187683,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.12458691000938416,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.039701592177152634,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05614984780550003,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.029840555042028427,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.06097931042313576,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.027426715940237045,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.09883654862642288,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031690437346696854,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.0700431764125824,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.024079838767647743,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.05957406386733055,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.02303817868232727,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.14374858140945435,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.031183632090687752,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.09187919646501541,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.031176958233118057,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.0540630929172039,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.024949276819825172,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06875574588775635,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.02890622243285179,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.10081329196691513,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.03019360452890396,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.11833225935697556,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.020365778356790543,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.08700298517942429,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.027046984061598778,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.08660133928060532,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.027088070288300514,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.06983930617570877,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.019332535564899445,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.09463227540254593,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.02780212089419365,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.10251298546791077,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.026878856122493744,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.15963847935199738,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.03437665104866028,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.11342372000217438,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.02877948433160782,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.0937543660402298,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.02759186364710331,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.07137084752321243,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.02941890060901642,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.3511611819267273,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.024331524968147278,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.12344356626272202,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.0348694771528244,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.07144290208816528,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.021711278706789017,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.09835992008447647,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.03408564254641533,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.4978399872779846,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.03810017928481102,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.06314591318368912,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.0201277956366539,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.07504695653915405,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.025770913809537888,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.1028534397482872,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.02469150349497795,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.09341974556446075,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.036506302654743195,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09348680078983307,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02507903426885605,
+ "step": 198
+ },
+ {
+ "epoch": 1.0050632911392405,
+ "grad_norm": 0.06890113651752472,
+ "learning_rate": 0.0001,
+ "loss": 0.028374083340168,
+ "step": 199
+ },
+ {
+ "epoch": 1.010126582278481,
+ "grad_norm": 0.051041170954704285,
+ "learning_rate": 9.994388327721661e-05,
+ "loss": 0.022860335186123848,
+ "step": 200
+ },
+ {
+ "epoch": 1.0151898734177216,
+ "grad_norm": 0.10253743082284927,
+ "learning_rate": 9.988776655443322e-05,
+ "loss": 0.02864072285592556,
+ "step": 201
+ },
+ {
+ "epoch": 1.0202531645569621,
+ "grad_norm": 0.08295776695013046,
+ "learning_rate": 9.983164983164983e-05,
+ "loss": 0.0327395498752594,
+ "step": 202
+ },
+ {
+ "epoch": 1.0253164556962024,
+ "grad_norm": 0.07240694016218185,
+ "learning_rate": 9.977553310886645e-05,
+ "loss": 0.029215697199106216,
+ "step": 203
+ },
+ {
+ "epoch": 1.030379746835443,
+ "grad_norm": 0.0688897892832756,
+ "learning_rate": 9.971941638608306e-05,
+ "loss": 0.027594968676567078,
+ "step": 204
+ },
+ {
+ "epoch": 1.0354430379746835,
+ "grad_norm": 0.08463896065950394,
+ "learning_rate": 9.966329966329967e-05,
+ "loss": 0.02292536199092865,
+ "step": 205
+ },
+ {
+ "epoch": 1.040506329113924,
+ "grad_norm": 0.062013301998376846,
+ "learning_rate": 9.960718294051628e-05,
+ "loss": 0.023678191006183624,
+ "step": 206
+ },
+ {
+ "epoch": 1.0455696202531646,
+ "grad_norm": 0.08735264092683792,
+ "learning_rate": 9.955106621773289e-05,
+ "loss": 0.022060325369238853,
+ "step": 207
+ },
+ {
+ "epoch": 1.0506329113924051,
+ "grad_norm": 0.07634295523166656,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02764434739947319,
+ "step": 208
+ },
+ {
+ "epoch": 1.0556962025316456,
+ "grad_norm": 0.09735682606697083,
+ "learning_rate": 9.943883277216612e-05,
+ "loss": 0.03304428607225418,
+ "step": 209
+ },
+ {
+ "epoch": 1.0607594936708862,
+ "grad_norm": 0.06860044598579407,
+ "learning_rate": 9.938271604938272e-05,
+ "loss": 0.0340178906917572,
+ "step": 210
+ },
+ {
+ "epoch": 1.0658227848101265,
+ "grad_norm": 0.3715139627456665,
+ "learning_rate": 9.932659932659934e-05,
+ "loss": 0.02541016787290573,
+ "step": 211
+ },
+ {
+ "epoch": 1.070886075949367,
+ "grad_norm": 0.07673332840204239,
+ "learning_rate": 9.927048260381594e-05,
+ "loss": 0.025950253009796143,
+ "step": 212
+ },
+ {
+ "epoch": 1.0759493670886076,
+ "grad_norm": 0.07359500974416733,
+ "learning_rate": 9.921436588103256e-05,
+ "loss": 0.024356549605727196,
+ "step": 213
+ },
+ {
+ "epoch": 1.081012658227848,
+ "grad_norm": 0.07760954648256302,
+ "learning_rate": 9.915824915824916e-05,
+ "loss": 0.02338298037648201,
+ "step": 214
+ },
+ {
+ "epoch": 1.0860759493670886,
+ "grad_norm": 0.09183681756258011,
+ "learning_rate": 9.910213243546578e-05,
+ "loss": 0.020955465734004974,
+ "step": 215
+ },
+ {
+ "epoch": 1.0911392405063292,
+ "grad_norm": 0.21278677880764008,
+ "learning_rate": 9.904601571268239e-05,
+ "loss": 0.028164055198431015,
+ "step": 216
+ },
+ {
+ "epoch": 1.0962025316455697,
+ "grad_norm": 0.22437937557697296,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.03543347865343094,
+ "step": 217
+ },
+ {
+ "epoch": 1.1012658227848102,
+ "grad_norm": 0.08677598088979721,
+ "learning_rate": 9.893378226711561e-05,
+ "loss": 0.031265974044799805,
+ "step": 218
+ },
+ {
+ "epoch": 1.1063291139240505,
+ "grad_norm": 0.09595583379268646,
+ "learning_rate": 9.887766554433222e-05,
+ "loss": 0.02384507656097412,
+ "step": 219
+ },
+ {
+ "epoch": 1.111392405063291,
+ "grad_norm": 0.08256062865257263,
+ "learning_rate": 9.882154882154883e-05,
+ "loss": 0.022209012880921364,
+ "step": 220
+ },
+ {
+ "epoch": 1.1164556962025316,
+ "grad_norm": 0.07712455838918686,
+ "learning_rate": 9.876543209876543e-05,
+ "loss": 0.025278344750404358,
+ "step": 221
+ },
+ {
+ "epoch": 1.1215189873417721,
+ "grad_norm": 0.09704182296991348,
+ "learning_rate": 9.870931537598205e-05,
+ "loss": 0.024904735386371613,
+ "step": 222
+ },
+ {
+ "epoch": 1.1265822784810127,
+ "grad_norm": 0.09094078838825226,
+ "learning_rate": 9.865319865319865e-05,
+ "loss": 0.0280012097209692,
+ "step": 223
+ },
+ {
+ "epoch": 1.1316455696202532,
+ "grad_norm": 0.07607442885637283,
+ "learning_rate": 9.859708193041527e-05,
+ "loss": 0.026181645691394806,
+ "step": 224
+ },
+ {
+ "epoch": 1.1367088607594937,
+ "grad_norm": 0.06568697839975357,
+ "learning_rate": 9.854096520763188e-05,
+ "loss": 0.02883346565067768,
+ "step": 225
+ },
+ {
+ "epoch": 1.1417721518987343,
+ "grad_norm": 0.07192376255989075,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.027345171198248863,
+ "step": 226
+ },
+ {
+ "epoch": 1.1468354430379746,
+ "grad_norm": 0.1464017778635025,
+ "learning_rate": 9.84287317620651e-05,
+ "loss": 0.03213154152035713,
+ "step": 227
+ },
+ {
+ "epoch": 1.1518987341772151,
+ "grad_norm": 0.06766578555107117,
+ "learning_rate": 9.837261503928171e-05,
+ "loss": 0.02554963156580925,
+ "step": 228
+ },
+ {
+ "epoch": 1.1569620253164556,
+ "grad_norm": 0.09428609162569046,
+ "learning_rate": 9.831649831649832e-05,
+ "loss": 0.02484097331762314,
+ "step": 229
+ },
+ {
+ "epoch": 1.1620253164556962,
+ "grad_norm": 0.1648297905921936,
+ "learning_rate": 9.826038159371493e-05,
+ "loss": 0.03450813889503479,
+ "step": 230
+ },
+ {
+ "epoch": 1.1670886075949367,
+ "grad_norm": 0.06389904767274857,
+ "learning_rate": 9.820426487093154e-05,
+ "loss": 0.02957337349653244,
+ "step": 231
+ },
+ {
+ "epoch": 1.1721518987341772,
+ "grad_norm": 0.11517420411109924,
+ "learning_rate": 9.814814814814815e-05,
+ "loss": 0.024299729615449905,
+ "step": 232
+ },
+ {
+ "epoch": 1.1772151898734178,
+ "grad_norm": 0.06960142403841019,
+ "learning_rate": 9.809203142536476e-05,
+ "loss": 0.025762220844626427,
+ "step": 233
+ },
+ {
+ "epoch": 1.1822784810126583,
+ "grad_norm": 0.11682946234941483,
+ "learning_rate": 9.803591470258137e-05,
+ "loss": 0.02457268163561821,
+ "step": 234
+ },
+ {
+ "epoch": 1.1873417721518988,
+ "grad_norm": 0.07964848726987839,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.027285631746053696,
+ "step": 235
+ },
+ {
+ "epoch": 1.1924050632911392,
+ "grad_norm": 0.053044773638248444,
+ "learning_rate": 9.79236812570146e-05,
+ "loss": 0.020997609943151474,
+ "step": 236
+ },
+ {
+ "epoch": 1.1974683544303797,
+ "grad_norm": 0.13531149923801422,
+ "learning_rate": 9.78675645342312e-05,
+ "loss": 0.02474522590637207,
+ "step": 237
+ },
+ {
+ "epoch": 1.2025316455696202,
+ "grad_norm": 0.0774424746632576,
+ "learning_rate": 9.781144781144782e-05,
+ "loss": 0.025272740051150322,
+ "step": 238
+ },
+ {
+ "epoch": 1.2075949367088608,
+ "grad_norm": 0.042708419263362885,
+ "learning_rate": 9.775533108866442e-05,
+ "loss": 0.019522909075021744,
+ "step": 239
+ },
+ {
+ "epoch": 1.2126582278481013,
+ "grad_norm": 0.10364090651273727,
+ "learning_rate": 9.769921436588104e-05,
+ "loss": 0.02728935517370701,
+ "step": 240
+ },
+ {
+ "epoch": 1.2177215189873418,
+ "grad_norm": 0.0756702646613121,
+ "learning_rate": 9.764309764309764e-05,
+ "loss": 0.02659972943365574,
+ "step": 241
+ },
+ {
+ "epoch": 1.2227848101265824,
+ "grad_norm": 0.07232004404067993,
+ "learning_rate": 9.758698092031426e-05,
+ "loss": 0.017723949626088142,
+ "step": 242
+ },
+ {
+ "epoch": 1.2278481012658227,
+ "grad_norm": 0.058345306664705276,
+ "learning_rate": 9.753086419753087e-05,
+ "loss": 0.019348861649632454,
+ "step": 243
+ },
+ {
+ "epoch": 1.2329113924050632,
+ "grad_norm": 0.14832371473312378,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.03227488696575165,
+ "step": 244
+ },
+ {
+ "epoch": 1.2379746835443037,
+ "grad_norm": 0.05343412607908249,
+ "learning_rate": 9.74186307519641e-05,
+ "loss": 0.0210015457123518,
+ "step": 245
+ },
+ {
+ "epoch": 1.2430379746835443,
+ "grad_norm": 0.054104797542095184,
+ "learning_rate": 9.736251402918069e-05,
+ "loss": 0.02430287003517151,
+ "step": 246
+ },
+ {
+ "epoch": 1.2481012658227848,
+ "grad_norm": 0.11686044931411743,
+ "learning_rate": 9.730639730639732e-05,
+ "loss": 0.029372017830610275,
+ "step": 247
+ },
+ {
+ "epoch": 1.2531645569620253,
+ "grad_norm": 0.05970177799463272,
+ "learning_rate": 9.725028058361391e-05,
+ "loss": 0.024995045736432076,
+ "step": 248
+ },
+ {
+ "epoch": 1.2582278481012659,
+ "grad_norm": 0.06506923586130142,
+ "learning_rate": 9.719416386083054e-05,
+ "loss": 0.024779727682471275,
+ "step": 249
+ },
+ {
+ "epoch": 1.2632911392405064,
+ "grad_norm": 0.12711220979690552,
+ "learning_rate": 9.713804713804715e-05,
+ "loss": 0.026196476072072983,
+ "step": 250
+ },
+ {
+ "epoch": 1.268354430379747,
+ "grad_norm": 0.056023694574832916,
+ "learning_rate": 9.708193041526376e-05,
+ "loss": 0.01813146471977234,
+ "step": 251
+ },
+ {
+ "epoch": 1.2734177215189875,
+ "grad_norm": 0.04508040472865105,
+ "learning_rate": 9.702581369248037e-05,
+ "loss": 0.019225183874368668,
+ "step": 252
+ },
+ {
+ "epoch": 1.2784810126582278,
+ "grad_norm": 0.10354425758123398,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.02940209209918976,
+ "step": 253
+ },
+ {
+ "epoch": 1.2835443037974683,
+ "grad_norm": 0.06974297761917114,
+ "learning_rate": 9.691358024691359e-05,
+ "loss": 0.02482295036315918,
+ "step": 254
+ },
+ {
+ "epoch": 1.2886075949367088,
+ "grad_norm": 0.06940010190010071,
+ "learning_rate": 9.68574635241302e-05,
+ "loss": 0.020605089142918587,
+ "step": 255
+ },
+ {
+ "epoch": 1.2936708860759494,
+ "grad_norm": 0.09167850762605667,
+ "learning_rate": 9.68013468013468e-05,
+ "loss": 0.02429921180009842,
+ "step": 256
+ },
+ {
+ "epoch": 1.29873417721519,
+ "grad_norm": 0.048866868019104004,
+ "learning_rate": 9.674523007856342e-05,
+ "loss": 0.021776504814624786,
+ "step": 257
+ },
+ {
+ "epoch": 1.3037974683544304,
+ "grad_norm": 0.06977155059576035,
+ "learning_rate": 9.668911335578003e-05,
+ "loss": 0.02758147194981575,
+ "step": 258
+ },
+ {
+ "epoch": 1.3088607594936708,
+ "grad_norm": 0.17602303624153137,
+ "learning_rate": 9.663299663299664e-05,
+ "loss": 0.026518259197473526,
+ "step": 259
+ },
+ {
+ "epoch": 1.3139240506329113,
+ "grad_norm": 0.08011946082115173,
+ "learning_rate": 9.657687991021325e-05,
+ "loss": 0.026240577921271324,
+ "step": 260
+ },
+ {
+ "epoch": 1.3189873417721518,
+ "grad_norm": 0.06296376883983612,
+ "learning_rate": 9.652076318742987e-05,
+ "loss": 0.03159455955028534,
+ "step": 261
+ },
+ {
+ "epoch": 1.3240506329113924,
+ "grad_norm": 0.04424722492694855,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.024151435121893883,
+ "step": 262
+ },
+ {
+ "epoch": 1.3291139240506329,
+ "grad_norm": 0.045779623091220856,
+ "learning_rate": 9.640852974186309e-05,
+ "loss": 0.018655993044376373,
+ "step": 263
+ },
+ {
+ "epoch": 1.3341772151898734,
+ "grad_norm": 0.06355931609869003,
+ "learning_rate": 9.635241301907969e-05,
+ "loss": 0.01999380812048912,
+ "step": 264
+ },
+ {
+ "epoch": 1.339240506329114,
+ "grad_norm": 0.04477616026997566,
+ "learning_rate": 9.62962962962963e-05,
+ "loss": 0.021614115685224533,
+ "step": 265
+ },
+ {
+ "epoch": 1.3443037974683545,
+ "grad_norm": 0.05851180478930473,
+ "learning_rate": 9.62401795735129e-05,
+ "loss": 0.023495908826589584,
+ "step": 266
+ },
+ {
+ "epoch": 1.349367088607595,
+ "grad_norm": 0.04724022373557091,
+ "learning_rate": 9.618406285072952e-05,
+ "loss": 0.02053767442703247,
+ "step": 267
+ },
+ {
+ "epoch": 1.3544303797468356,
+ "grad_norm": 0.12757639586925507,
+ "learning_rate": 9.612794612794614e-05,
+ "loss": 0.030612681061029434,
+ "step": 268
+ },
+ {
+ "epoch": 1.3594936708860759,
+ "grad_norm": 0.18316853046417236,
+ "learning_rate": 9.607182940516274e-05,
+ "loss": 0.039485104382038116,
+ "step": 269
+ },
+ {
+ "epoch": 1.3645569620253164,
+ "grad_norm": 0.09149223566055298,
+ "learning_rate": 9.601571268237936e-05,
+ "loss": 0.031156456097960472,
+ "step": 270
+ },
+ {
+ "epoch": 1.369620253164557,
+ "grad_norm": 0.07885908335447311,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.026395633816719055,
+ "step": 271
+ },
+ {
+ "epoch": 1.3746835443037975,
+ "grad_norm": 0.0984397754073143,
+ "learning_rate": 9.590347923681258e-05,
+ "loss": 0.02990398183465004,
+ "step": 272
+ },
+ {
+ "epoch": 1.379746835443038,
+ "grad_norm": 0.08566205203533173,
+ "learning_rate": 9.584736251402918e-05,
+ "loss": 0.024353420361876488,
+ "step": 273
+ },
+ {
+ "epoch": 1.3848101265822785,
+ "grad_norm": 0.16623689234256744,
+ "learning_rate": 9.57912457912458e-05,
+ "loss": 0.03626095876097679,
+ "step": 274
+ },
+ {
+ "epoch": 1.389873417721519,
+ "grad_norm": 0.07134243100881577,
+ "learning_rate": 9.57351290684624e-05,
+ "loss": 0.026036158204078674,
+ "step": 275
+ },
+ {
+ "epoch": 1.3949367088607594,
+ "grad_norm": 0.07753578573465347,
+ "learning_rate": 9.567901234567902e-05,
+ "loss": 0.03266923502087593,
+ "step": 276
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.07113673537969589,
+ "learning_rate": 9.562289562289563e-05,
+ "loss": 0.024128902703523636,
+ "step": 277
+ },
+ {
+ "epoch": 1.4050632911392404,
+ "grad_norm": 0.0954187884926796,
+ "learning_rate": 9.556677890011224e-05,
+ "loss": 0.03310588374733925,
+ "step": 278
+ },
+ {
+ "epoch": 1.410126582278481,
+ "grad_norm": 0.08755122870206833,
+ "learning_rate": 9.551066217732885e-05,
+ "loss": 0.030977975577116013,
+ "step": 279
+ },
+ {
+ "epoch": 1.4151898734177215,
+ "grad_norm": 0.06839736551046371,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.029557062312960625,
+ "step": 280
+ },
+ {
+ "epoch": 1.420253164556962,
+ "grad_norm": 0.051050763577222824,
+ "learning_rate": 9.539842873176207e-05,
+ "loss": 0.022091392427682877,
+ "step": 281
+ },
+ {
+ "epoch": 1.4253164556962026,
+ "grad_norm": 0.05898132920265198,
+ "learning_rate": 9.534231200897868e-05,
+ "loss": 0.024804875254631042,
+ "step": 282
+ },
+ {
+ "epoch": 1.4303797468354431,
+ "grad_norm": 0.04517035931348801,
+ "learning_rate": 9.528619528619529e-05,
+ "loss": 0.024234894663095474,
+ "step": 283
+ },
+ {
+ "epoch": 1.4354430379746836,
+ "grad_norm": 0.05625253543257713,
+ "learning_rate": 9.52300785634119e-05,
+ "loss": 0.02342807501554489,
+ "step": 284
+ },
+ {
+ "epoch": 1.4405063291139242,
+ "grad_norm": 0.047006960958242416,
+ "learning_rate": 9.517396184062851e-05,
+ "loss": 0.021819880232214928,
+ "step": 285
+ },
+ {
+ "epoch": 1.4455696202531645,
+ "grad_norm": 0.051774390041828156,
+ "learning_rate": 9.511784511784512e-05,
+ "loss": 0.020575571805238724,
+ "step": 286
+ },
+ {
+ "epoch": 1.450632911392405,
+ "grad_norm": 0.0684620812535286,
+ "learning_rate": 9.506172839506173e-05,
+ "loss": 0.025043494999408722,
+ "step": 287
+ },
+ {
+ "epoch": 1.4556962025316456,
+ "grad_norm": 0.05345604941248894,
+ "learning_rate": 9.500561167227834e-05,
+ "loss": 0.020829960703849792,
+ "step": 288
+ },
+ {
+ "epoch": 1.460759493670886,
+ "grad_norm": 0.07588688284158707,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.02842051535844803,
+ "step": 289
+ },
+ {
+ "epoch": 1.4658227848101266,
+ "grad_norm": 0.0371188148856163,
+ "learning_rate": 9.489337822671156e-05,
+ "loss": 0.020213091745972633,
+ "step": 290
+ },
+ {
+ "epoch": 1.4708860759493672,
+ "grad_norm": 0.03922685980796814,
+ "learning_rate": 9.483726150392817e-05,
+ "loss": 0.020665431395173073,
+ "step": 291
+ },
+ {
+ "epoch": 1.4759493670886075,
+ "grad_norm": 0.10213606059551239,
+ "learning_rate": 9.478114478114478e-05,
+ "loss": 0.024979032576084137,
+ "step": 292
+ },
+ {
+ "epoch": 1.481012658227848,
+ "grad_norm": 0.04574638605117798,
+ "learning_rate": 9.472502805836139e-05,
+ "loss": 0.0215127132833004,
+ "step": 293
+ },
+ {
+ "epoch": 1.4860759493670885,
+ "grad_norm": 0.0829704999923706,
+ "learning_rate": 9.4668911335578e-05,
+ "loss": 0.023608818650245667,
+ "step": 294
+ },
+ {
+ "epoch": 1.491139240506329,
+ "grad_norm": 0.036335594952106476,
+ "learning_rate": 9.461279461279463e-05,
+ "loss": 0.01993970200419426,
+ "step": 295
+ },
+ {
+ "epoch": 1.4962025316455696,
+ "grad_norm": 0.08291227370500565,
+ "learning_rate": 9.455667789001122e-05,
+ "loss": 0.02223093807697296,
+ "step": 296
+ },
+ {
+ "epoch": 1.5012658227848101,
+ "grad_norm": 0.048284996300935745,
+ "learning_rate": 9.450056116722785e-05,
+ "loss": 0.019440360367298126,
+ "step": 297
+ },
+ {
+ "epoch": 1.5063291139240507,
+ "grad_norm": 0.25126877427101135,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.030357610434293747,
+ "step": 298
+ },
+ {
+ "epoch": 1.5113924050632912,
+ "grad_norm": 0.08812759816646576,
+ "learning_rate": 9.438832772166107e-05,
+ "loss": 0.025407828390598297,
+ "step": 299
+ },
+ {
+ "epoch": 1.5164556962025317,
+ "grad_norm": 0.09417422115802765,
+ "learning_rate": 9.433221099887766e-05,
+ "loss": 0.028768496587872505,
+ "step": 300
+ },
+ {
+ "epoch": 1.5215189873417723,
+ "grad_norm": 0.10820329934358597,
+ "learning_rate": 9.427609427609429e-05,
+ "loss": 0.03250410035252571,
+ "step": 301
+ },
+ {
+ "epoch": 1.5265822784810128,
+ "grad_norm": 0.06633433699607849,
+ "learning_rate": 9.42199775533109e-05,
+ "loss": 0.019816454499959946,
+ "step": 302
+ },
+ {
+ "epoch": 1.5316455696202531,
+ "grad_norm": 0.05545264482498169,
+ "learning_rate": 9.41638608305275e-05,
+ "loss": 0.020919661968946457,
+ "step": 303
+ },
+ {
+ "epoch": 1.5367088607594936,
+ "grad_norm": 0.08201726526021957,
+ "learning_rate": 9.410774410774412e-05,
+ "loss": 0.0309453085064888,
+ "step": 304
+ },
+ {
+ "epoch": 1.5417721518987342,
+ "grad_norm": 0.047229036688804626,
+ "learning_rate": 9.405162738496073e-05,
+ "loss": 0.02079029008746147,
+ "step": 305
+ },
+ {
+ "epoch": 1.5468354430379747,
+ "grad_norm": 0.04493536427617073,
+ "learning_rate": 9.399551066217734e-05,
+ "loss": 0.020319776609539986,
+ "step": 306
+ },
+ {
+ "epoch": 1.5518987341772152,
+ "grad_norm": 0.07935966551303864,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.03144281357526779,
+ "step": 307
+ },
+ {
+ "epoch": 1.5569620253164556,
+ "grad_norm": 0.10108500719070435,
+ "learning_rate": 9.388327721661056e-05,
+ "loss": 0.029823362827301025,
+ "step": 308
+ },
+ {
+ "epoch": 1.562025316455696,
+ "grad_norm": 0.05187584087252617,
+ "learning_rate": 9.382716049382717e-05,
+ "loss": 0.029090257361531258,
+ "step": 309
+ },
+ {
+ "epoch": 1.5670886075949366,
+ "grad_norm": 0.09131086617708206,
+ "learning_rate": 9.377104377104378e-05,
+ "loss": 0.020090997219085693,
+ "step": 310
+ },
+ {
+ "epoch": 1.5721518987341772,
+ "grad_norm": 0.06874370574951172,
+ "learning_rate": 9.371492704826039e-05,
+ "loss": 0.022118568420410156,
+ "step": 311
+ },
+ {
+ "epoch": 1.5772151898734177,
+ "grad_norm": 0.07480651885271072,
+ "learning_rate": 9.3658810325477e-05,
+ "loss": 0.030924849212169647,
+ "step": 312
+ },
+ {
+ "epoch": 1.5822784810126582,
+ "grad_norm": 0.04049983248114586,
+ "learning_rate": 9.36026936026936e-05,
+ "loss": 0.02086808532476425,
+ "step": 313
+ },
+ {
+ "epoch": 1.5873417721518988,
+ "grad_norm": 0.037067580968141556,
+ "learning_rate": 9.354657687991022e-05,
+ "loss": 0.022019919008016586,
+ "step": 314
+ },
+ {
+ "epoch": 1.5924050632911393,
+ "grad_norm": 0.0599038302898407,
+ "learning_rate": 9.349046015712683e-05,
+ "loss": 0.02305535599589348,
+ "step": 315
+ },
+ {
+ "epoch": 1.5974683544303798,
+ "grad_norm": 0.056727997958660126,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.025360889732837677,
+ "step": 316
+ },
+ {
+ "epoch": 1.6025316455696204,
+ "grad_norm": 0.06659650057554245,
+ "learning_rate": 9.337822671156005e-05,
+ "loss": 0.02528395690023899,
+ "step": 317
+ },
+ {
+ "epoch": 1.6075949367088609,
+ "grad_norm": 0.06213822215795517,
+ "learning_rate": 9.332210998877666e-05,
+ "loss": 0.028841618448495865,
+ "step": 318
+ },
+ {
+ "epoch": 1.6126582278481014,
+ "grad_norm": 0.03757556155323982,
+ "learning_rate": 9.326599326599327e-05,
+ "loss": 0.02282278798520565,
+ "step": 319
+ },
+ {
+ "epoch": 1.6177215189873417,
+ "grad_norm": 0.061945486813783646,
+ "learning_rate": 9.320987654320989e-05,
+ "loss": 0.02733437530696392,
+ "step": 320
+ },
+ {
+ "epoch": 1.6227848101265823,
+ "grad_norm": 0.07904566079378128,
+ "learning_rate": 9.315375982042649e-05,
+ "loss": 0.02630138024687767,
+ "step": 321
+ },
+ {
+ "epoch": 1.6278481012658228,
+ "grad_norm": 0.07157077640295029,
+ "learning_rate": 9.309764309764311e-05,
+ "loss": 0.023403439670801163,
+ "step": 322
+ },
+ {
+ "epoch": 1.6329113924050633,
+ "grad_norm": 0.03518318012356758,
+ "learning_rate": 9.304152637485971e-05,
+ "loss": 0.021487422287464142,
+ "step": 323
+ },
+ {
+ "epoch": 1.6379746835443036,
+ "grad_norm": 0.11178159713745117,
+ "learning_rate": 9.298540965207633e-05,
+ "loss": 0.03142111003398895,
+ "step": 324
+ },
+ {
+ "epoch": 1.6430379746835442,
+ "grad_norm": 0.05046987161040306,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.020960725843906403,
+ "step": 325
+ },
+ {
+ "epoch": 1.6481012658227847,
+ "grad_norm": 0.05356504023075104,
+ "learning_rate": 9.287317620650955e-05,
+ "loss": 0.01934133842587471,
+ "step": 326
+ },
+ {
+ "epoch": 1.6531645569620252,
+ "grad_norm": 0.07995260506868362,
+ "learning_rate": 9.281705948372615e-05,
+ "loss": 0.0248265378177166,
+ "step": 327
+ },
+ {
+ "epoch": 1.6582278481012658,
+ "grad_norm": 0.08783978968858719,
+ "learning_rate": 9.276094276094277e-05,
+ "loss": 0.024171534925699234,
+ "step": 328
+ },
+ {
+ "epoch": 1.6632911392405063,
+ "grad_norm": 0.043143950402736664,
+ "learning_rate": 9.270482603815938e-05,
+ "loss": 0.021554211154580116,
+ "step": 329
+ },
+ {
+ "epoch": 1.6683544303797468,
+ "grad_norm": 0.05635169520974159,
+ "learning_rate": 9.264870931537598e-05,
+ "loss": 0.025942442938685417,
+ "step": 330
+ },
+ {
+ "epoch": 1.6734177215189874,
+ "grad_norm": 0.042691316455602646,
+ "learning_rate": 9.25925925925926e-05,
+ "loss": 0.021898634731769562,
+ "step": 331
+ },
+ {
+ "epoch": 1.678481012658228,
+ "grad_norm": 0.07666946202516556,
+ "learning_rate": 9.25364758698092e-05,
+ "loss": 0.02928568609058857,
+ "step": 332
+ },
+ {
+ "epoch": 1.6835443037974684,
+ "grad_norm": 0.04230545833706856,
+ "learning_rate": 9.248035914702582e-05,
+ "loss": 0.020812246948480606,
+ "step": 333
+ },
+ {
+ "epoch": 1.688607594936709,
+ "grad_norm": 0.1077270656824112,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.025568369776010513,
+ "step": 334
+ },
+ {
+ "epoch": 1.6936708860759495,
+ "grad_norm": 0.04277936369180679,
+ "learning_rate": 9.236812570145904e-05,
+ "loss": 0.018935058265924454,
+ "step": 335
+ },
+ {
+ "epoch": 1.6987341772151898,
+ "grad_norm": 0.04454135522246361,
+ "learning_rate": 9.231200897867565e-05,
+ "loss": 0.01933746598660946,
+ "step": 336
+ },
+ {
+ "epoch": 1.7037974683544304,
+ "grad_norm": 0.0674893856048584,
+ "learning_rate": 9.225589225589226e-05,
+ "loss": 0.021518435329198837,
+ "step": 337
+ },
+ {
+ "epoch": 1.7088607594936709,
+ "grad_norm": 0.06007042154669762,
+ "learning_rate": 9.219977553310887e-05,
+ "loss": 0.019427424296736717,
+ "step": 338
+ },
+ {
+ "epoch": 1.7139240506329114,
+ "grad_norm": 0.09564489126205444,
+ "learning_rate": 9.214365881032548e-05,
+ "loss": 0.027250545099377632,
+ "step": 339
+ },
+ {
+ "epoch": 1.7189873417721517,
+ "grad_norm": 0.053655482828617096,
+ "learning_rate": 9.208754208754209e-05,
+ "loss": 0.020125389099121094,
+ "step": 340
+ },
+ {
+ "epoch": 1.7240506329113923,
+ "grad_norm": 0.038283221423625946,
+ "learning_rate": 9.20314253647587e-05,
+ "loss": 0.017948098480701447,
+ "step": 341
+ },
+ {
+ "epoch": 1.7291139240506328,
+ "grad_norm": 0.04724166542291641,
+ "learning_rate": 9.197530864197531e-05,
+ "loss": 0.02523602545261383,
+ "step": 342
+ },
+ {
+ "epoch": 1.7341772151898733,
+ "grad_norm": 0.10365224629640579,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.035696640610694885,
+ "step": 343
+ },
+ {
+ "epoch": 1.7392405063291139,
+ "grad_norm": 0.07362233102321625,
+ "learning_rate": 9.186307519640853e-05,
+ "loss": 0.026104427874088287,
+ "step": 344
+ },
+ {
+ "epoch": 1.7443037974683544,
+ "grad_norm": 0.05976846069097519,
+ "learning_rate": 9.180695847362514e-05,
+ "loss": 0.026634451001882553,
+ "step": 345
+ },
+ {
+ "epoch": 1.749367088607595,
+ "grad_norm": 0.07387223839759827,
+ "learning_rate": 9.175084175084175e-05,
+ "loss": 0.025733446702361107,
+ "step": 346
+ },
+ {
+ "epoch": 1.7544303797468355,
+ "grad_norm": 0.04727378115057945,
+ "learning_rate": 9.169472502805838e-05,
+ "loss": 0.01889938861131668,
+ "step": 347
+ },
+ {
+ "epoch": 1.759493670886076,
+ "grad_norm": 0.10614906996488571,
+ "learning_rate": 9.163860830527497e-05,
+ "loss": 0.02275039628148079,
+ "step": 348
+ },
+ {
+ "epoch": 1.7645569620253165,
+ "grad_norm": 0.04877970367670059,
+ "learning_rate": 9.15824915824916e-05,
+ "loss": 0.022580452263355255,
+ "step": 349
+ },
+ {
+ "epoch": 1.769620253164557,
+ "grad_norm": 0.18825598061084747,
+ "learning_rate": 9.152637485970819e-05,
+ "loss": 0.03054988384246826,
+ "step": 350
+ },
+ {
+ "epoch": 1.7746835443037976,
+ "grad_norm": 0.06315254420042038,
+ "learning_rate": 9.147025813692482e-05,
+ "loss": 0.025584843009710312,
+ "step": 351
+ },
+ {
+ "epoch": 1.7797468354430381,
+ "grad_norm": 0.04519108682870865,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.0214737206697464,
+ "step": 352
+ },
+ {
+ "epoch": 1.7848101265822784,
+ "grad_norm": 0.07401937246322632,
+ "learning_rate": 9.135802469135802e-05,
+ "loss": 0.02984039857983589,
+ "step": 353
+ },
+ {
+ "epoch": 1.789873417721519,
+ "grad_norm": 0.05138625577092171,
+ "learning_rate": 9.130190796857465e-05,
+ "loss": 0.024221282452344894,
+ "step": 354
+ },
+ {
+ "epoch": 1.7949367088607595,
+ "grad_norm": 0.10182037204504013,
+ "learning_rate": 9.124579124579124e-05,
+ "loss": 0.0237903892993927,
+ "step": 355
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.056737013161182404,
+ "learning_rate": 9.118967452300787e-05,
+ "loss": 0.026514701545238495,
+ "step": 356
+ },
+ {
+ "epoch": 1.8050632911392404,
+ "grad_norm": 0.04826146364212036,
+ "learning_rate": 9.113355780022446e-05,
+ "loss": 0.021808844059705734,
+ "step": 357
+ },
+ {
+ "epoch": 1.810126582278481,
+ "grad_norm": 0.07099983841180801,
+ "learning_rate": 9.107744107744109e-05,
+ "loss": 0.028031716123223305,
+ "step": 358
+ },
+ {
+ "epoch": 1.8151898734177214,
+ "grad_norm": 0.04242753982543945,
+ "learning_rate": 9.102132435465768e-05,
+ "loss": 0.018858186900615692,
+ "step": 359
+ },
+ {
+ "epoch": 1.820253164556962,
+ "grad_norm": 0.053701240569353104,
+ "learning_rate": 9.096520763187431e-05,
+ "loss": 0.025603849440813065,
+ "step": 360
+ },
+ {
+ "epoch": 1.8253164556962025,
+ "grad_norm": 0.05277755856513977,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.021214714273810387,
+ "step": 361
+ },
+ {
+ "epoch": 1.830379746835443,
+ "grad_norm": 0.048843637108802795,
+ "learning_rate": 9.085297418630753e-05,
+ "loss": 0.024215007200837135,
+ "step": 362
+ },
+ {
+ "epoch": 1.8354430379746836,
+ "grad_norm": 0.04203329607844353,
+ "learning_rate": 9.079685746352414e-05,
+ "loss": 0.022748971357941628,
+ "step": 363
+ },
+ {
+ "epoch": 1.840506329113924,
+ "grad_norm": 0.04655196890234947,
+ "learning_rate": 9.074074074074075e-05,
+ "loss": 0.019658325240015984,
+ "step": 364
+ },
+ {
+ "epoch": 1.8455696202531646,
+ "grad_norm": 0.10654491931200027,
+ "learning_rate": 9.068462401795736e-05,
+ "loss": 0.03210999816656113,
+ "step": 365
+ },
+ {
+ "epoch": 1.8506329113924052,
+ "grad_norm": 0.04377336800098419,
+ "learning_rate": 9.062850729517397e-05,
+ "loss": 0.01867927983403206,
+ "step": 366
+ },
+ {
+ "epoch": 1.8556962025316457,
+ "grad_norm": 0.04619381204247475,
+ "learning_rate": 9.057239057239058e-05,
+ "loss": 0.01952965185046196,
+ "step": 367
+ },
+ {
+ "epoch": 1.8607594936708862,
+ "grad_norm": 0.04015986621379852,
+ "learning_rate": 9.051627384960719e-05,
+ "loss": 0.017353296279907227,
+ "step": 368
+ },
+ {
+ "epoch": 1.8658227848101265,
+ "grad_norm": 0.11403095722198486,
+ "learning_rate": 9.04601571268238e-05,
+ "loss": 0.02238992229104042,
+ "step": 369
+ },
+ {
+ "epoch": 1.870886075949367,
+ "grad_norm": 0.043767284601926804,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.02202833816409111,
+ "step": 370
+ },
+ {
+ "epoch": 1.8759493670886076,
+ "grad_norm": 0.053445883095264435,
+ "learning_rate": 9.034792368125702e-05,
+ "loss": 0.023765750229358673,
+ "step": 371
+ },
+ {
+ "epoch": 1.8810126582278481,
+ "grad_norm": 0.05750055983662605,
+ "learning_rate": 9.029180695847364e-05,
+ "loss": 0.026259474456310272,
+ "step": 372
+ },
+ {
+ "epoch": 1.8860759493670884,
+ "grad_norm": 0.04525497183203697,
+ "learning_rate": 9.023569023569024e-05,
+ "loss": 0.024194583296775818,
+ "step": 373
+ },
+ {
+ "epoch": 1.891139240506329,
+ "grad_norm": 0.04918856918811798,
+ "learning_rate": 9.017957351290685e-05,
+ "loss": 0.020951319485902786,
+ "step": 374
+ },
+ {
+ "epoch": 1.8962025316455695,
+ "grad_norm": 0.08538687229156494,
+ "learning_rate": 9.012345679012346e-05,
+ "loss": 0.022266045212745667,
+ "step": 375
+ },
+ {
+ "epoch": 1.90126582278481,
+ "grad_norm": 0.07101748883724213,
+ "learning_rate": 9.006734006734007e-05,
+ "loss": 0.028090521693229675,
+ "step": 376
+ },
+ {
+ "epoch": 1.9063291139240506,
+ "grad_norm": 0.06256446987390518,
+ "learning_rate": 9.001122334455668e-05,
+ "loss": 0.027174800634384155,
+ "step": 377
+ },
+ {
+ "epoch": 1.9113924050632911,
+ "grad_norm": 0.07588270306587219,
+ "learning_rate": 8.995510662177329e-05,
+ "loss": 0.028438206762075424,
+ "step": 378
+ },
+ {
+ "epoch": 1.9164556962025316,
+ "grad_norm": 5.8829851150512695,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.01749270409345627,
+ "step": 379
+ },
+ {
+ "epoch": 1.9215189873417722,
+ "grad_norm": 0.038905344903469086,
+ "learning_rate": 8.984287317620651e-05,
+ "loss": 0.019571108743548393,
+ "step": 380
+ },
+ {
+ "epoch": 1.9265822784810127,
+ "grad_norm": 0.05960959196090698,
+ "learning_rate": 8.978675645342313e-05,
+ "loss": 0.024591946974396706,
+ "step": 381
+ },
+ {
+ "epoch": 1.9316455696202532,
+ "grad_norm": 0.07935867458581924,
+ "learning_rate": 8.973063973063973e-05,
+ "loss": 0.020205039530992508,
+ "step": 382
+ },
+ {
+ "epoch": 1.9367088607594938,
+ "grad_norm": 0.08682888746261597,
+ "learning_rate": 8.967452300785635e-05,
+ "loss": 0.023299653083086014,
+ "step": 383
+ },
+ {
+ "epoch": 1.9417721518987343,
+ "grad_norm": 0.07220255583524704,
+ "learning_rate": 8.961840628507295e-05,
+ "loss": 0.025364618748426437,
+ "step": 384
+ },
+ {
+ "epoch": 1.9468354430379748,
+ "grad_norm": 0.08230294287204742,
+ "learning_rate": 8.956228956228957e-05,
+ "loss": 0.023587457835674286,
+ "step": 385
+ },
+ {
+ "epoch": 1.9518987341772152,
+ "grad_norm": 0.05176795646548271,
+ "learning_rate": 8.950617283950617e-05,
+ "loss": 0.018942706286907196,
+ "step": 386
+ },
+ {
+ "epoch": 1.9569620253164557,
+ "grad_norm": 0.04784144088625908,
+ "learning_rate": 8.945005611672279e-05,
+ "loss": 0.020134730264544487,
+ "step": 387
+ },
+ {
+ "epoch": 1.9620253164556962,
+ "grad_norm": 0.04668115824460983,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.022084465250372887,
+ "step": 388
+ },
+ {
+ "epoch": 1.9670886075949368,
+ "grad_norm": 0.05892647057771683,
+ "learning_rate": 8.933782267115601e-05,
+ "loss": 0.02586008608341217,
+ "step": 389
+ },
+ {
+ "epoch": 1.972151898734177,
+ "grad_norm": 0.048669006675481796,
+ "learning_rate": 8.928170594837262e-05,
+ "loss": 0.020011097192764282,
+ "step": 390
+ },
+ {
+ "epoch": 1.9772151898734176,
+ "grad_norm": 0.0973723903298378,
+ "learning_rate": 8.922558922558923e-05,
+ "loss": 0.030240919440984726,
+ "step": 391
+ },
+ {
+ "epoch": 1.9822784810126581,
+ "grad_norm": 0.090507872402668,
+ "learning_rate": 8.916947250280584e-05,
+ "loss": 0.028250183910131454,
+ "step": 392
+ },
+ {
+ "epoch": 1.9873417721518987,
+ "grad_norm": 0.03921318054199219,
+ "learning_rate": 8.911335578002245e-05,
+ "loss": 0.02076716348528862,
+ "step": 393
+ },
+ {
+ "epoch": 1.9924050632911392,
+ "grad_norm": 0.04830043017864227,
+ "learning_rate": 8.905723905723906e-05,
+ "loss": 0.02241525426506996,
+ "step": 394
+ },
+ {
+ "epoch": 1.9974683544303797,
+ "grad_norm": 0.04455797001719475,
+ "learning_rate": 8.900112233445567e-05,
+ "loss": 0.026035301387310028,
+ "step": 395
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.10931648313999176,
+ "learning_rate": 8.894500561167228e-05,
+ "loss": 0.03514251485466957,
+ "step": 396
+ },
+ {
+ "epoch": 2.0050632911392405,
+ "grad_norm": 0.07531362026929855,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.021771814674139023,
+ "step": 397
+ },
+ {
+ "epoch": 2.010126582278481,
+ "grad_norm": 0.0649140477180481,
+ "learning_rate": 8.88327721661055e-05,
+ "loss": 0.02932022325694561,
+ "step": 398
+ },
+ {
+ "epoch": 2.0151898734177216,
+ "grad_norm": 0.07461163401603699,
+ "learning_rate": 8.877665544332211e-05,
+ "loss": 0.023864082992076874,
+ "step": 399
+ },
+ {
+ "epoch": 2.020253164556962,
+ "grad_norm": 0.054510265588760376,
+ "learning_rate": 8.872053872053872e-05,
+ "loss": 0.027578316628932953,
+ "step": 400
+ },
+ {
+ "epoch": 2.0253164556962027,
+ "grad_norm": 0.04434451460838318,
+ "learning_rate": 8.866442199775533e-05,
+ "loss": 0.022873830050230026,
+ "step": 401
+ },
+ {
+ "epoch": 2.030379746835443,
+ "grad_norm": 0.052791960537433624,
+ "learning_rate": 8.860830527497194e-05,
+ "loss": 0.021092431619763374,
+ "step": 402
+ },
+ {
+ "epoch": 2.0354430379746837,
+ "grad_norm": 0.04550998657941818,
+ "learning_rate": 8.855218855218855e-05,
+ "loss": 0.022475749254226685,
+ "step": 403
+ },
+ {
+ "epoch": 2.0405063291139243,
+ "grad_norm": 0.2512972354888916,
+ "learning_rate": 8.849607182940516e-05,
+ "loss": 0.02201610803604126,
+ "step": 404
+ },
+ {
+ "epoch": 2.0455696202531644,
+ "grad_norm": 0.04554569348692894,
+ "learning_rate": 8.843995510662177e-05,
+ "loss": 0.02180359698832035,
+ "step": 405
+ },
+ {
+ "epoch": 2.050632911392405,
+ "grad_norm": 0.04094229266047478,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.01960112899541855,
+ "step": 406
+ },
+ {
+ "epoch": 2.0556962025316454,
+ "grad_norm": 0.07398641109466553,
+ "learning_rate": 8.8327721661055e-05,
+ "loss": 0.02206597849726677,
+ "step": 407
+ },
+ {
+ "epoch": 2.060759493670886,
+ "grad_norm": 0.07659231871366501,
+ "learning_rate": 8.827160493827162e-05,
+ "loss": 0.019660351797938347,
+ "step": 408
+ },
+ {
+ "epoch": 2.0658227848101265,
+ "grad_norm": 0.05986466258764267,
+ "learning_rate": 8.821548821548821e-05,
+ "loss": 0.027121691033244133,
+ "step": 409
+ },
+ {
+ "epoch": 2.070886075949367,
+ "grad_norm": 0.03376661241054535,
+ "learning_rate": 8.815937149270484e-05,
+ "loss": 0.021059338003396988,
+ "step": 410
+ },
+ {
+ "epoch": 2.0759493670886076,
+ "grad_norm": 0.081104576587677,
+ "learning_rate": 8.810325476992143e-05,
+ "loss": 0.031228341162204742,
+ "step": 411
+ },
+ {
+ "epoch": 2.081012658227848,
+ "grad_norm": 0.04295242205262184,
+ "learning_rate": 8.804713804713806e-05,
+ "loss": 0.020738180726766586,
+ "step": 412
+ },
+ {
+ "epoch": 2.0860759493670886,
+ "grad_norm": 0.03715268895030022,
+ "learning_rate": 8.799102132435467e-05,
+ "loss": 0.018579209223389626,
+ "step": 413
+ },
+ {
+ "epoch": 2.091139240506329,
+ "grad_norm": 0.06769359856843948,
+ "learning_rate": 8.793490460157128e-05,
+ "loss": 0.026761794462800026,
+ "step": 414
+ },
+ {
+ "epoch": 2.0962025316455697,
+ "grad_norm": 0.03715744614601135,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.022879980504512787,
+ "step": 415
+ },
+ {
+ "epoch": 2.1012658227848102,
+ "grad_norm": 0.04305677488446236,
+ "learning_rate": 8.78226711560045e-05,
+ "loss": 0.022773049771785736,
+ "step": 416
+ },
+ {
+ "epoch": 2.1063291139240508,
+ "grad_norm": 0.0449112169444561,
+ "learning_rate": 8.776655443322111e-05,
+ "loss": 0.022499293088912964,
+ "step": 417
+ },
+ {
+ "epoch": 2.1113924050632913,
+ "grad_norm": 0.0457427054643631,
+ "learning_rate": 8.77104377104377e-05,
+ "loss": 0.024978693574666977,
+ "step": 418
+ },
+ {
+ "epoch": 2.116455696202532,
+ "grad_norm": 0.04705161228775978,
+ "learning_rate": 8.765432098765433e-05,
+ "loss": 0.024807877838611603,
+ "step": 419
+ },
+ {
+ "epoch": 2.1215189873417724,
+ "grad_norm": 0.04377812147140503,
+ "learning_rate": 8.759820426487092e-05,
+ "loss": 0.025857431814074516,
+ "step": 420
+ },
+ {
+ "epoch": 2.1265822784810124,
+ "grad_norm": 0.08598720282316208,
+ "learning_rate": 8.754208754208755e-05,
+ "loss": 0.021972455084323883,
+ "step": 421
+ },
+ {
+ "epoch": 2.131645569620253,
+ "grad_norm": 0.4669632017612457,
+ "learning_rate": 8.748597081930416e-05,
+ "loss": 0.02055199444293976,
+ "step": 422
+ },
+ {
+ "epoch": 2.1367088607594935,
+ "grad_norm": 0.05292733013629913,
+ "learning_rate": 8.742985409652077e-05,
+ "loss": 0.020852137356996536,
+ "step": 423
+ },
+ {
+ "epoch": 2.141772151898734,
+ "grad_norm": 0.05878116562962532,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.02444305270910263,
+ "step": 424
+ },
+ {
+ "epoch": 2.1468354430379746,
+ "grad_norm": 0.05234210565686226,
+ "learning_rate": 8.731762065095399e-05,
+ "loss": 0.02202335000038147,
+ "step": 425
+ },
+ {
+ "epoch": 2.151898734177215,
+ "grad_norm": 0.04706348851323128,
+ "learning_rate": 8.72615039281706e-05,
+ "loss": 0.019998187199234962,
+ "step": 426
+ },
+ {
+ "epoch": 2.1569620253164556,
+ "grad_norm": 0.05263376981019974,
+ "learning_rate": 8.720538720538721e-05,
+ "loss": 0.028126951307058334,
+ "step": 427
+ },
+ {
+ "epoch": 2.162025316455696,
+ "grad_norm": 0.062016960233449936,
+ "learning_rate": 8.714927048260382e-05,
+ "loss": 0.0286184661090374,
+ "step": 428
+ },
+ {
+ "epoch": 2.1670886075949367,
+ "grad_norm": 0.13798244297504425,
+ "learning_rate": 8.709315375982043e-05,
+ "loss": 0.026699248701334,
+ "step": 429
+ },
+ {
+ "epoch": 2.1721518987341772,
+ "grad_norm": 0.09159042686223984,
+ "learning_rate": 8.703703703703704e-05,
+ "loss": 0.025515643879771233,
+ "step": 430
+ },
+ {
+ "epoch": 2.1772151898734178,
+ "grad_norm": 0.0828855037689209,
+ "learning_rate": 8.698092031425365e-05,
+ "loss": 0.025481123477220535,
+ "step": 431
+ },
+ {
+ "epoch": 2.1822784810126583,
+ "grad_norm": 0.09840776771306992,
+ "learning_rate": 8.692480359147026e-05,
+ "loss": 0.020968927070498466,
+ "step": 432
+ },
+ {
+ "epoch": 2.187341772151899,
+ "grad_norm": 0.10999752581119537,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.028588412329554558,
+ "step": 433
+ },
+ {
+ "epoch": 2.1924050632911394,
+ "grad_norm": 0.06938561797142029,
+ "learning_rate": 8.681257014590348e-05,
+ "loss": 0.024119220674037933,
+ "step": 434
+ },
+ {
+ "epoch": 2.19746835443038,
+ "grad_norm": 0.054689887911081314,
+ "learning_rate": 8.67564534231201e-05,
+ "loss": 0.02173299714922905,
+ "step": 435
+ },
+ {
+ "epoch": 2.2025316455696204,
+ "grad_norm": 0.09605880081653595,
+ "learning_rate": 8.67003367003367e-05,
+ "loss": 0.02312455326318741,
+ "step": 436
+ },
+ {
+ "epoch": 2.207594936708861,
+ "grad_norm": 0.06863043457269669,
+ "learning_rate": 8.664421997755332e-05,
+ "loss": 0.020868321880698204,
+ "step": 437
+ },
+ {
+ "epoch": 2.212658227848101,
+ "grad_norm": 0.11743242293596268,
+ "learning_rate": 8.658810325476992e-05,
+ "loss": 0.029748965054750443,
+ "step": 438
+ },
+ {
+ "epoch": 2.2177215189873416,
+ "grad_norm": 0.08399086445569992,
+ "learning_rate": 8.653198653198653e-05,
+ "loss": 0.02379520982503891,
+ "step": 439
+ },
+ {
+ "epoch": 2.222784810126582,
+ "grad_norm": 0.052164461463689804,
+ "learning_rate": 8.647586980920315e-05,
+ "loss": 0.02010851353406906,
+ "step": 440
+ },
+ {
+ "epoch": 2.2278481012658227,
+ "grad_norm": 0.11834696680307388,
+ "learning_rate": 8.641975308641975e-05,
+ "loss": 0.02748255990445614,
+ "step": 441
+ },
+ {
+ "epoch": 2.232911392405063,
+ "grad_norm": 0.06718999892473221,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.026828233152627945,
+ "step": 442
+ },
+ {
+ "epoch": 2.2379746835443037,
+ "grad_norm": 0.042458854615688324,
+ "learning_rate": 8.630751964085297e-05,
+ "loss": 0.021280258893966675,
+ "step": 443
+ },
+ {
+ "epoch": 2.2430379746835443,
+ "grad_norm": 0.036516617983579636,
+ "learning_rate": 8.62514029180696e-05,
+ "loss": 0.021773381158709526,
+ "step": 444
+ },
+ {
+ "epoch": 2.248101265822785,
+ "grad_norm": 0.04317261651158333,
+ "learning_rate": 8.619528619528619e-05,
+ "loss": 0.022671079263091087,
+ "step": 445
+ },
+ {
+ "epoch": 2.2531645569620253,
+ "grad_norm": 0.08610037714242935,
+ "learning_rate": 8.613916947250281e-05,
+ "loss": 0.02425701916217804,
+ "step": 446
+ },
+ {
+ "epoch": 2.258227848101266,
+ "grad_norm": 0.03478290140628815,
+ "learning_rate": 8.608305274971942e-05,
+ "loss": 0.022291556000709534,
+ "step": 447
+ },
+ {
+ "epoch": 2.2632911392405064,
+ "grad_norm": 0.04682233929634094,
+ "learning_rate": 8.602693602693603e-05,
+ "loss": 0.02036888152360916,
+ "step": 448
+ },
+ {
+ "epoch": 2.268354430379747,
+ "grad_norm": 0.0808606892824173,
+ "learning_rate": 8.597081930415264e-05,
+ "loss": 0.025470012798905373,
+ "step": 449
+ },
+ {
+ "epoch": 2.2734177215189875,
+ "grad_norm": 0.042830612510442734,
+ "learning_rate": 8.591470258136925e-05,
+ "loss": 0.020565971732139587,
+ "step": 450
+ },
+ {
+ "epoch": 2.278481012658228,
+ "grad_norm": 0.06374406069517136,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031990330666303635,
+ "step": 451
+ },
+ {
+ "epoch": 2.2835443037974685,
+ "grad_norm": 0.05716697871685028,
+ "learning_rate": 8.580246913580247e-05,
+ "loss": 0.024125374853610992,
+ "step": 452
+ },
+ {
+ "epoch": 2.2886075949367086,
+ "grad_norm": 0.04057484492659569,
+ "learning_rate": 8.574635241301908e-05,
+ "loss": 0.021739482879638672,
+ "step": 453
+ },
+ {
+ "epoch": 2.293670886075949,
+ "grad_norm": 0.07754945009946823,
+ "learning_rate": 8.56902356902357e-05,
+ "loss": 0.02694481424987316,
+ "step": 454
+ },
+ {
+ "epoch": 2.2987341772151897,
+ "grad_norm": 0.06022442877292633,
+ "learning_rate": 8.56341189674523e-05,
+ "loss": 0.021221034228801727,
+ "step": 455
+ },
+ {
+ "epoch": 2.3037974683544302,
+ "grad_norm": 0.06909896433353424,
+ "learning_rate": 8.557800224466891e-05,
+ "loss": 0.02247895672917366,
+ "step": 456
+ },
+ {
+ "epoch": 2.3088607594936708,
+ "grad_norm": 0.05362236499786377,
+ "learning_rate": 8.552188552188552e-05,
+ "loss": 0.020700538530945778,
+ "step": 457
+ },
+ {
+ "epoch": 2.3139240506329113,
+ "grad_norm": 0.09836408495903015,
+ "learning_rate": 8.546576879910215e-05,
+ "loss": 0.02611887827515602,
+ "step": 458
+ },
+ {
+ "epoch": 2.318987341772152,
+ "grad_norm": 0.036625102162361145,
+ "learning_rate": 8.540965207631874e-05,
+ "loss": 0.0196938905864954,
+ "step": 459
+ },
+ {
+ "epoch": 2.3240506329113924,
+ "grad_norm": 0.07372298091650009,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.020545657724142075,
+ "step": 460
+ },
+ {
+ "epoch": 2.329113924050633,
+ "grad_norm": 0.20502988994121552,
+ "learning_rate": 8.529741863075196e-05,
+ "loss": 0.02884715050458908,
+ "step": 461
+ },
+ {
+ "epoch": 2.3341772151898734,
+ "grad_norm": 0.04867224395275116,
+ "learning_rate": 8.524130190796857e-05,
+ "loss": 0.019854716956615448,
+ "step": 462
+ },
+ {
+ "epoch": 2.339240506329114,
+ "grad_norm": 0.029550092294812202,
+ "learning_rate": 8.518518518518518e-05,
+ "loss": 0.01884104311466217,
+ "step": 463
+ },
+ {
+ "epoch": 2.3443037974683545,
+ "grad_norm": 0.04299351945519447,
+ "learning_rate": 8.51290684624018e-05,
+ "loss": 0.01954217068850994,
+ "step": 464
+ },
+ {
+ "epoch": 2.349367088607595,
+ "grad_norm": 0.043467242270708084,
+ "learning_rate": 8.507295173961842e-05,
+ "loss": 0.024274462834000587,
+ "step": 465
+ },
+ {
+ "epoch": 2.3544303797468356,
+ "grad_norm": 0.05131510645151138,
+ "learning_rate": 8.501683501683501e-05,
+ "loss": 0.026246599853038788,
+ "step": 466
+ },
+ {
+ "epoch": 2.359493670886076,
+ "grad_norm": 0.06280570477247238,
+ "learning_rate": 8.496071829405164e-05,
+ "loss": 0.024986159056425095,
+ "step": 467
+ },
+ {
+ "epoch": 2.3645569620253166,
+ "grad_norm": 0.04968208447098732,
+ "learning_rate": 8.490460157126824e-05,
+ "loss": 0.02912936732172966,
+ "step": 468
+ },
+ {
+ "epoch": 2.369620253164557,
+ "grad_norm": 0.08504039794206619,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.027097277343273163,
+ "step": 469
+ },
+ {
+ "epoch": 2.3746835443037977,
+ "grad_norm": 0.18385924398899078,
+ "learning_rate": 8.479236812570146e-05,
+ "loss": 0.02459462732076645,
+ "step": 470
+ },
+ {
+ "epoch": 2.379746835443038,
+ "grad_norm": 0.0663745328783989,
+ "learning_rate": 8.473625140291808e-05,
+ "loss": 0.020224973559379578,
+ "step": 471
+ },
+ {
+ "epoch": 2.3848101265822783,
+ "grad_norm": 0.04759671539068222,
+ "learning_rate": 8.468013468013468e-05,
+ "loss": 0.02591642364859581,
+ "step": 472
+ },
+ {
+ "epoch": 2.389873417721519,
+ "grad_norm": 0.044010091572999954,
+ "learning_rate": 8.46240179573513e-05,
+ "loss": 0.025122515857219696,
+ "step": 473
+ },
+ {
+ "epoch": 2.3949367088607594,
+ "grad_norm": 0.035054467618465424,
+ "learning_rate": 8.456790123456791e-05,
+ "loss": 0.019854065030813217,
+ "step": 474
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.03171153366565704,
+ "learning_rate": 8.451178451178452e-05,
+ "loss": 0.02009584940969944,
+ "step": 475
+ },
+ {
+ "epoch": 2.4050632911392404,
+ "grad_norm": 0.17388089001178741,
+ "learning_rate": 8.445566778900113e-05,
+ "loss": 0.02714207023382187,
+ "step": 476
+ },
+ {
+ "epoch": 2.410126582278481,
+ "grad_norm": 0.038392502814531326,
+ "learning_rate": 8.439955106621774e-05,
+ "loss": 0.020382478833198547,
+ "step": 477
+ },
+ {
+ "epoch": 2.4151898734177215,
+ "grad_norm": 0.04264051839709282,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.022726822644472122,
+ "step": 478
+ },
+ {
+ "epoch": 2.420253164556962,
+ "grad_norm": 0.046432014554739,
+ "learning_rate": 8.428731762065096e-05,
+ "loss": 0.021431483328342438,
+ "step": 479
+ },
+ {
+ "epoch": 2.4253164556962026,
+ "grad_norm": 0.07288242876529694,
+ "learning_rate": 8.423120089786757e-05,
+ "loss": 0.026229504495859146,
+ "step": 480
+ },
+ {
+ "epoch": 2.430379746835443,
+ "grad_norm": 0.04801097884774208,
+ "learning_rate": 8.417508417508418e-05,
+ "loss": 0.020924456417560577,
+ "step": 481
+ },
+ {
+ "epoch": 2.4354430379746836,
+ "grad_norm": 0.11201190203428268,
+ "learning_rate": 8.411896745230079e-05,
+ "loss": 0.022652529180049896,
+ "step": 482
+ },
+ {
+ "epoch": 2.440506329113924,
+ "grad_norm": 0.06151285395026207,
+ "learning_rate": 8.40628507295174e-05,
+ "loss": 0.02416859194636345,
+ "step": 483
+ },
+ {
+ "epoch": 2.4455696202531647,
+ "grad_norm": 0.04006446525454521,
+ "learning_rate": 8.400673400673401e-05,
+ "loss": 0.02390255406498909,
+ "step": 484
+ },
+ {
+ "epoch": 2.4506329113924052,
+ "grad_norm": 0.027193108573555946,
+ "learning_rate": 8.395061728395062e-05,
+ "loss": 0.015282701700925827,
+ "step": 485
+ },
+ {
+ "epoch": 2.4556962025316453,
+ "grad_norm": 0.05453994497656822,
+ "learning_rate": 8.389450056116723e-05,
+ "loss": 0.025738034397363663,
+ "step": 486
+ },
+ {
+ "epoch": 2.460759493670886,
+ "grad_norm": 0.03226681798696518,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.02111941948533058,
+ "step": 487
+ },
+ {
+ "epoch": 2.4658227848101264,
+ "grad_norm": 0.0451083667576313,
+ "learning_rate": 8.378226711560045e-05,
+ "loss": 0.020694585517048836,
+ "step": 488
+ },
+ {
+ "epoch": 2.470886075949367,
+ "grad_norm": 0.0390113927423954,
+ "learning_rate": 8.372615039281706e-05,
+ "loss": 0.022557765245437622,
+ "step": 489
+ },
+ {
+ "epoch": 2.4759493670886075,
+ "grad_norm": 0.05983779951930046,
+ "learning_rate": 8.367003367003367e-05,
+ "loss": 0.02489873766899109,
+ "step": 490
+ },
+ {
+ "epoch": 2.481012658227848,
+ "grad_norm": 0.03961458057165146,
+ "learning_rate": 8.361391694725028e-05,
+ "loss": 0.021655399352312088,
+ "step": 491
+ },
+ {
+ "epoch": 2.4860759493670885,
+ "grad_norm": 0.03814523667097092,
+ "learning_rate": 8.35578002244669e-05,
+ "loss": 0.02217719703912735,
+ "step": 492
+ },
+ {
+ "epoch": 2.491139240506329,
+ "grad_norm": 0.030563514679670334,
+ "learning_rate": 8.35016835016835e-05,
+ "loss": 0.01679009571671486,
+ "step": 493
+ },
+ {
+ "epoch": 2.4962025316455696,
+ "grad_norm": 0.04566824436187744,
+ "learning_rate": 8.344556677890012e-05,
+ "loss": 0.019699417054653168,
+ "step": 494
+ },
+ {
+ "epoch": 2.50126582278481,
+ "grad_norm": 0.06117499992251396,
+ "learning_rate": 8.338945005611672e-05,
+ "loss": 0.028571851551532745,
+ "step": 495
+ },
+ {
+ "epoch": 2.5063291139240507,
+ "grad_norm": 0.03510760888457298,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.023387223482131958,
+ "step": 496
+ },
+ {
+ "epoch": 2.511392405063291,
+ "grad_norm": 0.028878437355160713,
+ "learning_rate": 8.327721661054994e-05,
+ "loss": 0.023329850286245346,
+ "step": 497
+ },
+ {
+ "epoch": 2.5164556962025317,
+ "grad_norm": 0.02818676456809044,
+ "learning_rate": 8.322109988776656e-05,
+ "loss": 0.017786618322134018,
+ "step": 498
+ },
+ {
+ "epoch": 2.5215189873417723,
+ "grad_norm": 0.06660276651382446,
+ "learning_rate": 8.316498316498317e-05,
+ "loss": 0.023636367172002792,
+ "step": 499
+ },
+ {
+ "epoch": 2.526582278481013,
+ "grad_norm": 0.05663186311721802,
+ "learning_rate": 8.310886644219978e-05,
+ "loss": 0.02607567049562931,
+ "step": 500
+ },
+ {
+ "epoch": 2.5316455696202533,
+ "grad_norm": 0.04156090319156647,
+ "learning_rate": 8.30527497194164e-05,
+ "loss": 0.024936942383646965,
+ "step": 501
+ },
+ {
+ "epoch": 2.536708860759494,
+ "grad_norm": 0.036135219037532806,
+ "learning_rate": 8.2996632996633e-05,
+ "loss": 0.023583384230732918,
+ "step": 502
+ },
+ {
+ "epoch": 2.5417721518987344,
+ "grad_norm": 0.052026644349098206,
+ "learning_rate": 8.294051627384961e-05,
+ "loss": 0.02324807643890381,
+ "step": 503
+ },
+ {
+ "epoch": 2.546835443037975,
+ "grad_norm": 0.03599514439702034,
+ "learning_rate": 8.288439955106621e-05,
+ "loss": 0.01879853755235672,
+ "step": 504
+ },
+ {
+ "epoch": 2.5518987341772155,
+ "grad_norm": 0.03505280241370201,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.017342131584882736,
+ "step": 505
+ },
+ {
+ "epoch": 2.5569620253164556,
+ "grad_norm": 0.0403706431388855,
+ "learning_rate": 8.277216610549943e-05,
+ "loss": 0.02082991972565651,
+ "step": 506
+ },
+ {
+ "epoch": 2.562025316455696,
+ "grad_norm": 0.031072309240698814,
+ "learning_rate": 8.271604938271605e-05,
+ "loss": 0.01711331121623516,
+ "step": 507
+ },
+ {
+ "epoch": 2.5670886075949366,
+ "grad_norm": 0.04118587449193001,
+ "learning_rate": 8.265993265993266e-05,
+ "loss": 0.01940922439098358,
+ "step": 508
+ },
+ {
+ "epoch": 2.572151898734177,
+ "grad_norm": 0.039908040314912796,
+ "learning_rate": 8.260381593714927e-05,
+ "loss": 0.021229952573776245,
+ "step": 509
+ },
+ {
+ "epoch": 2.5772151898734177,
+ "grad_norm": 0.02886618860065937,
+ "learning_rate": 8.254769921436589e-05,
+ "loss": 0.02004890888929367,
+ "step": 510
+ },
+ {
+ "epoch": 2.5822784810126582,
+ "grad_norm": 0.04229263588786125,
+ "learning_rate": 8.24915824915825e-05,
+ "loss": 0.019512392580509186,
+ "step": 511
+ },
+ {
+ "epoch": 2.5873417721518988,
+ "grad_norm": 0.030951635912060738,
+ "learning_rate": 8.24354657687991e-05,
+ "loss": 0.01836536079645157,
+ "step": 512
+ },
+ {
+ "epoch": 2.5924050632911393,
+ "grad_norm": 0.057054903358221054,
+ "learning_rate": 8.237934904601572e-05,
+ "loss": 0.028897594660520554,
+ "step": 513
+ },
+ {
+ "epoch": 2.59746835443038,
+ "grad_norm": 0.10734204202890396,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.024986904114484787,
+ "step": 514
+ },
+ {
+ "epoch": 2.6025316455696204,
+ "grad_norm": 0.029653102159500122,
+ "learning_rate": 8.226711560044894e-05,
+ "loss": 0.02242947742342949,
+ "step": 515
+ },
+ {
+ "epoch": 2.607594936708861,
+ "grad_norm": 0.05601462349295616,
+ "learning_rate": 8.221099887766555e-05,
+ "loss": 0.020091768354177475,
+ "step": 516
+ },
+ {
+ "epoch": 2.6126582278481014,
+ "grad_norm": 0.04170191287994385,
+ "learning_rate": 8.215488215488217e-05,
+ "loss": 0.021796470507979393,
+ "step": 517
+ },
+ {
+ "epoch": 2.6177215189873415,
+ "grad_norm": 0.06347091495990753,
+ "learning_rate": 8.209876543209877e-05,
+ "loss": 0.024338826537132263,
+ "step": 518
+ },
+ {
+ "epoch": 2.622784810126582,
+ "grad_norm": 0.06084204465150833,
+ "learning_rate": 8.204264870931539e-05,
+ "loss": 0.02493124082684517,
+ "step": 519
+ },
+ {
+ "epoch": 2.6278481012658226,
+ "grad_norm": 0.03094005584716797,
+ "learning_rate": 8.198653198653199e-05,
+ "loss": 0.021345658227801323,
+ "step": 520
+ },
+ {
+ "epoch": 2.632911392405063,
+ "grad_norm": 0.04017730429768562,
+ "learning_rate": 8.193041526374861e-05,
+ "loss": 0.019823770970106125,
+ "step": 521
+ },
+ {
+ "epoch": 2.6379746835443036,
+ "grad_norm": 0.045351576060056686,
+ "learning_rate": 8.18742985409652e-05,
+ "loss": 0.02385132387280464,
+ "step": 522
+ },
+ {
+ "epoch": 2.643037974683544,
+ "grad_norm": 0.04823896288871765,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.021753432229161263,
+ "step": 523
+ },
+ {
+ "epoch": 2.6481012658227847,
+ "grad_norm": 0.0442446693778038,
+ "learning_rate": 8.176206509539843e-05,
+ "loss": 0.022134695202112198,
+ "step": 524
+ },
+ {
+ "epoch": 2.6531645569620252,
+ "grad_norm": 0.07998359203338623,
+ "learning_rate": 8.170594837261504e-05,
+ "loss": 0.021159570664167404,
+ "step": 525
+ },
+ {
+ "epoch": 2.6582278481012658,
+ "grad_norm": 0.07844395190477371,
+ "learning_rate": 8.164983164983166e-05,
+ "loss": 0.023695990443229675,
+ "step": 526
+ },
+ {
+ "epoch": 2.6632911392405063,
+ "grad_norm": 0.025296518579125404,
+ "learning_rate": 8.159371492704826e-05,
+ "loss": 0.020914766937494278,
+ "step": 527
+ },
+ {
+ "epoch": 2.668354430379747,
+ "grad_norm": 0.337454617023468,
+ "learning_rate": 8.153759820426488e-05,
+ "loss": 0.02948678657412529,
+ "step": 528
+ },
+ {
+ "epoch": 2.6734177215189874,
+ "grad_norm": 0.03531114012002945,
+ "learning_rate": 8.148148148148148e-05,
+ "loss": 0.020608587190508842,
+ "step": 529
+ },
+ {
+ "epoch": 2.678481012658228,
+ "grad_norm": 0.0496559739112854,
+ "learning_rate": 8.14253647586981e-05,
+ "loss": 0.023600757122039795,
+ "step": 530
+ },
+ {
+ "epoch": 2.6835443037974684,
+ "grad_norm": 0.04093128815293312,
+ "learning_rate": 8.13692480359147e-05,
+ "loss": 0.022392068058252335,
+ "step": 531
+ },
+ {
+ "epoch": 2.688607594936709,
+ "grad_norm": 0.05343819782137871,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.01882098615169525,
+ "step": 532
+ },
+ {
+ "epoch": 2.6936708860759495,
+ "grad_norm": 0.0334453359246254,
+ "learning_rate": 8.125701459034793e-05,
+ "loss": 0.020492104813456535,
+ "step": 533
+ },
+ {
+ "epoch": 2.69873417721519,
+ "grad_norm": 0.045540470629930496,
+ "learning_rate": 8.120089786756454e-05,
+ "loss": 0.021309707313776016,
+ "step": 534
+ },
+ {
+ "epoch": 2.7037974683544306,
+ "grad_norm": 0.03238926827907562,
+ "learning_rate": 8.114478114478115e-05,
+ "loss": 0.01929772086441517,
+ "step": 535
+ },
+ {
+ "epoch": 2.708860759493671,
+ "grad_norm": 0.10985280573368073,
+ "learning_rate": 8.108866442199776e-05,
+ "loss": 0.02431013062596321,
+ "step": 536
+ },
+ {
+ "epoch": 2.7139240506329116,
+ "grad_norm": 0.039785534143447876,
+ "learning_rate": 8.103254769921437e-05,
+ "loss": 0.022708022966980934,
+ "step": 537
+ },
+ {
+ "epoch": 2.7189873417721517,
+ "grad_norm": 0.06239910051226616,
+ "learning_rate": 8.097643097643098e-05,
+ "loss": 0.02715257555246353,
+ "step": 538
+ },
+ {
+ "epoch": 2.7240506329113923,
+ "grad_norm": 0.03662843257188797,
+ "learning_rate": 8.092031425364759e-05,
+ "loss": 0.024876421317458153,
+ "step": 539
+ },
+ {
+ "epoch": 2.729113924050633,
+ "grad_norm": 0.05869411304593086,
+ "learning_rate": 8.08641975308642e-05,
+ "loss": 0.022937750443816185,
+ "step": 540
+ },
+ {
+ "epoch": 2.7341772151898733,
+ "grad_norm": 0.07220412790775299,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02227093279361725,
+ "step": 541
+ },
+ {
+ "epoch": 2.739240506329114,
+ "grad_norm": 0.03881363570690155,
+ "learning_rate": 8.075196408529742e-05,
+ "loss": 0.020784813910722733,
+ "step": 542
+ },
+ {
+ "epoch": 2.7443037974683544,
+ "grad_norm": 0.04756273329257965,
+ "learning_rate": 8.069584736251403e-05,
+ "loss": 0.02334344945847988,
+ "step": 543
+ },
+ {
+ "epoch": 2.749367088607595,
+ "grad_norm": 0.05327540263533592,
+ "learning_rate": 8.063973063973065e-05,
+ "loss": 0.026313351467251778,
+ "step": 544
+ },
+ {
+ "epoch": 2.7544303797468355,
+ "grad_norm": 0.1605764925479889,
+ "learning_rate": 8.058361391694725e-05,
+ "loss": 0.02474561519920826,
+ "step": 545
+ },
+ {
+ "epoch": 2.759493670886076,
+ "grad_norm": 0.044486165046691895,
+ "learning_rate": 8.052749719416387e-05,
+ "loss": 0.023557808250188828,
+ "step": 546
+ },
+ {
+ "epoch": 2.7645569620253165,
+ "grad_norm": 0.04645116999745369,
+ "learning_rate": 8.047138047138047e-05,
+ "loss": 0.017340417951345444,
+ "step": 547
+ },
+ {
+ "epoch": 2.769620253164557,
+ "grad_norm": 0.04009381681680679,
+ "learning_rate": 8.041526374859708e-05,
+ "loss": 0.018324140459299088,
+ "step": 548
+ },
+ {
+ "epoch": 2.7746835443037976,
+ "grad_norm": 0.12476589530706406,
+ "learning_rate": 8.035914702581369e-05,
+ "loss": 0.023337965831160545,
+ "step": 549
+ },
+ {
+ "epoch": 2.779746835443038,
+ "grad_norm": 0.04257349297404289,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.021878249943256378,
+ "step": 550
+ },
+ {
+ "epoch": 2.7848101265822782,
+ "grad_norm": 0.044377341866493225,
+ "learning_rate": 8.024691358024692e-05,
+ "loss": 0.019643619656562805,
+ "step": 551
+ },
+ {
+ "epoch": 2.7898734177215188,
+ "grad_norm": 0.0801771879196167,
+ "learning_rate": 8.019079685746352e-05,
+ "loss": 0.021452955901622772,
+ "step": 552
+ },
+ {
+ "epoch": 2.7949367088607593,
+ "grad_norm": 0.04462383687496185,
+ "learning_rate": 8.013468013468015e-05,
+ "loss": 0.02363801747560501,
+ "step": 553
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.05768737941980362,
+ "learning_rate": 8.007856341189674e-05,
+ "loss": 0.03572218120098114,
+ "step": 554
+ },
+ {
+ "epoch": 2.8050632911392404,
+ "grad_norm": 0.03812364116311073,
+ "learning_rate": 8.002244668911337e-05,
+ "loss": 0.01964751072227955,
+ "step": 555
+ },
+ {
+ "epoch": 2.810126582278481,
+ "grad_norm": 0.03297588974237442,
+ "learning_rate": 7.996632996632996e-05,
+ "loss": 0.019139982759952545,
+ "step": 556
+ },
+ {
+ "epoch": 2.8151898734177214,
+ "grad_norm": 0.024627596139907837,
+ "learning_rate": 7.991021324354659e-05,
+ "loss": 0.021029513329267502,
+ "step": 557
+ },
+ {
+ "epoch": 2.820253164556962,
+ "grad_norm": 0.058927983045578,
+ "learning_rate": 7.985409652076318e-05,
+ "loss": 0.03308084234595299,
+ "step": 558
+ },
+ {
+ "epoch": 2.8253164556962025,
+ "grad_norm": 0.11811497062444687,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.028271127492189407,
+ "step": 559
+ },
+ {
+ "epoch": 2.830379746835443,
+ "grad_norm": 0.043665409088134766,
+ "learning_rate": 7.974186307519642e-05,
+ "loss": 0.02708129584789276,
+ "step": 560
+ },
+ {
+ "epoch": 2.8354430379746836,
+ "grad_norm": 0.034729309380054474,
+ "learning_rate": 7.968574635241303e-05,
+ "loss": 0.023845072835683823,
+ "step": 561
+ },
+ {
+ "epoch": 2.840506329113924,
+ "grad_norm": 0.028991155326366425,
+ "learning_rate": 7.962962962962964e-05,
+ "loss": 0.018426496535539627,
+ "step": 562
+ },
+ {
+ "epoch": 2.8455696202531646,
+ "grad_norm": 0.04660327732563019,
+ "learning_rate": 7.957351290684625e-05,
+ "loss": 0.02610144019126892,
+ "step": 563
+ },
+ {
+ "epoch": 2.850632911392405,
+ "grad_norm": 0.03947063535451889,
+ "learning_rate": 7.951739618406286e-05,
+ "loss": 0.025909483432769775,
+ "step": 564
+ },
+ {
+ "epoch": 2.8556962025316457,
+ "grad_norm": 0.06056501716375351,
+ "learning_rate": 7.946127946127947e-05,
+ "loss": 0.030405592173337936,
+ "step": 565
+ },
+ {
+ "epoch": 2.8607594936708862,
+ "grad_norm": 0.03398960456252098,
+ "learning_rate": 7.940516273849608e-05,
+ "loss": 0.02486085705459118,
+ "step": 566
+ },
+ {
+ "epoch": 2.8658227848101268,
+ "grad_norm": 0.03136906027793884,
+ "learning_rate": 7.934904601571269e-05,
+ "loss": 0.020573778077960014,
+ "step": 567
+ },
+ {
+ "epoch": 2.8708860759493673,
+ "grad_norm": 0.03404523804783821,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.021034879609942436,
+ "step": 568
+ },
+ {
+ "epoch": 2.875949367088608,
+ "grad_norm": 0.02937588468194008,
+ "learning_rate": 7.92368125701459e-05,
+ "loss": 0.02275373972952366,
+ "step": 569
+ },
+ {
+ "epoch": 2.8810126582278484,
+ "grad_norm": 0.03971172124147415,
+ "learning_rate": 7.918069584736252e-05,
+ "loss": 0.021558552980422974,
+ "step": 570
+ },
+ {
+ "epoch": 2.8860759493670884,
+ "grad_norm": 0.05636494606733322,
+ "learning_rate": 7.912457912457913e-05,
+ "loss": 0.025583568960428238,
+ "step": 571
+ },
+ {
+ "epoch": 2.891139240506329,
+ "grad_norm": 0.2013683319091797,
+ "learning_rate": 7.906846240179574e-05,
+ "loss": 0.025386696681380272,
+ "step": 572
+ },
+ {
+ "epoch": 2.8962025316455695,
+ "grad_norm": 0.05875328183174133,
+ "learning_rate": 7.901234567901235e-05,
+ "loss": 0.023778585717082024,
+ "step": 573
+ },
+ {
+ "epoch": 2.90126582278481,
+ "grad_norm": 0.031178263947367668,
+ "learning_rate": 7.895622895622896e-05,
+ "loss": 0.02130977436900139,
+ "step": 574
+ },
+ {
+ "epoch": 2.9063291139240506,
+ "grad_norm": 0.028125282377004623,
+ "learning_rate": 7.890011223344557e-05,
+ "loss": 0.023941578343510628,
+ "step": 575
+ },
+ {
+ "epoch": 2.911392405063291,
+ "grad_norm": 0.03701331466436386,
+ "learning_rate": 7.884399551066218e-05,
+ "loss": 0.01856887713074684,
+ "step": 576
+ },
+ {
+ "epoch": 2.9164556962025316,
+ "grad_norm": 0.05281993746757507,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.023393619805574417,
+ "step": 577
+ },
+ {
+ "epoch": 2.921518987341772,
+ "grad_norm": 0.03958812728524208,
+ "learning_rate": 7.873176206509541e-05,
+ "loss": 0.019871000200510025,
+ "step": 578
+ },
+ {
+ "epoch": 2.9265822784810127,
+ "grad_norm": 0.0439714752137661,
+ "learning_rate": 7.867564534231201e-05,
+ "loss": 0.025316016748547554,
+ "step": 579
+ },
+ {
+ "epoch": 2.9316455696202532,
+ "grad_norm": 0.03543296083807945,
+ "learning_rate": 7.861952861952863e-05,
+ "loss": 0.022549735382199287,
+ "step": 580
+ },
+ {
+ "epoch": 2.9367088607594938,
+ "grad_norm": 0.05503656715154648,
+ "learning_rate": 7.856341189674523e-05,
+ "loss": 0.02716357260942459,
+ "step": 581
+ },
+ {
+ "epoch": 2.9417721518987343,
+ "grad_norm": 0.03273561969399452,
+ "learning_rate": 7.850729517396185e-05,
+ "loss": 0.017606684938073158,
+ "step": 582
+ },
+ {
+ "epoch": 2.946835443037975,
+ "grad_norm": 0.04668378457427025,
+ "learning_rate": 7.845117845117845e-05,
+ "loss": 0.022529952228069305,
+ "step": 583
+ },
+ {
+ "epoch": 2.951898734177215,
+ "grad_norm": 0.034348756074905396,
+ "learning_rate": 7.839506172839507e-05,
+ "loss": 0.02549612522125244,
+ "step": 584
+ },
+ {
+ "epoch": 2.9569620253164555,
+ "grad_norm": 0.03485729172825813,
+ "learning_rate": 7.833894500561168e-05,
+ "loss": 0.019362375140190125,
+ "step": 585
+ },
+ {
+ "epoch": 2.962025316455696,
+ "grad_norm": 0.034695904701948166,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.023550841957330704,
+ "step": 586
+ },
+ {
+ "epoch": 2.9670886075949365,
+ "grad_norm": 0.02703205682337284,
+ "learning_rate": 7.82267115600449e-05,
+ "loss": 0.016860410571098328,
+ "step": 587
+ },
+ {
+ "epoch": 2.972151898734177,
+ "grad_norm": 0.0694100558757782,
+ "learning_rate": 7.817059483726151e-05,
+ "loss": 0.02669605240225792,
+ "step": 588
+ },
+ {
+ "epoch": 2.9772151898734176,
+ "grad_norm": 0.02641797810792923,
+ "learning_rate": 7.811447811447812e-05,
+ "loss": 0.019620027393102646,
+ "step": 589
+ },
+ {
+ "epoch": 2.982278481012658,
+ "grad_norm": 0.03643452376127243,
+ "learning_rate": 7.805836139169473e-05,
+ "loss": 0.018797604367136955,
+ "step": 590
+ },
+ {
+ "epoch": 2.9873417721518987,
+ "grad_norm": 0.04125158116221428,
+ "learning_rate": 7.800224466891134e-05,
+ "loss": 0.020387161523103714,
+ "step": 591
+ },
+ {
+ "epoch": 2.992405063291139,
+ "grad_norm": 0.037161167711019516,
+ "learning_rate": 7.794612794612795e-05,
+ "loss": 0.02484878897666931,
+ "step": 592
+ },
+ {
+ "epoch": 2.9974683544303797,
+ "grad_norm": 0.03352266550064087,
+ "learning_rate": 7.789001122334456e-05,
+ "loss": 0.022045889869332314,
+ "step": 593
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.07333379238843918,
+ "learning_rate": 7.783389450056117e-05,
+ "loss": 0.025806350633502007,
+ "step": 594
+ },
+ {
+ "epoch": 3.0050632911392405,
+ "grad_norm": 0.05492037162184715,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.025387149304151535,
+ "step": 595
+ },
+ {
+ "epoch": 3.010126582278481,
+ "grad_norm": 0.03932039067149162,
+ "learning_rate": 7.772166105499439e-05,
+ "loss": 0.020961906760931015,
+ "step": 596
+ },
+ {
+ "epoch": 3.0151898734177216,
+ "grad_norm": 0.03346814960241318,
+ "learning_rate": 7.7665544332211e-05,
+ "loss": 0.018602946773171425,
+ "step": 597
+ },
+ {
+ "epoch": 3.020253164556962,
+ "grad_norm": 0.041588157415390015,
+ "learning_rate": 7.760942760942761e-05,
+ "loss": 0.02350936457514763,
+ "step": 598
+ },
+ {
+ "epoch": 3.0253164556962027,
+ "grad_norm": 0.0634593740105629,
+ "learning_rate": 7.755331088664422e-05,
+ "loss": 0.02807607129216194,
+ "step": 599
+ },
+ {
+ "epoch": 3.030379746835443,
+ "grad_norm": 0.037369582802057266,
+ "learning_rate": 7.749719416386083e-05,
+ "loss": 0.01987743005156517,
+ "step": 600
+ },
+ {
+ "epoch": 3.0354430379746837,
+ "grad_norm": 0.051795534789562225,
+ "learning_rate": 7.744107744107744e-05,
+ "loss": 0.02273828536272049,
+ "step": 601
+ },
+ {
+ "epoch": 3.0405063291139243,
+ "grad_norm": 0.06508016586303711,
+ "learning_rate": 7.738496071829405e-05,
+ "loss": 0.022526375949382782,
+ "step": 602
+ },
+ {
+ "epoch": 3.0455696202531644,
+ "grad_norm": 0.05076521635055542,
+ "learning_rate": 7.732884399551068e-05,
+ "loss": 0.030540699139237404,
+ "step": 603
+ },
+ {
+ "epoch": 3.050632911392405,
+ "grad_norm": 0.05223327502608299,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.025222979485988617,
+ "step": 604
+ },
+ {
+ "epoch": 3.0556962025316454,
+ "grad_norm": 0.040298622101545334,
+ "learning_rate": 7.72166105499439e-05,
+ "loss": 0.024349395185709,
+ "step": 605
+ },
+ {
+ "epoch": 3.060759493670886,
+ "grad_norm": 0.031546592712402344,
+ "learning_rate": 7.716049382716049e-05,
+ "loss": 0.022118842229247093,
+ "step": 606
+ },
+ {
+ "epoch": 3.0658227848101265,
+ "grad_norm": 0.03639276325702667,
+ "learning_rate": 7.710437710437712e-05,
+ "loss": 0.019809089601039886,
+ "step": 607
+ },
+ {
+ "epoch": 3.070886075949367,
+ "grad_norm": 0.03702636435627937,
+ "learning_rate": 7.704826038159371e-05,
+ "loss": 0.023927533999085426,
+ "step": 608
+ },
+ {
+ "epoch": 3.0759493670886076,
+ "grad_norm": 0.027585966512560844,
+ "learning_rate": 7.699214365881034e-05,
+ "loss": 0.017853228375315666,
+ "step": 609
+ },
+ {
+ "epoch": 3.081012658227848,
+ "grad_norm": 0.036372315138578415,
+ "learning_rate": 7.693602693602693e-05,
+ "loss": 0.027036674320697784,
+ "step": 610
+ },
+ {
+ "epoch": 3.0860759493670886,
+ "grad_norm": 0.03734718635678291,
+ "learning_rate": 7.687991021324356e-05,
+ "loss": 0.021930409595370293,
+ "step": 611
+ },
+ {
+ "epoch": 3.091139240506329,
+ "grad_norm": 0.04167135804891586,
+ "learning_rate": 7.682379349046017e-05,
+ "loss": 0.02211524173617363,
+ "step": 612
+ },
+ {
+ "epoch": 3.0962025316455697,
+ "grad_norm": 0.06541049480438232,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.02102654054760933,
+ "step": 613
+ },
+ {
+ "epoch": 3.1012658227848102,
+ "grad_norm": 0.03505360335111618,
+ "learning_rate": 7.671156004489339e-05,
+ "loss": 0.021799035370349884,
+ "step": 614
+ },
+ {
+ "epoch": 3.1063291139240508,
+ "grad_norm": 0.038781505078077316,
+ "learning_rate": 7.665544332210998e-05,
+ "loss": 0.020275672897696495,
+ "step": 615
+ },
+ {
+ "epoch": 3.1113924050632913,
+ "grad_norm": 0.05527551844716072,
+ "learning_rate": 7.65993265993266e-05,
+ "loss": 0.02752656675875187,
+ "step": 616
+ },
+ {
+ "epoch": 3.116455696202532,
+ "grad_norm": 0.092417873442173,
+ "learning_rate": 7.65432098765432e-05,
+ "loss": 0.034416262060403824,
+ "step": 617
+ },
+ {
+ "epoch": 3.1215189873417724,
+ "grad_norm": 0.04619184136390686,
+ "learning_rate": 7.648709315375983e-05,
+ "loss": 0.028675489127635956,
+ "step": 618
+ },
+ {
+ "epoch": 3.1265822784810124,
+ "grad_norm": 0.027103425934910774,
+ "learning_rate": 7.643097643097644e-05,
+ "loss": 0.01944906637072563,
+ "step": 619
+ },
+ {
+ "epoch": 3.131645569620253,
+ "grad_norm": 0.062025271356105804,
+ "learning_rate": 7.637485970819305e-05,
+ "loss": 0.030966270714998245,
+ "step": 620
+ },
+ {
+ "epoch": 3.1367088607594935,
+ "grad_norm": 0.029828928411006927,
+ "learning_rate": 7.631874298540966e-05,
+ "loss": 0.02199825644493103,
+ "step": 621
+ },
+ {
+ "epoch": 3.141772151898734,
+ "grad_norm": 0.029867300763726234,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.02649630233645439,
+ "step": 622
+ },
+ {
+ "epoch": 3.1468354430379746,
+ "grad_norm": 0.055938251316547394,
+ "learning_rate": 7.620650953984288e-05,
+ "loss": 0.03135379031300545,
+ "step": 623
+ },
+ {
+ "epoch": 3.151898734177215,
+ "grad_norm": 0.035160645842552185,
+ "learning_rate": 7.615039281705949e-05,
+ "loss": 0.025492198765277863,
+ "step": 624
+ },
+ {
+ "epoch": 3.1569620253164556,
+ "grad_norm": 0.0550227165222168,
+ "learning_rate": 7.60942760942761e-05,
+ "loss": 0.024527709931135178,
+ "step": 625
+ },
+ {
+ "epoch": 3.162025316455696,
+ "grad_norm": 0.045406773686409,
+ "learning_rate": 7.603815937149271e-05,
+ "loss": 0.021749500185251236,
+ "step": 626
+ },
+ {
+ "epoch": 3.1670886075949367,
+ "grad_norm": 0.03407207131385803,
+ "learning_rate": 7.598204264870932e-05,
+ "loss": 0.022218957543373108,
+ "step": 627
+ },
+ {
+ "epoch": 3.1721518987341772,
+ "grad_norm": 0.07292751222848892,
+ "learning_rate": 7.592592592592593e-05,
+ "loss": 0.027731608599424362,
+ "step": 628
+ },
+ {
+ "epoch": 3.1772151898734178,
+ "grad_norm": 0.05087915435433388,
+ "learning_rate": 7.586980920314254e-05,
+ "loss": 0.025174522772431374,
+ "step": 629
+ },
+ {
+ "epoch": 3.1822784810126583,
+ "grad_norm": 0.03146078437566757,
+ "learning_rate": 7.581369248035916e-05,
+ "loss": 0.023854102939367294,
+ "step": 630
+ },
+ {
+ "epoch": 3.187341772151899,
+ "grad_norm": 0.03517632558941841,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.021264635026454926,
+ "step": 631
+ },
+ {
+ "epoch": 3.1924050632911394,
+ "grad_norm": 0.0355447381734848,
+ "learning_rate": 7.570145903479238e-05,
+ "loss": 0.023219801485538483,
+ "step": 632
+ },
+ {
+ "epoch": 3.19746835443038,
+ "grad_norm": 0.03751067817211151,
+ "learning_rate": 7.564534231200898e-05,
+ "loss": 0.02329118922352791,
+ "step": 633
+ },
+ {
+ "epoch": 3.2025316455696204,
+ "grad_norm": 0.03923696279525757,
+ "learning_rate": 7.558922558922559e-05,
+ "loss": 0.025390561670064926,
+ "step": 634
+ },
+ {
+ "epoch": 3.207594936708861,
+ "grad_norm": 0.03601266071200371,
+ "learning_rate": 7.55331088664422e-05,
+ "loss": 0.02001899480819702,
+ "step": 635
+ },
+ {
+ "epoch": 3.212658227848101,
+ "grad_norm": 0.032203998416662216,
+ "learning_rate": 7.547699214365881e-05,
+ "loss": 0.022725094109773636,
+ "step": 636
+ },
+ {
+ "epoch": 3.2177215189873416,
+ "grad_norm": 0.040842000395059586,
+ "learning_rate": 7.542087542087543e-05,
+ "loss": 0.021683380007743835,
+ "step": 637
+ },
+ {
+ "epoch": 3.222784810126582,
+ "grad_norm": 0.03078434057533741,
+ "learning_rate": 7.536475869809203e-05,
+ "loss": 0.02051977440714836,
+ "step": 638
+ },
+ {
+ "epoch": 3.2278481012658227,
+ "grad_norm": 0.025937417522072792,
+ "learning_rate": 7.530864197530865e-05,
+ "loss": 0.01884596049785614,
+ "step": 639
+ },
+ {
+ "epoch": 3.232911392405063,
+ "grad_norm": 0.0464826263487339,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.018389636650681496,
+ "step": 640
+ },
+ {
+ "epoch": 3.2379746835443037,
+ "grad_norm": 0.04150732606649399,
+ "learning_rate": 7.519640852974187e-05,
+ "loss": 0.020952530205249786,
+ "step": 641
+ },
+ {
+ "epoch": 3.2430379746835443,
+ "grad_norm": 0.04317227005958557,
+ "learning_rate": 7.514029180695847e-05,
+ "loss": 0.024093877524137497,
+ "step": 642
+ },
+ {
+ "epoch": 3.248101265822785,
+ "grad_norm": 0.04621734470129013,
+ "learning_rate": 7.508417508417509e-05,
+ "loss": 0.029940858483314514,
+ "step": 643
+ },
+ {
+ "epoch": 3.2531645569620253,
+ "grad_norm": 0.03514556586742401,
+ "learning_rate": 7.50280583613917e-05,
+ "loss": 0.022350966930389404,
+ "step": 644
+ },
+ {
+ "epoch": 3.258227848101266,
+ "grad_norm": 0.025245223194360733,
+ "learning_rate": 7.497194163860831e-05,
+ "loss": 0.018291346728801727,
+ "step": 645
+ },
+ {
+ "epoch": 3.2632911392405064,
+ "grad_norm": 0.02498617395758629,
+ "learning_rate": 7.491582491582492e-05,
+ "loss": 0.01909235306084156,
+ "step": 646
+ },
+ {
+ "epoch": 3.268354430379747,
+ "grad_norm": 0.022831663489341736,
+ "learning_rate": 7.485970819304153e-05,
+ "loss": 0.01462332159280777,
+ "step": 647
+ },
+ {
+ "epoch": 3.2734177215189875,
+ "grad_norm": 0.03779070824384689,
+ "learning_rate": 7.480359147025814e-05,
+ "loss": 0.019472766667604446,
+ "step": 648
+ },
+ {
+ "epoch": 3.278481012658228,
+ "grad_norm": 0.030341917648911476,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.018727967515587807,
+ "step": 649
+ },
+ {
+ "epoch": 3.2835443037974685,
+ "grad_norm": 0.045589644461870193,
+ "learning_rate": 7.469135802469136e-05,
+ "loss": 0.023640938103199005,
+ "step": 650
+ },
+ {
+ "epoch": 3.2886075949367086,
+ "grad_norm": 0.023883633315563202,
+ "learning_rate": 7.463524130190797e-05,
+ "loss": 0.019227800890803337,
+ "step": 651
+ },
+ {
+ "epoch": 3.293670886075949,
+ "grad_norm": 0.03794898837804794,
+ "learning_rate": 7.457912457912458e-05,
+ "loss": 0.02445095032453537,
+ "step": 652
+ },
+ {
+ "epoch": 3.2987341772151897,
+ "grad_norm": 0.1442285180091858,
+ "learning_rate": 7.452300785634119e-05,
+ "loss": 0.023129010573029518,
+ "step": 653
+ },
+ {
+ "epoch": 3.3037974683544302,
+ "grad_norm": 0.03197013959288597,
+ "learning_rate": 7.44668911335578e-05,
+ "loss": 0.02768155373632908,
+ "step": 654
+ },
+ {
+ "epoch": 3.3088607594936708,
+ "grad_norm": 0.0434270016849041,
+ "learning_rate": 7.441077441077443e-05,
+ "loss": 0.02330004796385765,
+ "step": 655
+ },
+ {
+ "epoch": 3.3139240506329113,
+ "grad_norm": 0.03878983482718468,
+ "learning_rate": 7.435465768799102e-05,
+ "loss": 0.028383342549204826,
+ "step": 656
+ },
+ {
+ "epoch": 3.318987341772152,
+ "grad_norm": 0.035334642976522446,
+ "learning_rate": 7.429854096520763e-05,
+ "loss": 0.02583262138068676,
+ "step": 657
+ },
+ {
+ "epoch": 3.3240506329113924,
+ "grad_norm": 0.0473608672618866,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.030471306294202805,
+ "step": 658
+ },
+ {
+ "epoch": 3.329113924050633,
+ "grad_norm": 0.04193368926644325,
+ "learning_rate": 7.418630751964085e-05,
+ "loss": 0.016215423122048378,
+ "step": 659
+ },
+ {
+ "epoch": 3.3341772151898734,
+ "grad_norm": 0.023891586810350418,
+ "learning_rate": 7.413019079685746e-05,
+ "loss": 0.021040987223386765,
+ "step": 660
+ },
+ {
+ "epoch": 3.339240506329114,
+ "grad_norm": 0.029971614480018616,
+ "learning_rate": 7.407407407407407e-05,
+ "loss": 0.022258542478084564,
+ "step": 661
+ },
+ {
+ "epoch": 3.3443037974683545,
+ "grad_norm": 0.035308364778757095,
+ "learning_rate": 7.401795735129068e-05,
+ "loss": 0.02215534821152687,
+ "step": 662
+ },
+ {
+ "epoch": 3.349367088607595,
+ "grad_norm": 0.036979664117097855,
+ "learning_rate": 7.39618406285073e-05,
+ "loss": 0.027577020227909088,
+ "step": 663
+ },
+ {
+ "epoch": 3.3544303797468356,
+ "grad_norm": 0.03403281047940254,
+ "learning_rate": 7.390572390572392e-05,
+ "loss": 0.024540117010474205,
+ "step": 664
+ },
+ {
+ "epoch": 3.359493670886076,
+ "grad_norm": 0.04739405959844589,
+ "learning_rate": 7.384960718294051e-05,
+ "loss": 0.01647120714187622,
+ "step": 665
+ },
+ {
+ "epoch": 3.3645569620253166,
+ "grad_norm": 0.036933764815330505,
+ "learning_rate": 7.379349046015714e-05,
+ "loss": 0.02817656472325325,
+ "step": 666
+ },
+ {
+ "epoch": 3.369620253164557,
+ "grad_norm": 0.05966564640402794,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.028103439137339592,
+ "step": 667
+ },
+ {
+ "epoch": 3.3746835443037977,
+ "grad_norm": 0.09403033554553986,
+ "learning_rate": 7.368125701459036e-05,
+ "loss": 0.024899154901504517,
+ "step": 668
+ },
+ {
+ "epoch": 3.379746835443038,
+ "grad_norm": 0.056374453008174896,
+ "learning_rate": 7.362514029180695e-05,
+ "loss": 0.025570789352059364,
+ "step": 669
+ },
+ {
+ "epoch": 3.3848101265822783,
+ "grad_norm": 0.056454673409461975,
+ "learning_rate": 7.356902356902358e-05,
+ "loss": 0.02471453696489334,
+ "step": 670
+ },
+ {
+ "epoch": 3.389873417721519,
+ "grad_norm": 0.04115903005003929,
+ "learning_rate": 7.351290684624019e-05,
+ "loss": 0.017306309193372726,
+ "step": 671
+ },
+ {
+ "epoch": 3.3949367088607594,
+ "grad_norm": 0.030604340136051178,
+ "learning_rate": 7.34567901234568e-05,
+ "loss": 0.019510511308908463,
+ "step": 672
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.059018854051828384,
+ "learning_rate": 7.340067340067341e-05,
+ "loss": 0.02810611203312874,
+ "step": 673
+ },
+ {
+ "epoch": 3.4050632911392404,
+ "grad_norm": 0.026413513347506523,
+ "learning_rate": 7.334455667789002e-05,
+ "loss": 0.018966296687722206,
+ "step": 674
+ },
+ {
+ "epoch": 3.410126582278481,
+ "grad_norm": 0.03285476937890053,
+ "learning_rate": 7.328843995510663e-05,
+ "loss": 0.026708189398050308,
+ "step": 675
+ },
+ {
+ "epoch": 3.4151898734177215,
+ "grad_norm": 0.0392388291656971,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.022320115938782692,
+ "step": 676
+ },
+ {
+ "epoch": 3.420253164556962,
+ "grad_norm": 0.0305775236338377,
+ "learning_rate": 7.317620650953985e-05,
+ "loss": 0.018710114061832428,
+ "step": 677
+ },
+ {
+ "epoch": 3.4253164556962026,
+ "grad_norm": 0.033393554389476776,
+ "learning_rate": 7.312008978675646e-05,
+ "loss": 0.018753021955490112,
+ "step": 678
+ },
+ {
+ "epoch": 3.430379746835443,
+ "grad_norm": 0.02704286389052868,
+ "learning_rate": 7.306397306397307e-05,
+ "loss": 0.01539788581430912,
+ "step": 679
+ },
+ {
+ "epoch": 3.4354430379746836,
+ "grad_norm": 0.038779884576797485,
+ "learning_rate": 7.300785634118968e-05,
+ "loss": 0.024458929896354675,
+ "step": 680
+ },
+ {
+ "epoch": 3.440506329113924,
+ "grad_norm": 0.061135295778512955,
+ "learning_rate": 7.295173961840629e-05,
+ "loss": 0.021106259897351265,
+ "step": 681
+ },
+ {
+ "epoch": 3.4455696202531647,
+ "grad_norm": 0.02436748333275318,
+ "learning_rate": 7.28956228956229e-05,
+ "loss": 0.019037332385778427,
+ "step": 682
+ },
+ {
+ "epoch": 3.4506329113924052,
+ "grad_norm": 0.037567682564258575,
+ "learning_rate": 7.283950617283951e-05,
+ "loss": 0.02065495029091835,
+ "step": 683
+ },
+ {
+ "epoch": 3.4556962025316453,
+ "grad_norm": 0.03743781894445419,
+ "learning_rate": 7.278338945005612e-05,
+ "loss": 0.02559451386332512,
+ "step": 684
+ },
+ {
+ "epoch": 3.460759493670886,
+ "grad_norm": 0.04715351387858391,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.021420618519186974,
+ "step": 685
+ },
+ {
+ "epoch": 3.4658227848101264,
+ "grad_norm": 0.02502383477985859,
+ "learning_rate": 7.267115600448934e-05,
+ "loss": 0.019398193806409836,
+ "step": 686
+ },
+ {
+ "epoch": 3.470886075949367,
+ "grad_norm": 0.02199714072048664,
+ "learning_rate": 7.261503928170595e-05,
+ "loss": 0.019068796187639236,
+ "step": 687
+ },
+ {
+ "epoch": 3.4759493670886075,
+ "grad_norm": 0.034711211919784546,
+ "learning_rate": 7.255892255892256e-05,
+ "loss": 0.021794648841023445,
+ "step": 688
+ },
+ {
+ "epoch": 3.481012658227848,
+ "grad_norm": 0.040784433484077454,
+ "learning_rate": 7.250280583613918e-05,
+ "loss": 0.022812314331531525,
+ "step": 689
+ },
+ {
+ "epoch": 3.4860759493670885,
+ "grad_norm": 0.035993628203868866,
+ "learning_rate": 7.244668911335578e-05,
+ "loss": 0.026385463774204254,
+ "step": 690
+ },
+ {
+ "epoch": 3.491139240506329,
+ "grad_norm": 0.031834330409765244,
+ "learning_rate": 7.23905723905724e-05,
+ "loss": 0.022114556282758713,
+ "step": 691
+ },
+ {
+ "epoch": 3.4962025316455696,
+ "grad_norm": 0.025820165872573853,
+ "learning_rate": 7.2334455667789e-05,
+ "loss": 0.01813361421227455,
+ "step": 692
+ },
+ {
+ "epoch": 3.50126582278481,
+ "grad_norm": 0.04998617246747017,
+ "learning_rate": 7.227833894500562e-05,
+ "loss": 0.022573690861463547,
+ "step": 693
+ },
+ {
+ "epoch": 3.5063291139240507,
+ "grad_norm": 0.04184528812766075,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.026092834770679474,
+ "step": 694
+ },
+ {
+ "epoch": 3.511392405063291,
+ "grad_norm": 0.050683457404375076,
+ "learning_rate": 7.216610549943884e-05,
+ "loss": 0.021743692457675934,
+ "step": 695
+ },
+ {
+ "epoch": 3.5164556962025317,
+ "grad_norm": 0.07393304258584976,
+ "learning_rate": 7.210998877665545e-05,
+ "loss": 0.024253465235233307,
+ "step": 696
+ },
+ {
+ "epoch": 3.5215189873417723,
+ "grad_norm": 0.02564188838005066,
+ "learning_rate": 7.205387205387206e-05,
+ "loss": 0.019201550632715225,
+ "step": 697
+ },
+ {
+ "epoch": 3.526582278481013,
+ "grad_norm": 0.035527680069208145,
+ "learning_rate": 7.199775533108867e-05,
+ "loss": 0.02153913676738739,
+ "step": 698
+ },
+ {
+ "epoch": 3.5316455696202533,
+ "grad_norm": 0.036737874150276184,
+ "learning_rate": 7.194163860830527e-05,
+ "loss": 0.025572702288627625,
+ "step": 699
+ },
+ {
+ "epoch": 3.536708860759494,
+ "grad_norm": 0.03383871540427208,
+ "learning_rate": 7.188552188552189e-05,
+ "loss": 0.017153475433588028,
+ "step": 700
+ },
+ {
+ "epoch": 3.5417721518987344,
+ "grad_norm": 0.0350637212395668,
+ "learning_rate": 7.182940516273849e-05,
+ "loss": 0.018297579139471054,
+ "step": 701
+ },
+ {
+ "epoch": 3.546835443037975,
+ "grad_norm": 0.029637211933732033,
+ "learning_rate": 7.177328843995511e-05,
+ "loss": 0.017981912940740585,
+ "step": 702
+ },
+ {
+ "epoch": 3.5518987341772155,
+ "grad_norm": 0.03611799329519272,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.02710491605103016,
+ "step": 703
+ },
+ {
+ "epoch": 3.5569620253164556,
+ "grad_norm": 0.02008277364075184,
+ "learning_rate": 7.166105499438833e-05,
+ "loss": 0.02035117708146572,
+ "step": 704
+ },
+ {
+ "epoch": 3.562025316455696,
+ "grad_norm": 0.026698170229792595,
+ "learning_rate": 7.160493827160494e-05,
+ "loss": 0.017481079325079918,
+ "step": 705
+ },
+ {
+ "epoch": 3.5670886075949366,
+ "grad_norm": 0.036382947117090225,
+ "learning_rate": 7.154882154882155e-05,
+ "loss": 0.019109399989247322,
+ "step": 706
+ },
+ {
+ "epoch": 3.572151898734177,
+ "grad_norm": 0.04591331630945206,
+ "learning_rate": 7.149270482603816e-05,
+ "loss": 0.023143479600548744,
+ "step": 707
+ },
+ {
+ "epoch": 3.5772151898734177,
+ "grad_norm": 0.04864713177084923,
+ "learning_rate": 7.143658810325477e-05,
+ "loss": 0.022374317049980164,
+ "step": 708
+ },
+ {
+ "epoch": 3.5822784810126582,
+ "grad_norm": 0.03528938442468643,
+ "learning_rate": 7.138047138047138e-05,
+ "loss": 0.021928273141384125,
+ "step": 709
+ },
+ {
+ "epoch": 3.5873417721518988,
+ "grad_norm": 0.03548784181475639,
+ "learning_rate": 7.1324354657688e-05,
+ "loss": 0.02179766446352005,
+ "step": 710
+ },
+ {
+ "epoch": 3.5924050632911393,
+ "grad_norm": 0.041786350309848785,
+ "learning_rate": 7.12682379349046e-05,
+ "loss": 0.028576329350471497,
+ "step": 711
+ },
+ {
+ "epoch": 3.59746835443038,
+ "grad_norm": 0.03197047486901283,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.018731534481048584,
+ "step": 712
+ },
+ {
+ "epoch": 3.6025316455696204,
+ "grad_norm": 0.04037933051586151,
+ "learning_rate": 7.115600448933782e-05,
+ "loss": 0.024375513195991516,
+ "step": 713
+ },
+ {
+ "epoch": 3.607594936708861,
+ "grad_norm": 0.032266534864902496,
+ "learning_rate": 7.109988776655443e-05,
+ "loss": 0.016232451424002647,
+ "step": 714
+ },
+ {
+ "epoch": 3.6126582278481014,
+ "grad_norm": 0.02890392392873764,
+ "learning_rate": 7.104377104377104e-05,
+ "loss": 0.018303632736206055,
+ "step": 715
+ },
+ {
+ "epoch": 3.6177215189873415,
+ "grad_norm": 0.032750677317380905,
+ "learning_rate": 7.098765432098767e-05,
+ "loss": 0.021466076374053955,
+ "step": 716
+ },
+ {
+ "epoch": 3.622784810126582,
+ "grad_norm": 0.05076618492603302,
+ "learning_rate": 7.093153759820426e-05,
+ "loss": 0.022349126636981964,
+ "step": 717
+ },
+ {
+ "epoch": 3.6278481012658226,
+ "grad_norm": 0.034143563359975815,
+ "learning_rate": 7.087542087542089e-05,
+ "loss": 0.02274998091161251,
+ "step": 718
+ },
+ {
+ "epoch": 3.632911392405063,
+ "grad_norm": 0.025406064465641975,
+ "learning_rate": 7.081930415263748e-05,
+ "loss": 0.016980832442641258,
+ "step": 719
+ },
+ {
+ "epoch": 3.6379746835443036,
+ "grad_norm": 0.031938597559928894,
+ "learning_rate": 7.076318742985411e-05,
+ "loss": 0.023153938353061676,
+ "step": 720
+ },
+ {
+ "epoch": 3.643037974683544,
+ "grad_norm": 0.03354712948203087,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.018384695053100586,
+ "step": 721
+ },
+ {
+ "epoch": 3.6481012658227847,
+ "grad_norm": 0.028671689331531525,
+ "learning_rate": 7.065095398428731e-05,
+ "loss": 0.021795600652694702,
+ "step": 722
+ },
+ {
+ "epoch": 3.6531645569620252,
+ "grad_norm": 0.057982735335826874,
+ "learning_rate": 7.059483726150394e-05,
+ "loss": 0.026870068162679672,
+ "step": 723
+ },
+ {
+ "epoch": 3.6582278481012658,
+ "grad_norm": 0.036460306495428085,
+ "learning_rate": 7.053872053872053e-05,
+ "loss": 0.019742611795663834,
+ "step": 724
+ },
+ {
+ "epoch": 3.6632911392405063,
+ "grad_norm": 0.06633497029542923,
+ "learning_rate": 7.048260381593716e-05,
+ "loss": 0.01737678050994873,
+ "step": 725
+ },
+ {
+ "epoch": 3.668354430379747,
+ "grad_norm": 0.0410747192800045,
+ "learning_rate": 7.042648709315375e-05,
+ "loss": 0.023570548743009567,
+ "step": 726
+ },
+ {
+ "epoch": 3.6734177215189874,
+ "grad_norm": 0.04499414190649986,
+ "learning_rate": 7.037037037037038e-05,
+ "loss": 0.024305228143930435,
+ "step": 727
+ },
+ {
+ "epoch": 3.678481012658228,
+ "grad_norm": 0.024429699406027794,
+ "learning_rate": 7.031425364758697e-05,
+ "loss": 0.018056385219097137,
+ "step": 728
+ },
+ {
+ "epoch": 3.6835443037974684,
+ "grad_norm": 0.03042393922805786,
+ "learning_rate": 7.02581369248036e-05,
+ "loss": 0.019678741693496704,
+ "step": 729
+ },
+ {
+ "epoch": 3.688607594936709,
+ "grad_norm": 0.04088849946856499,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.026466136798262596,
+ "step": 730
+ },
+ {
+ "epoch": 3.6936708860759495,
+ "grad_norm": 0.03353559225797653,
+ "learning_rate": 7.014590347923682e-05,
+ "loss": 0.021056771278381348,
+ "step": 731
+ },
+ {
+ "epoch": 3.69873417721519,
+ "grad_norm": 0.03120904415845871,
+ "learning_rate": 7.008978675645343e-05,
+ "loss": 0.020675398409366608,
+ "step": 732
+ },
+ {
+ "epoch": 3.7037974683544306,
+ "grad_norm": 0.05723356828093529,
+ "learning_rate": 7.003367003367004e-05,
+ "loss": 0.033802516758441925,
+ "step": 733
+ },
+ {
+ "epoch": 3.708860759493671,
+ "grad_norm": 0.03580084443092346,
+ "learning_rate": 6.997755331088665e-05,
+ "loss": 0.026392754167318344,
+ "step": 734
+ },
+ {
+ "epoch": 3.7139240506329116,
+ "grad_norm": 0.05164967477321625,
+ "learning_rate": 6.992143658810326e-05,
+ "loss": 0.0241309255361557,
+ "step": 735
+ },
+ {
+ "epoch": 3.7189873417721517,
+ "grad_norm": 0.02190530300140381,
+ "learning_rate": 6.986531986531987e-05,
+ "loss": 0.018209822475910187,
+ "step": 736
+ },
+ {
+ "epoch": 3.7240506329113923,
+ "grad_norm": 0.027256503701210022,
+ "learning_rate": 6.980920314253648e-05,
+ "loss": 0.022063471376895905,
+ "step": 737
+ },
+ {
+ "epoch": 3.729113924050633,
+ "grad_norm": 0.03337831795215607,
+ "learning_rate": 6.975308641975309e-05,
+ "loss": 0.018506363034248352,
+ "step": 738
+ },
+ {
+ "epoch": 3.7341772151898733,
+ "grad_norm": 0.025730784982442856,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.016883976757526398,
+ "step": 739
+ },
+ {
+ "epoch": 3.739240506329114,
+ "grad_norm": 0.026203135028481483,
+ "learning_rate": 6.964085297418631e-05,
+ "loss": 0.023329125717282295,
+ "step": 740
+ },
+ {
+ "epoch": 3.7443037974683544,
+ "grad_norm": 0.02676830254495144,
+ "learning_rate": 6.958473625140293e-05,
+ "loss": 0.020962664857506752,
+ "step": 741
+ },
+ {
+ "epoch": 3.749367088607595,
+ "grad_norm": 0.019974667578935623,
+ "learning_rate": 6.952861952861953e-05,
+ "loss": 0.018353454768657684,
+ "step": 742
+ },
+ {
+ "epoch": 3.7544303797468355,
+ "grad_norm": 0.02399631030857563,
+ "learning_rate": 6.947250280583614e-05,
+ "loss": 0.01820143684744835,
+ "step": 743
+ },
+ {
+ "epoch": 3.759493670886076,
+ "grad_norm": 0.02083951234817505,
+ "learning_rate": 6.941638608305275e-05,
+ "loss": 0.02312408946454525,
+ "step": 744
+ },
+ {
+ "epoch": 3.7645569620253165,
+ "grad_norm": 0.025636207312345505,
+ "learning_rate": 6.936026936026936e-05,
+ "loss": 0.01757936365902424,
+ "step": 745
+ },
+ {
+ "epoch": 3.769620253164557,
+ "grad_norm": 0.036856744438409805,
+ "learning_rate": 6.930415263748597e-05,
+ "loss": 0.028933756053447723,
+ "step": 746
+ },
+ {
+ "epoch": 3.7746835443037976,
+ "grad_norm": 0.037415456026792526,
+ "learning_rate": 6.924803591470258e-05,
+ "loss": 0.022136090323328972,
+ "step": 747
+ },
+ {
+ "epoch": 3.779746835443038,
+ "grad_norm": 0.027949288487434387,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.022943630814552307,
+ "step": 748
+ },
+ {
+ "epoch": 3.7848101265822782,
+ "grad_norm": 0.037508148699998856,
+ "learning_rate": 6.91358024691358e-05,
+ "loss": 0.020460065454244614,
+ "step": 749
+ },
+ {
+ "epoch": 3.7898734177215188,
+ "grad_norm": 0.037965189665555954,
+ "learning_rate": 6.907968574635242e-05,
+ "loss": 0.024793215095996857,
+ "step": 750
+ },
+ {
+ "epoch": 3.7949367088607593,
+ "grad_norm": 0.027956753969192505,
+ "learning_rate": 6.902356902356902e-05,
+ "loss": 0.02188705839216709,
+ "step": 751
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.027417965233325958,
+ "learning_rate": 6.896745230078564e-05,
+ "loss": 0.01465995516628027,
+ "step": 752
+ },
+ {
+ "epoch": 3.8050632911392404,
+ "grad_norm": 0.036644525825977325,
+ "learning_rate": 6.891133557800224e-05,
+ "loss": 0.020246809348464012,
+ "step": 753
+ },
+ {
+ "epoch": 3.810126582278481,
+ "grad_norm": 0.027043674141168594,
+ "learning_rate": 6.885521885521886e-05,
+ "loss": 0.02293788641691208,
+ "step": 754
+ },
+ {
+ "epoch": 3.8151898734177214,
+ "grad_norm": 0.033968694508075714,
+ "learning_rate": 6.879910213243546e-05,
+ "loss": 0.024979766458272934,
+ "step": 755
+ },
+ {
+ "epoch": 3.820253164556962,
+ "grad_norm": 0.022790739312767982,
+ "learning_rate": 6.874298540965208e-05,
+ "loss": 0.019254112616181374,
+ "step": 756
+ },
+ {
+ "epoch": 3.8253164556962025,
+ "grad_norm": 0.028349611908197403,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.018624842166900635,
+ "step": 757
+ },
+ {
+ "epoch": 3.830379746835443,
+ "grad_norm": 0.034140367060899734,
+ "learning_rate": 6.86307519640853e-05,
+ "loss": 0.01691599376499653,
+ "step": 758
+ },
+ {
+ "epoch": 3.8354430379746836,
+ "grad_norm": 0.03422265127301216,
+ "learning_rate": 6.857463524130191e-05,
+ "loss": 0.01864086464047432,
+ "step": 759
+ },
+ {
+ "epoch": 3.840506329113924,
+ "grad_norm": 0.037322208285331726,
+ "learning_rate": 6.851851851851852e-05,
+ "loss": 0.024382904171943665,
+ "step": 760
+ },
+ {
+ "epoch": 3.8455696202531646,
+ "grad_norm": 0.022540392354130745,
+ "learning_rate": 6.846240179573513e-05,
+ "loss": 0.017390096560120583,
+ "step": 761
+ },
+ {
+ "epoch": 3.850632911392405,
+ "grad_norm": 0.035701289772987366,
+ "learning_rate": 6.840628507295174e-05,
+ "loss": 0.01928594335913658,
+ "step": 762
+ },
+ {
+ "epoch": 3.8556962025316457,
+ "grad_norm": 0.047425150871276855,
+ "learning_rate": 6.835016835016835e-05,
+ "loss": 0.026818927377462387,
+ "step": 763
+ },
+ {
+ "epoch": 3.8607594936708862,
+ "grad_norm": 0.0244912076741457,
+ "learning_rate": 6.829405162738496e-05,
+ "loss": 0.01811584085226059,
+ "step": 764
+ },
+ {
+ "epoch": 3.8658227848101268,
+ "grad_norm": 0.03282126039266586,
+ "learning_rate": 6.823793490460157e-05,
+ "loss": 0.01521163061261177,
+ "step": 765
+ },
+ {
+ "epoch": 3.8708860759493673,
+ "grad_norm": 0.030519530177116394,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.023735523223876953,
+ "step": 766
+ },
+ {
+ "epoch": 3.875949367088608,
+ "grad_norm": 0.03829387575387955,
+ "learning_rate": 6.81257014590348e-05,
+ "loss": 0.02391430363059044,
+ "step": 767
+ },
+ {
+ "epoch": 3.8810126582278484,
+ "grad_norm": 0.03133988752961159,
+ "learning_rate": 6.80695847362514e-05,
+ "loss": 0.022026970982551575,
+ "step": 768
+ },
+ {
+ "epoch": 3.8860759493670884,
+ "grad_norm": 0.036327920854091644,
+ "learning_rate": 6.801346801346801e-05,
+ "loss": 0.01740797609090805,
+ "step": 769
+ },
+ {
+ "epoch": 3.891139240506329,
+ "grad_norm": 0.06766671687364578,
+ "learning_rate": 6.795735129068462e-05,
+ "loss": 0.02804078534245491,
+ "step": 770
+ },
+ {
+ "epoch": 3.8962025316455695,
+ "grad_norm": 0.06390757858753204,
+ "learning_rate": 6.790123456790123e-05,
+ "loss": 0.032084181904792786,
+ "step": 771
+ },
+ {
+ "epoch": 3.90126582278481,
+ "grad_norm": 0.03238178789615631,
+ "learning_rate": 6.784511784511784e-05,
+ "loss": 0.02189403772354126,
+ "step": 772
+ },
+ {
+ "epoch": 3.9063291139240506,
+ "grad_norm": 0.03206197917461395,
+ "learning_rate": 6.778900112233445e-05,
+ "loss": 0.022829271852970123,
+ "step": 773
+ },
+ {
+ "epoch": 3.911392405063291,
+ "grad_norm": 0.030897945165634155,
+ "learning_rate": 6.773288439955107e-05,
+ "loss": 0.021807631477713585,
+ "step": 774
+ },
+ {
+ "epoch": 3.9164556962025316,
+ "grad_norm": 0.04285162314772606,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.023028545081615448,
+ "step": 775
+ },
+ {
+ "epoch": 3.921518987341772,
+ "grad_norm": 0.02819208987057209,
+ "learning_rate": 6.762065095398429e-05,
+ "loss": 0.02110828459262848,
+ "step": 776
+ },
+ {
+ "epoch": 3.9265822784810127,
+ "grad_norm": 0.03159799054265022,
+ "learning_rate": 6.756453423120091e-05,
+ "loss": 0.02116553671658039,
+ "step": 777
+ },
+ {
+ "epoch": 3.9316455696202532,
+ "grad_norm": 0.028514137491583824,
+ "learning_rate": 6.75084175084175e-05,
+ "loss": 0.020262988284230232,
+ "step": 778
+ },
+ {
+ "epoch": 3.9367088607594938,
+ "grad_norm": 0.03610249608755112,
+ "learning_rate": 6.745230078563413e-05,
+ "loss": 0.016928158700466156,
+ "step": 779
+ },
+ {
+ "epoch": 3.9417721518987343,
+ "grad_norm": 0.02753387950360775,
+ "learning_rate": 6.739618406285073e-05,
+ "loss": 0.022629719227552414,
+ "step": 780
+ },
+ {
+ "epoch": 3.946835443037975,
+ "grad_norm": 0.026071136817336082,
+ "learning_rate": 6.734006734006735e-05,
+ "loss": 0.020297978073358536,
+ "step": 781
+ },
+ {
+ "epoch": 3.951898734177215,
+ "grad_norm": 0.04774617776274681,
+ "learning_rate": 6.728395061728396e-05,
+ "loss": 0.01858438178896904,
+ "step": 782
+ },
+ {
+ "epoch": 3.9569620253164555,
+ "grad_norm": 0.03666248545050621,
+ "learning_rate": 6.722783389450057e-05,
+ "loss": 0.024037979543209076,
+ "step": 783
+ },
+ {
+ "epoch": 3.962025316455696,
+ "grad_norm": 0.04990983009338379,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.027675451710820198,
+ "step": 784
+ },
+ {
+ "epoch": 3.9670886075949365,
+ "grad_norm": 0.04734862968325615,
+ "learning_rate": 6.711560044893379e-05,
+ "loss": 0.02003151923418045,
+ "step": 785
+ },
+ {
+ "epoch": 3.972151898734177,
+ "grad_norm": 0.031911976635456085,
+ "learning_rate": 6.70594837261504e-05,
+ "loss": 0.02302616462111473,
+ "step": 786
+ },
+ {
+ "epoch": 3.9772151898734176,
+ "grad_norm": 0.03199504688382149,
+ "learning_rate": 6.7003367003367e-05,
+ "loss": 0.020066704601049423,
+ "step": 787
+ },
+ {
+ "epoch": 3.982278481012658,
+ "grad_norm": 0.02664150856435299,
+ "learning_rate": 6.694725028058362e-05,
+ "loss": 0.01888475939631462,
+ "step": 788
+ },
+ {
+ "epoch": 3.9873417721518987,
+ "grad_norm": 0.03886157646775246,
+ "learning_rate": 6.689113355780023e-05,
+ "loss": 0.016029106453061104,
+ "step": 789
+ },
+ {
+ "epoch": 3.992405063291139,
+ "grad_norm": 0.025033561512827873,
+ "learning_rate": 6.683501683501684e-05,
+ "loss": 0.01627909578382969,
+ "step": 790
+ },
+ {
+ "epoch": 3.9974683544303797,
+ "grad_norm": 0.04991500452160835,
+ "learning_rate": 6.677890011223345e-05,
+ "loss": 0.02633330039680004,
+ "step": 791
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.0552835538983345,
+ "learning_rate": 6.672278338945006e-05,
+ "loss": 0.025268658995628357,
+ "step": 792
+ },
+ {
+ "epoch": 4.0050632911392405,
+ "grad_norm": 0.04223925992846489,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.023410093039274216,
+ "step": 793
+ },
+ {
+ "epoch": 4.010126582278481,
+ "grad_norm": 0.03191488981246948,
+ "learning_rate": 6.661054994388328e-05,
+ "loss": 0.01913982629776001,
+ "step": 794
+ },
+ {
+ "epoch": 4.015189873417722,
+ "grad_norm": 0.03535325452685356,
+ "learning_rate": 6.655443322109989e-05,
+ "loss": 0.020550835877656937,
+ "step": 795
+ },
+ {
+ "epoch": 4.020253164556962,
+ "grad_norm": 0.027277838438749313,
+ "learning_rate": 6.64983164983165e-05,
+ "loss": 0.02178161032497883,
+ "step": 796
+ },
+ {
+ "epoch": 4.025316455696203,
+ "grad_norm": 0.03889140114188194,
+ "learning_rate": 6.644219977553311e-05,
+ "loss": 0.02359630912542343,
+ "step": 797
+ },
+ {
+ "epoch": 4.030379746835443,
+ "grad_norm": 0.03794289380311966,
+ "learning_rate": 6.638608305274972e-05,
+ "loss": 0.02135687693953514,
+ "step": 798
+ },
+ {
+ "epoch": 4.035443037974684,
+ "grad_norm": 0.030842013657093048,
+ "learning_rate": 6.632996632996633e-05,
+ "loss": 0.026881888508796692,
+ "step": 799
+ },
+ {
+ "epoch": 4.040506329113924,
+ "grad_norm": 0.036720771342515945,
+ "learning_rate": 6.627384960718295e-05,
+ "loss": 0.017526758834719658,
+ "step": 800
+ },
+ {
+ "epoch": 4.045569620253165,
+ "grad_norm": 0.04940621554851532,
+ "learning_rate": 6.621773288439955e-05,
+ "loss": 0.023458952084183693,
+ "step": 801
+ },
+ {
+ "epoch": 4.050632911392405,
+ "grad_norm": 0.0228698942810297,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.017165549099445343,
+ "step": 802
+ },
+ {
+ "epoch": 4.055696202531646,
+ "grad_norm": 0.0323697030544281,
+ "learning_rate": 6.610549943883277e-05,
+ "loss": 0.020573658868670464,
+ "step": 803
+ },
+ {
+ "epoch": 4.060759493670886,
+ "grad_norm": 0.03041171282529831,
+ "learning_rate": 6.60493827160494e-05,
+ "loss": 0.022557582706212997,
+ "step": 804
+ },
+ {
+ "epoch": 4.065822784810127,
+ "grad_norm": 0.030996058136224747,
+ "learning_rate": 6.599326599326599e-05,
+ "loss": 0.024344075471162796,
+ "step": 805
+ },
+ {
+ "epoch": 4.0708860759493675,
+ "grad_norm": 0.02448248863220215,
+ "learning_rate": 6.593714927048261e-05,
+ "loss": 0.018718231469392776,
+ "step": 806
+ },
+ {
+ "epoch": 4.075949367088608,
+ "grad_norm": 0.03839370980858803,
+ "learning_rate": 6.588103254769921e-05,
+ "loss": 0.02680569887161255,
+ "step": 807
+ },
+ {
+ "epoch": 4.0810126582278485,
+ "grad_norm": 0.029364196583628654,
+ "learning_rate": 6.582491582491582e-05,
+ "loss": 0.01946680247783661,
+ "step": 808
+ },
+ {
+ "epoch": 4.086075949367088,
+ "grad_norm": 0.02478131465613842,
+ "learning_rate": 6.576879910213244e-05,
+ "loss": 0.021097835153341293,
+ "step": 809
+ },
+ {
+ "epoch": 4.091139240506329,
+ "grad_norm": 0.030616244301199913,
+ "learning_rate": 6.571268237934904e-05,
+ "loss": 0.021518010646104813,
+ "step": 810
+ },
+ {
+ "epoch": 4.096202531645569,
+ "grad_norm": 0.02732054330408573,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.02008533477783203,
+ "step": 811
+ },
+ {
+ "epoch": 4.10126582278481,
+ "grad_norm": 0.0323524996638298,
+ "learning_rate": 6.560044893378226e-05,
+ "loss": 0.025486933067440987,
+ "step": 812
+ },
+ {
+ "epoch": 4.10632911392405,
+ "grad_norm": 0.026200806722044945,
+ "learning_rate": 6.554433221099888e-05,
+ "loss": 0.019320383667945862,
+ "step": 813
+ },
+ {
+ "epoch": 4.111392405063291,
+ "grad_norm": 0.03883595019578934,
+ "learning_rate": 6.548821548821548e-05,
+ "loss": 0.021837443113327026,
+ "step": 814
+ },
+ {
+ "epoch": 4.116455696202531,
+ "grad_norm": 0.037654533982276917,
+ "learning_rate": 6.54320987654321e-05,
+ "loss": 0.024574559181928635,
+ "step": 815
+ },
+ {
+ "epoch": 4.121518987341772,
+ "grad_norm": 0.04923658072948456,
+ "learning_rate": 6.537598204264871e-05,
+ "loss": 0.01940765418112278,
+ "step": 816
+ },
+ {
+ "epoch": 4.1265822784810124,
+ "grad_norm": 0.02900642342865467,
+ "learning_rate": 6.531986531986533e-05,
+ "loss": 0.019193468615412712,
+ "step": 817
+ },
+ {
+ "epoch": 4.131645569620253,
+ "grad_norm": 0.03798971325159073,
+ "learning_rate": 6.526374859708194e-05,
+ "loss": 0.022473281249403954,
+ "step": 818
+ },
+ {
+ "epoch": 4.1367088607594935,
+ "grad_norm": 0.05821327865123749,
+ "learning_rate": 6.520763187429855e-05,
+ "loss": 0.025292381644248962,
+ "step": 819
+ },
+ {
+ "epoch": 4.141772151898734,
+ "grad_norm": 0.02774794027209282,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.021283335983753204,
+ "step": 820
+ },
+ {
+ "epoch": 4.146835443037975,
+ "grad_norm": 0.03002094104886055,
+ "learning_rate": 6.509539842873177e-05,
+ "loss": 0.020336506888270378,
+ "step": 821
+ },
+ {
+ "epoch": 4.151898734177215,
+ "grad_norm": 0.02205439656972885,
+ "learning_rate": 6.503928170594838e-05,
+ "loss": 0.01669773831963539,
+ "step": 822
+ },
+ {
+ "epoch": 4.156962025316456,
+ "grad_norm": 0.023610664531588554,
+ "learning_rate": 6.498316498316499e-05,
+ "loss": 0.016195815056562424,
+ "step": 823
+ },
+ {
+ "epoch": 4.162025316455696,
+ "grad_norm": 0.02679222822189331,
+ "learning_rate": 6.49270482603816e-05,
+ "loss": 0.020671207457780838,
+ "step": 824
+ },
+ {
+ "epoch": 4.167088607594937,
+ "grad_norm": 0.043805427849292755,
+ "learning_rate": 6.48709315375982e-05,
+ "loss": 0.029262011870741844,
+ "step": 825
+ },
+ {
+ "epoch": 4.172151898734177,
+ "grad_norm": 0.024075932800769806,
+ "learning_rate": 6.481481481481482e-05,
+ "loss": 0.0180169977247715,
+ "step": 826
+ },
+ {
+ "epoch": 4.177215189873418,
+ "grad_norm": 0.027496427297592163,
+ "learning_rate": 6.475869809203144e-05,
+ "loss": 0.01985255442559719,
+ "step": 827
+ },
+ {
+ "epoch": 4.182278481012658,
+ "grad_norm": 0.028868619352579117,
+ "learning_rate": 6.470258136924804e-05,
+ "loss": 0.02416200190782547,
+ "step": 828
+ },
+ {
+ "epoch": 4.187341772151899,
+ "grad_norm": 0.026004688814282417,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.01904168725013733,
+ "step": 829
+ },
+ {
+ "epoch": 4.192405063291139,
+ "grad_norm": 0.04274019971489906,
+ "learning_rate": 6.459034792368126e-05,
+ "loss": 0.02680842950940132,
+ "step": 830
+ },
+ {
+ "epoch": 4.19746835443038,
+ "grad_norm": 0.024735039100050926,
+ "learning_rate": 6.453423120089787e-05,
+ "loss": 0.016491729766130447,
+ "step": 831
+ },
+ {
+ "epoch": 4.2025316455696204,
+ "grad_norm": 0.04336397722363472,
+ "learning_rate": 6.447811447811448e-05,
+ "loss": 0.02140970341861248,
+ "step": 832
+ },
+ {
+ "epoch": 4.207594936708861,
+ "grad_norm": 0.025922754779458046,
+ "learning_rate": 6.442199775533109e-05,
+ "loss": 0.017252741381525993,
+ "step": 833
+ },
+ {
+ "epoch": 4.2126582278481015,
+ "grad_norm": 0.0322343185544014,
+ "learning_rate": 6.436588103254771e-05,
+ "loss": 0.015862349420785904,
+ "step": 834
+ },
+ {
+ "epoch": 4.217721518987342,
+ "grad_norm": 0.033133670687675476,
+ "learning_rate": 6.43097643097643e-05,
+ "loss": 0.02029406651854515,
+ "step": 835
+ },
+ {
+ "epoch": 4.222784810126583,
+ "grad_norm": 0.044879183173179626,
+ "learning_rate": 6.425364758698093e-05,
+ "loss": 0.021223746240139008,
+ "step": 836
+ },
+ {
+ "epoch": 4.227848101265823,
+ "grad_norm": 0.031861864030361176,
+ "learning_rate": 6.419753086419753e-05,
+ "loss": 0.023331837728619576,
+ "step": 837
+ },
+ {
+ "epoch": 4.232911392405064,
+ "grad_norm": 0.03642997145652771,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.025932632386684418,
+ "step": 838
+ },
+ {
+ "epoch": 4.237974683544304,
+ "grad_norm": 0.025531062856316566,
+ "learning_rate": 6.408529741863075e-05,
+ "loss": 0.019921796396374702,
+ "step": 839
+ },
+ {
+ "epoch": 4.243037974683545,
+ "grad_norm": 0.025292333215475082,
+ "learning_rate": 6.402918069584737e-05,
+ "loss": 0.017363781109452248,
+ "step": 840
+ },
+ {
+ "epoch": 4.248101265822784,
+ "grad_norm": 0.03679105266928673,
+ "learning_rate": 6.397306397306398e-05,
+ "loss": 0.026451613754034042,
+ "step": 841
+ },
+ {
+ "epoch": 4.253164556962025,
+ "grad_norm": 0.029125263914465904,
+ "learning_rate": 6.391694725028059e-05,
+ "loss": 0.018277600407600403,
+ "step": 842
+ },
+ {
+ "epoch": 4.258227848101265,
+ "grad_norm": 0.03969479724764824,
+ "learning_rate": 6.38608305274972e-05,
+ "loss": 0.026814289391040802,
+ "step": 843
+ },
+ {
+ "epoch": 4.263291139240506,
+ "grad_norm": 0.03083009086549282,
+ "learning_rate": 6.380471380471381e-05,
+ "loss": 0.01898398995399475,
+ "step": 844
+ },
+ {
+ "epoch": 4.2683544303797465,
+ "grad_norm": 0.04128425940871239,
+ "learning_rate": 6.374859708193042e-05,
+ "loss": 0.02890118584036827,
+ "step": 845
+ },
+ {
+ "epoch": 4.273417721518987,
+ "grad_norm": 0.03675759211182594,
+ "learning_rate": 6.369248035914703e-05,
+ "loss": 0.0232902429997921,
+ "step": 846
+ },
+ {
+ "epoch": 4.2784810126582276,
+ "grad_norm": 0.035842880606651306,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.018688444048166275,
+ "step": 847
+ },
+ {
+ "epoch": 4.283544303797468,
+ "grad_norm": 0.041631679981946945,
+ "learning_rate": 6.358024691358025e-05,
+ "loss": 0.028953872621059418,
+ "step": 848
+ },
+ {
+ "epoch": 4.288607594936709,
+ "grad_norm": 0.02474270947277546,
+ "learning_rate": 6.352413019079686e-05,
+ "loss": 0.02291303500533104,
+ "step": 849
+ },
+ {
+ "epoch": 4.293670886075949,
+ "grad_norm": 0.0414784699678421,
+ "learning_rate": 6.346801346801347e-05,
+ "loss": 0.0197298601269722,
+ "step": 850
+ },
+ {
+ "epoch": 4.29873417721519,
+ "grad_norm": 0.022596480324864388,
+ "learning_rate": 6.341189674523008e-05,
+ "loss": 0.022477108985185623,
+ "step": 851
+ },
+ {
+ "epoch": 4.30379746835443,
+ "grad_norm": 0.03707405552268028,
+ "learning_rate": 6.335578002244669e-05,
+ "loss": 0.02374342642724514,
+ "step": 852
+ },
+ {
+ "epoch": 4.308860759493671,
+ "grad_norm": 0.036069657653570175,
+ "learning_rate": 6.32996632996633e-05,
+ "loss": 0.025015011429786682,
+ "step": 853
+ },
+ {
+ "epoch": 4.313924050632911,
+ "grad_norm": 0.025126038119196892,
+ "learning_rate": 6.324354657687991e-05,
+ "loss": 0.022152241319417953,
+ "step": 854
+ },
+ {
+ "epoch": 4.318987341772152,
+ "grad_norm": 0.03695147857069969,
+ "learning_rate": 6.318742985409652e-05,
+ "loss": 0.019978618249297142,
+ "step": 855
+ },
+ {
+ "epoch": 4.324050632911392,
+ "grad_norm": 0.034860849380493164,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.01976930722594261,
+ "step": 856
+ },
+ {
+ "epoch": 4.329113924050633,
+ "grad_norm": 0.029625017195940018,
+ "learning_rate": 6.307519640852974e-05,
+ "loss": 0.024136420339345932,
+ "step": 857
+ },
+ {
+ "epoch": 4.334177215189873,
+ "grad_norm": 0.03501079976558685,
+ "learning_rate": 6.301907968574635e-05,
+ "loss": 0.020777776837348938,
+ "step": 858
+ },
+ {
+ "epoch": 4.339240506329114,
+ "grad_norm": 0.037415534257888794,
+ "learning_rate": 6.296296296296296e-05,
+ "loss": 0.016332093626260757,
+ "step": 859
+ },
+ {
+ "epoch": 4.3443037974683545,
+ "grad_norm": 0.032555654644966125,
+ "learning_rate": 6.290684624017957e-05,
+ "loss": 0.02344547212123871,
+ "step": 860
+ },
+ {
+ "epoch": 4.349367088607595,
+ "grad_norm": 0.04069099947810173,
+ "learning_rate": 6.28507295173962e-05,
+ "loss": 0.019369281828403473,
+ "step": 861
+ },
+ {
+ "epoch": 4.3544303797468356,
+ "grad_norm": 0.05188984051346779,
+ "learning_rate": 6.279461279461279e-05,
+ "loss": 0.02291448414325714,
+ "step": 862
+ },
+ {
+ "epoch": 4.359493670886076,
+ "grad_norm": 0.0357513502240181,
+ "learning_rate": 6.273849607182942e-05,
+ "loss": 0.02141542360186577,
+ "step": 863
+ },
+ {
+ "epoch": 4.364556962025317,
+ "grad_norm": 0.026472769677639008,
+ "learning_rate": 6.268237934904601e-05,
+ "loss": 0.01893937960267067,
+ "step": 864
+ },
+ {
+ "epoch": 4.369620253164557,
+ "grad_norm": 0.0498812235891819,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.021839456632733345,
+ "step": 865
+ },
+ {
+ "epoch": 4.374683544303798,
+ "grad_norm": 0.05202518403530121,
+ "learning_rate": 6.257014590347923e-05,
+ "loss": 0.023422567173838615,
+ "step": 866
+ },
+ {
+ "epoch": 4.379746835443038,
+ "grad_norm": 0.024116024374961853,
+ "learning_rate": 6.251402918069586e-05,
+ "loss": 0.018288200721144676,
+ "step": 867
+ },
+ {
+ "epoch": 4.384810126582279,
+ "grad_norm": 0.02667090855538845,
+ "learning_rate": 6.245791245791247e-05,
+ "loss": 0.022375311702489853,
+ "step": 868
+ },
+ {
+ "epoch": 4.389873417721519,
+ "grad_norm": 0.02306467480957508,
+ "learning_rate": 6.240179573512908e-05,
+ "loss": 0.017447657883167267,
+ "step": 869
+ },
+ {
+ "epoch": 4.39493670886076,
+ "grad_norm": 0.031131602823734283,
+ "learning_rate": 6.234567901234569e-05,
+ "loss": 0.021768944337964058,
+ "step": 870
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.05789825692772865,
+ "learning_rate": 6.22895622895623e-05,
+ "loss": 0.02762719616293907,
+ "step": 871
+ },
+ {
+ "epoch": 4.405063291139241,
+ "grad_norm": 0.03830523043870926,
+ "learning_rate": 6.22334455667789e-05,
+ "loss": 0.023558061569929123,
+ "step": 872
+ },
+ {
+ "epoch": 4.410126582278481,
+ "grad_norm": 0.025961998850107193,
+ "learning_rate": 6.21773288439955e-05,
+ "loss": 0.022518256679177284,
+ "step": 873
+ },
+ {
+ "epoch": 4.415189873417722,
+ "grad_norm": 0.025299636647105217,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.018432877957820892,
+ "step": 874
+ },
+ {
+ "epoch": 4.4202531645569625,
+ "grad_norm": 0.027106614783406258,
+ "learning_rate": 6.206509539842874e-05,
+ "loss": 0.01614236831665039,
+ "step": 875
+ },
+ {
+ "epoch": 4.425316455696202,
+ "grad_norm": 0.04538397118449211,
+ "learning_rate": 6.200897867564535e-05,
+ "loss": 0.027474530041217804,
+ "step": 876
+ },
+ {
+ "epoch": 4.430379746835443,
+ "grad_norm": 0.041059643030166626,
+ "learning_rate": 6.195286195286196e-05,
+ "loss": 0.030840855091810226,
+ "step": 877
+ },
+ {
+ "epoch": 4.435443037974683,
+ "grad_norm": 0.055599089711904526,
+ "learning_rate": 6.189674523007857e-05,
+ "loss": 0.02877015620470047,
+ "step": 878
+ },
+ {
+ "epoch": 4.440506329113924,
+ "grad_norm": 0.023808903992176056,
+ "learning_rate": 6.184062850729518e-05,
+ "loss": 0.018071971833705902,
+ "step": 879
+ },
+ {
+ "epoch": 4.445569620253164,
+ "grad_norm": 0.04098769649863243,
+ "learning_rate": 6.178451178451179e-05,
+ "loss": 0.019321631640195847,
+ "step": 880
+ },
+ {
+ "epoch": 4.450632911392405,
+ "grad_norm": 0.0329279750585556,
+ "learning_rate": 6.17283950617284e-05,
+ "loss": 0.023013390600681305,
+ "step": 881
+ },
+ {
+ "epoch": 4.455696202531645,
+ "grad_norm": 0.030751917511224747,
+ "learning_rate": 6.1672278338945e-05,
+ "loss": 0.018062159419059753,
+ "step": 882
+ },
+ {
+ "epoch": 4.460759493670886,
+ "grad_norm": 0.025446373969316483,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.020532462745904922,
+ "step": 883
+ },
+ {
+ "epoch": 4.465822784810126,
+ "grad_norm": 0.037997085601091385,
+ "learning_rate": 6.156004489337823e-05,
+ "loss": 0.024340521544218063,
+ "step": 884
+ },
+ {
+ "epoch": 4.470886075949367,
+ "grad_norm": 0.021509790793061256,
+ "learning_rate": 6.150392817059484e-05,
+ "loss": 0.018887734040617943,
+ "step": 885
+ },
+ {
+ "epoch": 4.4759493670886075,
+ "grad_norm": 0.027931779623031616,
+ "learning_rate": 6.144781144781146e-05,
+ "loss": 0.02148054540157318,
+ "step": 886
+ },
+ {
+ "epoch": 4.481012658227848,
+ "grad_norm": 0.035554565489292145,
+ "learning_rate": 6.139169472502806e-05,
+ "loss": 0.019528254866600037,
+ "step": 887
+ },
+ {
+ "epoch": 4.4860759493670885,
+ "grad_norm": 0.02668517455458641,
+ "learning_rate": 6.133557800224468e-05,
+ "loss": 0.022182706743478775,
+ "step": 888
+ },
+ {
+ "epoch": 4.491139240506329,
+ "grad_norm": 0.0376712940633297,
+ "learning_rate": 6.127946127946128e-05,
+ "loss": 0.026006314903497696,
+ "step": 889
+ },
+ {
+ "epoch": 4.49620253164557,
+ "grad_norm": 0.02952289767563343,
+ "learning_rate": 6.12233445566779e-05,
+ "loss": 0.022582251578569412,
+ "step": 890
+ },
+ {
+ "epoch": 4.50126582278481,
+ "grad_norm": 0.05064458027482033,
+ "learning_rate": 6.11672278338945e-05,
+ "loss": 0.021709535270929337,
+ "step": 891
+ },
+ {
+ "epoch": 4.506329113924051,
+ "grad_norm": 0.021470079198479652,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.015116477385163307,
+ "step": 892
+ },
+ {
+ "epoch": 4.511392405063291,
+ "grad_norm": 0.04210078716278076,
+ "learning_rate": 6.105499438832773e-05,
+ "loss": 0.030057771131396294,
+ "step": 893
+ },
+ {
+ "epoch": 4.516455696202532,
+ "grad_norm": 0.20027652382850647,
+ "learning_rate": 6.099887766554434e-05,
+ "loss": 0.02081073820590973,
+ "step": 894
+ },
+ {
+ "epoch": 4.521518987341772,
+ "grad_norm": 0.03083370067179203,
+ "learning_rate": 6.0942760942760944e-05,
+ "loss": 0.020705904811620712,
+ "step": 895
+ },
+ {
+ "epoch": 4.526582278481013,
+ "grad_norm": 0.05921618640422821,
+ "learning_rate": 6.0886644219977554e-05,
+ "loss": 0.020449915900826454,
+ "step": 896
+ },
+ {
+ "epoch": 4.531645569620253,
+ "grad_norm": 0.02304214984178543,
+ "learning_rate": 6.0830527497194164e-05,
+ "loss": 0.01927848532795906,
+ "step": 897
+ },
+ {
+ "epoch": 4.536708860759494,
+ "grad_norm": 0.03946949169039726,
+ "learning_rate": 6.0774410774410774e-05,
+ "loss": 0.026231423020362854,
+ "step": 898
+ },
+ {
+ "epoch": 4.541772151898734,
+ "grad_norm": 0.027822930365800858,
+ "learning_rate": 6.071829405162739e-05,
+ "loss": 0.022259924560785294,
+ "step": 899
+ },
+ {
+ "epoch": 4.546835443037975,
+ "grad_norm": 0.029135817661881447,
+ "learning_rate": 6.0662177328843995e-05,
+ "loss": 0.019272884353995323,
+ "step": 900
+ },
+ {
+ "epoch": 4.5518987341772155,
+ "grad_norm": 0.03746713697910309,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.022191740572452545,
+ "step": 901
+ },
+ {
+ "epoch": 4.556962025316456,
+ "grad_norm": 0.027378680184483528,
+ "learning_rate": 6.0549943883277215e-05,
+ "loss": 0.023043492808938026,
+ "step": 902
+ },
+ {
+ "epoch": 4.5620253164556965,
+ "grad_norm": 0.047497715801000595,
+ "learning_rate": 6.049382716049383e-05,
+ "loss": 0.023993097245693207,
+ "step": 903
+ },
+ {
+ "epoch": 4.567088607594937,
+ "grad_norm": 0.02557055652141571,
+ "learning_rate": 6.0437710437710435e-05,
+ "loss": 0.020033126696944237,
+ "step": 904
+ },
+ {
+ "epoch": 4.572151898734178,
+ "grad_norm": 0.08165695518255234,
+ "learning_rate": 6.038159371492705e-05,
+ "loss": 0.02415328472852707,
+ "step": 905
+ },
+ {
+ "epoch": 4.577215189873417,
+ "grad_norm": 0.03633309155702591,
+ "learning_rate": 6.032547699214366e-05,
+ "loss": 0.02082585170865059,
+ "step": 906
+ },
+ {
+ "epoch": 4.582278481012658,
+ "grad_norm": 0.03273358196020126,
+ "learning_rate": 6.026936026936028e-05,
+ "loss": 0.020049303770065308,
+ "step": 907
+ },
+ {
+ "epoch": 4.587341772151898,
+ "grad_norm": 0.040032029151916504,
+ "learning_rate": 6.021324354657688e-05,
+ "loss": 0.02167242392897606,
+ "step": 908
+ },
+ {
+ "epoch": 4.592405063291139,
+ "grad_norm": 0.02789166197180748,
+ "learning_rate": 6.01571268237935e-05,
+ "loss": 0.01964012160897255,
+ "step": 909
+ },
+ {
+ "epoch": 4.597468354430379,
+ "grad_norm": 0.03285825625061989,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.024942882359027863,
+ "step": 910
+ },
+ {
+ "epoch": 4.60253164556962,
+ "grad_norm": 0.02894079126417637,
+ "learning_rate": 6.004489337822672e-05,
+ "loss": 0.022012561559677124,
+ "step": 911
+ },
+ {
+ "epoch": 4.6075949367088604,
+ "grad_norm": 0.03291299566626549,
+ "learning_rate": 5.998877665544332e-05,
+ "loss": 0.02291432023048401,
+ "step": 912
+ },
+ {
+ "epoch": 4.612658227848101,
+ "grad_norm": 0.05124634876847267,
+ "learning_rate": 5.993265993265994e-05,
+ "loss": 0.017874885350465775,
+ "step": 913
+ },
+ {
+ "epoch": 4.6177215189873415,
+ "grad_norm": 0.042412169277668,
+ "learning_rate": 5.987654320987654e-05,
+ "loss": 0.0233401320874691,
+ "step": 914
+ },
+ {
+ "epoch": 4.622784810126582,
+ "grad_norm": 0.03447306156158447,
+ "learning_rate": 5.982042648709316e-05,
+ "loss": 0.022503826767206192,
+ "step": 915
+ },
+ {
+ "epoch": 4.627848101265823,
+ "grad_norm": 0.022415662184357643,
+ "learning_rate": 5.976430976430977e-05,
+ "loss": 0.01659448817372322,
+ "step": 916
+ },
+ {
+ "epoch": 4.632911392405063,
+ "grad_norm": 0.04882103577256203,
+ "learning_rate": 5.970819304152637e-05,
+ "loss": 0.02342696487903595,
+ "step": 917
+ },
+ {
+ "epoch": 4.637974683544304,
+ "grad_norm": 0.0341666042804718,
+ "learning_rate": 5.965207631874299e-05,
+ "loss": 0.026119260117411613,
+ "step": 918
+ },
+ {
+ "epoch": 4.643037974683544,
+ "grad_norm": 0.03507097065448761,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.022042831405997276,
+ "step": 919
+ },
+ {
+ "epoch": 4.648101265822785,
+ "grad_norm": 0.04078570008277893,
+ "learning_rate": 5.953984287317621e-05,
+ "loss": 0.01978793554008007,
+ "step": 920
+ },
+ {
+ "epoch": 4.653164556962025,
+ "grad_norm": 0.03481799736618996,
+ "learning_rate": 5.948372615039281e-05,
+ "loss": 0.02518302947282791,
+ "step": 921
+ },
+ {
+ "epoch": 4.658227848101266,
+ "grad_norm": 0.0456753633916378,
+ "learning_rate": 5.942760942760943e-05,
+ "loss": 0.027814291417598724,
+ "step": 922
+ },
+ {
+ "epoch": 4.663291139240506,
+ "grad_norm": 0.026144322007894516,
+ "learning_rate": 5.937149270482604e-05,
+ "loss": 0.020842768251895905,
+ "step": 923
+ },
+ {
+ "epoch": 4.668354430379747,
+ "grad_norm": 0.027078162878751755,
+ "learning_rate": 5.9315375982042657e-05,
+ "loss": 0.026818346232175827,
+ "step": 924
+ },
+ {
+ "epoch": 4.673417721518987,
+ "grad_norm": 0.04505958408117294,
+ "learning_rate": 5.925925925925926e-05,
+ "loss": 0.01925778016448021,
+ "step": 925
+ },
+ {
+ "epoch": 4.678481012658228,
+ "grad_norm": 0.028921643272042274,
+ "learning_rate": 5.920314253647588e-05,
+ "loss": 0.017857741564512253,
+ "step": 926
+ },
+ {
+ "epoch": 4.6835443037974684,
+ "grad_norm": 0.021489476785063744,
+ "learning_rate": 5.914702581369248e-05,
+ "loss": 0.018585946410894394,
+ "step": 927
+ },
+ {
+ "epoch": 4.688607594936709,
+ "grad_norm": 0.02885374240577221,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.023486338555812836,
+ "step": 928
+ },
+ {
+ "epoch": 4.6936708860759495,
+ "grad_norm": 0.037063464522361755,
+ "learning_rate": 5.90347923681257e-05,
+ "loss": 0.02569335326552391,
+ "step": 929
+ },
+ {
+ "epoch": 4.69873417721519,
+ "grad_norm": 0.02460661344230175,
+ "learning_rate": 5.897867564534232e-05,
+ "loss": 0.01580418087542057,
+ "step": 930
+ },
+ {
+ "epoch": 4.703797468354431,
+ "grad_norm": 0.030016187578439713,
+ "learning_rate": 5.892255892255892e-05,
+ "loss": 0.01811431720852852,
+ "step": 931
+ },
+ {
+ "epoch": 4.708860759493671,
+ "grad_norm": 0.030638013035058975,
+ "learning_rate": 5.886644219977554e-05,
+ "loss": 0.02380264922976494,
+ "step": 932
+ },
+ {
+ "epoch": 4.713924050632912,
+ "grad_norm": 0.022593742236495018,
+ "learning_rate": 5.881032547699215e-05,
+ "loss": 0.017498169094324112,
+ "step": 933
+ },
+ {
+ "epoch": 4.718987341772152,
+ "grad_norm": 0.026072485372424126,
+ "learning_rate": 5.8754208754208764e-05,
+ "loss": 0.020261723548173904,
+ "step": 934
+ },
+ {
+ "epoch": 4.724050632911393,
+ "grad_norm": 0.020842554047703743,
+ "learning_rate": 5.869809203142537e-05,
+ "loss": 0.018765904009342194,
+ "step": 935
+ },
+ {
+ "epoch": 4.729113924050633,
+ "grad_norm": 0.02724885568022728,
+ "learning_rate": 5.8641975308641984e-05,
+ "loss": 0.01877676695585251,
+ "step": 936
+ },
+ {
+ "epoch": 4.734177215189874,
+ "grad_norm": 0.037401214241981506,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.026435203850269318,
+ "step": 937
+ },
+ {
+ "epoch": 4.739240506329114,
+ "grad_norm": 0.06131114065647125,
+ "learning_rate": 5.852974186307519e-05,
+ "loss": 0.023247163742780685,
+ "step": 938
+ },
+ {
+ "epoch": 4.744303797468355,
+ "grad_norm": 0.04543917998671532,
+ "learning_rate": 5.847362514029181e-05,
+ "loss": 0.024184830486774445,
+ "step": 939
+ },
+ {
+ "epoch": 4.749367088607595,
+ "grad_norm": 0.03184051439166069,
+ "learning_rate": 5.841750841750842e-05,
+ "loss": 0.02176564559340477,
+ "step": 940
+ },
+ {
+ "epoch": 4.754430379746836,
+ "grad_norm": 0.0309689249843359,
+ "learning_rate": 5.8361391694725034e-05,
+ "loss": 0.023136526346206665,
+ "step": 941
+ },
+ {
+ "epoch": 4.759493670886076,
+ "grad_norm": 0.024972833693027496,
+ "learning_rate": 5.830527497194164e-05,
+ "loss": 0.017270661890506744,
+ "step": 942
+ },
+ {
+ "epoch": 4.764556962025316,
+ "grad_norm": 0.03733127936720848,
+ "learning_rate": 5.8249158249158255e-05,
+ "loss": 0.022722383961081505,
+ "step": 943
+ },
+ {
+ "epoch": 4.769620253164557,
+ "grad_norm": 0.04425952583551407,
+ "learning_rate": 5.819304152637486e-05,
+ "loss": 0.02506185881793499,
+ "step": 944
+ },
+ {
+ "epoch": 4.774683544303797,
+ "grad_norm": 0.022625036537647247,
+ "learning_rate": 5.8136924803591475e-05,
+ "loss": 0.017418090254068375,
+ "step": 945
+ },
+ {
+ "epoch": 4.779746835443038,
+ "grad_norm": 0.02716260775923729,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.022329077124595642,
+ "step": 946
+ },
+ {
+ "epoch": 4.784810126582278,
+ "grad_norm": 0.03288663551211357,
+ "learning_rate": 5.8024691358024695e-05,
+ "loss": 0.02051950991153717,
+ "step": 947
+ },
+ {
+ "epoch": 4.789873417721519,
+ "grad_norm": 0.03347448632121086,
+ "learning_rate": 5.7968574635241305e-05,
+ "loss": 0.01883091777563095,
+ "step": 948
+ },
+ {
+ "epoch": 4.794936708860759,
+ "grad_norm": 0.036814238876104355,
+ "learning_rate": 5.7912457912457915e-05,
+ "loss": 0.02320999652147293,
+ "step": 949
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.030795598402619362,
+ "learning_rate": 5.7856341189674525e-05,
+ "loss": 0.01819070428609848,
+ "step": 950
+ },
+ {
+ "epoch": 4.80506329113924,
+ "grad_norm": 0.03846567124128342,
+ "learning_rate": 5.780022446689114e-05,
+ "loss": 0.01933719590306282,
+ "step": 951
+ },
+ {
+ "epoch": 4.810126582278481,
+ "grad_norm": 0.029248127713799477,
+ "learning_rate": 5.7744107744107745e-05,
+ "loss": 0.01642131432890892,
+ "step": 952
+ },
+ {
+ "epoch": 4.815189873417721,
+ "grad_norm": 0.025749213993549347,
+ "learning_rate": 5.768799102132436e-05,
+ "loss": 0.017750587314367294,
+ "step": 953
+ },
+ {
+ "epoch": 4.820253164556962,
+ "grad_norm": 0.043794333934783936,
+ "learning_rate": 5.7631874298540965e-05,
+ "loss": 0.02561376616358757,
+ "step": 954
+ },
+ {
+ "epoch": 4.8253164556962025,
+ "grad_norm": 0.04074554517865181,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.023251589387655258,
+ "step": 955
+ },
+ {
+ "epoch": 4.830379746835443,
+ "grad_norm": 0.043594326823949814,
+ "learning_rate": 5.7519640852974186e-05,
+ "loss": 0.025138206779956818,
+ "step": 956
+ },
+ {
+ "epoch": 4.8354430379746836,
+ "grad_norm": 0.05410498008131981,
+ "learning_rate": 5.74635241301908e-05,
+ "loss": 0.023706410080194473,
+ "step": 957
+ },
+ {
+ "epoch": 4.840506329113924,
+ "grad_norm": 0.0299235749989748,
+ "learning_rate": 5.740740740740741e-05,
+ "loss": 0.01801147311925888,
+ "step": 958
+ },
+ {
+ "epoch": 4.845569620253165,
+ "grad_norm": 0.02982177399098873,
+ "learning_rate": 5.735129068462403e-05,
+ "loss": 0.021112898364663124,
+ "step": 959
+ },
+ {
+ "epoch": 4.850632911392405,
+ "grad_norm": 0.04181864112615585,
+ "learning_rate": 5.729517396184063e-05,
+ "loss": 0.02110268548130989,
+ "step": 960
+ },
+ {
+ "epoch": 4.855696202531646,
+ "grad_norm": 0.040301334112882614,
+ "learning_rate": 5.7239057239057236e-05,
+ "loss": 0.020649928599596024,
+ "step": 961
+ },
+ {
+ "epoch": 4.860759493670886,
+ "grad_norm": 0.03669300675392151,
+ "learning_rate": 5.718294051627385e-05,
+ "loss": 0.023078542202711105,
+ "step": 962
+ },
+ {
+ "epoch": 4.865822784810127,
+ "grad_norm": 0.023378873243927956,
+ "learning_rate": 5.7126823793490456e-05,
+ "loss": 0.01759505085647106,
+ "step": 963
+ },
+ {
+ "epoch": 4.870886075949367,
+ "grad_norm": 0.044835980981588364,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.023342810571193695,
+ "step": 964
+ },
+ {
+ "epoch": 4.875949367088608,
+ "grad_norm": 0.03264521807432175,
+ "learning_rate": 5.701459034792368e-05,
+ "loss": 0.021122846752405167,
+ "step": 965
+ },
+ {
+ "epoch": 4.881012658227848,
+ "grad_norm": 0.036651868373155594,
+ "learning_rate": 5.695847362514029e-05,
+ "loss": 0.026279672980308533,
+ "step": 966
+ },
+ {
+ "epoch": 4.886075949367089,
+ "grad_norm": 0.023810314014554024,
+ "learning_rate": 5.69023569023569e-05,
+ "loss": 0.020299838855862617,
+ "step": 967
+ },
+ {
+ "epoch": 4.891139240506329,
+ "grad_norm": 0.028432384133338928,
+ "learning_rate": 5.684624017957352e-05,
+ "loss": 0.019828233867883682,
+ "step": 968
+ },
+ {
+ "epoch": 4.89620253164557,
+ "grad_norm": 0.02499561943113804,
+ "learning_rate": 5.679012345679012e-05,
+ "loss": 0.023105870932340622,
+ "step": 969
+ },
+ {
+ "epoch": 4.9012658227848105,
+ "grad_norm": 0.0340624563395977,
+ "learning_rate": 5.673400673400674e-05,
+ "loss": 0.023707572370767593,
+ "step": 970
+ },
+ {
+ "epoch": 4.90632911392405,
+ "grad_norm": 0.02945004589855671,
+ "learning_rate": 5.667789001122334e-05,
+ "loss": 0.019038598984479904,
+ "step": 971
+ },
+ {
+ "epoch": 4.911392405063291,
+ "grad_norm": 0.034173011779785156,
+ "learning_rate": 5.662177328843996e-05,
+ "loss": 0.02678484097123146,
+ "step": 972
+ },
+ {
+ "epoch": 4.916455696202531,
+ "grad_norm": 0.0515705943107605,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.02983126789331436,
+ "step": 973
+ },
+ {
+ "epoch": 4.921518987341772,
+ "grad_norm": 0.024027375504374504,
+ "learning_rate": 5.650953984287318e-05,
+ "loss": 0.021375803276896477,
+ "step": 974
+ },
+ {
+ "epoch": 4.926582278481012,
+ "grad_norm": 0.03331667557358742,
+ "learning_rate": 5.645342312008979e-05,
+ "loss": 0.021600808948278427,
+ "step": 975
+ },
+ {
+ "epoch": 4.931645569620253,
+ "grad_norm": 0.029174596071243286,
+ "learning_rate": 5.639730639730641e-05,
+ "loss": 0.022452034056186676,
+ "step": 976
+ },
+ {
+ "epoch": 4.936708860759493,
+ "grad_norm": 0.03323808312416077,
+ "learning_rate": 5.634118967452301e-05,
+ "loss": 0.02531963586807251,
+ "step": 977
+ },
+ {
+ "epoch": 4.941772151898734,
+ "grad_norm": 0.02238641493022442,
+ "learning_rate": 5.628507295173963e-05,
+ "loss": 0.01655597612261772,
+ "step": 978
+ },
+ {
+ "epoch": 4.946835443037974,
+ "grad_norm": 0.03279856964945793,
+ "learning_rate": 5.622895622895623e-05,
+ "loss": 0.02232341095805168,
+ "step": 979
+ },
+ {
+ "epoch": 4.951898734177215,
+ "grad_norm": 0.03852152079343796,
+ "learning_rate": 5.617283950617285e-05,
+ "loss": 0.025721147656440735,
+ "step": 980
+ },
+ {
+ "epoch": 4.9569620253164555,
+ "grad_norm": 0.039974186569452286,
+ "learning_rate": 5.611672278338945e-05,
+ "loss": 0.015438543632626534,
+ "step": 981
+ },
+ {
+ "epoch": 4.962025316455696,
+ "grad_norm": 0.0348355695605278,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.021361682564020157,
+ "step": 982
+ },
+ {
+ "epoch": 4.9670886075949365,
+ "grad_norm": 0.02576221525669098,
+ "learning_rate": 5.600448933782267e-05,
+ "loss": 0.02103075385093689,
+ "step": 983
+ },
+ {
+ "epoch": 4.972151898734177,
+ "grad_norm": 0.039421118795871735,
+ "learning_rate": 5.594837261503928e-05,
+ "loss": 0.026340002194046974,
+ "step": 984
+ },
+ {
+ "epoch": 4.977215189873418,
+ "grad_norm": 0.02953593246638775,
+ "learning_rate": 5.58922558922559e-05,
+ "loss": 0.020818116143345833,
+ "step": 985
+ },
+ {
+ "epoch": 4.982278481012658,
+ "grad_norm": 0.033213913440704346,
+ "learning_rate": 5.58361391694725e-05,
+ "loss": 0.020878788083791733,
+ "step": 986
+ },
+ {
+ "epoch": 4.987341772151899,
+ "grad_norm": 0.04450162872672081,
+ "learning_rate": 5.578002244668912e-05,
+ "loss": 0.02208695001900196,
+ "step": 987
+ },
+ {
+ "epoch": 4.992405063291139,
+ "grad_norm": 0.04752403125166893,
+ "learning_rate": 5.572390572390572e-05,
+ "loss": 0.021128743886947632,
+ "step": 988
+ },
+ {
+ "epoch": 4.99746835443038,
+ "grad_norm": 0.03401600942015648,
+ "learning_rate": 5.566778900112234e-05,
+ "loss": 0.020553182810544968,
+ "step": 989
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.031174728646874428,
+ "learning_rate": 5.561167227833894e-05,
+ "loss": 0.01929999701678753,
+ "step": 990
+ },
+ {
+ "epoch": 5.0050632911392405,
+ "grad_norm": 0.056407660245895386,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.024739203974604607,
+ "step": 991
+ },
+ {
+ "epoch": 5.010126582278481,
+ "grad_norm": 0.019481178373098373,
+ "learning_rate": 5.549943883277217e-05,
+ "loss": 0.016404341906309128,
+ "step": 992
+ },
+ {
+ "epoch": 5.015189873417722,
+ "grad_norm": 0.029707469046115875,
+ "learning_rate": 5.5443322109988785e-05,
+ "loss": 0.017014270648360252,
+ "step": 993
+ },
+ {
+ "epoch": 5.020253164556962,
+ "grad_norm": 0.039400286972522736,
+ "learning_rate": 5.538720538720539e-05,
+ "loss": 0.016073700040578842,
+ "step": 994
+ },
+ {
+ "epoch": 5.025316455696203,
+ "grad_norm": 0.047592055052518845,
+ "learning_rate": 5.5331088664422005e-05,
+ "loss": 0.02021213248372078,
+ "step": 995
+ },
+ {
+ "epoch": 5.030379746835443,
+ "grad_norm": 0.054195769131183624,
+ "learning_rate": 5.527497194163861e-05,
+ "loss": 0.027454158291220665,
+ "step": 996
+ },
+ {
+ "epoch": 5.035443037974684,
+ "grad_norm": 0.02753913588821888,
+ "learning_rate": 5.5218855218855225e-05,
+ "loss": 0.01993582770228386,
+ "step": 997
+ },
+ {
+ "epoch": 5.040506329113924,
+ "grad_norm": 0.038280900567770004,
+ "learning_rate": 5.516273849607183e-05,
+ "loss": 0.017832420766353607,
+ "step": 998
+ },
+ {
+ "epoch": 5.045569620253165,
+ "grad_norm": 0.0289705079048872,
+ "learning_rate": 5.5106621773288446e-05,
+ "loss": 0.019040051847696304,
+ "step": 999
+ },
+ {
+ "epoch": 5.050632911392405,
+ "grad_norm": 0.030929062515497208,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.02529517561197281,
+ "step": 1000
+ },
+ {
+ "epoch": 5.055696202531646,
+ "grad_norm": 0.039416536688804626,
+ "learning_rate": 5.4994388327721666e-05,
+ "loss": 0.017563793808221817,
+ "step": 1001
+ },
+ {
+ "epoch": 5.060759493670886,
+ "grad_norm": 0.039831917732954025,
+ "learning_rate": 5.4938271604938276e-05,
+ "loss": 0.022547172382473946,
+ "step": 1002
+ },
+ {
+ "epoch": 5.065822784810127,
+ "grad_norm": 0.02979891747236252,
+ "learning_rate": 5.488215488215489e-05,
+ "loss": 0.019676152616739273,
+ "step": 1003
+ },
+ {
+ "epoch": 5.0708860759493675,
+ "grad_norm": 0.025752373039722443,
+ "learning_rate": 5.4826038159371496e-05,
+ "loss": 0.016172030940651894,
+ "step": 1004
+ },
+ {
+ "epoch": 5.075949367088608,
+ "grad_norm": 0.03433040529489517,
+ "learning_rate": 5.47699214365881e-05,
+ "loss": 0.022616712376475334,
+ "step": 1005
+ },
+ {
+ "epoch": 5.0810126582278485,
+ "grad_norm": 0.04834216088056564,
+ "learning_rate": 5.4713804713804716e-05,
+ "loss": 0.02641037292778492,
+ "step": 1006
+ },
+ {
+ "epoch": 5.086075949367088,
+ "grad_norm": 0.03748583421111107,
+ "learning_rate": 5.465768799102132e-05,
+ "loss": 0.02212962508201599,
+ "step": 1007
+ },
+ {
+ "epoch": 5.091139240506329,
+ "grad_norm": 0.03406492620706558,
+ "learning_rate": 5.4601571268237936e-05,
+ "loss": 0.022490520030260086,
+ "step": 1008
+ },
+ {
+ "epoch": 5.096202531645569,
+ "grad_norm": 0.025412574410438538,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.018286626785993576,
+ "step": 1009
+ },
+ {
+ "epoch": 5.10126582278481,
+ "grad_norm": 0.030613059177994728,
+ "learning_rate": 5.448933782267116e-05,
+ "loss": 0.018090849742293358,
+ "step": 1010
+ },
+ {
+ "epoch": 5.10632911392405,
+ "grad_norm": 0.032511018216609955,
+ "learning_rate": 5.4433221099887766e-05,
+ "loss": 0.019871044903993607,
+ "step": 1011
+ },
+ {
+ "epoch": 5.111392405063291,
+ "grad_norm": 0.041535500437021255,
+ "learning_rate": 5.437710437710438e-05,
+ "loss": 0.02880081906914711,
+ "step": 1012
+ },
+ {
+ "epoch": 5.116455696202531,
+ "grad_norm": 0.053748298436403275,
+ "learning_rate": 5.4320987654320986e-05,
+ "loss": 0.024350278079509735,
+ "step": 1013
+ },
+ {
+ "epoch": 5.121518987341772,
+ "grad_norm": 0.03045419417321682,
+ "learning_rate": 5.42648709315376e-05,
+ "loss": 0.026830779388546944,
+ "step": 1014
+ },
+ {
+ "epoch": 5.1265822784810124,
+ "grad_norm": 0.02704838663339615,
+ "learning_rate": 5.420875420875421e-05,
+ "loss": 0.019440406933426857,
+ "step": 1015
+ },
+ {
+ "epoch": 5.131645569620253,
+ "grad_norm": 0.037976089864969254,
+ "learning_rate": 5.4152637485970823e-05,
+ "loss": 0.02016528509557247,
+ "step": 1016
+ },
+ {
+ "epoch": 5.1367088607594935,
+ "grad_norm": 0.04055245593190193,
+ "learning_rate": 5.4096520763187434e-05,
+ "loss": 0.021118413656949997,
+ "step": 1017
+ },
+ {
+ "epoch": 5.141772151898734,
+ "grad_norm": 0.02943083830177784,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.01882058009505272,
+ "step": 1018
+ },
+ {
+ "epoch": 5.146835443037975,
+ "grad_norm": 0.03773244097828865,
+ "learning_rate": 5.3984287317620654e-05,
+ "loss": 0.025017477571964264,
+ "step": 1019
+ },
+ {
+ "epoch": 5.151898734177215,
+ "grad_norm": 0.026969652622938156,
+ "learning_rate": 5.392817059483727e-05,
+ "loss": 0.018443236127495766,
+ "step": 1020
+ },
+ {
+ "epoch": 5.156962025316456,
+ "grad_norm": 0.032142024487257004,
+ "learning_rate": 5.3872053872053874e-05,
+ "loss": 0.02332904376089573,
+ "step": 1021
+ },
+ {
+ "epoch": 5.162025316455696,
+ "grad_norm": 0.06372297555208206,
+ "learning_rate": 5.381593714927049e-05,
+ "loss": 0.027975570410490036,
+ "step": 1022
+ },
+ {
+ "epoch": 5.167088607594937,
+ "grad_norm": 0.03120330721139908,
+ "learning_rate": 5.3759820426487094e-05,
+ "loss": 0.023697681725025177,
+ "step": 1023
+ },
+ {
+ "epoch": 5.172151898734177,
+ "grad_norm": 0.029094889760017395,
+ "learning_rate": 5.370370370370371e-05,
+ "loss": 0.01727498322725296,
+ "step": 1024
+ },
+ {
+ "epoch": 5.177215189873418,
+ "grad_norm": 0.03791336342692375,
+ "learning_rate": 5.3647586980920314e-05,
+ "loss": 0.02156408131122589,
+ "step": 1025
+ },
+ {
+ "epoch": 5.182278481012658,
+ "grad_norm": 0.028603199869394302,
+ "learning_rate": 5.3591470258136924e-05,
+ "loss": 0.01781666837632656,
+ "step": 1026
+ },
+ {
+ "epoch": 5.187341772151899,
+ "grad_norm": 0.034254368394613266,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.023422224447131157,
+ "step": 1027
+ },
+ {
+ "epoch": 5.192405063291139,
+ "grad_norm": 0.025661299005150795,
+ "learning_rate": 5.3479236812570144e-05,
+ "loss": 0.017852213233709335,
+ "step": 1028
+ },
+ {
+ "epoch": 5.19746835443038,
+ "grad_norm": 0.03156711906194687,
+ "learning_rate": 5.342312008978676e-05,
+ "loss": 0.022492870688438416,
+ "step": 1029
+ },
+ {
+ "epoch": 5.2025316455696204,
+ "grad_norm": 0.0222217608243227,
+ "learning_rate": 5.3367003367003364e-05,
+ "loss": 0.015568151138722897,
+ "step": 1030
+ },
+ {
+ "epoch": 5.207594936708861,
+ "grad_norm": 0.04563366249203682,
+ "learning_rate": 5.331088664421998e-05,
+ "loss": 0.022124778479337692,
+ "step": 1031
+ },
+ {
+ "epoch": 5.2126582278481015,
+ "grad_norm": 0.04612975940108299,
+ "learning_rate": 5.3254769921436585e-05,
+ "loss": 0.027084846049547195,
+ "step": 1032
+ },
+ {
+ "epoch": 5.217721518987342,
+ "grad_norm": 0.047278422862291336,
+ "learning_rate": 5.31986531986532e-05,
+ "loss": 0.022641438990831375,
+ "step": 1033
+ },
+ {
+ "epoch": 5.222784810126583,
+ "grad_norm": 0.030134575441479683,
+ "learning_rate": 5.314253647586981e-05,
+ "loss": 0.01842697337269783,
+ "step": 1034
+ },
+ {
+ "epoch": 5.227848101265823,
+ "grad_norm": 0.019028518348932266,
+ "learning_rate": 5.308641975308642e-05,
+ "loss": 0.017543386667966843,
+ "step": 1035
+ },
+ {
+ "epoch": 5.232911392405064,
+ "grad_norm": 0.04117404296994209,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.02185094729065895,
+ "step": 1036
+ },
+ {
+ "epoch": 5.237974683544304,
+ "grad_norm": 0.0310111902654171,
+ "learning_rate": 5.297418630751965e-05,
+ "loss": 0.02418985590338707,
+ "step": 1037
+ },
+ {
+ "epoch": 5.243037974683545,
+ "grad_norm": 0.034619491547346115,
+ "learning_rate": 5.291806958473625e-05,
+ "loss": 0.02162736840546131,
+ "step": 1038
+ },
+ {
+ "epoch": 5.248101265822784,
+ "grad_norm": 0.04028276726603508,
+ "learning_rate": 5.286195286195287e-05,
+ "loss": 0.02554975263774395,
+ "step": 1039
+ },
+ {
+ "epoch": 5.253164556962025,
+ "grad_norm": 0.0336519293487072,
+ "learning_rate": 5.280583613916947e-05,
+ "loss": 0.019465651363134384,
+ "step": 1040
+ },
+ {
+ "epoch": 5.258227848101265,
+ "grad_norm": 0.033565767109394073,
+ "learning_rate": 5.274971941638609e-05,
+ "loss": 0.020889155566692352,
+ "step": 1041
+ },
+ {
+ "epoch": 5.263291139240506,
+ "grad_norm": 0.02902410738170147,
+ "learning_rate": 5.269360269360269e-05,
+ "loss": 0.02131371572613716,
+ "step": 1042
+ },
+ {
+ "epoch": 5.2683544303797465,
+ "grad_norm": 0.03622325137257576,
+ "learning_rate": 5.263748597081931e-05,
+ "loss": 0.017162127420306206,
+ "step": 1043
+ },
+ {
+ "epoch": 5.273417721518987,
+ "grad_norm": 0.039386410266160965,
+ "learning_rate": 5.258136924803592e-05,
+ "loss": 0.016598902642726898,
+ "step": 1044
+ },
+ {
+ "epoch": 5.2784810126582276,
+ "grad_norm": 0.035566773265600204,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.022860797122120857,
+ "step": 1045
+ },
+ {
+ "epoch": 5.283544303797468,
+ "grad_norm": 0.04470687359571457,
+ "learning_rate": 5.246913580246914e-05,
+ "loss": 0.020824994891881943,
+ "step": 1046
+ },
+ {
+ "epoch": 5.288607594936709,
+ "grad_norm": 0.03889680653810501,
+ "learning_rate": 5.241301907968574e-05,
+ "loss": 0.017250075936317444,
+ "step": 1047
+ },
+ {
+ "epoch": 5.293670886075949,
+ "grad_norm": 0.02681683376431465,
+ "learning_rate": 5.235690235690236e-05,
+ "loss": 0.0191829651594162,
+ "step": 1048
+ },
+ {
+ "epoch": 5.29873417721519,
+ "grad_norm": 0.018965722993016243,
+ "learning_rate": 5.230078563411896e-05,
+ "loss": 0.02007337100803852,
+ "step": 1049
+ },
+ {
+ "epoch": 5.30379746835443,
+ "grad_norm": 0.023910261690616608,
+ "learning_rate": 5.224466891133558e-05,
+ "loss": 0.02189997211098671,
+ "step": 1050
+ },
+ {
+ "epoch": 5.308860759493671,
+ "grad_norm": 0.03607999160885811,
+ "learning_rate": 5.218855218855219e-05,
+ "loss": 0.023346582427620888,
+ "step": 1051
+ },
+ {
+ "epoch": 5.313924050632911,
+ "grad_norm": 0.02490268088877201,
+ "learning_rate": 5.2132435465768806e-05,
+ "loss": 0.017453521490097046,
+ "step": 1052
+ },
+ {
+ "epoch": 5.318987341772152,
+ "grad_norm": 0.04894902557134628,
+ "learning_rate": 5.207631874298541e-05,
+ "loss": 0.023999422788619995,
+ "step": 1053
+ },
+ {
+ "epoch": 5.324050632911392,
+ "grad_norm": 0.01724478043615818,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.013751897029578686,
+ "step": 1054
+ },
+ {
+ "epoch": 5.329113924050633,
+ "grad_norm": 0.05506094545125961,
+ "learning_rate": 5.196408529741863e-05,
+ "loss": 0.02599490061402321,
+ "step": 1055
+ },
+ {
+ "epoch": 5.334177215189873,
+ "grad_norm": 0.030050745233893394,
+ "learning_rate": 5.1907968574635247e-05,
+ "loss": 0.022996244952082634,
+ "step": 1056
+ },
+ {
+ "epoch": 5.339240506329114,
+ "grad_norm": 0.028648901730775833,
+ "learning_rate": 5.185185185185185e-05,
+ "loss": 0.024319645017385483,
+ "step": 1057
+ },
+ {
+ "epoch": 5.3443037974683545,
+ "grad_norm": 0.04159106686711311,
+ "learning_rate": 5.179573512906847e-05,
+ "loss": 0.02485204115509987,
+ "step": 1058
+ },
+ {
+ "epoch": 5.349367088607595,
+ "grad_norm": 0.04454904422163963,
+ "learning_rate": 5.173961840628507e-05,
+ "loss": 0.018921498209238052,
+ "step": 1059
+ },
+ {
+ "epoch": 5.3544303797468356,
+ "grad_norm": 0.05850376933813095,
+ "learning_rate": 5.168350168350169e-05,
+ "loss": 0.02758260816335678,
+ "step": 1060
+ },
+ {
+ "epoch": 5.359493670886076,
+ "grad_norm": 0.03319580852985382,
+ "learning_rate": 5.16273849607183e-05,
+ "loss": 0.02180345356464386,
+ "step": 1061
+ },
+ {
+ "epoch": 5.364556962025317,
+ "grad_norm": 0.046812329441308975,
+ "learning_rate": 5.1571268237934914e-05,
+ "loss": 0.021682530641555786,
+ "step": 1062
+ },
+ {
+ "epoch": 5.369620253164557,
+ "grad_norm": 0.028218183666467667,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.019677158445119858,
+ "step": 1063
+ },
+ {
+ "epoch": 5.374683544303798,
+ "grad_norm": 0.04918216913938522,
+ "learning_rate": 5.1459034792368134e-05,
+ "loss": 0.019348308444023132,
+ "step": 1064
+ },
+ {
+ "epoch": 5.379746835443038,
+ "grad_norm": 0.041713107377290726,
+ "learning_rate": 5.140291806958474e-05,
+ "loss": 0.01728012040257454,
+ "step": 1065
+ },
+ {
+ "epoch": 5.384810126582279,
+ "grad_norm": 0.034068260341882706,
+ "learning_rate": 5.1346801346801354e-05,
+ "loss": 0.020487628877162933,
+ "step": 1066
+ },
+ {
+ "epoch": 5.389873417721519,
+ "grad_norm": 0.028666919097304344,
+ "learning_rate": 5.129068462401796e-05,
+ "loss": 0.015318546444177628,
+ "step": 1067
+ },
+ {
+ "epoch": 5.39493670886076,
+ "grad_norm": 0.03828604146838188,
+ "learning_rate": 5.1234567901234574e-05,
+ "loss": 0.028930973261594772,
+ "step": 1068
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.01870056800544262,
+ "learning_rate": 5.1178451178451184e-05,
+ "loss": 0.015031076967716217,
+ "step": 1069
+ },
+ {
+ "epoch": 5.405063291139241,
+ "grad_norm": 0.02219143882393837,
+ "learning_rate": 5.112233445566779e-05,
+ "loss": 0.019569698721170425,
+ "step": 1070
+ },
+ {
+ "epoch": 5.410126582278481,
+ "grad_norm": 0.04418749734759331,
+ "learning_rate": 5.1066217732884404e-05,
+ "loss": 0.025913581252098083,
+ "step": 1071
+ },
+ {
+ "epoch": 5.415189873417722,
+ "grad_norm": 0.05946826562285423,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.03080957755446434,
+ "step": 1072
+ },
+ {
+ "epoch": 5.4202531645569625,
+ "grad_norm": 0.032025255262851715,
+ "learning_rate": 5.0953984287317624e-05,
+ "loss": 0.017155487090349197,
+ "step": 1073
+ },
+ {
+ "epoch": 5.425316455696202,
+ "grad_norm": 0.033507514744997025,
+ "learning_rate": 5.089786756453423e-05,
+ "loss": 0.022324759513139725,
+ "step": 1074
+ },
+ {
+ "epoch": 5.430379746835443,
+ "grad_norm": 0.025624485686421394,
+ "learning_rate": 5.0841750841750845e-05,
+ "loss": 0.021772298961877823,
+ "step": 1075
+ },
+ {
+ "epoch": 5.435443037974683,
+ "grad_norm": 0.055580489337444305,
+ "learning_rate": 5.078563411896745e-05,
+ "loss": 0.01938481442630291,
+ "step": 1076
+ },
+ {
+ "epoch": 5.440506329113924,
+ "grad_norm": 0.04581330716609955,
+ "learning_rate": 5.0729517396184065e-05,
+ "loss": 0.019239529967308044,
+ "step": 1077
+ },
+ {
+ "epoch": 5.445569620253164,
+ "grad_norm": 0.06254621595144272,
+ "learning_rate": 5.0673400673400675e-05,
+ "loss": 0.027182448655366898,
+ "step": 1078
+ },
+ {
+ "epoch": 5.450632911392405,
+ "grad_norm": 0.036759812384843826,
+ "learning_rate": 5.061728395061729e-05,
+ "loss": 0.027131710201501846,
+ "step": 1079
+ },
+ {
+ "epoch": 5.455696202531645,
+ "grad_norm": 0.03190915286540985,
+ "learning_rate": 5.0561167227833895e-05,
+ "loss": 0.0259249284863472,
+ "step": 1080
+ },
+ {
+ "epoch": 5.460759493670886,
+ "grad_norm": 0.03208916634321213,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.02531026303768158,
+ "step": 1081
+ },
+ {
+ "epoch": 5.465822784810126,
+ "grad_norm": 0.06676970422267914,
+ "learning_rate": 5.0448933782267115e-05,
+ "loss": 0.022145366296172142,
+ "step": 1082
+ },
+ {
+ "epoch": 5.470886075949367,
+ "grad_norm": 0.027604084461927414,
+ "learning_rate": 5.039281705948373e-05,
+ "loss": 0.018208740279078484,
+ "step": 1083
+ },
+ {
+ "epoch": 5.4759493670886075,
+ "grad_norm": 0.03812532126903534,
+ "learning_rate": 5.0336700336700335e-05,
+ "loss": 0.024251334369182587,
+ "step": 1084
+ },
+ {
+ "epoch": 5.481012658227848,
+ "grad_norm": 0.03016139566898346,
+ "learning_rate": 5.028058361391695e-05,
+ "loss": 0.02196047455072403,
+ "step": 1085
+ },
+ {
+ "epoch": 5.4860759493670885,
+ "grad_norm": 0.017749929800629616,
+ "learning_rate": 5.022446689113356e-05,
+ "loss": 0.01607266068458557,
+ "step": 1086
+ },
+ {
+ "epoch": 5.491139240506329,
+ "grad_norm": 0.023184901103377342,
+ "learning_rate": 5.016835016835017e-05,
+ "loss": 0.021226245909929276,
+ "step": 1087
+ },
+ {
+ "epoch": 5.49620253164557,
+ "grad_norm": 0.024662092328071594,
+ "learning_rate": 5.011223344556678e-05,
+ "loss": 0.019691254943609238,
+ "step": 1088
+ },
+ {
+ "epoch": 5.50126582278481,
+ "grad_norm": 0.05883142724633217,
+ "learning_rate": 5.00561167227834e-05,
+ "loss": 0.03039814904332161,
+ "step": 1089
+ },
+ {
+ "epoch": 5.506329113924051,
+ "grad_norm": 0.029918279498815536,
+ "learning_rate": 5e-05,
+ "loss": 0.022806301712989807,
+ "step": 1090
+ },
+ {
+ "epoch": 5.511392405063291,
+ "grad_norm": 0.023451462388038635,
+ "learning_rate": 4.994388327721661e-05,
+ "loss": 0.018920207396149635,
+ "step": 1091
+ },
+ {
+ "epoch": 5.516455696202532,
+ "grad_norm": 0.030591748654842377,
+ "learning_rate": 4.988776655443322e-05,
+ "loss": 0.024741975590586662,
+ "step": 1092
+ },
+ {
+ "epoch": 5.521518987341772,
+ "grad_norm": 0.020344361662864685,
+ "learning_rate": 4.983164983164983e-05,
+ "loss": 0.018007446080446243,
+ "step": 1093
+ },
+ {
+ "epoch": 5.526582278481013,
+ "grad_norm": 0.029899192973971367,
+ "learning_rate": 4.977553310886644e-05,
+ "loss": 0.02196051925420761,
+ "step": 1094
+ },
+ {
+ "epoch": 5.531645569620253,
+ "grad_norm": 0.030987054109573364,
+ "learning_rate": 4.971941638608306e-05,
+ "loss": 0.018726475536823273,
+ "step": 1095
+ },
+ {
+ "epoch": 5.536708860759494,
+ "grad_norm": 0.031603869050741196,
+ "learning_rate": 4.966329966329967e-05,
+ "loss": 0.027497179806232452,
+ "step": 1096
+ },
+ {
+ "epoch": 5.541772151898734,
+ "grad_norm": 0.041930630803108215,
+ "learning_rate": 4.960718294051628e-05,
+ "loss": 0.0274939127266407,
+ "step": 1097
+ },
+ {
+ "epoch": 5.546835443037975,
+ "grad_norm": 0.020828744396567345,
+ "learning_rate": 4.955106621773289e-05,
+ "loss": 0.020464252680540085,
+ "step": 1098
+ },
+ {
+ "epoch": 5.5518987341772155,
+ "grad_norm": 0.03408589959144592,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.024826694279909134,
+ "step": 1099
+ },
+ {
+ "epoch": 5.556962025316456,
+ "grad_norm": 0.03565233200788498,
+ "learning_rate": 4.943883277216611e-05,
+ "loss": 0.0297713503241539,
+ "step": 1100
+ },
+ {
+ "epoch": 5.5620253164556965,
+ "grad_norm": 0.03275191783905029,
+ "learning_rate": 4.938271604938271e-05,
+ "loss": 0.022985238581895828,
+ "step": 1101
+ },
+ {
+ "epoch": 5.567088607594937,
+ "grad_norm": 0.04215894266963005,
+ "learning_rate": 4.932659932659932e-05,
+ "loss": 0.020872686058282852,
+ "step": 1102
+ },
+ {
+ "epoch": 5.572151898734178,
+ "grad_norm": 0.03496193513274193,
+ "learning_rate": 4.927048260381594e-05,
+ "loss": 0.020619090646505356,
+ "step": 1103
+ },
+ {
+ "epoch": 5.577215189873417,
+ "grad_norm": 0.020121701061725616,
+ "learning_rate": 4.921436588103255e-05,
+ "loss": 0.017047466710209846,
+ "step": 1104
+ },
+ {
+ "epoch": 5.582278481012658,
+ "grad_norm": 0.02406349778175354,
+ "learning_rate": 4.915824915824916e-05,
+ "loss": 0.01753303036093712,
+ "step": 1105
+ },
+ {
+ "epoch": 5.587341772151898,
+ "grad_norm": 0.03804773837327957,
+ "learning_rate": 4.910213243546577e-05,
+ "loss": 0.026075419038534164,
+ "step": 1106
+ },
+ {
+ "epoch": 5.592405063291139,
+ "grad_norm": 0.024065209552645683,
+ "learning_rate": 4.904601571268238e-05,
+ "loss": 0.02253042347729206,
+ "step": 1107
+ },
+ {
+ "epoch": 5.597468354430379,
+ "grad_norm": 0.024677708745002747,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.02093282900750637,
+ "step": 1108
+ },
+ {
+ "epoch": 5.60253164556962,
+ "grad_norm": 0.022487351670861244,
+ "learning_rate": 4.89337822671156e-05,
+ "loss": 0.019194334745407104,
+ "step": 1109
+ },
+ {
+ "epoch": 5.6075949367088604,
+ "grad_norm": 0.023981913924217224,
+ "learning_rate": 4.887766554433221e-05,
+ "loss": 0.019715486094355583,
+ "step": 1110
+ },
+ {
+ "epoch": 5.612658227848101,
+ "grad_norm": 0.49088963866233826,
+ "learning_rate": 4.882154882154882e-05,
+ "loss": 0.01954624056816101,
+ "step": 1111
+ },
+ {
+ "epoch": 5.6177215189873415,
+ "grad_norm": 0.020698007196187973,
+ "learning_rate": 4.876543209876544e-05,
+ "loss": 0.0198826901614666,
+ "step": 1112
+ },
+ {
+ "epoch": 5.622784810126582,
+ "grad_norm": 0.030978364869952202,
+ "learning_rate": 4.870931537598205e-05,
+ "loss": 0.022201407700777054,
+ "step": 1113
+ },
+ {
+ "epoch": 5.627848101265823,
+ "grad_norm": 0.03610600158572197,
+ "learning_rate": 4.865319865319866e-05,
+ "loss": 0.020692896097898483,
+ "step": 1114
+ },
+ {
+ "epoch": 5.632911392405063,
+ "grad_norm": 0.03503869101405144,
+ "learning_rate": 4.859708193041527e-05,
+ "loss": 0.024315977469086647,
+ "step": 1115
+ },
+ {
+ "epoch": 5.637974683544304,
+ "grad_norm": 0.038263533264398575,
+ "learning_rate": 4.854096520763188e-05,
+ "loss": 0.02289794571697712,
+ "step": 1116
+ },
+ {
+ "epoch": 5.643037974683544,
+ "grad_norm": 0.06627792865037918,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.016900356858968735,
+ "step": 1117
+ },
+ {
+ "epoch": 5.648101265822785,
+ "grad_norm": 0.04108016937971115,
+ "learning_rate": 4.84287317620651e-05,
+ "loss": 0.026155930012464523,
+ "step": 1118
+ },
+ {
+ "epoch": 5.653164556962025,
+ "grad_norm": 0.027791379019618034,
+ "learning_rate": 4.837261503928171e-05,
+ "loss": 0.018122777342796326,
+ "step": 1119
+ },
+ {
+ "epoch": 5.658227848101266,
+ "grad_norm": 0.06097861006855965,
+ "learning_rate": 4.831649831649832e-05,
+ "loss": 0.022645950317382812,
+ "step": 1120
+ },
+ {
+ "epoch": 5.663291139240506,
+ "grad_norm": 0.06343472748994827,
+ "learning_rate": 4.8260381593714935e-05,
+ "loss": 0.029537659138441086,
+ "step": 1121
+ },
+ {
+ "epoch": 5.668354430379747,
+ "grad_norm": 0.05996944010257721,
+ "learning_rate": 4.8204264870931545e-05,
+ "loss": 0.02282993122935295,
+ "step": 1122
+ },
+ {
+ "epoch": 5.673417721518987,
+ "grad_norm": 0.030753644183278084,
+ "learning_rate": 4.814814814814815e-05,
+ "loss": 0.01835070736706257,
+ "step": 1123
+ },
+ {
+ "epoch": 5.678481012658228,
+ "grad_norm": 0.0284577663987875,
+ "learning_rate": 4.809203142536476e-05,
+ "loss": 0.019698038697242737,
+ "step": 1124
+ },
+ {
+ "epoch": 5.6835443037974684,
+ "grad_norm": 0.03136469051241875,
+ "learning_rate": 4.803591470258137e-05,
+ "loss": 0.018538501113653183,
+ "step": 1125
+ },
+ {
+ "epoch": 5.688607594936709,
+ "grad_norm": 0.042034219950437546,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.01609296351671219,
+ "step": 1126
+ },
+ {
+ "epoch": 5.6936708860759495,
+ "grad_norm": 0.04704117774963379,
+ "learning_rate": 4.792368125701459e-05,
+ "loss": 0.017442524433135986,
+ "step": 1127
+ },
+ {
+ "epoch": 5.69873417721519,
+ "grad_norm": 0.04261549562215805,
+ "learning_rate": 4.78675645342312e-05,
+ "loss": 0.022896092385053635,
+ "step": 1128
+ },
+ {
+ "epoch": 5.703797468354431,
+ "grad_norm": 0.035263415426015854,
+ "learning_rate": 4.7811447811447815e-05,
+ "loss": 0.02376401424407959,
+ "step": 1129
+ },
+ {
+ "epoch": 5.708860759493671,
+ "grad_norm": 0.029153654351830482,
+ "learning_rate": 4.7755331088664425e-05,
+ "loss": 0.019103601574897766,
+ "step": 1130
+ },
+ {
+ "epoch": 5.713924050632912,
+ "grad_norm": 0.024728860706090927,
+ "learning_rate": 4.7699214365881036e-05,
+ "loss": 0.019203007221221924,
+ "step": 1131
+ },
+ {
+ "epoch": 5.718987341772152,
+ "grad_norm": 0.0682872086763382,
+ "learning_rate": 4.7643097643097646e-05,
+ "loss": 0.023789528757333755,
+ "step": 1132
+ },
+ {
+ "epoch": 5.724050632911393,
+ "grad_norm": 0.03475257009267807,
+ "learning_rate": 4.7586980920314256e-05,
+ "loss": 0.01748424954712391,
+ "step": 1133
+ },
+ {
+ "epoch": 5.729113924050633,
+ "grad_norm": 0.03768116980791092,
+ "learning_rate": 4.7530864197530866e-05,
+ "loss": 0.019674118608236313,
+ "step": 1134
+ },
+ {
+ "epoch": 5.734177215189874,
+ "grad_norm": 0.06546973437070847,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.02400730922818184,
+ "step": 1135
+ },
+ {
+ "epoch": 5.739240506329114,
+ "grad_norm": 0.03348927944898605,
+ "learning_rate": 4.7418630751964086e-05,
+ "loss": 0.027110135182738304,
+ "step": 1136
+ },
+ {
+ "epoch": 5.744303797468355,
+ "grad_norm": 0.041038379073143005,
+ "learning_rate": 4.7362514029180696e-05,
+ "loss": 0.025943022221326828,
+ "step": 1137
+ },
+ {
+ "epoch": 5.749367088607595,
+ "grad_norm": 0.03094886802136898,
+ "learning_rate": 4.730639730639731e-05,
+ "loss": 0.018898673355579376,
+ "step": 1138
+ },
+ {
+ "epoch": 5.754430379746836,
+ "grad_norm": 0.03637633100152016,
+ "learning_rate": 4.725028058361392e-05,
+ "loss": 0.02247396484017372,
+ "step": 1139
+ },
+ {
+ "epoch": 5.759493670886076,
+ "grad_norm": 0.03672393038868904,
+ "learning_rate": 4.719416386083053e-05,
+ "loss": 0.02294430509209633,
+ "step": 1140
+ },
+ {
+ "epoch": 5.764556962025316,
+ "grad_norm": 0.03434748202562332,
+ "learning_rate": 4.713804713804714e-05,
+ "loss": 0.021498121321201324,
+ "step": 1141
+ },
+ {
+ "epoch": 5.769620253164557,
+ "grad_norm": 0.032241202890872955,
+ "learning_rate": 4.708193041526375e-05,
+ "loss": 0.02623910829424858,
+ "step": 1142
+ },
+ {
+ "epoch": 5.774683544303797,
+ "grad_norm": 0.028173472732305527,
+ "learning_rate": 4.702581369248036e-05,
+ "loss": 0.018390003591775894,
+ "step": 1143
+ },
+ {
+ "epoch": 5.779746835443038,
+ "grad_norm": 0.033768974244594574,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.022890064865350723,
+ "step": 1144
+ },
+ {
+ "epoch": 5.784810126582278,
+ "grad_norm": 0.03199310600757599,
+ "learning_rate": 4.691358024691358e-05,
+ "loss": 0.018634604290127754,
+ "step": 1145
+ },
+ {
+ "epoch": 5.789873417721519,
+ "grad_norm": 0.02942977100610733,
+ "learning_rate": 4.685746352413019e-05,
+ "loss": 0.021336350589990616,
+ "step": 1146
+ },
+ {
+ "epoch": 5.794936708860759,
+ "grad_norm": 0.026747260242700577,
+ "learning_rate": 4.68013468013468e-05,
+ "loss": 0.017634060233831406,
+ "step": 1147
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.052395813167095184,
+ "learning_rate": 4.6745230078563413e-05,
+ "loss": 0.019521519541740417,
+ "step": 1148
+ },
+ {
+ "epoch": 5.80506329113924,
+ "grad_norm": 0.07997749745845795,
+ "learning_rate": 4.6689113355780024e-05,
+ "loss": 0.027218502014875412,
+ "step": 1149
+ },
+ {
+ "epoch": 5.810126582278481,
+ "grad_norm": 0.04570790380239487,
+ "learning_rate": 4.6632996632996634e-05,
+ "loss": 0.027033157646656036,
+ "step": 1150
+ },
+ {
+ "epoch": 5.815189873417721,
+ "grad_norm": 0.05992640554904938,
+ "learning_rate": 4.6576879910213244e-05,
+ "loss": 0.020755816251039505,
+ "step": 1151
+ },
+ {
+ "epoch": 5.820253164556962,
+ "grad_norm": 0.03377217426896095,
+ "learning_rate": 4.6520763187429854e-05,
+ "loss": 0.019246265292167664,
+ "step": 1152
+ },
+ {
+ "epoch": 5.8253164556962025,
+ "grad_norm": 0.026675008237361908,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.019907813519239426,
+ "step": 1153
+ },
+ {
+ "epoch": 5.830379746835443,
+ "grad_norm": 0.04007306694984436,
+ "learning_rate": 4.6408529741863074e-05,
+ "loss": 0.02621765062212944,
+ "step": 1154
+ },
+ {
+ "epoch": 5.8354430379746836,
+ "grad_norm": 0.05345958471298218,
+ "learning_rate": 4.635241301907969e-05,
+ "loss": 0.021677743643522263,
+ "step": 1155
+ },
+ {
+ "epoch": 5.840506329113924,
+ "grad_norm": 0.03231236711144447,
+ "learning_rate": 4.62962962962963e-05,
+ "loss": 0.01898232102394104,
+ "step": 1156
+ },
+ {
+ "epoch": 5.845569620253165,
+ "grad_norm": 0.06332266330718994,
+ "learning_rate": 4.624017957351291e-05,
+ "loss": 0.022123044356703758,
+ "step": 1157
+ },
+ {
+ "epoch": 5.850632911392405,
+ "grad_norm": 0.017904918640851974,
+ "learning_rate": 4.618406285072952e-05,
+ "loss": 0.016008764505386353,
+ "step": 1158
+ },
+ {
+ "epoch": 5.855696202531646,
+ "grad_norm": 0.032957062125205994,
+ "learning_rate": 4.612794612794613e-05,
+ "loss": 0.026430988684296608,
+ "step": 1159
+ },
+ {
+ "epoch": 5.860759493670886,
+ "grad_norm": 0.02764013037085533,
+ "learning_rate": 4.607182940516274e-05,
+ "loss": 0.01749669760465622,
+ "step": 1160
+ },
+ {
+ "epoch": 5.865822784810127,
+ "grad_norm": 0.031616635620594025,
+ "learning_rate": 4.601571268237935e-05,
+ "loss": 0.022402513772249222,
+ "step": 1161
+ },
+ {
+ "epoch": 5.870886075949367,
+ "grad_norm": 0.026803012937307358,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.02391771227121353,
+ "step": 1162
+ },
+ {
+ "epoch": 5.875949367088608,
+ "grad_norm": 0.039992235600948334,
+ "learning_rate": 4.590347923681257e-05,
+ "loss": 0.0186441782861948,
+ "step": 1163
+ },
+ {
+ "epoch": 5.881012658227848,
+ "grad_norm": 0.034594062715768814,
+ "learning_rate": 4.584736251402919e-05,
+ "loss": 0.020437058061361313,
+ "step": 1164
+ },
+ {
+ "epoch": 5.886075949367089,
+ "grad_norm": 0.01877710409462452,
+ "learning_rate": 4.57912457912458e-05,
+ "loss": 0.01517703477293253,
+ "step": 1165
+ },
+ {
+ "epoch": 5.891139240506329,
+ "grad_norm": 0.021410809829831123,
+ "learning_rate": 4.573512906846241e-05,
+ "loss": 0.021264132112264633,
+ "step": 1166
+ },
+ {
+ "epoch": 5.89620253164557,
+ "grad_norm": 0.04017850384116173,
+ "learning_rate": 4.567901234567901e-05,
+ "loss": 0.024904146790504456,
+ "step": 1167
+ },
+ {
+ "epoch": 5.9012658227848105,
+ "grad_norm": 0.030386412516236305,
+ "learning_rate": 4.562289562289562e-05,
+ "loss": 0.02334582805633545,
+ "step": 1168
+ },
+ {
+ "epoch": 5.90632911392405,
+ "grad_norm": 0.043996457010507584,
+ "learning_rate": 4.556677890011223e-05,
+ "loss": 0.02326396480202675,
+ "step": 1169
+ },
+ {
+ "epoch": 5.911392405063291,
+ "grad_norm": 0.028154531493782997,
+ "learning_rate": 4.551066217732884e-05,
+ "loss": 0.019153760746121407,
+ "step": 1170
+ },
+ {
+ "epoch": 5.916455696202531,
+ "grad_norm": 0.02629070170223713,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.02149396575987339,
+ "step": 1171
+ },
+ {
+ "epoch": 5.921518987341772,
+ "grad_norm": 0.024712109938263893,
+ "learning_rate": 4.539842873176207e-05,
+ "loss": 0.01731209270656109,
+ "step": 1172
+ },
+ {
+ "epoch": 5.926582278481012,
+ "grad_norm": 0.027591124176979065,
+ "learning_rate": 4.534231200897868e-05,
+ "loss": 0.018549319356679916,
+ "step": 1173
+ },
+ {
+ "epoch": 5.931645569620253,
+ "grad_norm": 0.025680841878056526,
+ "learning_rate": 4.528619528619529e-05,
+ "loss": 0.019339032471179962,
+ "step": 1174
+ },
+ {
+ "epoch": 5.936708860759493,
+ "grad_norm": 0.0393349826335907,
+ "learning_rate": 4.52300785634119e-05,
+ "loss": 0.026176627725362778,
+ "step": 1175
+ },
+ {
+ "epoch": 5.941772151898734,
+ "grad_norm": 0.028960758820176125,
+ "learning_rate": 4.517396184062851e-05,
+ "loss": 0.020635023713111877,
+ "step": 1176
+ },
+ {
+ "epoch": 5.946835443037974,
+ "grad_norm": 0.038171909749507904,
+ "learning_rate": 4.511784511784512e-05,
+ "loss": 0.025552934035658836,
+ "step": 1177
+ },
+ {
+ "epoch": 5.951898734177215,
+ "grad_norm": 0.0229384396225214,
+ "learning_rate": 4.506172839506173e-05,
+ "loss": 0.016696415841579437,
+ "step": 1178
+ },
+ {
+ "epoch": 5.9569620253164555,
+ "grad_norm": 0.03247852623462677,
+ "learning_rate": 4.500561167227834e-05,
+ "loss": 0.020189210772514343,
+ "step": 1179
+ },
+ {
+ "epoch": 5.962025316455696,
+ "grad_norm": 0.09168937802314758,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.02350265346467495,
+ "step": 1180
+ },
+ {
+ "epoch": 5.9670886075949365,
+ "grad_norm": 0.0498431995511055,
+ "learning_rate": 4.4893378226711566e-05,
+ "loss": 0.025292757898569107,
+ "step": 1181
+ },
+ {
+ "epoch": 5.972151898734177,
+ "grad_norm": 0.027248093858361244,
+ "learning_rate": 4.4837261503928176e-05,
+ "loss": 0.022255534306168556,
+ "step": 1182
+ },
+ {
+ "epoch": 5.977215189873418,
+ "grad_norm": 0.0405442975461483,
+ "learning_rate": 4.4781144781144786e-05,
+ "loss": 0.029488639906048775,
+ "step": 1183
+ },
+ {
+ "epoch": 5.982278481012658,
+ "grad_norm": 0.032689113169908524,
+ "learning_rate": 4.4725028058361396e-05,
+ "loss": 0.02393949031829834,
+ "step": 1184
+ },
+ {
+ "epoch": 5.987341772151899,
+ "grad_norm": 0.0387105718255043,
+ "learning_rate": 4.4668911335578006e-05,
+ "loss": 0.02393876016139984,
+ "step": 1185
+ },
+ {
+ "epoch": 5.992405063291139,
+ "grad_norm": 0.03787006437778473,
+ "learning_rate": 4.4612794612794616e-05,
+ "loss": 0.019787393510341644,
+ "step": 1186
+ },
+ {
+ "epoch": 5.99746835443038,
+ "grad_norm": 0.07046152651309967,
+ "learning_rate": 4.4556677890011226e-05,
+ "loss": 0.02120082452893257,
+ "step": 1187
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.04410094395279884,
+ "learning_rate": 4.4500561167227837e-05,
+ "loss": 0.01791391335427761,
+ "step": 1188
+ },
+ {
+ "epoch": 6.0050632911392405,
+ "grad_norm": 0.01917901448905468,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.01695849373936653,
+ "step": 1189
+ },
+ {
+ "epoch": 6.010126582278481,
+ "grad_norm": 0.036047060042619705,
+ "learning_rate": 4.438832772166106e-05,
+ "loss": 0.019642764702439308,
+ "step": 1190
+ },
+ {
+ "epoch": 6.015189873417722,
+ "grad_norm": 0.03756589815020561,
+ "learning_rate": 4.433221099887767e-05,
+ "loss": 0.01982583850622177,
+ "step": 1191
+ },
+ {
+ "epoch": 6.020253164556962,
+ "grad_norm": 0.04311134293675423,
+ "learning_rate": 4.427609427609428e-05,
+ "loss": 0.020853077992796898,
+ "step": 1192
+ },
+ {
+ "epoch": 6.025316455696203,
+ "grad_norm": 0.03493127599358559,
+ "learning_rate": 4.421997755331089e-05,
+ "loss": 0.022622421383857727,
+ "step": 1193
+ },
+ {
+ "epoch": 6.030379746835443,
+ "grad_norm": 0.05356646701693535,
+ "learning_rate": 4.41638608305275e-05,
+ "loss": 0.029369797557592392,
+ "step": 1194
+ },
+ {
+ "epoch": 6.035443037974684,
+ "grad_norm": 0.024938970804214478,
+ "learning_rate": 4.410774410774411e-05,
+ "loss": 0.02220488339662552,
+ "step": 1195
+ },
+ {
+ "epoch": 6.040506329113924,
+ "grad_norm": 0.03809231147170067,
+ "learning_rate": 4.405162738496072e-05,
+ "loss": 0.018828250467777252,
+ "step": 1196
+ },
+ {
+ "epoch": 6.045569620253165,
+ "grad_norm": 0.026176417246460915,
+ "learning_rate": 4.3995510662177334e-05,
+ "loss": 0.020378272980451584,
+ "step": 1197
+ },
+ {
+ "epoch": 6.050632911392405,
+ "grad_norm": 0.022295907139778137,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.016497395932674408,
+ "step": 1198
+ },
+ {
+ "epoch": 6.055696202531646,
+ "grad_norm": 0.03591796010732651,
+ "learning_rate": 4.3883277216610554e-05,
+ "loss": 0.01610766164958477,
+ "step": 1199
+ },
+ {
+ "epoch": 6.060759493670886,
+ "grad_norm": 0.02228034846484661,
+ "learning_rate": 4.3827160493827164e-05,
+ "loss": 0.016445940360426903,
+ "step": 1200
+ },
+ {
+ "epoch": 6.065822784810127,
+ "grad_norm": 0.046840816736221313,
+ "learning_rate": 4.3771043771043774e-05,
+ "loss": 0.025499895215034485,
+ "step": 1201
+ },
+ {
+ "epoch": 6.0708860759493675,
+ "grad_norm": 0.032549306750297546,
+ "learning_rate": 4.3714927048260384e-05,
+ "loss": 0.019290868192911148,
+ "step": 1202
+ },
+ {
+ "epoch": 6.075949367088608,
+ "grad_norm": 0.027548272162675858,
+ "learning_rate": 4.3658810325476994e-05,
+ "loss": 0.021467119455337524,
+ "step": 1203
+ },
+ {
+ "epoch": 6.0810126582278485,
+ "grad_norm": 0.04975379258394241,
+ "learning_rate": 4.3602693602693604e-05,
+ "loss": 0.025195952504873276,
+ "step": 1204
+ },
+ {
+ "epoch": 6.086075949367088,
+ "grad_norm": 0.033716000616550446,
+ "learning_rate": 4.3546576879910214e-05,
+ "loss": 0.022922039031982422,
+ "step": 1205
+ },
+ {
+ "epoch": 6.091139240506329,
+ "grad_norm": 0.0233322661370039,
+ "learning_rate": 4.3490460157126825e-05,
+ "loss": 0.016717061400413513,
+ "step": 1206
+ },
+ {
+ "epoch": 6.096202531645569,
+ "grad_norm": 0.037477824836969376,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.026978954672813416,
+ "step": 1207
+ },
+ {
+ "epoch": 6.10126582278481,
+ "grad_norm": 0.028440799564123154,
+ "learning_rate": 4.337822671156005e-05,
+ "loss": 0.02273373492062092,
+ "step": 1208
+ },
+ {
+ "epoch": 6.10632911392405,
+ "grad_norm": 0.035822827368974686,
+ "learning_rate": 4.332210998877666e-05,
+ "loss": 0.023257501423358917,
+ "step": 1209
+ },
+ {
+ "epoch": 6.111392405063291,
+ "grad_norm": 0.04019193351268768,
+ "learning_rate": 4.3265993265993265e-05,
+ "loss": 0.023539364337921143,
+ "step": 1210
+ },
+ {
+ "epoch": 6.116455696202531,
+ "grad_norm": 0.05412938818335533,
+ "learning_rate": 4.3209876543209875e-05,
+ "loss": 0.027814611792564392,
+ "step": 1211
+ },
+ {
+ "epoch": 6.121518987341772,
+ "grad_norm": 0.02482062578201294,
+ "learning_rate": 4.3153759820426485e-05,
+ "loss": 0.02218860387802124,
+ "step": 1212
+ },
+ {
+ "epoch": 6.1265822784810124,
+ "grad_norm": 0.0334421806037426,
+ "learning_rate": 4.3097643097643095e-05,
+ "loss": 0.017350582405924797,
+ "step": 1213
+ },
+ {
+ "epoch": 6.131645569620253,
+ "grad_norm": 0.056203264743089676,
+ "learning_rate": 4.304152637485971e-05,
+ "loss": 0.02287295088171959,
+ "step": 1214
+ },
+ {
+ "epoch": 6.1367088607594935,
+ "grad_norm": 0.039818573743104935,
+ "learning_rate": 4.298540965207632e-05,
+ "loss": 0.020514609292149544,
+ "step": 1215
+ },
+ {
+ "epoch": 6.141772151898734,
+ "grad_norm": 0.04640622064471245,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.024438779801130295,
+ "step": 1216
+ },
+ {
+ "epoch": 6.146835443037975,
+ "grad_norm": 0.029660161584615707,
+ "learning_rate": 4.287317620650954e-05,
+ "loss": 0.02020389772951603,
+ "step": 1217
+ },
+ {
+ "epoch": 6.151898734177215,
+ "grad_norm": 0.03027571365237236,
+ "learning_rate": 4.281705948372615e-05,
+ "loss": 0.020769162103533745,
+ "step": 1218
+ },
+ {
+ "epoch": 6.156962025316456,
+ "grad_norm": 0.03282143920660019,
+ "learning_rate": 4.276094276094276e-05,
+ "loss": 0.02164040133357048,
+ "step": 1219
+ },
+ {
+ "epoch": 6.162025316455696,
+ "grad_norm": 0.025130681693553925,
+ "learning_rate": 4.270482603815937e-05,
+ "loss": 0.01677907630801201,
+ "step": 1220
+ },
+ {
+ "epoch": 6.167088607594937,
+ "grad_norm": 0.031690534204244614,
+ "learning_rate": 4.264870931537598e-05,
+ "loss": 0.024241283535957336,
+ "step": 1221
+ },
+ {
+ "epoch": 6.172151898734177,
+ "grad_norm": 0.03872871398925781,
+ "learning_rate": 4.259259259259259e-05,
+ "loss": 0.021466728299856186,
+ "step": 1222
+ },
+ {
+ "epoch": 6.177215189873418,
+ "grad_norm": 0.025186678394675255,
+ "learning_rate": 4.253647586980921e-05,
+ "loss": 0.01849488914012909,
+ "step": 1223
+ },
+ {
+ "epoch": 6.182278481012658,
+ "grad_norm": 0.0362236425280571,
+ "learning_rate": 4.248035914702582e-05,
+ "loss": 0.023382779210805893,
+ "step": 1224
+ },
+ {
+ "epoch": 6.187341772151899,
+ "grad_norm": 0.03484080359339714,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.02402529865503311,
+ "step": 1225
+ },
+ {
+ "epoch": 6.192405063291139,
+ "grad_norm": 0.030236870050430298,
+ "learning_rate": 4.236812570145904e-05,
+ "loss": 0.02027088962495327,
+ "step": 1226
+ },
+ {
+ "epoch": 6.19746835443038,
+ "grad_norm": 0.042696740478277206,
+ "learning_rate": 4.231200897867565e-05,
+ "loss": 0.026293184608221054,
+ "step": 1227
+ },
+ {
+ "epoch": 6.2025316455696204,
+ "grad_norm": 0.033474963158369064,
+ "learning_rate": 4.225589225589226e-05,
+ "loss": 0.0192638598382473,
+ "step": 1228
+ },
+ {
+ "epoch": 6.207594936708861,
+ "grad_norm": 0.02278994210064411,
+ "learning_rate": 4.219977553310887e-05,
+ "loss": 0.016719598323106766,
+ "step": 1229
+ },
+ {
+ "epoch": 6.2126582278481015,
+ "grad_norm": 0.02794811874628067,
+ "learning_rate": 4.214365881032548e-05,
+ "loss": 0.02083922177553177,
+ "step": 1230
+ },
+ {
+ "epoch": 6.217721518987342,
+ "grad_norm": 0.036294132471084595,
+ "learning_rate": 4.208754208754209e-05,
+ "loss": 0.019131788983941078,
+ "step": 1231
+ },
+ {
+ "epoch": 6.222784810126583,
+ "grad_norm": 0.04194558039307594,
+ "learning_rate": 4.20314253647587e-05,
+ "loss": 0.02200900763273239,
+ "step": 1232
+ },
+ {
+ "epoch": 6.227848101265823,
+ "grad_norm": 0.031245706602931023,
+ "learning_rate": 4.197530864197531e-05,
+ "loss": 0.020135007798671722,
+ "step": 1233
+ },
+ {
+ "epoch": 6.232911392405064,
+ "grad_norm": 0.28146594762802124,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.028484351933002472,
+ "step": 1234
+ },
+ {
+ "epoch": 6.237974683544304,
+ "grad_norm": 0.03472084552049637,
+ "learning_rate": 4.186307519640853e-05,
+ "loss": 0.022836994379758835,
+ "step": 1235
+ },
+ {
+ "epoch": 6.243037974683545,
+ "grad_norm": 0.03993033990263939,
+ "learning_rate": 4.180695847362514e-05,
+ "loss": 0.02047956921160221,
+ "step": 1236
+ },
+ {
+ "epoch": 6.248101265822784,
+ "grad_norm": 0.04095892980694771,
+ "learning_rate": 4.175084175084175e-05,
+ "loss": 0.02556988038122654,
+ "step": 1237
+ },
+ {
+ "epoch": 6.253164556962025,
+ "grad_norm": 0.025003930553793907,
+ "learning_rate": 4.169472502805836e-05,
+ "loss": 0.02012123167514801,
+ "step": 1238
+ },
+ {
+ "epoch": 6.258227848101265,
+ "grad_norm": 0.13136205077171326,
+ "learning_rate": 4.163860830527497e-05,
+ "loss": 0.02262711711227894,
+ "step": 1239
+ },
+ {
+ "epoch": 6.263291139240506,
+ "grad_norm": 0.030299177393317223,
+ "learning_rate": 4.158249158249159e-05,
+ "loss": 0.02208639681339264,
+ "step": 1240
+ },
+ {
+ "epoch": 6.2683544303797465,
+ "grad_norm": 0.029313303530216217,
+ "learning_rate": 4.15263748597082e-05,
+ "loss": 0.01897791400551796,
+ "step": 1241
+ },
+ {
+ "epoch": 6.273417721518987,
+ "grad_norm": 0.02532120980322361,
+ "learning_rate": 4.147025813692481e-05,
+ "loss": 0.017832642421126366,
+ "step": 1242
+ },
+ {
+ "epoch": 6.2784810126582276,
+ "grad_norm": 0.03251331299543381,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.018247608095407486,
+ "step": 1243
+ },
+ {
+ "epoch": 6.283544303797468,
+ "grad_norm": 0.022575413808226585,
+ "learning_rate": 4.135802469135803e-05,
+ "loss": 0.018954705446958542,
+ "step": 1244
+ },
+ {
+ "epoch": 6.288607594936709,
+ "grad_norm": 0.039219100028276443,
+ "learning_rate": 4.130190796857464e-05,
+ "loss": 0.024930771440267563,
+ "step": 1245
+ },
+ {
+ "epoch": 6.293670886075949,
+ "grad_norm": 0.0373169481754303,
+ "learning_rate": 4.124579124579125e-05,
+ "loss": 0.01826397515833378,
+ "step": 1246
+ },
+ {
+ "epoch": 6.29873417721519,
+ "grad_norm": 0.027518540620803833,
+ "learning_rate": 4.118967452300786e-05,
+ "loss": 0.019876884296536446,
+ "step": 1247
+ },
+ {
+ "epoch": 6.30379746835443,
+ "grad_norm": 0.0396210178732872,
+ "learning_rate": 4.113355780022447e-05,
+ "loss": 0.025219090282917023,
+ "step": 1248
+ },
+ {
+ "epoch": 6.308860759493671,
+ "grad_norm": 0.08618787676095963,
+ "learning_rate": 4.1077441077441085e-05,
+ "loss": 0.023020410910248756,
+ "step": 1249
+ },
+ {
+ "epoch": 6.313924050632911,
+ "grad_norm": 0.029861560091376305,
+ "learning_rate": 4.1021324354657695e-05,
+ "loss": 0.017338024452328682,
+ "step": 1250
+ },
+ {
+ "epoch": 6.318987341772152,
+ "grad_norm": 0.02950313501060009,
+ "learning_rate": 4.0965207631874305e-05,
+ "loss": 0.02082744613289833,
+ "step": 1251
+ },
+ {
+ "epoch": 6.324050632911392,
+ "grad_norm": 0.04144814610481262,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.022624965757131577,
+ "step": 1252
+ },
+ {
+ "epoch": 6.329113924050633,
+ "grad_norm": 0.026044249534606934,
+ "learning_rate": 4.085297418630752e-05,
+ "loss": 0.021008584648370743,
+ "step": 1253
+ },
+ {
+ "epoch": 6.334177215189873,
+ "grad_norm": 0.022971170023083687,
+ "learning_rate": 4.079685746352413e-05,
+ "loss": 0.017941180616617203,
+ "step": 1254
+ },
+ {
+ "epoch": 6.339240506329114,
+ "grad_norm": 0.06906288862228394,
+ "learning_rate": 4.074074074074074e-05,
+ "loss": 0.028001971542835236,
+ "step": 1255
+ },
+ {
+ "epoch": 6.3443037974683545,
+ "grad_norm": 0.023604001849889755,
+ "learning_rate": 4.068462401795735e-05,
+ "loss": 0.01718234084546566,
+ "step": 1256
+ },
+ {
+ "epoch": 6.349367088607595,
+ "grad_norm": 0.01937725767493248,
+ "learning_rate": 4.0628507295173965e-05,
+ "loss": 0.014251970686018467,
+ "step": 1257
+ },
+ {
+ "epoch": 6.3544303797468356,
+ "grad_norm": 0.029861370101571083,
+ "learning_rate": 4.0572390572390575e-05,
+ "loss": 0.020723488181829453,
+ "step": 1258
+ },
+ {
+ "epoch": 6.359493670886076,
+ "grad_norm": 0.021436452865600586,
+ "learning_rate": 4.0516273849607185e-05,
+ "loss": 0.017737478017807007,
+ "step": 1259
+ },
+ {
+ "epoch": 6.364556962025317,
+ "grad_norm": 0.028320396319031715,
+ "learning_rate": 4.0460157126823795e-05,
+ "loss": 0.018616296350955963,
+ "step": 1260
+ },
+ {
+ "epoch": 6.369620253164557,
+ "grad_norm": 0.06868637353181839,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.021761005744338036,
+ "step": 1261
+ },
+ {
+ "epoch": 6.374683544303798,
+ "grad_norm": 0.051593340933322906,
+ "learning_rate": 4.0347923681257015e-05,
+ "loss": 0.024777185171842575,
+ "step": 1262
+ },
+ {
+ "epoch": 6.379746835443038,
+ "grad_norm": 0.03426795080304146,
+ "learning_rate": 4.0291806958473625e-05,
+ "loss": 0.018097344785928726,
+ "step": 1263
+ },
+ {
+ "epoch": 6.384810126582279,
+ "grad_norm": 0.029523326084017754,
+ "learning_rate": 4.0235690235690236e-05,
+ "loss": 0.021459240466356277,
+ "step": 1264
+ },
+ {
+ "epoch": 6.389873417721519,
+ "grad_norm": 0.0349370501935482,
+ "learning_rate": 4.0179573512906846e-05,
+ "loss": 0.02003314346075058,
+ "step": 1265
+ },
+ {
+ "epoch": 6.39493670886076,
+ "grad_norm": 0.03242987021803856,
+ "learning_rate": 4.012345679012346e-05,
+ "loss": 0.021367881447076797,
+ "step": 1266
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.024630239233374596,
+ "learning_rate": 4.006734006734007e-05,
+ "loss": 0.018102720379829407,
+ "step": 1267
+ },
+ {
+ "epoch": 6.405063291139241,
+ "grad_norm": 0.031077086925506592,
+ "learning_rate": 4.001122334455668e-05,
+ "loss": 0.018588688224554062,
+ "step": 1268
+ },
+ {
+ "epoch": 6.410126582278481,
+ "grad_norm": 0.027421677485108376,
+ "learning_rate": 3.995510662177329e-05,
+ "loss": 0.02185939997434616,
+ "step": 1269
+ },
+ {
+ "epoch": 6.415189873417722,
+ "grad_norm": 0.025877851992845535,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.014880839735269547,
+ "step": 1270
+ },
+ {
+ "epoch": 6.4202531645569625,
+ "grad_norm": 0.06078079342842102,
+ "learning_rate": 3.984287317620651e-05,
+ "loss": 0.020707489922642708,
+ "step": 1271
+ },
+ {
+ "epoch": 6.425316455696202,
+ "grad_norm": 0.037427812814712524,
+ "learning_rate": 3.978675645342312e-05,
+ "loss": 0.019588246941566467,
+ "step": 1272
+ },
+ {
+ "epoch": 6.430379746835443,
+ "grad_norm": 0.021001679822802544,
+ "learning_rate": 3.973063973063973e-05,
+ "loss": 0.01820206455886364,
+ "step": 1273
+ },
+ {
+ "epoch": 6.435443037974683,
+ "grad_norm": 0.05302223563194275,
+ "learning_rate": 3.967452300785634e-05,
+ "loss": 0.028976645320653915,
+ "step": 1274
+ },
+ {
+ "epoch": 6.440506329113924,
+ "grad_norm": 0.021593907848000526,
+ "learning_rate": 3.961840628507295e-05,
+ "loss": 0.018273863941431046,
+ "step": 1275
+ },
+ {
+ "epoch": 6.445569620253164,
+ "grad_norm": 0.05006744712591171,
+ "learning_rate": 3.956228956228956e-05,
+ "loss": 0.020786389708518982,
+ "step": 1276
+ },
+ {
+ "epoch": 6.450632911392405,
+ "grad_norm": 0.025030262768268585,
+ "learning_rate": 3.950617283950617e-05,
+ "loss": 0.017760692164301872,
+ "step": 1277
+ },
+ {
+ "epoch": 6.455696202531645,
+ "grad_norm": 0.04701874032616615,
+ "learning_rate": 3.945005611672278e-05,
+ "loss": 0.029284045100212097,
+ "step": 1278
+ },
+ {
+ "epoch": 6.460759493670886,
+ "grad_norm": 0.032726943492889404,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.02018846571445465,
+ "step": 1279
+ },
+ {
+ "epoch": 6.465822784810126,
+ "grad_norm": 0.039836980402469635,
+ "learning_rate": 3.9337822671156003e-05,
+ "loss": 0.01897161826491356,
+ "step": 1280
+ },
+ {
+ "epoch": 6.470886075949367,
+ "grad_norm": 0.033106207847595215,
+ "learning_rate": 3.9281705948372613e-05,
+ "loss": 0.01981613039970398,
+ "step": 1281
+ },
+ {
+ "epoch": 6.4759493670886075,
+ "grad_norm": 0.024439049884676933,
+ "learning_rate": 3.9225589225589224e-05,
+ "loss": 0.018410254269838333,
+ "step": 1282
+ },
+ {
+ "epoch": 6.481012658227848,
+ "grad_norm": 0.025965489447116852,
+ "learning_rate": 3.916947250280584e-05,
+ "loss": 0.02004053071141243,
+ "step": 1283
+ },
+ {
+ "epoch": 6.4860759493670885,
+ "grad_norm": 0.02710670977830887,
+ "learning_rate": 3.911335578002245e-05,
+ "loss": 0.022794827818870544,
+ "step": 1284
+ },
+ {
+ "epoch": 6.491139240506329,
+ "grad_norm": 0.04063912108540535,
+ "learning_rate": 3.905723905723906e-05,
+ "loss": 0.022095832973718643,
+ "step": 1285
+ },
+ {
+ "epoch": 6.49620253164557,
+ "grad_norm": 0.02844894304871559,
+ "learning_rate": 3.900112233445567e-05,
+ "loss": 0.02208099141716957,
+ "step": 1286
+ },
+ {
+ "epoch": 6.50126582278481,
+ "grad_norm": 0.042183391749858856,
+ "learning_rate": 3.894500561167228e-05,
+ "loss": 0.022891748696565628,
+ "step": 1287
+ },
+ {
+ "epoch": 6.506329113924051,
+ "grad_norm": 0.03206615149974823,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.01791396550834179,
+ "step": 1288
+ },
+ {
+ "epoch": 6.511392405063291,
+ "grad_norm": 0.20604346692562103,
+ "learning_rate": 3.88327721661055e-05,
+ "loss": 0.021381299942731857,
+ "step": 1289
+ },
+ {
+ "epoch": 6.516455696202532,
+ "grad_norm": 0.040892940014600754,
+ "learning_rate": 3.877665544332211e-05,
+ "loss": 0.027452345937490463,
+ "step": 1290
+ },
+ {
+ "epoch": 6.521518987341772,
+ "grad_norm": 0.036108002066612244,
+ "learning_rate": 3.872053872053872e-05,
+ "loss": 0.02328622341156006,
+ "step": 1291
+ },
+ {
+ "epoch": 6.526582278481013,
+ "grad_norm": 0.0261856522411108,
+ "learning_rate": 3.866442199775534e-05,
+ "loss": 0.019690997898578644,
+ "step": 1292
+ },
+ {
+ "epoch": 6.531645569620253,
+ "grad_norm": 0.03961426392197609,
+ "learning_rate": 3.860830527497195e-05,
+ "loss": 0.0222979336977005,
+ "step": 1293
+ },
+ {
+ "epoch": 6.536708860759494,
+ "grad_norm": 0.04051761329174042,
+ "learning_rate": 3.855218855218856e-05,
+ "loss": 0.025474993512034416,
+ "step": 1294
+ },
+ {
+ "epoch": 6.541772151898734,
+ "grad_norm": 0.02267736941576004,
+ "learning_rate": 3.849607182940517e-05,
+ "loss": 0.022006051614880562,
+ "step": 1295
+ },
+ {
+ "epoch": 6.546835443037975,
+ "grad_norm": 0.030732441693544388,
+ "learning_rate": 3.843995510662178e-05,
+ "loss": 0.019268793985247612,
+ "step": 1296
+ },
+ {
+ "epoch": 6.5518987341772155,
+ "grad_norm": 0.028448719531297684,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.022158455103635788,
+ "step": 1297
+ },
+ {
+ "epoch": 6.556962025316456,
+ "grad_norm": 0.03139292076230049,
+ "learning_rate": 3.832772166105499e-05,
+ "loss": 0.022079430520534515,
+ "step": 1298
+ },
+ {
+ "epoch": 6.5620253164556965,
+ "grad_norm": 0.031093589961528778,
+ "learning_rate": 3.82716049382716e-05,
+ "loss": 0.018232567235827446,
+ "step": 1299
+ },
+ {
+ "epoch": 6.567088607594937,
+ "grad_norm": 0.05002875253558159,
+ "learning_rate": 3.821548821548822e-05,
+ "loss": 0.025977667421102524,
+ "step": 1300
+ },
+ {
+ "epoch": 6.572151898734178,
+ "grad_norm": 0.022760825231671333,
+ "learning_rate": 3.815937149270483e-05,
+ "loss": 0.01952279731631279,
+ "step": 1301
+ },
+ {
+ "epoch": 6.577215189873417,
+ "grad_norm": 0.038710758090019226,
+ "learning_rate": 3.810325476992144e-05,
+ "loss": 0.018337469547986984,
+ "step": 1302
+ },
+ {
+ "epoch": 6.582278481012658,
+ "grad_norm": 0.03606388345360756,
+ "learning_rate": 3.804713804713805e-05,
+ "loss": 0.022117454558610916,
+ "step": 1303
+ },
+ {
+ "epoch": 6.587341772151898,
+ "grad_norm": 0.0337548591196537,
+ "learning_rate": 3.799102132435466e-05,
+ "loss": 0.021384209394454956,
+ "step": 1304
+ },
+ {
+ "epoch": 6.592405063291139,
+ "grad_norm": 0.03523571416735649,
+ "learning_rate": 3.793490460157127e-05,
+ "loss": 0.017840903252363205,
+ "step": 1305
+ },
+ {
+ "epoch": 6.597468354430379,
+ "grad_norm": 0.06067586690187454,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.024789758026599884,
+ "step": 1306
+ },
+ {
+ "epoch": 6.60253164556962,
+ "grad_norm": 0.03350597992539406,
+ "learning_rate": 3.782267115600449e-05,
+ "loss": 0.02044159173965454,
+ "step": 1307
+ },
+ {
+ "epoch": 6.6075949367088604,
+ "grad_norm": 0.027923524379730225,
+ "learning_rate": 3.77665544332211e-05,
+ "loss": 0.016555916517972946,
+ "step": 1308
+ },
+ {
+ "epoch": 6.612658227848101,
+ "grad_norm": 0.049295879900455475,
+ "learning_rate": 3.7710437710437716e-05,
+ "loss": 0.02809835597872734,
+ "step": 1309
+ },
+ {
+ "epoch": 6.6177215189873415,
+ "grad_norm": 0.0679546371102333,
+ "learning_rate": 3.7654320987654326e-05,
+ "loss": 0.02421809732913971,
+ "step": 1310
+ },
+ {
+ "epoch": 6.622784810126582,
+ "grad_norm": 0.027567917481064796,
+ "learning_rate": 3.7598204264870936e-05,
+ "loss": 0.020084332674741745,
+ "step": 1311
+ },
+ {
+ "epoch": 6.627848101265823,
+ "grad_norm": 0.04364616423845291,
+ "learning_rate": 3.7542087542087546e-05,
+ "loss": 0.024303186684846878,
+ "step": 1312
+ },
+ {
+ "epoch": 6.632911392405063,
+ "grad_norm": 0.060693949460983276,
+ "learning_rate": 3.7485970819304156e-05,
+ "loss": 0.022462837398052216,
+ "step": 1313
+ },
+ {
+ "epoch": 6.637974683544304,
+ "grad_norm": 0.05344981327652931,
+ "learning_rate": 3.7429854096520766e-05,
+ "loss": 0.02119705080986023,
+ "step": 1314
+ },
+ {
+ "epoch": 6.643037974683544,
+ "grad_norm": 0.04188868775963783,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.02262813225388527,
+ "step": 1315
+ },
+ {
+ "epoch": 6.648101265822785,
+ "grad_norm": 0.10617388039827347,
+ "learning_rate": 3.7317620650953986e-05,
+ "loss": 0.028262268751859665,
+ "step": 1316
+ },
+ {
+ "epoch": 6.653164556962025,
+ "grad_norm": 0.028918985277414322,
+ "learning_rate": 3.7261503928170596e-05,
+ "loss": 0.018603652715682983,
+ "step": 1317
+ },
+ {
+ "epoch": 6.658227848101266,
+ "grad_norm": 0.037515874952077866,
+ "learning_rate": 3.720538720538721e-05,
+ "loss": 0.024647820740938187,
+ "step": 1318
+ },
+ {
+ "epoch": 6.663291139240506,
+ "grad_norm": 0.0347459651529789,
+ "learning_rate": 3.7149270482603816e-05,
+ "loss": 0.024235039949417114,
+ "step": 1319
+ },
+ {
+ "epoch": 6.668354430379747,
+ "grad_norm": 0.04326598346233368,
+ "learning_rate": 3.7093153759820426e-05,
+ "loss": 0.02030426263809204,
+ "step": 1320
+ },
+ {
+ "epoch": 6.673417721518987,
+ "grad_norm": 0.026792412623763084,
+ "learning_rate": 3.7037037037037037e-05,
+ "loss": 0.02184079959988594,
+ "step": 1321
+ },
+ {
+ "epoch": 6.678481012658228,
+ "grad_norm": 0.033112917095422745,
+ "learning_rate": 3.698092031425365e-05,
+ "loss": 0.019945142790675163,
+ "step": 1322
+ },
+ {
+ "epoch": 6.6835443037974684,
+ "grad_norm": 0.031808555126190186,
+ "learning_rate": 3.692480359147026e-05,
+ "loss": 0.024434339255094528,
+ "step": 1323
+ },
+ {
+ "epoch": 6.688607594936709,
+ "grad_norm": 0.03284522145986557,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.017459489405155182,
+ "step": 1324
+ },
+ {
+ "epoch": 6.6936708860759495,
+ "grad_norm": 0.029303887858986855,
+ "learning_rate": 3.681257014590348e-05,
+ "loss": 0.017790818586945534,
+ "step": 1325
+ },
+ {
+ "epoch": 6.69873417721519,
+ "grad_norm": 0.028168147429823875,
+ "learning_rate": 3.6756453423120094e-05,
+ "loss": 0.022105036303400993,
+ "step": 1326
+ },
+ {
+ "epoch": 6.703797468354431,
+ "grad_norm": 0.045645441859960556,
+ "learning_rate": 3.6700336700336704e-05,
+ "loss": 0.0288691483438015,
+ "step": 1327
+ },
+ {
+ "epoch": 6.708860759493671,
+ "grad_norm": 0.02225707843899727,
+ "learning_rate": 3.6644219977553314e-05,
+ "loss": 0.016150090843439102,
+ "step": 1328
+ },
+ {
+ "epoch": 6.713924050632912,
+ "grad_norm": 0.02501208707690239,
+ "learning_rate": 3.6588103254769924e-05,
+ "loss": 0.023236583918333054,
+ "step": 1329
+ },
+ {
+ "epoch": 6.718987341772152,
+ "grad_norm": 0.038911011070013046,
+ "learning_rate": 3.6531986531986534e-05,
+ "loss": 0.025721289217472076,
+ "step": 1330
+ },
+ {
+ "epoch": 6.724050632911393,
+ "grad_norm": 0.036257173866033554,
+ "learning_rate": 3.6475869809203144e-05,
+ "loss": 0.025515632703900337,
+ "step": 1331
+ },
+ {
+ "epoch": 6.729113924050633,
+ "grad_norm": 0.03473728895187378,
+ "learning_rate": 3.6419753086419754e-05,
+ "loss": 0.02300131320953369,
+ "step": 1332
+ },
+ {
+ "epoch": 6.734177215189874,
+ "grad_norm": 0.03154155611991882,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.024625634774565697,
+ "step": 1333
+ },
+ {
+ "epoch": 6.739240506329114,
+ "grad_norm": 0.04241670295596123,
+ "learning_rate": 3.6307519640852974e-05,
+ "loss": 0.021008290350437164,
+ "step": 1334
+ },
+ {
+ "epoch": 6.744303797468355,
+ "grad_norm": 0.027151785790920258,
+ "learning_rate": 3.625140291806959e-05,
+ "loss": 0.021018799394369125,
+ "step": 1335
+ },
+ {
+ "epoch": 6.749367088607595,
+ "grad_norm": 0.026534251868724823,
+ "learning_rate": 3.61952861952862e-05,
+ "loss": 0.018448853865265846,
+ "step": 1336
+ },
+ {
+ "epoch": 6.754430379746836,
+ "grad_norm": 0.02729695476591587,
+ "learning_rate": 3.613916947250281e-05,
+ "loss": 0.022980306297540665,
+ "step": 1337
+ },
+ {
+ "epoch": 6.759493670886076,
+ "grad_norm": 0.023642007261514664,
+ "learning_rate": 3.608305274971942e-05,
+ "loss": 0.019568361341953278,
+ "step": 1338
+ },
+ {
+ "epoch": 6.764556962025316,
+ "grad_norm": 0.03455951064825058,
+ "learning_rate": 3.602693602693603e-05,
+ "loss": 0.019078724086284637,
+ "step": 1339
+ },
+ {
+ "epoch": 6.769620253164557,
+ "grad_norm": 0.02380317822098732,
+ "learning_rate": 3.5970819304152635e-05,
+ "loss": 0.01807081699371338,
+ "step": 1340
+ },
+ {
+ "epoch": 6.774683544303797,
+ "grad_norm": 0.0337495282292366,
+ "learning_rate": 3.5914702581369245e-05,
+ "loss": 0.019128164276480675,
+ "step": 1341
+ },
+ {
+ "epoch": 6.779746835443038,
+ "grad_norm": 0.041405126452445984,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.017617477104067802,
+ "step": 1342
+ },
+ {
+ "epoch": 6.784810126582278,
+ "grad_norm": 0.028542209416627884,
+ "learning_rate": 3.580246913580247e-05,
+ "loss": 0.01781628280878067,
+ "step": 1343
+ },
+ {
+ "epoch": 6.789873417721519,
+ "grad_norm": 0.038718484342098236,
+ "learning_rate": 3.574635241301908e-05,
+ "loss": 0.025421444326639175,
+ "step": 1344
+ },
+ {
+ "epoch": 6.794936708860759,
+ "grad_norm": 0.03298761323094368,
+ "learning_rate": 3.569023569023569e-05,
+ "loss": 0.01900479383766651,
+ "step": 1345
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.024823278188705444,
+ "learning_rate": 3.56341189674523e-05,
+ "loss": 0.021245522424578667,
+ "step": 1346
+ },
+ {
+ "epoch": 6.80506329113924,
+ "grad_norm": 0.0321645587682724,
+ "learning_rate": 3.557800224466891e-05,
+ "loss": 0.01712404564023018,
+ "step": 1347
+ },
+ {
+ "epoch": 6.810126582278481,
+ "grad_norm": 0.03605357185006142,
+ "learning_rate": 3.552188552188552e-05,
+ "loss": 0.02691786363720894,
+ "step": 1348
+ },
+ {
+ "epoch": 6.815189873417721,
+ "grad_norm": 0.03685377910733223,
+ "learning_rate": 3.546576879910213e-05,
+ "loss": 0.02375425398349762,
+ "step": 1349
+ },
+ {
+ "epoch": 6.820253164556962,
+ "grad_norm": 0.022712258622050285,
+ "learning_rate": 3.540965207631874e-05,
+ "loss": 0.016492441296577454,
+ "step": 1350
+ },
+ {
+ "epoch": 6.8253164556962025,
+ "grad_norm": 0.027446497231721878,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.019083943217992783,
+ "step": 1351
+ },
+ {
+ "epoch": 6.830379746835443,
+ "grad_norm": 0.060375552624464035,
+ "learning_rate": 3.529741863075197e-05,
+ "loss": 0.021610641852021217,
+ "step": 1352
+ },
+ {
+ "epoch": 6.8354430379746836,
+ "grad_norm": 0.026175983250141144,
+ "learning_rate": 3.524130190796858e-05,
+ "loss": 0.02164904959499836,
+ "step": 1353
+ },
+ {
+ "epoch": 6.840506329113924,
+ "grad_norm": 0.04348548501729965,
+ "learning_rate": 3.518518518518519e-05,
+ "loss": 0.02257148176431656,
+ "step": 1354
+ },
+ {
+ "epoch": 6.845569620253165,
+ "grad_norm": 0.051051557064056396,
+ "learning_rate": 3.51290684624018e-05,
+ "loss": 0.027986399829387665,
+ "step": 1355
+ },
+ {
+ "epoch": 6.850632911392405,
+ "grad_norm": 0.02255374938249588,
+ "learning_rate": 3.507295173961841e-05,
+ "loss": 0.017260409891605377,
+ "step": 1356
+ },
+ {
+ "epoch": 6.855696202531646,
+ "grad_norm": 0.053478825837373734,
+ "learning_rate": 3.501683501683502e-05,
+ "loss": 0.025036044418811798,
+ "step": 1357
+ },
+ {
+ "epoch": 6.860759493670886,
+ "grad_norm": 0.03688240423798561,
+ "learning_rate": 3.496071829405163e-05,
+ "loss": 0.0243881456553936,
+ "step": 1358
+ },
+ {
+ "epoch": 6.865822784810127,
+ "grad_norm": 0.03860153257846832,
+ "learning_rate": 3.490460157126824e-05,
+ "loss": 0.018570398911833763,
+ "step": 1359
+ },
+ {
+ "epoch": 6.870886075949367,
+ "grad_norm": 0.02771756984293461,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.022013407200574875,
+ "step": 1360
+ },
+ {
+ "epoch": 6.875949367088608,
+ "grad_norm": 0.03359522670507431,
+ "learning_rate": 3.4792368125701466e-05,
+ "loss": 0.024430446326732635,
+ "step": 1361
+ },
+ {
+ "epoch": 6.881012658227848,
+ "grad_norm": 0.028827447444200516,
+ "learning_rate": 3.473625140291807e-05,
+ "loss": 0.018073707818984985,
+ "step": 1362
+ },
+ {
+ "epoch": 6.886075949367089,
+ "grad_norm": 0.03537776693701744,
+ "learning_rate": 3.468013468013468e-05,
+ "loss": 0.022164030000567436,
+ "step": 1363
+ },
+ {
+ "epoch": 6.891139240506329,
+ "grad_norm": 0.029529782012104988,
+ "learning_rate": 3.462401795735129e-05,
+ "loss": 0.02529158815741539,
+ "step": 1364
+ },
+ {
+ "epoch": 6.89620253164557,
+ "grad_norm": 0.026303067803382874,
+ "learning_rate": 3.45679012345679e-05,
+ "loss": 0.019374631345272064,
+ "step": 1365
+ },
+ {
+ "epoch": 6.9012658227848105,
+ "grad_norm": 0.039471473544836044,
+ "learning_rate": 3.451178451178451e-05,
+ "loss": 0.022283609956502914,
+ "step": 1366
+ },
+ {
+ "epoch": 6.90632911392405,
+ "grad_norm": 0.03414482623338699,
+ "learning_rate": 3.445566778900112e-05,
+ "loss": 0.024151155725121498,
+ "step": 1367
+ },
+ {
+ "epoch": 6.911392405063291,
+ "grad_norm": 0.01648244820535183,
+ "learning_rate": 3.439955106621773e-05,
+ "loss": 0.01653912290930748,
+ "step": 1368
+ },
+ {
+ "epoch": 6.916455696202531,
+ "grad_norm": 0.036713164299726486,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.01961999014019966,
+ "step": 1369
+ },
+ {
+ "epoch": 6.921518987341772,
+ "grad_norm": 0.02502237819135189,
+ "learning_rate": 3.428731762065096e-05,
+ "loss": 0.019946709275245667,
+ "step": 1370
+ },
+ {
+ "epoch": 6.926582278481012,
+ "grad_norm": 0.03062540479004383,
+ "learning_rate": 3.423120089786757e-05,
+ "loss": 0.023258816450834274,
+ "step": 1371
+ },
+ {
+ "epoch": 6.931645569620253,
+ "grad_norm": 0.021536799147725105,
+ "learning_rate": 3.417508417508418e-05,
+ "loss": 0.01964723877608776,
+ "step": 1372
+ },
+ {
+ "epoch": 6.936708860759493,
+ "grad_norm": 0.035745471715927124,
+ "learning_rate": 3.411896745230079e-05,
+ "loss": 0.026319682598114014,
+ "step": 1373
+ },
+ {
+ "epoch": 6.941772151898734,
+ "grad_norm": 0.03711705282330513,
+ "learning_rate": 3.40628507295174e-05,
+ "loss": 0.022980816662311554,
+ "step": 1374
+ },
+ {
+ "epoch": 6.946835443037974,
+ "grad_norm": 0.02977835014462471,
+ "learning_rate": 3.400673400673401e-05,
+ "loss": 0.020178712904453278,
+ "step": 1375
+ },
+ {
+ "epoch": 6.951898734177215,
+ "grad_norm": 0.122103750705719,
+ "learning_rate": 3.395061728395062e-05,
+ "loss": 0.028520341962575912,
+ "step": 1376
+ },
+ {
+ "epoch": 6.9569620253164555,
+ "grad_norm": 0.046767886728048325,
+ "learning_rate": 3.389450056116723e-05,
+ "loss": 0.0207063015550375,
+ "step": 1377
+ },
+ {
+ "epoch": 6.962025316455696,
+ "grad_norm": 0.027442077174782753,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.018590064719319344,
+ "step": 1378
+ },
+ {
+ "epoch": 6.9670886075949365,
+ "grad_norm": 0.03202109411358833,
+ "learning_rate": 3.3782267115600454e-05,
+ "loss": 0.0225562434643507,
+ "step": 1379
+ },
+ {
+ "epoch": 6.972151898734177,
+ "grad_norm": 0.024545297026634216,
+ "learning_rate": 3.3726150392817064e-05,
+ "loss": 0.020356591790914536,
+ "step": 1380
+ },
+ {
+ "epoch": 6.977215189873418,
+ "grad_norm": 0.028534026816487312,
+ "learning_rate": 3.3670033670033675e-05,
+ "loss": 0.017728019505739212,
+ "step": 1381
+ },
+ {
+ "epoch": 6.982278481012658,
+ "grad_norm": 0.04066401720046997,
+ "learning_rate": 3.3613916947250285e-05,
+ "loss": 0.02500733733177185,
+ "step": 1382
+ },
+ {
+ "epoch": 6.987341772151899,
+ "grad_norm": 0.03498203679919243,
+ "learning_rate": 3.3557800224466895e-05,
+ "loss": 0.020952323451638222,
+ "step": 1383
+ },
+ {
+ "epoch": 6.992405063291139,
+ "grad_norm": 0.024813339114189148,
+ "learning_rate": 3.35016835016835e-05,
+ "loss": 0.019022852182388306,
+ "step": 1384
+ },
+ {
+ "epoch": 6.99746835443038,
+ "grad_norm": 0.02122138813138008,
+ "learning_rate": 3.3445566778900115e-05,
+ "loss": 0.019452452659606934,
+ "step": 1385
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.025631824508309364,
+ "learning_rate": 3.3389450056116725e-05,
+ "loss": 0.01880500651896,
+ "step": 1386
+ },
+ {
+ "epoch": 7.0050632911392405,
+ "grad_norm": 0.03023305907845497,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.019060317426919937,
+ "step": 1387
+ },
+ {
+ "epoch": 7.010126582278481,
+ "grad_norm": 0.03772016614675522,
+ "learning_rate": 3.3277216610549945e-05,
+ "loss": 0.024812128394842148,
+ "step": 1388
+ },
+ {
+ "epoch": 7.015189873417722,
+ "grad_norm": 0.022726386785507202,
+ "learning_rate": 3.3221099887766555e-05,
+ "loss": 0.016584882512688637,
+ "step": 1389
+ },
+ {
+ "epoch": 7.020253164556962,
+ "grad_norm": 0.034556008875370026,
+ "learning_rate": 3.3164983164983165e-05,
+ "loss": 0.019786395132541656,
+ "step": 1390
+ },
+ {
+ "epoch": 7.025316455696203,
+ "grad_norm": 0.028575370088219643,
+ "learning_rate": 3.3108866442199775e-05,
+ "loss": 0.01822180114686489,
+ "step": 1391
+ },
+ {
+ "epoch": 7.030379746835443,
+ "grad_norm": 0.023528434336185455,
+ "learning_rate": 3.3052749719416385e-05,
+ "loss": 0.020981397479772568,
+ "step": 1392
+ },
+ {
+ "epoch": 7.035443037974684,
+ "grad_norm": 0.022872168570756912,
+ "learning_rate": 3.2996632996632995e-05,
+ "loss": 0.01915448158979416,
+ "step": 1393
+ },
+ {
+ "epoch": 7.040506329113924,
+ "grad_norm": 0.027755601331591606,
+ "learning_rate": 3.2940516273849605e-05,
+ "loss": 0.022184018045663834,
+ "step": 1394
+ },
+ {
+ "epoch": 7.045569620253165,
+ "grad_norm": 0.02798120491206646,
+ "learning_rate": 3.288439955106622e-05,
+ "loss": 0.018451202660799026,
+ "step": 1395
+ },
+ {
+ "epoch": 7.050632911392405,
+ "grad_norm": 0.03338237479329109,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.020784873515367508,
+ "step": 1396
+ },
+ {
+ "epoch": 7.055696202531646,
+ "grad_norm": 0.02282361313700676,
+ "learning_rate": 3.277216610549944e-05,
+ "loss": 0.017811089754104614,
+ "step": 1397
+ },
+ {
+ "epoch": 7.060759493670886,
+ "grad_norm": 0.03505925461649895,
+ "learning_rate": 3.271604938271605e-05,
+ "loss": 0.02735268510878086,
+ "step": 1398
+ },
+ {
+ "epoch": 7.065822784810127,
+ "grad_norm": 0.023442594334483147,
+ "learning_rate": 3.265993265993266e-05,
+ "loss": 0.017855383455753326,
+ "step": 1399
+ },
+ {
+ "epoch": 7.0708860759493675,
+ "grad_norm": 0.028511418029665947,
+ "learning_rate": 3.260381593714927e-05,
+ "loss": 0.01905960589647293,
+ "step": 1400
+ },
+ {
+ "epoch": 7.075949367088608,
+ "grad_norm": 0.027948686853051186,
+ "learning_rate": 3.254769921436588e-05,
+ "loss": 0.019588086754083633,
+ "step": 1401
+ },
+ {
+ "epoch": 7.0810126582278485,
+ "grad_norm": 0.031204944476485252,
+ "learning_rate": 3.249158249158249e-05,
+ "loss": 0.025335699319839478,
+ "step": 1402
+ },
+ {
+ "epoch": 7.086075949367088,
+ "grad_norm": 0.026365051046013832,
+ "learning_rate": 3.24354657687991e-05,
+ "loss": 0.020061418414115906,
+ "step": 1403
+ },
+ {
+ "epoch": 7.091139240506329,
+ "grad_norm": 0.02992449328303337,
+ "learning_rate": 3.237934904601572e-05,
+ "loss": 0.0207480788230896,
+ "step": 1404
+ },
+ {
+ "epoch": 7.096202531645569,
+ "grad_norm": 0.023861777037382126,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.018660075962543488,
+ "step": 1405
+ },
+ {
+ "epoch": 7.10126582278481,
+ "grad_norm": 0.029991189017891884,
+ "learning_rate": 3.226711560044893e-05,
+ "loss": 0.01724623516201973,
+ "step": 1406
+ },
+ {
+ "epoch": 7.10632911392405,
+ "grad_norm": 0.0326378308236599,
+ "learning_rate": 3.221099887766554e-05,
+ "loss": 0.02030283957719803,
+ "step": 1407
+ },
+ {
+ "epoch": 7.111392405063291,
+ "grad_norm": 0.21390174329280853,
+ "learning_rate": 3.215488215488215e-05,
+ "loss": 0.022705763578414917,
+ "step": 1408
+ },
+ {
+ "epoch": 7.116455696202531,
+ "grad_norm": 0.03886239975690842,
+ "learning_rate": 3.209876543209876e-05,
+ "loss": 0.018677497282624245,
+ "step": 1409
+ },
+ {
+ "epoch": 7.121518987341772,
+ "grad_norm": 0.08851044625043869,
+ "learning_rate": 3.204264870931537e-05,
+ "loss": 0.023592950776219368,
+ "step": 1410
+ },
+ {
+ "epoch": 7.1265822784810124,
+ "grad_norm": 0.02696068212389946,
+ "learning_rate": 3.198653198653199e-05,
+ "loss": 0.02084396779537201,
+ "step": 1411
+ },
+ {
+ "epoch": 7.131645569620253,
+ "grad_norm": 0.02673780545592308,
+ "learning_rate": 3.19304152637486e-05,
+ "loss": 0.01957092061638832,
+ "step": 1412
+ },
+ {
+ "epoch": 7.1367088607594935,
+ "grad_norm": 0.027915315702557564,
+ "learning_rate": 3.187429854096521e-05,
+ "loss": 0.017723560333251953,
+ "step": 1413
+ },
+ {
+ "epoch": 7.141772151898734,
+ "grad_norm": 0.03920222446322441,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.025390218943357468,
+ "step": 1414
+ },
+ {
+ "epoch": 7.146835443037975,
+ "grad_norm": 0.0384795181453228,
+ "learning_rate": 3.176206509539843e-05,
+ "loss": 0.01968265138566494,
+ "step": 1415
+ },
+ {
+ "epoch": 7.151898734177215,
+ "grad_norm": 0.035265080630779266,
+ "learning_rate": 3.170594837261504e-05,
+ "loss": 0.024998726323246956,
+ "step": 1416
+ },
+ {
+ "epoch": 7.156962025316456,
+ "grad_norm": 0.029263779520988464,
+ "learning_rate": 3.164983164983165e-05,
+ "loss": 0.020544305443763733,
+ "step": 1417
+ },
+ {
+ "epoch": 7.162025316455696,
+ "grad_norm": 0.04175667464733124,
+ "learning_rate": 3.159371492704826e-05,
+ "loss": 0.019445113837718964,
+ "step": 1418
+ },
+ {
+ "epoch": 7.167088607594937,
+ "grad_norm": 0.041344888508319855,
+ "learning_rate": 3.153759820426487e-05,
+ "loss": 0.02322668954730034,
+ "step": 1419
+ },
+ {
+ "epoch": 7.172151898734177,
+ "grad_norm": 0.03339385986328125,
+ "learning_rate": 3.148148148148148e-05,
+ "loss": 0.023453861474990845,
+ "step": 1420
+ },
+ {
+ "epoch": 7.177215189873418,
+ "grad_norm": 0.07248332351446152,
+ "learning_rate": 3.14253647586981e-05,
+ "loss": 0.02372308447957039,
+ "step": 1421
+ },
+ {
+ "epoch": 7.182278481012658,
+ "grad_norm": 0.03583402931690216,
+ "learning_rate": 3.136924803591471e-05,
+ "loss": 0.021252157166600227,
+ "step": 1422
+ },
+ {
+ "epoch": 7.187341772151899,
+ "grad_norm": 0.035940300673246384,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.02373434416949749,
+ "step": 1423
+ },
+ {
+ "epoch": 7.192405063291139,
+ "grad_norm": 0.037396274507045746,
+ "learning_rate": 3.125701459034793e-05,
+ "loss": 0.021743204444646835,
+ "step": 1424
+ },
+ {
+ "epoch": 7.19746835443038,
+ "grad_norm": 0.03273582085967064,
+ "learning_rate": 3.120089786756454e-05,
+ "loss": 0.021748099476099014,
+ "step": 1425
+ },
+ {
+ "epoch": 7.2025316455696204,
+ "grad_norm": 0.05356048792600632,
+ "learning_rate": 3.114478114478115e-05,
+ "loss": 0.018289824947714806,
+ "step": 1426
+ },
+ {
+ "epoch": 7.207594936708861,
+ "grad_norm": 0.08134915679693222,
+ "learning_rate": 3.108866442199775e-05,
+ "loss": 0.019879773259162903,
+ "step": 1427
+ },
+ {
+ "epoch": 7.2126582278481015,
+ "grad_norm": 0.028759760782122612,
+ "learning_rate": 3.103254769921437e-05,
+ "loss": 0.02021026611328125,
+ "step": 1428
+ },
+ {
+ "epoch": 7.217721518987342,
+ "grad_norm": 0.03647785633802414,
+ "learning_rate": 3.097643097643098e-05,
+ "loss": 0.019807487726211548,
+ "step": 1429
+ },
+ {
+ "epoch": 7.222784810126583,
+ "grad_norm": 0.04302947223186493,
+ "learning_rate": 3.092031425364759e-05,
+ "loss": 0.02610229328274727,
+ "step": 1430
+ },
+ {
+ "epoch": 7.227848101265823,
+ "grad_norm": 0.040028274059295654,
+ "learning_rate": 3.08641975308642e-05,
+ "loss": 0.020702369511127472,
+ "step": 1431
+ },
+ {
+ "epoch": 7.232911392405064,
+ "grad_norm": 0.03221731632947922,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.019945278763771057,
+ "step": 1432
+ },
+ {
+ "epoch": 7.237974683544304,
+ "grad_norm": 0.043122660368680954,
+ "learning_rate": 3.075196408529742e-05,
+ "loss": 0.01944747380912304,
+ "step": 1433
+ },
+ {
+ "epoch": 7.243037974683545,
+ "grad_norm": 0.041211001574993134,
+ "learning_rate": 3.069584736251403e-05,
+ "loss": 0.02140875533223152,
+ "step": 1434
+ },
+ {
+ "epoch": 7.248101265822784,
+ "grad_norm": 0.038251616060733795,
+ "learning_rate": 3.063973063973064e-05,
+ "loss": 0.017319878563284874,
+ "step": 1435
+ },
+ {
+ "epoch": 7.253164556962025,
+ "grad_norm": 0.023718461394309998,
+ "learning_rate": 3.058361391694725e-05,
+ "loss": 0.017003588378429413,
+ "step": 1436
+ },
+ {
+ "epoch": 7.258227848101265,
+ "grad_norm": 0.04274767264723778,
+ "learning_rate": 3.0527497194163865e-05,
+ "loss": 0.022676389664411545,
+ "step": 1437
+ },
+ {
+ "epoch": 7.263291139240506,
+ "grad_norm": 0.05663180723786354,
+ "learning_rate": 3.0471380471380472e-05,
+ "loss": 0.018122078850865364,
+ "step": 1438
+ },
+ {
+ "epoch": 7.2683544303797465,
+ "grad_norm": 0.046230170875787735,
+ "learning_rate": 3.0415263748597082e-05,
+ "loss": 0.02533666044473648,
+ "step": 1439
+ },
+ {
+ "epoch": 7.273417721518987,
+ "grad_norm": 0.029917370527982712,
+ "learning_rate": 3.0359147025813696e-05,
+ "loss": 0.017602022737264633,
+ "step": 1440
+ },
+ {
+ "epoch": 7.2784810126582276,
+ "grad_norm": 0.02992556430399418,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.018274672329425812,
+ "step": 1441
+ },
+ {
+ "epoch": 7.283544303797468,
+ "grad_norm": 0.02617500349879265,
+ "learning_rate": 3.0246913580246916e-05,
+ "loss": 0.01885201409459114,
+ "step": 1442
+ },
+ {
+ "epoch": 7.288607594936709,
+ "grad_norm": 0.065202996134758,
+ "learning_rate": 3.0190796857463526e-05,
+ "loss": 0.026795238256454468,
+ "step": 1443
+ },
+ {
+ "epoch": 7.293670886075949,
+ "grad_norm": 0.03273150697350502,
+ "learning_rate": 3.013468013468014e-05,
+ "loss": 0.021357936784625053,
+ "step": 1444
+ },
+ {
+ "epoch": 7.29873417721519,
+ "grad_norm": 0.024254770949482918,
+ "learning_rate": 3.007856341189675e-05,
+ "loss": 0.018274925649166107,
+ "step": 1445
+ },
+ {
+ "epoch": 7.30379746835443,
+ "grad_norm": 0.03504091128706932,
+ "learning_rate": 3.002244668911336e-05,
+ "loss": 0.02005249634385109,
+ "step": 1446
+ },
+ {
+ "epoch": 7.308860759493671,
+ "grad_norm": 0.03011571802198887,
+ "learning_rate": 2.996632996632997e-05,
+ "loss": 0.02488003298640251,
+ "step": 1447
+ },
+ {
+ "epoch": 7.313924050632911,
+ "grad_norm": 0.027476035058498383,
+ "learning_rate": 2.991021324354658e-05,
+ "loss": 0.01974816992878914,
+ "step": 1448
+ },
+ {
+ "epoch": 7.318987341772152,
+ "grad_norm": 0.026227811351418495,
+ "learning_rate": 2.9854096520763186e-05,
+ "loss": 0.019309503957629204,
+ "step": 1449
+ },
+ {
+ "epoch": 7.324050632911392,
+ "grad_norm": 0.03413211554288864,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.02053218148648739,
+ "step": 1450
+ },
+ {
+ "epoch": 7.329113924050633,
+ "grad_norm": 0.05214853584766388,
+ "learning_rate": 2.9741863075196406e-05,
+ "loss": 0.02286684140563011,
+ "step": 1451
+ },
+ {
+ "epoch": 7.334177215189873,
+ "grad_norm": 0.041933804750442505,
+ "learning_rate": 2.968574635241302e-05,
+ "loss": 0.025886723771691322,
+ "step": 1452
+ },
+ {
+ "epoch": 7.339240506329114,
+ "grad_norm": 0.029031161218881607,
+ "learning_rate": 2.962962962962963e-05,
+ "loss": 0.017816081643104553,
+ "step": 1453
+ },
+ {
+ "epoch": 7.3443037974683545,
+ "grad_norm": 0.02532730996608734,
+ "learning_rate": 2.957351290684624e-05,
+ "loss": 0.017425578087568283,
+ "step": 1454
+ },
+ {
+ "epoch": 7.349367088607595,
+ "grad_norm": 0.02859879471361637,
+ "learning_rate": 2.951739618406285e-05,
+ "loss": 0.02076636254787445,
+ "step": 1455
+ },
+ {
+ "epoch": 7.3544303797468356,
+ "grad_norm": 0.03137378767132759,
+ "learning_rate": 2.946127946127946e-05,
+ "loss": 0.020406391471624374,
+ "step": 1456
+ },
+ {
+ "epoch": 7.359493670886076,
+ "grad_norm": 0.032471053302288055,
+ "learning_rate": 2.9405162738496074e-05,
+ "loss": 0.01692109927535057,
+ "step": 1457
+ },
+ {
+ "epoch": 7.364556962025317,
+ "grad_norm": 0.028477061539888382,
+ "learning_rate": 2.9349046015712684e-05,
+ "loss": 0.020386110991239548,
+ "step": 1458
+ },
+ {
+ "epoch": 7.369620253164557,
+ "grad_norm": 0.022607816383242607,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.01817784458398819,
+ "step": 1459
+ },
+ {
+ "epoch": 7.374683544303798,
+ "grad_norm": 0.023832928389310837,
+ "learning_rate": 2.9236812570145904e-05,
+ "loss": 0.01865188032388687,
+ "step": 1460
+ },
+ {
+ "epoch": 7.379746835443038,
+ "grad_norm": 0.027590278536081314,
+ "learning_rate": 2.9180695847362517e-05,
+ "loss": 0.022126823663711548,
+ "step": 1461
+ },
+ {
+ "epoch": 7.384810126582279,
+ "grad_norm": 0.4172179698944092,
+ "learning_rate": 2.9124579124579127e-05,
+ "loss": 0.022308025509119034,
+ "step": 1462
+ },
+ {
+ "epoch": 7.389873417721519,
+ "grad_norm": 0.026935985311865807,
+ "learning_rate": 2.9068462401795737e-05,
+ "loss": 0.019504904747009277,
+ "step": 1463
+ },
+ {
+ "epoch": 7.39493670886076,
+ "grad_norm": 0.03200481832027435,
+ "learning_rate": 2.9012345679012347e-05,
+ "loss": 0.02669564262032509,
+ "step": 1464
+ },
+ {
+ "epoch": 7.4,
+ "grad_norm": 0.029977383092045784,
+ "learning_rate": 2.8956228956228958e-05,
+ "loss": 0.020015545189380646,
+ "step": 1465
+ },
+ {
+ "epoch": 7.405063291139241,
+ "grad_norm": 0.056856609880924225,
+ "learning_rate": 2.890011223344557e-05,
+ "loss": 0.02192942053079605,
+ "step": 1466
+ },
+ {
+ "epoch": 7.410126582278481,
+ "grad_norm": 0.025086626410484314,
+ "learning_rate": 2.884399551066218e-05,
+ "loss": 0.01919681392610073,
+ "step": 1467
+ },
+ {
+ "epoch": 7.415189873417722,
+ "grad_norm": 0.022608574479818344,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.01909647136926651,
+ "step": 1468
+ },
+ {
+ "epoch": 7.4202531645569625,
+ "grad_norm": 0.034612007439136505,
+ "learning_rate": 2.87317620650954e-05,
+ "loss": 0.01842370256781578,
+ "step": 1469
+ },
+ {
+ "epoch": 7.425316455696202,
+ "grad_norm": 0.06468075513839722,
+ "learning_rate": 2.8675645342312015e-05,
+ "loss": 0.02434670552611351,
+ "step": 1470
+ },
+ {
+ "epoch": 7.430379746835443,
+ "grad_norm": 0.03149627894163132,
+ "learning_rate": 2.8619528619528618e-05,
+ "loss": 0.019917085766792297,
+ "step": 1471
+ },
+ {
+ "epoch": 7.435443037974683,
+ "grad_norm": 0.057844966650009155,
+ "learning_rate": 2.8563411896745228e-05,
+ "loss": 0.024164216592907906,
+ "step": 1472
+ },
+ {
+ "epoch": 7.440506329113924,
+ "grad_norm": 0.026152828708291054,
+ "learning_rate": 2.850729517396184e-05,
+ "loss": 0.01977004110813141,
+ "step": 1473
+ },
+ {
+ "epoch": 7.445569620253164,
+ "grad_norm": 0.02952045202255249,
+ "learning_rate": 2.845117845117845e-05,
+ "loss": 0.017811203375458717,
+ "step": 1474
+ },
+ {
+ "epoch": 7.450632911392405,
+ "grad_norm": 0.04974228888750076,
+ "learning_rate": 2.839506172839506e-05,
+ "loss": 0.02152227610349655,
+ "step": 1475
+ },
+ {
+ "epoch": 7.455696202531645,
+ "grad_norm": 0.031569063663482666,
+ "learning_rate": 2.833894500561167e-05,
+ "loss": 0.01801261678338051,
+ "step": 1476
+ },
+ {
+ "epoch": 7.460759493670886,
+ "grad_norm": 0.027251577004790306,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.019541654735803604,
+ "step": 1477
+ },
+ {
+ "epoch": 7.465822784810126,
+ "grad_norm": 0.05990522354841232,
+ "learning_rate": 2.8226711560044895e-05,
+ "loss": 0.028783954679965973,
+ "step": 1478
+ },
+ {
+ "epoch": 7.470886075949367,
+ "grad_norm": 0.05585836246609688,
+ "learning_rate": 2.8170594837261505e-05,
+ "loss": 0.021160079166293144,
+ "step": 1479
+ },
+ {
+ "epoch": 7.4759493670886075,
+ "grad_norm": 0.07603998482227325,
+ "learning_rate": 2.8114478114478115e-05,
+ "loss": 0.020453037694096565,
+ "step": 1480
+ },
+ {
+ "epoch": 7.481012658227848,
+ "grad_norm": 0.027796803042292595,
+ "learning_rate": 2.8058361391694725e-05,
+ "loss": 0.018019884824752808,
+ "step": 1481
+ },
+ {
+ "epoch": 7.4860759493670885,
+ "grad_norm": 0.03738328441977501,
+ "learning_rate": 2.8002244668911335e-05,
+ "loss": 0.018781842663884163,
+ "step": 1482
+ },
+ {
+ "epoch": 7.491139240506329,
+ "grad_norm": 0.026894861832261086,
+ "learning_rate": 2.794612794612795e-05,
+ "loss": 0.018704136833548546,
+ "step": 1483
+ },
+ {
+ "epoch": 7.49620253164557,
+ "grad_norm": 0.04921836778521538,
+ "learning_rate": 2.789001122334456e-05,
+ "loss": 0.025394737720489502,
+ "step": 1484
+ },
+ {
+ "epoch": 7.50126582278481,
+ "grad_norm": 0.02966165542602539,
+ "learning_rate": 2.783389450056117e-05,
+ "loss": 0.018199149519205093,
+ "step": 1485
+ },
+ {
+ "epoch": 7.506329113924051,
+ "grad_norm": 0.0387556366622448,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.022723186761140823,
+ "step": 1486
+ },
+ {
+ "epoch": 7.511392405063291,
+ "grad_norm": 0.03414534777402878,
+ "learning_rate": 2.7721661054994393e-05,
+ "loss": 0.02049117535352707,
+ "step": 1487
+ },
+ {
+ "epoch": 7.516455696202532,
+ "grad_norm": 0.03540657088160515,
+ "learning_rate": 2.7665544332211003e-05,
+ "loss": 0.016004232689738274,
+ "step": 1488
+ },
+ {
+ "epoch": 7.521518987341772,
+ "grad_norm": 0.02518565021455288,
+ "learning_rate": 2.7609427609427613e-05,
+ "loss": 0.01941412314772606,
+ "step": 1489
+ },
+ {
+ "epoch": 7.526582278481013,
+ "grad_norm": 0.05959590524435043,
+ "learning_rate": 2.7553310886644223e-05,
+ "loss": 0.02951142191886902,
+ "step": 1490
+ },
+ {
+ "epoch": 7.531645569620253,
+ "grad_norm": 0.03249293565750122,
+ "learning_rate": 2.7497194163860833e-05,
+ "loss": 0.017881492152810097,
+ "step": 1491
+ },
+ {
+ "epoch": 7.536708860759494,
+ "grad_norm": 0.03257756307721138,
+ "learning_rate": 2.7441077441077446e-05,
+ "loss": 0.02113383263349533,
+ "step": 1492
+ },
+ {
+ "epoch": 7.541772151898734,
+ "grad_norm": 0.033309679478406906,
+ "learning_rate": 2.738496071829405e-05,
+ "loss": 0.026215262711048126,
+ "step": 1493
+ },
+ {
+ "epoch": 7.546835443037975,
+ "grad_norm": 0.022595476359128952,
+ "learning_rate": 2.732884399551066e-05,
+ "loss": 0.02027580887079239,
+ "step": 1494
+ },
+ {
+ "epoch": 7.5518987341772155,
+ "grad_norm": 0.031081587076187134,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.019502829760313034,
+ "step": 1495
+ },
+ {
+ "epoch": 7.556962025316456,
+ "grad_norm": 0.03038015030324459,
+ "learning_rate": 2.7216610549943883e-05,
+ "loss": 0.01952512189745903,
+ "step": 1496
+ },
+ {
+ "epoch": 7.5620253164556965,
+ "grad_norm": 0.029864326119422913,
+ "learning_rate": 2.7160493827160493e-05,
+ "loss": 0.02026083692908287,
+ "step": 1497
+ },
+ {
+ "epoch": 7.567088607594937,
+ "grad_norm": 0.040809404104948044,
+ "learning_rate": 2.7104377104377103e-05,
+ "loss": 0.026188697665929794,
+ "step": 1498
+ },
+ {
+ "epoch": 7.572151898734178,
+ "grad_norm": 0.023756515234708786,
+ "learning_rate": 2.7048260381593717e-05,
+ "loss": 0.019195934757590294,
+ "step": 1499
+ },
+ {
+ "epoch": 7.577215189873417,
+ "grad_norm": 0.04987863078713417,
+ "learning_rate": 2.6992143658810327e-05,
+ "loss": 0.02136474847793579,
+ "step": 1500
+ },
+ {
+ "epoch": 7.582278481012658,
+ "grad_norm": 0.027713749557733536,
+ "learning_rate": 2.6936026936026937e-05,
+ "loss": 0.01946287602186203,
+ "step": 1501
+ },
+ {
+ "epoch": 7.587341772151898,
+ "grad_norm": 0.039245858788490295,
+ "learning_rate": 2.6879910213243547e-05,
+ "loss": 0.02284877747297287,
+ "step": 1502
+ },
+ {
+ "epoch": 7.592405063291139,
+ "grad_norm": 0.028289446607232094,
+ "learning_rate": 2.6823793490460157e-05,
+ "loss": 0.01939627155661583,
+ "step": 1503
+ },
+ {
+ "epoch": 7.597468354430379,
+ "grad_norm": 0.032388728111982346,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.021464064717292786,
+ "step": 1504
+ },
+ {
+ "epoch": 7.60253164556962,
+ "grad_norm": 0.029117215424776077,
+ "learning_rate": 2.671156004489338e-05,
+ "loss": 0.021073060110211372,
+ "step": 1505
+ },
+ {
+ "epoch": 7.6075949367088604,
+ "grad_norm": 0.041485581547021866,
+ "learning_rate": 2.665544332210999e-05,
+ "loss": 0.022546250373125076,
+ "step": 1506
+ },
+ {
+ "epoch": 7.612658227848101,
+ "grad_norm": 0.03320342302322388,
+ "learning_rate": 2.65993265993266e-05,
+ "loss": 0.026163101196289062,
+ "step": 1507
+ },
+ {
+ "epoch": 7.6177215189873415,
+ "grad_norm": 0.021322058513760567,
+ "learning_rate": 2.654320987654321e-05,
+ "loss": 0.015460850670933723,
+ "step": 1508
+ },
+ {
+ "epoch": 7.622784810126582,
+ "grad_norm": 0.029875705018639565,
+ "learning_rate": 2.6487093153759824e-05,
+ "loss": 0.017766594886779785,
+ "step": 1509
+ },
+ {
+ "epoch": 7.627848101265823,
+ "grad_norm": 0.02629193477332592,
+ "learning_rate": 2.6430976430976434e-05,
+ "loss": 0.019405700266361237,
+ "step": 1510
+ },
+ {
+ "epoch": 7.632911392405063,
+ "grad_norm": 0.027344992384314537,
+ "learning_rate": 2.6374859708193044e-05,
+ "loss": 0.021626925095915794,
+ "step": 1511
+ },
+ {
+ "epoch": 7.637974683544304,
+ "grad_norm": 0.03218991681933403,
+ "learning_rate": 2.6318742985409654e-05,
+ "loss": 0.025306588038802147,
+ "step": 1512
+ },
+ {
+ "epoch": 7.643037974683544,
+ "grad_norm": 0.03371857479214668,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.02218639850616455,
+ "step": 1513
+ },
+ {
+ "epoch": 7.648101265822785,
+ "grad_norm": 0.033074695616960526,
+ "learning_rate": 2.620650953984287e-05,
+ "loss": 0.022175181657075882,
+ "step": 1514
+ },
+ {
+ "epoch": 7.653164556962025,
+ "grad_norm": 0.040838733315467834,
+ "learning_rate": 2.615039281705948e-05,
+ "loss": 0.024300530552864075,
+ "step": 1515
+ },
+ {
+ "epoch": 7.658227848101266,
+ "grad_norm": 0.04166492819786072,
+ "learning_rate": 2.6094276094276095e-05,
+ "loss": 0.023746581748127937,
+ "step": 1516
+ },
+ {
+ "epoch": 7.663291139240506,
+ "grad_norm": 0.024037878960371017,
+ "learning_rate": 2.6038159371492705e-05,
+ "loss": 0.014877275563776493,
+ "step": 1517
+ },
+ {
+ "epoch": 7.668354430379747,
+ "grad_norm": 0.027796877548098564,
+ "learning_rate": 2.5982042648709315e-05,
+ "loss": 0.020726773887872696,
+ "step": 1518
+ },
+ {
+ "epoch": 7.673417721518987,
+ "grad_norm": 0.027635321021080017,
+ "learning_rate": 2.5925925925925925e-05,
+ "loss": 0.01928134821355343,
+ "step": 1519
+ },
+ {
+ "epoch": 7.678481012658228,
+ "grad_norm": 0.03595967963337898,
+ "learning_rate": 2.5869809203142535e-05,
+ "loss": 0.021230777725577354,
+ "step": 1520
+ },
+ {
+ "epoch": 7.6835443037974684,
+ "grad_norm": 0.027645453810691833,
+ "learning_rate": 2.581369248035915e-05,
+ "loss": 0.020900100469589233,
+ "step": 1521
+ },
+ {
+ "epoch": 7.688607594936709,
+ "grad_norm": 0.026998694986104965,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.01859203726053238,
+ "step": 1522
+ },
+ {
+ "epoch": 7.6936708860759495,
+ "grad_norm": 0.03182216361165047,
+ "learning_rate": 2.570145903479237e-05,
+ "loss": 0.01927625760436058,
+ "step": 1523
+ },
+ {
+ "epoch": 7.69873417721519,
+ "grad_norm": 0.04432869702577591,
+ "learning_rate": 2.564534231200898e-05,
+ "loss": 0.020073015242815018,
+ "step": 1524
+ },
+ {
+ "epoch": 7.703797468354431,
+ "grad_norm": 0.03800998628139496,
+ "learning_rate": 2.5589225589225592e-05,
+ "loss": 0.0257626473903656,
+ "step": 1525
+ },
+ {
+ "epoch": 7.708860759493671,
+ "grad_norm": 0.03346885368227959,
+ "learning_rate": 2.5533108866442202e-05,
+ "loss": 0.020997589454054832,
+ "step": 1526
+ },
+ {
+ "epoch": 7.713924050632912,
+ "grad_norm": 0.031936272978782654,
+ "learning_rate": 2.5476992143658812e-05,
+ "loss": 0.018775295466184616,
+ "step": 1527
+ },
+ {
+ "epoch": 7.718987341772152,
+ "grad_norm": 0.038017526268959045,
+ "learning_rate": 2.5420875420875422e-05,
+ "loss": 0.023845292627811432,
+ "step": 1528
+ },
+ {
+ "epoch": 7.724050632911393,
+ "grad_norm": 0.0348825678229332,
+ "learning_rate": 2.5364758698092032e-05,
+ "loss": 0.018793366849422455,
+ "step": 1529
+ },
+ {
+ "epoch": 7.729113924050633,
+ "grad_norm": 0.040639717131853104,
+ "learning_rate": 2.5308641975308646e-05,
+ "loss": 0.02135619707405567,
+ "step": 1530
+ },
+ {
+ "epoch": 7.734177215189874,
+ "grad_norm": 0.03508064150810242,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.01841862127184868,
+ "step": 1531
+ },
+ {
+ "epoch": 7.739240506329114,
+ "grad_norm": 0.028800271451473236,
+ "learning_rate": 2.5196408529741866e-05,
+ "loss": 0.017473943531513214,
+ "step": 1532
+ },
+ {
+ "epoch": 7.744303797468355,
+ "grad_norm": 0.03582684323191643,
+ "learning_rate": 2.5140291806958476e-05,
+ "loss": 0.026108454912900925,
+ "step": 1533
+ },
+ {
+ "epoch": 7.749367088607595,
+ "grad_norm": 0.02528059482574463,
+ "learning_rate": 2.5084175084175086e-05,
+ "loss": 0.022859979420900345,
+ "step": 1534
+ },
+ {
+ "epoch": 7.754430379746836,
+ "grad_norm": 0.04829512536525726,
+ "learning_rate": 2.50280583613917e-05,
+ "loss": 0.027691150084137917,
+ "step": 1535
+ },
+ {
+ "epoch": 7.759493670886076,
+ "grad_norm": 0.050450246781110764,
+ "learning_rate": 2.4971941638608306e-05,
+ "loss": 0.022913554683327675,
+ "step": 1536
+ },
+ {
+ "epoch": 7.764556962025316,
+ "grad_norm": 0.045245204120874405,
+ "learning_rate": 2.4915824915824916e-05,
+ "loss": 0.02299308404326439,
+ "step": 1537
+ },
+ {
+ "epoch": 7.769620253164557,
+ "grad_norm": 0.041785869747400284,
+ "learning_rate": 2.485970819304153e-05,
+ "loss": 0.019534088671207428,
+ "step": 1538
+ },
+ {
+ "epoch": 7.774683544303797,
+ "grad_norm": 0.02439288981258869,
+ "learning_rate": 2.480359147025814e-05,
+ "loss": 0.017930708825588226,
+ "step": 1539
+ },
+ {
+ "epoch": 7.779746835443038,
+ "grad_norm": 0.08324351161718369,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.028837718069553375,
+ "step": 1540
+ },
+ {
+ "epoch": 7.784810126582278,
+ "grad_norm": 0.04910506680607796,
+ "learning_rate": 2.4691358024691357e-05,
+ "loss": 0.023599382489919662,
+ "step": 1541
+ },
+ {
+ "epoch": 7.789873417721519,
+ "grad_norm": 0.02449595369398594,
+ "learning_rate": 2.463524130190797e-05,
+ "loss": 0.017761975526809692,
+ "step": 1542
+ },
+ {
+ "epoch": 7.794936708860759,
+ "grad_norm": 0.07905204594135284,
+ "learning_rate": 2.457912457912458e-05,
+ "loss": 0.017839400097727776,
+ "step": 1543
+ },
+ {
+ "epoch": 7.8,
+ "grad_norm": 0.030506471171975136,
+ "learning_rate": 2.452300785634119e-05,
+ "loss": 0.021404195576906204,
+ "step": 1544
+ },
+ {
+ "epoch": 7.80506329113924,
+ "grad_norm": 0.03580015152692795,
+ "learning_rate": 2.44668911335578e-05,
+ "loss": 0.023948010057210922,
+ "step": 1545
+ },
+ {
+ "epoch": 7.810126582278481,
+ "grad_norm": 0.027275504544377327,
+ "learning_rate": 2.441077441077441e-05,
+ "loss": 0.01799733377993107,
+ "step": 1546
+ },
+ {
+ "epoch": 7.815189873417721,
+ "grad_norm": 0.032968342304229736,
+ "learning_rate": 2.4354657687991024e-05,
+ "loss": 0.020244449377059937,
+ "step": 1547
+ },
+ {
+ "epoch": 7.820253164556962,
+ "grad_norm": 0.04385100305080414,
+ "learning_rate": 2.4298540965207634e-05,
+ "loss": 0.022481925785541534,
+ "step": 1548
+ },
+ {
+ "epoch": 7.8253164556962025,
+ "grad_norm": 0.038451679050922394,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.01878458261489868,
+ "step": 1549
+ },
+ {
+ "epoch": 7.830379746835443,
+ "grad_norm": 0.033544667065143585,
+ "learning_rate": 2.4186307519640854e-05,
+ "loss": 0.016049742698669434,
+ "step": 1550
+ },
+ {
+ "epoch": 7.8354430379746836,
+ "grad_norm": 0.03697581961750984,
+ "learning_rate": 2.4130190796857467e-05,
+ "loss": 0.020224547013640404,
+ "step": 1551
+ },
+ {
+ "epoch": 7.840506329113924,
+ "grad_norm": 0.029879426583647728,
+ "learning_rate": 2.4074074074074074e-05,
+ "loss": 0.020256631076335907,
+ "step": 1552
+ },
+ {
+ "epoch": 7.845569620253165,
+ "grad_norm": 0.04084770381450653,
+ "learning_rate": 2.4017957351290684e-05,
+ "loss": 0.020736820995807648,
+ "step": 1553
+ },
+ {
+ "epoch": 7.850632911392405,
+ "grad_norm": 0.03414049744606018,
+ "learning_rate": 2.3961840628507294e-05,
+ "loss": 0.019767913967370987,
+ "step": 1554
+ },
+ {
+ "epoch": 7.855696202531646,
+ "grad_norm": 0.039317626506090164,
+ "learning_rate": 2.3905723905723908e-05,
+ "loss": 0.018381286412477493,
+ "step": 1555
+ },
+ {
+ "epoch": 7.860759493670886,
+ "grad_norm": 0.031546756625175476,
+ "learning_rate": 2.3849607182940518e-05,
+ "loss": 0.02302321046590805,
+ "step": 1556
+ },
+ {
+ "epoch": 7.865822784810127,
+ "grad_norm": 0.029209598898887634,
+ "learning_rate": 2.3793490460157128e-05,
+ "loss": 0.018067756667733192,
+ "step": 1557
+ },
+ {
+ "epoch": 7.870886075949367,
+ "grad_norm": 0.051513414829969406,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.022878596559166908,
+ "step": 1558
+ },
+ {
+ "epoch": 7.875949367088608,
+ "grad_norm": 0.03623906150460243,
+ "learning_rate": 2.3681257014590348e-05,
+ "loss": 0.023763731122016907,
+ "step": 1559
+ },
+ {
+ "epoch": 7.881012658227848,
+ "grad_norm": 0.07554662227630615,
+ "learning_rate": 2.362514029180696e-05,
+ "loss": 0.030443711206316948,
+ "step": 1560
+ },
+ {
+ "epoch": 7.886075949367089,
+ "grad_norm": 0.0360538624227047,
+ "learning_rate": 2.356902356902357e-05,
+ "loss": 0.021874116733670235,
+ "step": 1561
+ },
+ {
+ "epoch": 7.891139240506329,
+ "grad_norm": 0.047155726701021194,
+ "learning_rate": 2.351290684624018e-05,
+ "loss": 0.019587252289056778,
+ "step": 1562
+ },
+ {
+ "epoch": 7.89620253164557,
+ "grad_norm": 0.04118090867996216,
+ "learning_rate": 2.345679012345679e-05,
+ "loss": 0.019452955573797226,
+ "step": 1563
+ },
+ {
+ "epoch": 7.9012658227848105,
+ "grad_norm": 0.04445638135075569,
+ "learning_rate": 2.34006734006734e-05,
+ "loss": 0.021509487181901932,
+ "step": 1564
+ },
+ {
+ "epoch": 7.90632911392405,
+ "grad_norm": 0.035687156021595,
+ "learning_rate": 2.3344556677890012e-05,
+ "loss": 0.0197590384632349,
+ "step": 1565
+ },
+ {
+ "epoch": 7.911392405063291,
+ "grad_norm": 0.0370895117521286,
+ "learning_rate": 2.3288439955106622e-05,
+ "loss": 0.02165234461426735,
+ "step": 1566
+ },
+ {
+ "epoch": 7.916455696202531,
+ "grad_norm": 0.047829173505306244,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.02411428466439247,
+ "step": 1567
+ },
+ {
+ "epoch": 7.921518987341772,
+ "grad_norm": 0.04207474738359451,
+ "learning_rate": 2.3176206509539845e-05,
+ "loss": 0.01990335062146187,
+ "step": 1568
+ },
+ {
+ "epoch": 7.926582278481012,
+ "grad_norm": 0.03687848150730133,
+ "learning_rate": 2.3120089786756455e-05,
+ "loss": 0.019368968904018402,
+ "step": 1569
+ },
+ {
+ "epoch": 7.931645569620253,
+ "grad_norm": 0.05300358310341835,
+ "learning_rate": 2.3063973063973065e-05,
+ "loss": 0.023623181506991386,
+ "step": 1570
+ },
+ {
+ "epoch": 7.936708860759493,
+ "grad_norm": 0.03355899825692177,
+ "learning_rate": 2.3007856341189676e-05,
+ "loss": 0.020780185237526894,
+ "step": 1571
+ },
+ {
+ "epoch": 7.941772151898734,
+ "grad_norm": 0.03521987795829773,
+ "learning_rate": 2.2951739618406286e-05,
+ "loss": 0.02071826532483101,
+ "step": 1572
+ },
+ {
+ "epoch": 7.946835443037974,
+ "grad_norm": 0.055831391364336014,
+ "learning_rate": 2.28956228956229e-05,
+ "loss": 0.024928733706474304,
+ "step": 1573
+ },
+ {
+ "epoch": 7.951898734177215,
+ "grad_norm": 0.035024408251047134,
+ "learning_rate": 2.2839506172839506e-05,
+ "loss": 0.025659071281552315,
+ "step": 1574
+ },
+ {
+ "epoch": 7.9569620253164555,
+ "grad_norm": 0.02845335751771927,
+ "learning_rate": 2.2783389450056116e-05,
+ "loss": 0.019141599535942078,
+ "step": 1575
+ },
+ {
+ "epoch": 7.962025316455696,
+ "grad_norm": 0.04973668232560158,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.019758496433496475,
+ "step": 1576
+ },
+ {
+ "epoch": 7.9670886075949365,
+ "grad_norm": 0.03656197339296341,
+ "learning_rate": 2.267115600448934e-05,
+ "loss": 0.02074349671602249,
+ "step": 1577
+ },
+ {
+ "epoch": 7.972151898734177,
+ "grad_norm": 0.02872154489159584,
+ "learning_rate": 2.261503928170595e-05,
+ "loss": 0.021470116451382637,
+ "step": 1578
+ },
+ {
+ "epoch": 7.977215189873418,
+ "grad_norm": 0.0539005771279335,
+ "learning_rate": 2.255892255892256e-05,
+ "loss": 0.02254091575741768,
+ "step": 1579
+ },
+ {
+ "epoch": 7.982278481012658,
+ "grad_norm": 0.02891739085316658,
+ "learning_rate": 2.250280583613917e-05,
+ "loss": 0.021109875291585922,
+ "step": 1580
+ },
+ {
+ "epoch": 7.987341772151899,
+ "grad_norm": 0.04463773965835571,
+ "learning_rate": 2.2446689113355783e-05,
+ "loss": 0.01814463920891285,
+ "step": 1581
+ },
+ {
+ "epoch": 7.992405063291139,
+ "grad_norm": 0.02977980673313141,
+ "learning_rate": 2.2390572390572393e-05,
+ "loss": 0.019279852509498596,
+ "step": 1582
+ },
+ {
+ "epoch": 7.99746835443038,
+ "grad_norm": 0.05468489229679108,
+ "learning_rate": 2.2334455667789003e-05,
+ "loss": 0.02706337347626686,
+ "step": 1583
+ },
+ {
+ "epoch": 8.0,
+ "grad_norm": 0.039158184081315994,
+ "learning_rate": 2.2278338945005613e-05,
+ "loss": 0.019180098548531532,
+ "step": 1584
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 1980,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 1.0086604463874048e+17,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-1584/training_args.bin b/checkpoint-1584/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ce6b9228ad6cf155da5af64a370f864d5fe04e56
--- /dev/null
+++ b/checkpoint-1584/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3a4d7936dc7001e3baf6e9cead308b6188ace221538f9d436668bdf0b1d43a1
+size 5777
diff --git a/checkpoint-175/README.md b/checkpoint-175/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-175/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-175/adapter_config.json b/checkpoint-175/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-175/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-175/adapter_model.safetensors b/checkpoint-175/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2a1e0fe6c4d84ab5d129c979b7fec1811d11c3d9
--- /dev/null
+++ b/checkpoint-175/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4240d0791bbc2da5c98e01256d2cc6ffb79078dcc53893bfdb03e0d8771bf620
+size 132187888
diff --git a/checkpoint-175/chat_template.jinja b/checkpoint-175/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-175/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-175/optimizer.pt b/checkpoint-175/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..de21ed26ff12fc885999d3d9ee1a916ac924defc
--- /dev/null
+++ b/checkpoint-175/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:beba8ed3f07ce67dc430befd37f4a748aaa88bd3d6b2a1480f099d05fab017ae
+size 67688197
diff --git a/checkpoint-175/rng_state.pth b/checkpoint-175/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..f8402b2586fcee7b5a43887ca285370521ba5f1e
--- /dev/null
+++ b/checkpoint-175/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2922886dc37f9211a4affea61093cbe4db90c0a37e91e7edac63ec0cf7b13d45
+size 14645
diff --git a/checkpoint-175/scheduler.pt b/checkpoint-175/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..e326453b323922ffc9f9d4b2eb5993387de5fd96
--- /dev/null
+++ b/checkpoint-175/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b23fe373828a7867d6e21ae2ae4ae7fcb52df2fd0558921b0c901c93fb2f3749
+size 1465
diff --git a/checkpoint-175/tokenizer.json b/checkpoint-175/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-175/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-175/tokenizer_config.json b/checkpoint-175/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-175/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-175/trainer_state.json b/checkpoint-175/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..495a90c46d729cef644744c3a6c26cdf69157759
--- /dev/null
+++ b/checkpoint-175/trainer_state.json
@@ -0,0 +1,1259 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 7.0,
+ "eval_steps": 500,
+ "global_step": 175,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ },
+ {
+ "epoch": 1.04,
+ "grad_norm": 0.36699211597442627,
+ "learning_rate": 0.0001,
+ "loss": 0.4363247752189636,
+ "step": 26
+ },
+ {
+ "epoch": 1.08,
+ "grad_norm": 0.3731786608695984,
+ "learning_rate": 9.955555555555556e-05,
+ "loss": 0.4297473430633545,
+ "step": 27
+ },
+ {
+ "epoch": 1.12,
+ "grad_norm": 0.3378784954547882,
+ "learning_rate": 9.911111111111112e-05,
+ "loss": 0.35973912477493286,
+ "step": 28
+ },
+ {
+ "epoch": 1.16,
+ "grad_norm": 0.36273664236068726,
+ "learning_rate": 9.866666666666668e-05,
+ "loss": 0.34903788566589355,
+ "step": 29
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 0.362885981798172,
+ "learning_rate": 9.822222222222223e-05,
+ "loss": 0.3119792342185974,
+ "step": 30
+ },
+ {
+ "epoch": 1.24,
+ "grad_norm": 0.3790324032306671,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 0.29530155658721924,
+ "step": 31
+ },
+ {
+ "epoch": 1.28,
+ "grad_norm": 0.37333837151527405,
+ "learning_rate": 9.733333333333335e-05,
+ "loss": 0.2653456926345825,
+ "step": 32
+ },
+ {
+ "epoch": 1.32,
+ "grad_norm": 0.32163503766059875,
+ "learning_rate": 9.68888888888889e-05,
+ "loss": 0.19654956459999084,
+ "step": 33
+ },
+ {
+ "epoch": 1.3599999999999999,
+ "grad_norm": 0.5297159552574158,
+ "learning_rate": 9.644444444444445e-05,
+ "loss": 0.23580318689346313,
+ "step": 34
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.4474238455295563,
+ "learning_rate": 9.6e-05,
+ "loss": 0.18798796832561493,
+ "step": 35
+ },
+ {
+ "epoch": 1.44,
+ "grad_norm": 0.31346794962882996,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 0.12066371738910675,
+ "step": 36
+ },
+ {
+ "epoch": 1.48,
+ "grad_norm": 0.3099532723426819,
+ "learning_rate": 9.511111111111112e-05,
+ "loss": 0.08859007060527802,
+ "step": 37
+ },
+ {
+ "epoch": 1.52,
+ "grad_norm": 0.3490828275680542,
+ "learning_rate": 9.466666666666667e-05,
+ "loss": 0.07878822088241577,
+ "step": 38
+ },
+ {
+ "epoch": 1.56,
+ "grad_norm": 0.32395538687705994,
+ "learning_rate": 9.422222222222223e-05,
+ "loss": 0.06694570928812027,
+ "step": 39
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 0.20870603621006012,
+ "learning_rate": 9.377777777777779e-05,
+ "loss": 0.04379018768668175,
+ "step": 40
+ },
+ {
+ "epoch": 1.6400000000000001,
+ "grad_norm": 0.3310009837150574,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.048647329211235046,
+ "step": 41
+ },
+ {
+ "epoch": 1.6800000000000002,
+ "grad_norm": 0.26949432492256165,
+ "learning_rate": 9.28888888888889e-05,
+ "loss": 0.039286017417907715,
+ "step": 42
+ },
+ {
+ "epoch": 1.72,
+ "grad_norm": 0.11029712855815887,
+ "learning_rate": 9.244444444444445e-05,
+ "loss": 0.029231950640678406,
+ "step": 43
+ },
+ {
+ "epoch": 1.76,
+ "grad_norm": 0.1476302146911621,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.027003085240721703,
+ "step": 44
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.18617521226406097,
+ "learning_rate": 9.155555555555557e-05,
+ "loss": 0.025106143206357956,
+ "step": 45
+ },
+ {
+ "epoch": 1.8399999999999999,
+ "grad_norm": 0.13198262453079224,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.025741657242178917,
+ "step": 46
+ },
+ {
+ "epoch": 1.88,
+ "grad_norm": 0.26712384819984436,
+ "learning_rate": 9.066666666666667e-05,
+ "loss": 0.035036977380514145,
+ "step": 47
+ },
+ {
+ "epoch": 1.92,
+ "grad_norm": 0.3569182753562927,
+ "learning_rate": 9.022222222222224e-05,
+ "loss": 0.04259534925222397,
+ "step": 48
+ },
+ {
+ "epoch": 1.96,
+ "grad_norm": 0.1843830794095993,
+ "learning_rate": 8.977777777777779e-05,
+ "loss": 0.03471647948026657,
+ "step": 49
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.1248057410120964,
+ "learning_rate": 8.933333333333334e-05,
+ "loss": 0.030936148017644882,
+ "step": 50
+ },
+ {
+ "epoch": 2.04,
+ "grad_norm": 0.12060711532831192,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.032452136278152466,
+ "step": 51
+ },
+ {
+ "epoch": 2.08,
+ "grad_norm": 0.2026030570268631,
+ "learning_rate": 8.844444444444445e-05,
+ "loss": 0.03268110007047653,
+ "step": 52
+ },
+ {
+ "epoch": 2.12,
+ "grad_norm": 0.21289987862110138,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.03406357392668724,
+ "step": 53
+ },
+ {
+ "epoch": 2.16,
+ "grad_norm": 0.14732478559017181,
+ "learning_rate": 8.755555555555556e-05,
+ "loss": 0.02936721034348011,
+ "step": 54
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.10120426118373871,
+ "learning_rate": 8.711111111111112e-05,
+ "loss": 0.02511693350970745,
+ "step": 55
+ },
+ {
+ "epoch": 2.24,
+ "grad_norm": 0.08917918056249619,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.025877539068460464,
+ "step": 56
+ },
+ {
+ "epoch": 2.2800000000000002,
+ "grad_norm": 0.08735086023807526,
+ "learning_rate": 8.622222222222222e-05,
+ "loss": 0.02145460993051529,
+ "step": 57
+ },
+ {
+ "epoch": 2.32,
+ "grad_norm": 0.07835431396961212,
+ "learning_rate": 8.577777777777777e-05,
+ "loss": 0.021244943141937256,
+ "step": 58
+ },
+ {
+ "epoch": 2.36,
+ "grad_norm": 0.06953317672014236,
+ "learning_rate": 8.533333333333334e-05,
+ "loss": 0.02279437705874443,
+ "step": 59
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.0854259729385376,
+ "learning_rate": 8.488888888888889e-05,
+ "loss": 0.023704543709754944,
+ "step": 60
+ },
+ {
+ "epoch": 2.44,
+ "grad_norm": 0.17068363726139069,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.035272784531116486,
+ "step": 61
+ },
+ {
+ "epoch": 2.48,
+ "grad_norm": 0.11971863359212875,
+ "learning_rate": 8.4e-05,
+ "loss": 0.02707826718688011,
+ "step": 62
+ },
+ {
+ "epoch": 2.52,
+ "grad_norm": 0.05303095281124115,
+ "learning_rate": 8.355555555555556e-05,
+ "loss": 0.01696968823671341,
+ "step": 63
+ },
+ {
+ "epoch": 2.56,
+ "grad_norm": 0.06503961980342865,
+ "learning_rate": 8.311111111111111e-05,
+ "loss": 0.018413860350847244,
+ "step": 64
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.05390244349837303,
+ "learning_rate": 8.266666666666667e-05,
+ "loss": 0.01641814410686493,
+ "step": 65
+ },
+ {
+ "epoch": 2.64,
+ "grad_norm": 0.07149611413478851,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.020658448338508606,
+ "step": 66
+ },
+ {
+ "epoch": 2.68,
+ "grad_norm": 0.09244706481695175,
+ "learning_rate": 8.177777777777778e-05,
+ "loss": 0.022394295781850815,
+ "step": 67
+ },
+ {
+ "epoch": 2.7199999999999998,
+ "grad_norm": 0.11381954699754715,
+ "learning_rate": 8.133333333333334e-05,
+ "loss": 0.028476765379309654,
+ "step": 68
+ },
+ {
+ "epoch": 2.76,
+ "grad_norm": 0.07354001700878143,
+ "learning_rate": 8.088888888888889e-05,
+ "loss": 0.019497834146022797,
+ "step": 69
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.06727641820907593,
+ "learning_rate": 8.044444444444444e-05,
+ "loss": 0.014356930740177631,
+ "step": 70
+ },
+ {
+ "epoch": 2.84,
+ "grad_norm": 0.07417713105678558,
+ "learning_rate": 8e-05,
+ "loss": 0.01823577657341957,
+ "step": 71
+ },
+ {
+ "epoch": 2.88,
+ "grad_norm": 0.09163317829370499,
+ "learning_rate": 7.955555555555556e-05,
+ "loss": 0.02139071188867092,
+ "step": 72
+ },
+ {
+ "epoch": 2.92,
+ "grad_norm": 0.08178975433111191,
+ "learning_rate": 7.911111111111111e-05,
+ "loss": 0.018335483968257904,
+ "step": 73
+ },
+ {
+ "epoch": 2.96,
+ "grad_norm": 0.08015220612287521,
+ "learning_rate": 7.866666666666666e-05,
+ "loss": 0.016001513227820396,
+ "step": 74
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.08509402722120285,
+ "learning_rate": 7.822222222222223e-05,
+ "loss": 0.017747700214385986,
+ "step": 75
+ },
+ {
+ "epoch": 3.04,
+ "grad_norm": 0.07863253355026245,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.015054607763886452,
+ "step": 76
+ },
+ {
+ "epoch": 3.08,
+ "grad_norm": 0.09398715198040009,
+ "learning_rate": 7.733333333333333e-05,
+ "loss": 0.01887289062142372,
+ "step": 77
+ },
+ {
+ "epoch": 3.12,
+ "grad_norm": 0.12165197730064392,
+ "learning_rate": 7.688888888888889e-05,
+ "loss": 0.020169202238321304,
+ "step": 78
+ },
+ {
+ "epoch": 3.16,
+ "grad_norm": 0.07627179473638535,
+ "learning_rate": 7.644444444444445e-05,
+ "loss": 0.012153002433478832,
+ "step": 79
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.0885142832994461,
+ "learning_rate": 7.6e-05,
+ "loss": 0.015390444546937943,
+ "step": 80
+ },
+ {
+ "epoch": 3.24,
+ "grad_norm": 0.11557707190513611,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.019245222210884094,
+ "step": 81
+ },
+ {
+ "epoch": 3.2800000000000002,
+ "grad_norm": 0.0976581946015358,
+ "learning_rate": 7.511111111111111e-05,
+ "loss": 0.014158917590975761,
+ "step": 82
+ },
+ {
+ "epoch": 3.32,
+ "grad_norm": 0.09829393774271011,
+ "learning_rate": 7.466666666666667e-05,
+ "loss": 0.013099931180477142,
+ "step": 83
+ },
+ {
+ "epoch": 3.36,
+ "grad_norm": 0.10063999146223068,
+ "learning_rate": 7.422222222222223e-05,
+ "loss": 0.013834481127560139,
+ "step": 84
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.09943496435880661,
+ "learning_rate": 7.377777777777778e-05,
+ "loss": 0.012920765206217766,
+ "step": 85
+ },
+ {
+ "epoch": 3.44,
+ "grad_norm": 0.1093878448009491,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.013458158820867538,
+ "step": 86
+ },
+ {
+ "epoch": 3.48,
+ "grad_norm": 0.1128634586930275,
+ "learning_rate": 7.28888888888889e-05,
+ "loss": 0.013067865744233131,
+ "step": 87
+ },
+ {
+ "epoch": 3.52,
+ "grad_norm": 0.11049138009548187,
+ "learning_rate": 7.244444444444445e-05,
+ "loss": 0.01237843930721283,
+ "step": 88
+ },
+ {
+ "epoch": 3.56,
+ "grad_norm": 0.1535821557044983,
+ "learning_rate": 7.2e-05,
+ "loss": 0.015146344900131226,
+ "step": 89
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.10436677187681198,
+ "learning_rate": 7.155555555555555e-05,
+ "loss": 0.00996164046227932,
+ "step": 90
+ },
+ {
+ "epoch": 3.64,
+ "grad_norm": 0.14084051549434662,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.013795388862490654,
+ "step": 91
+ },
+ {
+ "epoch": 3.68,
+ "grad_norm": 0.12718933820724487,
+ "learning_rate": 7.066666666666667e-05,
+ "loss": 0.011878985911607742,
+ "step": 92
+ },
+ {
+ "epoch": 3.7199999999999998,
+ "grad_norm": 0.1412353217601776,
+ "learning_rate": 7.022222222222222e-05,
+ "loss": 0.010964864864945412,
+ "step": 93
+ },
+ {
+ "epoch": 3.76,
+ "grad_norm": 0.11453556269407272,
+ "learning_rate": 6.977777777777779e-05,
+ "loss": 0.008170144632458687,
+ "step": 94
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.16155096888542175,
+ "learning_rate": 6.933333333333334e-05,
+ "loss": 0.011488870717585087,
+ "step": 95
+ },
+ {
+ "epoch": 3.84,
+ "grad_norm": 0.11969174444675446,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.007895090617239475,
+ "step": 96
+ },
+ {
+ "epoch": 3.88,
+ "grad_norm": 0.22626101970672607,
+ "learning_rate": 6.844444444444445e-05,
+ "loss": 0.01467936858534813,
+ "step": 97
+ },
+ {
+ "epoch": 3.92,
+ "grad_norm": 0.21040032804012299,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.010772328823804855,
+ "step": 98
+ },
+ {
+ "epoch": 3.96,
+ "grad_norm": 0.19558775424957275,
+ "learning_rate": 6.755555555555557e-05,
+ "loss": 0.009220557287335396,
+ "step": 99
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.18061381578445435,
+ "learning_rate": 6.711111111111112e-05,
+ "loss": 0.006471008062362671,
+ "step": 100
+ },
+ {
+ "epoch": 4.04,
+ "grad_norm": 0.12179632484912872,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.0057976702228188515,
+ "step": 101
+ },
+ {
+ "epoch": 4.08,
+ "grad_norm": 0.12671399116516113,
+ "learning_rate": 6.622222222222224e-05,
+ "loss": 0.006621541455388069,
+ "step": 102
+ },
+ {
+ "epoch": 4.12,
+ "grad_norm": 0.11084511876106262,
+ "learning_rate": 6.577777777777779e-05,
+ "loss": 0.006054866127669811,
+ "step": 103
+ },
+ {
+ "epoch": 4.16,
+ "grad_norm": 0.12502190470695496,
+ "learning_rate": 6.533333333333334e-05,
+ "loss": 0.00817898940294981,
+ "step": 104
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.09107036888599396,
+ "learning_rate": 6.488888888888889e-05,
+ "loss": 0.006295117549598217,
+ "step": 105
+ },
+ {
+ "epoch": 4.24,
+ "grad_norm": 0.07194884121417999,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.006192575674504042,
+ "step": 106
+ },
+ {
+ "epoch": 4.28,
+ "grad_norm": 0.03464571759104729,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.003843494923785329,
+ "step": 107
+ },
+ {
+ "epoch": 4.32,
+ "grad_norm": 0.10040883719921112,
+ "learning_rate": 6.355555555555556e-05,
+ "loss": 0.006318099796772003,
+ "step": 108
+ },
+ {
+ "epoch": 4.36,
+ "grad_norm": 0.07303845882415771,
+ "learning_rate": 6.311111111111112e-05,
+ "loss": 0.0047858962789177895,
+ "step": 109
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.03440818190574646,
+ "learning_rate": 6.266666666666667e-05,
+ "loss": 0.004050814546644688,
+ "step": 110
+ },
+ {
+ "epoch": 4.44,
+ "grad_norm": 0.046613194048404694,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.0035898215137422085,
+ "step": 111
+ },
+ {
+ "epoch": 4.48,
+ "grad_norm": 0.02108742855489254,
+ "learning_rate": 6.177777777777779e-05,
+ "loss": 0.003291932400316,
+ "step": 112
+ },
+ {
+ "epoch": 4.52,
+ "grad_norm": 0.04408564418554306,
+ "learning_rate": 6.133333333333334e-05,
+ "loss": 0.0033779453951865435,
+ "step": 113
+ },
+ {
+ "epoch": 4.5600000000000005,
+ "grad_norm": 0.022311383858323097,
+ "learning_rate": 6.08888888888889e-05,
+ "loss": 0.0038345090579241514,
+ "step": 114
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.026365282014012337,
+ "learning_rate": 6.044444444444445e-05,
+ "loss": 0.004205222241580486,
+ "step": 115
+ },
+ {
+ "epoch": 4.64,
+ "grad_norm": 0.04582115262746811,
+ "learning_rate": 6e-05,
+ "loss": 0.005077291280031204,
+ "step": 116
+ },
+ {
+ "epoch": 4.68,
+ "grad_norm": 0.05057913810014725,
+ "learning_rate": 5.9555555555555554e-05,
+ "loss": 0.004747368395328522,
+ "step": 117
+ },
+ {
+ "epoch": 4.72,
+ "grad_norm": 0.04699229821562767,
+ "learning_rate": 5.911111111111112e-05,
+ "loss": 0.00538603262975812,
+ "step": 118
+ },
+ {
+ "epoch": 4.76,
+ "grad_norm": 0.026704438030719757,
+ "learning_rate": 5.866666666666667e-05,
+ "loss": 0.0041087716817855835,
+ "step": 119
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.04175629839301109,
+ "learning_rate": 5.8222222222222224e-05,
+ "loss": 0.004437651485204697,
+ "step": 120
+ },
+ {
+ "epoch": 4.84,
+ "grad_norm": 0.032657600939273834,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.003728377167135477,
+ "step": 121
+ },
+ {
+ "epoch": 4.88,
+ "grad_norm": 0.03405195474624634,
+ "learning_rate": 5.7333333333333336e-05,
+ "loss": 0.005017922259867191,
+ "step": 122
+ },
+ {
+ "epoch": 4.92,
+ "grad_norm": 0.02600262127816677,
+ "learning_rate": 5.6888888888888895e-05,
+ "loss": 0.003841507714241743,
+ "step": 123
+ },
+ {
+ "epoch": 4.96,
+ "grad_norm": 0.03402233496308327,
+ "learning_rate": 5.644444444444445e-05,
+ "loss": 0.002483899937942624,
+ "step": 124
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.03151554986834526,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 0.0036559500731527805,
+ "step": 125
+ },
+ {
+ "epoch": 5.04,
+ "grad_norm": 0.03822990879416466,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.0028562736697494984,
+ "step": 126
+ },
+ {
+ "epoch": 5.08,
+ "grad_norm": 0.028356632217764854,
+ "learning_rate": 5.511111111111111e-05,
+ "loss": 0.003123738570138812,
+ "step": 127
+ },
+ {
+ "epoch": 5.12,
+ "grad_norm": 0.032560307532548904,
+ "learning_rate": 5.466666666666666e-05,
+ "loss": 0.004612874239683151,
+ "step": 128
+ },
+ {
+ "epoch": 5.16,
+ "grad_norm": 0.023662906140089035,
+ "learning_rate": 5.422222222222223e-05,
+ "loss": 0.0028404039330780506,
+ "step": 129
+ },
+ {
+ "epoch": 5.2,
+ "grad_norm": 0.03967975080013275,
+ "learning_rate": 5.377777777777778e-05,
+ "loss": 0.004116460680961609,
+ "step": 130
+ },
+ {
+ "epoch": 5.24,
+ "grad_norm": 0.02488141693174839,
+ "learning_rate": 5.333333333333333e-05,
+ "loss": 0.0041904142126441,
+ "step": 131
+ },
+ {
+ "epoch": 5.28,
+ "grad_norm": 0.011391286738216877,
+ "learning_rate": 5.2888888888888885e-05,
+ "loss": 0.002993058878928423,
+ "step": 132
+ },
+ {
+ "epoch": 5.32,
+ "grad_norm": 0.02595183439552784,
+ "learning_rate": 5.244444444444445e-05,
+ "loss": 0.00301048019900918,
+ "step": 133
+ },
+ {
+ "epoch": 5.36,
+ "grad_norm": 0.014937770552933216,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 0.003106491407379508,
+ "step": 134
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.0208111684769392,
+ "learning_rate": 5.1555555555555556e-05,
+ "loss": 0.003945561125874519,
+ "step": 135
+ },
+ {
+ "epoch": 5.44,
+ "grad_norm": 0.01186386402696371,
+ "learning_rate": 5.111111111111111e-05,
+ "loss": 0.003586095292121172,
+ "step": 136
+ },
+ {
+ "epoch": 5.48,
+ "grad_norm": 0.012205840088427067,
+ "learning_rate": 5.0666666666666674e-05,
+ "loss": 0.0032413718290627003,
+ "step": 137
+ },
+ {
+ "epoch": 5.52,
+ "grad_norm": 0.02764296717941761,
+ "learning_rate": 5.0222222222222226e-05,
+ "loss": 0.0030944915488362312,
+ "step": 138
+ },
+ {
+ "epoch": 5.5600000000000005,
+ "grad_norm": 0.023670295253396034,
+ "learning_rate": 4.977777777777778e-05,
+ "loss": 0.0030482488218694925,
+ "step": 139
+ },
+ {
+ "epoch": 5.6,
+ "grad_norm": 0.024959059432148933,
+ "learning_rate": 4.933333333333334e-05,
+ "loss": 0.002743522170931101,
+ "step": 140
+ },
+ {
+ "epoch": 5.64,
+ "grad_norm": 0.019349221140146255,
+ "learning_rate": 4.888888888888889e-05,
+ "loss": 0.002883533015847206,
+ "step": 141
+ },
+ {
+ "epoch": 5.68,
+ "grad_norm": 0.021185332909226418,
+ "learning_rate": 4.844444444444445e-05,
+ "loss": 0.0025618618819862604,
+ "step": 142
+ },
+ {
+ "epoch": 5.72,
+ "grad_norm": 0.017232399433851242,
+ "learning_rate": 4.8e-05,
+ "loss": 0.0027296345215290785,
+ "step": 143
+ },
+ {
+ "epoch": 5.76,
+ "grad_norm": 0.025460300967097282,
+ "learning_rate": 4.755555555555556e-05,
+ "loss": 0.002679885132238269,
+ "step": 144
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.021230001002550125,
+ "learning_rate": 4.711111111111111e-05,
+ "loss": 0.0037597499322146177,
+ "step": 145
+ },
+ {
+ "epoch": 5.84,
+ "grad_norm": 0.018495697528123856,
+ "learning_rate": 4.666666666666667e-05,
+ "loss": 0.0026929471641778946,
+ "step": 146
+ },
+ {
+ "epoch": 5.88,
+ "grad_norm": 0.027612268924713135,
+ "learning_rate": 4.6222222222222224e-05,
+ "loss": 0.0031238074880093336,
+ "step": 147
+ },
+ {
+ "epoch": 5.92,
+ "grad_norm": 0.039522312581539154,
+ "learning_rate": 4.577777777777778e-05,
+ "loss": 0.0035351444967091084,
+ "step": 148
+ },
+ {
+ "epoch": 5.96,
+ "grad_norm": 0.014303261414170265,
+ "learning_rate": 4.5333333333333335e-05,
+ "loss": 0.0025896867737174034,
+ "step": 149
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.03775525838136673,
+ "learning_rate": 4.4888888888888894e-05,
+ "loss": 0.0035551211331039667,
+ "step": 150
+ },
+ {
+ "epoch": 6.04,
+ "grad_norm": 0.04990272596478462,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.004297541920095682,
+ "step": 151
+ },
+ {
+ "epoch": 6.08,
+ "grad_norm": 0.017710352316498756,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 0.0033112887758761644,
+ "step": 152
+ },
+ {
+ "epoch": 6.12,
+ "grad_norm": 0.022754572331905365,
+ "learning_rate": 4.355555555555556e-05,
+ "loss": 0.002353265881538391,
+ "step": 153
+ },
+ {
+ "epoch": 6.16,
+ "grad_norm": 0.02410873770713806,
+ "learning_rate": 4.311111111111111e-05,
+ "loss": 0.0037385188043117523,
+ "step": 154
+ },
+ {
+ "epoch": 6.2,
+ "grad_norm": 0.02232186868786812,
+ "learning_rate": 4.266666666666667e-05,
+ "loss": 0.00313817011192441,
+ "step": 155
+ },
+ {
+ "epoch": 6.24,
+ "grad_norm": 0.02414192631840706,
+ "learning_rate": 4.222222222222222e-05,
+ "loss": 0.003970893565565348,
+ "step": 156
+ },
+ {
+ "epoch": 6.28,
+ "grad_norm": 0.03084409236907959,
+ "learning_rate": 4.177777777777778e-05,
+ "loss": 0.0034115584567189217,
+ "step": 157
+ },
+ {
+ "epoch": 6.32,
+ "grad_norm": 0.035011716187000275,
+ "learning_rate": 4.133333333333333e-05,
+ "loss": 0.004035938531160355,
+ "step": 158
+ },
+ {
+ "epoch": 6.36,
+ "grad_norm": 0.0190069992095232,
+ "learning_rate": 4.088888888888889e-05,
+ "loss": 0.003001230303198099,
+ "step": 159
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.03748108446598053,
+ "learning_rate": 4.0444444444444444e-05,
+ "loss": 0.0041668531484901905,
+ "step": 160
+ },
+ {
+ "epoch": 6.44,
+ "grad_norm": 0.03820832818746567,
+ "learning_rate": 4e-05,
+ "loss": 0.0028840310405939817,
+ "step": 161
+ },
+ {
+ "epoch": 6.48,
+ "grad_norm": 0.039001427590847015,
+ "learning_rate": 3.9555555555555556e-05,
+ "loss": 0.0028830585069954395,
+ "step": 162
+ },
+ {
+ "epoch": 6.52,
+ "grad_norm": 0.02733510732650757,
+ "learning_rate": 3.9111111111111115e-05,
+ "loss": 0.002750289160758257,
+ "step": 163
+ },
+ {
+ "epoch": 6.5600000000000005,
+ "grad_norm": 0.01641351543366909,
+ "learning_rate": 3.866666666666667e-05,
+ "loss": 0.002791184466332197,
+ "step": 164
+ },
+ {
+ "epoch": 6.6,
+ "grad_norm": 0.021426184102892876,
+ "learning_rate": 3.8222222222222226e-05,
+ "loss": 0.0032122773118317127,
+ "step": 165
+ },
+ {
+ "epoch": 6.64,
+ "grad_norm": 0.026212267577648163,
+ "learning_rate": 3.777777777777778e-05,
+ "loss": 0.002747473306953907,
+ "step": 166
+ },
+ {
+ "epoch": 6.68,
+ "grad_norm": 0.019693776965141296,
+ "learning_rate": 3.733333333333334e-05,
+ "loss": 0.002691935747861862,
+ "step": 167
+ },
+ {
+ "epoch": 6.72,
+ "grad_norm": 0.02187752164900303,
+ "learning_rate": 3.688888888888889e-05,
+ "loss": 0.0032634371891617775,
+ "step": 168
+ },
+ {
+ "epoch": 6.76,
+ "grad_norm": 0.02258922904729843,
+ "learning_rate": 3.644444444444445e-05,
+ "loss": 0.0025645019486546516,
+ "step": 169
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.02120850421488285,
+ "learning_rate": 3.6e-05,
+ "loss": 0.002402626909315586,
+ "step": 170
+ },
+ {
+ "epoch": 6.84,
+ "grad_norm": 0.027142135426402092,
+ "learning_rate": 3.555555555555556e-05,
+ "loss": 0.0029081657994538546,
+ "step": 171
+ },
+ {
+ "epoch": 6.88,
+ "grad_norm": 0.016608284786343575,
+ "learning_rate": 3.511111111111111e-05,
+ "loss": 0.002675814088433981,
+ "step": 172
+ },
+ {
+ "epoch": 6.92,
+ "grad_norm": 0.025261735543608665,
+ "learning_rate": 3.466666666666667e-05,
+ "loss": 0.0027554240077733994,
+ "step": 173
+ },
+ {
+ "epoch": 6.96,
+ "grad_norm": 0.027320940047502518,
+ "learning_rate": 3.4222222222222224e-05,
+ "loss": 0.003410451812669635,
+ "step": 174
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.026871275156736374,
+ "learning_rate": 3.377777777777778e-05,
+ "loss": 0.003376966342329979,
+ "step": 175
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 8584284311715840.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-175/training_args.bin b/checkpoint-175/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-175/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-1782/README.md b/checkpoint-1782/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-1782/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-1782/adapter_config.json b/checkpoint-1782/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..879d59d17cdb2aff2a9fcb7e4537a4f740bf19f5
--- /dev/null
+++ b/checkpoint-1782/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "o_proj",
+ "up_proj",
+ "down_proj",
+ "v_proj",
+ "k_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-1782/adapter_model.safetensors b/checkpoint-1782/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..f064f9125aa852d22b4a94562b1daf1954b6fa92
--- /dev/null
+++ b/checkpoint-1782/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b87be424e9700d5a2bf76a4ece93bde1af4f2878da654e1769d34dcdebba42dd
+size 132187888
diff --git a/checkpoint-1782/chat_template.jinja b/checkpoint-1782/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-1782/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-1782/optimizer.pt b/checkpoint-1782/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..59973f4b7866f70f11ae4f459b195799ebd686e7
--- /dev/null
+++ b/checkpoint-1782/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d84db4b06c89abb3dba6a62901a34614eee661884386087c6f69adfc55ef94a3
+size 67688645
diff --git a/checkpoint-1782/rng_state.pth b/checkpoint-1782/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..77729d4bc088ad9fab197923e9ca84ef702af1bc
--- /dev/null
+++ b/checkpoint-1782/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6846fcb7fd5a783ad80e0c1c5902482ea69e479e8dfeb46ebc73e2f33affb875
+size 14645
diff --git a/checkpoint-1782/scheduler.pt b/checkpoint-1782/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..0906525f895111cd330d1d6edf874b879b7ba36c
--- /dev/null
+++ b/checkpoint-1782/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1ceb8a4194aca82ce57679297a7dada91c34387f6dec3d69dd4c397f44b83e9b
+size 1465
diff --git a/checkpoint-1782/tokenizer.json b/checkpoint-1782/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-1782/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-1782/tokenizer_config.json b/checkpoint-1782/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-1782/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-1782/trainer_state.json b/checkpoint-1782/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..25d12dcee7d60fd0d30e66e0a010b54b1ac80e15
--- /dev/null
+++ b/checkpoint-1782/trainer_state.json
@@ -0,0 +1,12508 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 9.0,
+ "eval_steps": 500,
+ "global_step": 1782,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.54137122631073,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279057860374451,
+ "learning_rate": 5.050505050505052e-07,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.7017749547958374,
+ "learning_rate": 1.0101010101010103e-06,
+ "loss": 1.0435928106307983,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6033008098602295,
+ "learning_rate": 1.5151515151515152e-06,
+ "loss": 0.8843490481376648,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5495544672012329,
+ "learning_rate": 2.0202020202020206e-06,
+ "loss": 0.8034592866897583,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.802371621131897,
+ "learning_rate": 2.5252525252525253e-06,
+ "loss": 1.1588364839553833,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8238587975502014,
+ "learning_rate": 3.0303030303030305e-06,
+ "loss": 1.228503942489624,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6073964238166809,
+ "learning_rate": 3.5353535353535352e-06,
+ "loss": 0.8989433646202087,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 0.6492345333099365,
+ "learning_rate": 4.040404040404041e-06,
+ "loss": 0.9615614414215088,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.6880183815956116,
+ "learning_rate": 4.5454545454545455e-06,
+ "loss": 0.9233697652816772,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.470304012298584,
+ "learning_rate": 5.050505050505051e-06,
+ "loss": 0.7186562418937683,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6361913681030273,
+ "learning_rate": 5.555555555555556e-06,
+ "loss": 0.9312829375267029,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5554782152175903,
+ "learning_rate": 6.060606060606061e-06,
+ "loss": 0.8529565334320068,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5414550304412842,
+ "learning_rate": 6.565656565656567e-06,
+ "loss": 0.8071130514144897,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9267164468765259,
+ "learning_rate": 7.0707070707070704e-06,
+ "loss": 1.3577998876571655,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.6104046106338501,
+ "learning_rate": 7.5757575757575764e-06,
+ "loss": 0.923499345779419,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.7241935133934021,
+ "learning_rate": 8.080808080808082e-06,
+ "loss": 1.0400190353393555,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.6026384830474854,
+ "learning_rate": 8.585858585858587e-06,
+ "loss": 0.8413939476013184,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.7690514922142029,
+ "learning_rate": 9.090909090909091e-06,
+ "loss": 1.0870859622955322,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.5940403342247009,
+ "learning_rate": 9.595959595959595e-06,
+ "loss": 0.8468416929244995,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.669230580329895,
+ "learning_rate": 1.0101010101010101e-05,
+ "loss": 0.9340983629226685,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.5750640034675598,
+ "learning_rate": 1.0606060606060607e-05,
+ "loss": 0.8230171799659729,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.6579262614250183,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.9293508529663086,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.5956451296806335,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.8316305875778198,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.7270558476448059,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.9129499197006226,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.7505611777305603,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 1.0138367414474487,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.6870062947273254,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.901283860206604,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.7679643630981445,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.9833810329437256,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.866938591003418,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.8958402872085571,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.8687500357627869,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 1.1289801597595215,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 4.008030891418457,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 1.2739044427871704,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.7689681053161621,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.8514111638069153,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.7880434393882751,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.8862775564193726,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.6183183789253235,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.7857811450958252,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.6437809467315674,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.7093011736869812,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.5481512546539307,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.7350327968597412,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.4838634729385376,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.6584650874137878,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.523994505405426,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.7211161851882935,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.6523379683494568,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.9044773578643799,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.4274725615978241,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.568337082862854,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.5060272812843323,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.7201821208000183,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.3760877251625061,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.5880123376846313,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.3715391457080841,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.5693179368972778,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.4332570731639862,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.7277271151542664,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.38201987743377686,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.6458995938301086,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.4358846843242645,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.7559939026832581,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.4566098749637604,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.7792297601699829,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.3864676356315613,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.6894873380661011,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.31187522411346436,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.545581579208374,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.3325943350791931,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.5917496085166931,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.6410307884216309,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.44281136989593506,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.36323168873786926,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.6426926851272583,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.31924113631248474,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.5482619404792786,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.3632371723651886,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.6188253164291382,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.375381201505661,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.5487836003303528,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.3163473606109619,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.5367064476013184,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.42646294832229614,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.41221165657043457,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.41622766852378845,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.5274936556816101,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.30204030871391296,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.44855833053588867,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.3178975582122803,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.4036139249801636,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.2893930673599243,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.39234185218811035,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.2833489775657654,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.37406405806541443,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.3216562867164612,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.3938276767730713,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.26721706986427307,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.30402088165283203,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.3702670931816101,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.30594947934150696,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.2632184326648712,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.2691727876663208,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.36898860335350037,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.33992528915405273,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.2976086735725403,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.27603086829185486,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.32201430201530457,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.25665703415870667,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.35001808404922485,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.24190445244312286,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.5106059908866882,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.3093336820602417,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.3261374831199646,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.18783289194107056,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.38757652044296265,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.19549766182899475,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.4723363518714905,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.15751558542251587,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.36796173453330994,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.14514681696891785,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.3855208456516266,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.14030519127845764,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.5906668305397034,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.1478388011455536,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.2658001780509949,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.13253600895404816,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.33554506301879883,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.12156252562999725,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.2643960416316986,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.1089208647608757,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.19129537045955658,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.08515600860118866,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.22168858349323273,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.09310197830200195,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.16676382720470428,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.07711787521839142,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.23891882598400116,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.09763285517692566,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.28446146845817566,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.08980057388544083,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.146108940243721,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.06573648750782013,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.2007656991481781,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.0699995830655098,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.3082621395587921,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.0885838121175766,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.1624963879585266,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.06935172528028488,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.1562737673521042,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.07147250324487686,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.1660323292016983,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.0672944188117981,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.21427564322948456,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.07051930576562881,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.16495929658412933,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.05429624393582344,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.1978198140859604,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.07144488394260406,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.15077605843544006,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.055798254907131195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.2806876301765442,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.06058178097009659,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.1219187006354332,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.05044667422771454,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10286939144134521,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.048498690128326416,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.12813609838485718,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.06252863258123398,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10565406829118729,
+ "learning_rate": 5e-05,
+ "loss": 0.051401108503341675,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.09147113561630249,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.047376491129398346,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.08723224699497223,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.039745647460222244,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.16071128845214844,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.058398712426424026,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.1370300054550171,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.05132289230823517,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.19449608027935028,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.06682188808917999,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.13085028529167175,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.049861155450344086,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.1768050193786621,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.055694688111543655,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.2819313704967499,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.062391363084316254,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.10738537460565567,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.05093343183398247,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.11759619414806366,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.044827841222286224,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.21941131353378296,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.05238347500562668,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.1697252243757248,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.04869212955236435,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.19701889157295227,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.04484856128692627,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.11779771000146866,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.04135368764400482,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.19823911786079407,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.05097956955432892,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.17355702817440033,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.05781872197985649,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.13029292225837708,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.041528262197971344,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.1292058229446411,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.0442211888730526,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10058800131082535,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.03813612461090088,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.22936487197875977,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.056090980768203735,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.13063806295394897,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.04347142577171326,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.167104110121727,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.04442849010229111,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.11942817270755768,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.03964124619960785,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.17906631529331207,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.04372458904981613,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.13760331273078918,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.03980286419391632,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.18043340742588043,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.05500294268131256,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.31386223435401917,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.04253799840807915,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.1428707093000412,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.047894880175590515,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.11010178923606873,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.04534825310111046,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.10444525629281998,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.041347943246364594,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.18076039850711823,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.04535853862762451,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.19424672424793243,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.05037602037191391,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.1457783728837967,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.047546930611133575,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.1189681887626648,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.03254905715584755,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.18887822329998016,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.04018670320510864,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.12217189371585846,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.03981504589319229,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.10866257548332214,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.04322533681988716,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.15904399752616882,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.04488902539014816,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.12598516047000885,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.04718853533267975,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.22092872858047485,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.03646199405193329,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.1717238426208496,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.04607801511883736,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.16268078982830048,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.04759417474269867,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.19621087610721588,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.051741112023591995,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.15362979471683502,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.04363569617271423,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.1404130607843399,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.045428819954395294,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.12262272834777832,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.03828439861536026,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.10626570880413055,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.03420639410614967,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.12686072289943695,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.03474457561969757,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.153709277510643,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.03174472972750664,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.13035084307193756,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.02982976846396923,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.12288431823253632,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.03588784486055374,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.19307470321655273,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.04750734567642212,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.0996781438589096,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.027098631486296654,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.16898290812969208,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.040447790175676346,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.10996036231517792,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.02525201067328453,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.16161896288394928,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.04199359938502312,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.1536172777414322,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.02943507581949234,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.18457260727882385,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.04093889892101288,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.11232347041368484,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.029609719291329384,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.19080978631973267,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.0357801653444767,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.16634301841259003,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02980419248342514,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.28601372241973877,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.032849978655576706,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.1359848529100418,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.0230826735496521,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.11285015195608139,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.02447221614420414,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.14712421596050262,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.022657420486211777,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.18246804177761078,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.035991013050079346,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.143621563911438,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.024444863200187683,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.12458691000938416,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.039701592177152634,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05614984780550003,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.029840555042028427,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.06097931042313576,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.027426715940237045,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.09883654862642288,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031690437346696854,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.0700431764125824,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.024079838767647743,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.05957406386733055,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.02303817868232727,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.14374858140945435,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.031183632090687752,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.09187919646501541,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.031176958233118057,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.0540630929172039,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.024949276819825172,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06875574588775635,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.02890622243285179,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.10081329196691513,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.03019360452890396,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.11833225935697556,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.020365778356790543,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.08700298517942429,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.027046984061598778,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.08660133928060532,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.027088070288300514,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.06983930617570877,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.019332535564899445,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.09463227540254593,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.02780212089419365,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.10251298546791077,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.026878856122493744,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.15963847935199738,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.03437665104866028,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.11342372000217438,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.02877948433160782,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.0937543660402298,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.02759186364710331,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.07137084752321243,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.02941890060901642,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.3511611819267273,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.024331524968147278,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.12344356626272202,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.0348694771528244,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.07144290208816528,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.021711278706789017,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.09835992008447647,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.03408564254641533,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.4978399872779846,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.03810017928481102,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.06314591318368912,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.0201277956366539,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.07504695653915405,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.025770913809537888,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.1028534397482872,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.02469150349497795,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.09341974556446075,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.036506302654743195,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09348680078983307,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02507903426885605,
+ "step": 198
+ },
+ {
+ "epoch": 1.0050632911392405,
+ "grad_norm": 0.06890113651752472,
+ "learning_rate": 0.0001,
+ "loss": 0.028374083340168,
+ "step": 199
+ },
+ {
+ "epoch": 1.010126582278481,
+ "grad_norm": 0.051041170954704285,
+ "learning_rate": 9.994388327721661e-05,
+ "loss": 0.022860335186123848,
+ "step": 200
+ },
+ {
+ "epoch": 1.0151898734177216,
+ "grad_norm": 0.10253743082284927,
+ "learning_rate": 9.988776655443322e-05,
+ "loss": 0.02864072285592556,
+ "step": 201
+ },
+ {
+ "epoch": 1.0202531645569621,
+ "grad_norm": 0.08295776695013046,
+ "learning_rate": 9.983164983164983e-05,
+ "loss": 0.0327395498752594,
+ "step": 202
+ },
+ {
+ "epoch": 1.0253164556962024,
+ "grad_norm": 0.07240694016218185,
+ "learning_rate": 9.977553310886645e-05,
+ "loss": 0.029215697199106216,
+ "step": 203
+ },
+ {
+ "epoch": 1.030379746835443,
+ "grad_norm": 0.0688897892832756,
+ "learning_rate": 9.971941638608306e-05,
+ "loss": 0.027594968676567078,
+ "step": 204
+ },
+ {
+ "epoch": 1.0354430379746835,
+ "grad_norm": 0.08463896065950394,
+ "learning_rate": 9.966329966329967e-05,
+ "loss": 0.02292536199092865,
+ "step": 205
+ },
+ {
+ "epoch": 1.040506329113924,
+ "grad_norm": 0.062013301998376846,
+ "learning_rate": 9.960718294051628e-05,
+ "loss": 0.023678191006183624,
+ "step": 206
+ },
+ {
+ "epoch": 1.0455696202531646,
+ "grad_norm": 0.08735264092683792,
+ "learning_rate": 9.955106621773289e-05,
+ "loss": 0.022060325369238853,
+ "step": 207
+ },
+ {
+ "epoch": 1.0506329113924051,
+ "grad_norm": 0.07634295523166656,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02764434739947319,
+ "step": 208
+ },
+ {
+ "epoch": 1.0556962025316456,
+ "grad_norm": 0.09735682606697083,
+ "learning_rate": 9.943883277216612e-05,
+ "loss": 0.03304428607225418,
+ "step": 209
+ },
+ {
+ "epoch": 1.0607594936708862,
+ "grad_norm": 0.06860044598579407,
+ "learning_rate": 9.938271604938272e-05,
+ "loss": 0.0340178906917572,
+ "step": 210
+ },
+ {
+ "epoch": 1.0658227848101265,
+ "grad_norm": 0.3715139627456665,
+ "learning_rate": 9.932659932659934e-05,
+ "loss": 0.02541016787290573,
+ "step": 211
+ },
+ {
+ "epoch": 1.070886075949367,
+ "grad_norm": 0.07673332840204239,
+ "learning_rate": 9.927048260381594e-05,
+ "loss": 0.025950253009796143,
+ "step": 212
+ },
+ {
+ "epoch": 1.0759493670886076,
+ "grad_norm": 0.07359500974416733,
+ "learning_rate": 9.921436588103256e-05,
+ "loss": 0.024356549605727196,
+ "step": 213
+ },
+ {
+ "epoch": 1.081012658227848,
+ "grad_norm": 0.07760954648256302,
+ "learning_rate": 9.915824915824916e-05,
+ "loss": 0.02338298037648201,
+ "step": 214
+ },
+ {
+ "epoch": 1.0860759493670886,
+ "grad_norm": 0.09183681756258011,
+ "learning_rate": 9.910213243546578e-05,
+ "loss": 0.020955465734004974,
+ "step": 215
+ },
+ {
+ "epoch": 1.0911392405063292,
+ "grad_norm": 0.21278677880764008,
+ "learning_rate": 9.904601571268239e-05,
+ "loss": 0.028164055198431015,
+ "step": 216
+ },
+ {
+ "epoch": 1.0962025316455697,
+ "grad_norm": 0.22437937557697296,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.03543347865343094,
+ "step": 217
+ },
+ {
+ "epoch": 1.1012658227848102,
+ "grad_norm": 0.08677598088979721,
+ "learning_rate": 9.893378226711561e-05,
+ "loss": 0.031265974044799805,
+ "step": 218
+ },
+ {
+ "epoch": 1.1063291139240505,
+ "grad_norm": 0.09595583379268646,
+ "learning_rate": 9.887766554433222e-05,
+ "loss": 0.02384507656097412,
+ "step": 219
+ },
+ {
+ "epoch": 1.111392405063291,
+ "grad_norm": 0.08256062865257263,
+ "learning_rate": 9.882154882154883e-05,
+ "loss": 0.022209012880921364,
+ "step": 220
+ },
+ {
+ "epoch": 1.1164556962025316,
+ "grad_norm": 0.07712455838918686,
+ "learning_rate": 9.876543209876543e-05,
+ "loss": 0.025278344750404358,
+ "step": 221
+ },
+ {
+ "epoch": 1.1215189873417721,
+ "grad_norm": 0.09704182296991348,
+ "learning_rate": 9.870931537598205e-05,
+ "loss": 0.024904735386371613,
+ "step": 222
+ },
+ {
+ "epoch": 1.1265822784810127,
+ "grad_norm": 0.09094078838825226,
+ "learning_rate": 9.865319865319865e-05,
+ "loss": 0.0280012097209692,
+ "step": 223
+ },
+ {
+ "epoch": 1.1316455696202532,
+ "grad_norm": 0.07607442885637283,
+ "learning_rate": 9.859708193041527e-05,
+ "loss": 0.026181645691394806,
+ "step": 224
+ },
+ {
+ "epoch": 1.1367088607594937,
+ "grad_norm": 0.06568697839975357,
+ "learning_rate": 9.854096520763188e-05,
+ "loss": 0.02883346565067768,
+ "step": 225
+ },
+ {
+ "epoch": 1.1417721518987343,
+ "grad_norm": 0.07192376255989075,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.027345171198248863,
+ "step": 226
+ },
+ {
+ "epoch": 1.1468354430379746,
+ "grad_norm": 0.1464017778635025,
+ "learning_rate": 9.84287317620651e-05,
+ "loss": 0.03213154152035713,
+ "step": 227
+ },
+ {
+ "epoch": 1.1518987341772151,
+ "grad_norm": 0.06766578555107117,
+ "learning_rate": 9.837261503928171e-05,
+ "loss": 0.02554963156580925,
+ "step": 228
+ },
+ {
+ "epoch": 1.1569620253164556,
+ "grad_norm": 0.09428609162569046,
+ "learning_rate": 9.831649831649832e-05,
+ "loss": 0.02484097331762314,
+ "step": 229
+ },
+ {
+ "epoch": 1.1620253164556962,
+ "grad_norm": 0.1648297905921936,
+ "learning_rate": 9.826038159371493e-05,
+ "loss": 0.03450813889503479,
+ "step": 230
+ },
+ {
+ "epoch": 1.1670886075949367,
+ "grad_norm": 0.06389904767274857,
+ "learning_rate": 9.820426487093154e-05,
+ "loss": 0.02957337349653244,
+ "step": 231
+ },
+ {
+ "epoch": 1.1721518987341772,
+ "grad_norm": 0.11517420411109924,
+ "learning_rate": 9.814814814814815e-05,
+ "loss": 0.024299729615449905,
+ "step": 232
+ },
+ {
+ "epoch": 1.1772151898734178,
+ "grad_norm": 0.06960142403841019,
+ "learning_rate": 9.809203142536476e-05,
+ "loss": 0.025762220844626427,
+ "step": 233
+ },
+ {
+ "epoch": 1.1822784810126583,
+ "grad_norm": 0.11682946234941483,
+ "learning_rate": 9.803591470258137e-05,
+ "loss": 0.02457268163561821,
+ "step": 234
+ },
+ {
+ "epoch": 1.1873417721518988,
+ "grad_norm": 0.07964848726987839,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.027285631746053696,
+ "step": 235
+ },
+ {
+ "epoch": 1.1924050632911392,
+ "grad_norm": 0.053044773638248444,
+ "learning_rate": 9.79236812570146e-05,
+ "loss": 0.020997609943151474,
+ "step": 236
+ },
+ {
+ "epoch": 1.1974683544303797,
+ "grad_norm": 0.13531149923801422,
+ "learning_rate": 9.78675645342312e-05,
+ "loss": 0.02474522590637207,
+ "step": 237
+ },
+ {
+ "epoch": 1.2025316455696202,
+ "grad_norm": 0.0774424746632576,
+ "learning_rate": 9.781144781144782e-05,
+ "loss": 0.025272740051150322,
+ "step": 238
+ },
+ {
+ "epoch": 1.2075949367088608,
+ "grad_norm": 0.042708419263362885,
+ "learning_rate": 9.775533108866442e-05,
+ "loss": 0.019522909075021744,
+ "step": 239
+ },
+ {
+ "epoch": 1.2126582278481013,
+ "grad_norm": 0.10364090651273727,
+ "learning_rate": 9.769921436588104e-05,
+ "loss": 0.02728935517370701,
+ "step": 240
+ },
+ {
+ "epoch": 1.2177215189873418,
+ "grad_norm": 0.0756702646613121,
+ "learning_rate": 9.764309764309764e-05,
+ "loss": 0.02659972943365574,
+ "step": 241
+ },
+ {
+ "epoch": 1.2227848101265824,
+ "grad_norm": 0.07232004404067993,
+ "learning_rate": 9.758698092031426e-05,
+ "loss": 0.017723949626088142,
+ "step": 242
+ },
+ {
+ "epoch": 1.2278481012658227,
+ "grad_norm": 0.058345306664705276,
+ "learning_rate": 9.753086419753087e-05,
+ "loss": 0.019348861649632454,
+ "step": 243
+ },
+ {
+ "epoch": 1.2329113924050632,
+ "grad_norm": 0.14832371473312378,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.03227488696575165,
+ "step": 244
+ },
+ {
+ "epoch": 1.2379746835443037,
+ "grad_norm": 0.05343412607908249,
+ "learning_rate": 9.74186307519641e-05,
+ "loss": 0.0210015457123518,
+ "step": 245
+ },
+ {
+ "epoch": 1.2430379746835443,
+ "grad_norm": 0.054104797542095184,
+ "learning_rate": 9.736251402918069e-05,
+ "loss": 0.02430287003517151,
+ "step": 246
+ },
+ {
+ "epoch": 1.2481012658227848,
+ "grad_norm": 0.11686044931411743,
+ "learning_rate": 9.730639730639732e-05,
+ "loss": 0.029372017830610275,
+ "step": 247
+ },
+ {
+ "epoch": 1.2531645569620253,
+ "grad_norm": 0.05970177799463272,
+ "learning_rate": 9.725028058361391e-05,
+ "loss": 0.024995045736432076,
+ "step": 248
+ },
+ {
+ "epoch": 1.2582278481012659,
+ "grad_norm": 0.06506923586130142,
+ "learning_rate": 9.719416386083054e-05,
+ "loss": 0.024779727682471275,
+ "step": 249
+ },
+ {
+ "epoch": 1.2632911392405064,
+ "grad_norm": 0.12711220979690552,
+ "learning_rate": 9.713804713804715e-05,
+ "loss": 0.026196476072072983,
+ "step": 250
+ },
+ {
+ "epoch": 1.268354430379747,
+ "grad_norm": 0.056023694574832916,
+ "learning_rate": 9.708193041526376e-05,
+ "loss": 0.01813146471977234,
+ "step": 251
+ },
+ {
+ "epoch": 1.2734177215189875,
+ "grad_norm": 0.04508040472865105,
+ "learning_rate": 9.702581369248037e-05,
+ "loss": 0.019225183874368668,
+ "step": 252
+ },
+ {
+ "epoch": 1.2784810126582278,
+ "grad_norm": 0.10354425758123398,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.02940209209918976,
+ "step": 253
+ },
+ {
+ "epoch": 1.2835443037974683,
+ "grad_norm": 0.06974297761917114,
+ "learning_rate": 9.691358024691359e-05,
+ "loss": 0.02482295036315918,
+ "step": 254
+ },
+ {
+ "epoch": 1.2886075949367088,
+ "grad_norm": 0.06940010190010071,
+ "learning_rate": 9.68574635241302e-05,
+ "loss": 0.020605089142918587,
+ "step": 255
+ },
+ {
+ "epoch": 1.2936708860759494,
+ "grad_norm": 0.09167850762605667,
+ "learning_rate": 9.68013468013468e-05,
+ "loss": 0.02429921180009842,
+ "step": 256
+ },
+ {
+ "epoch": 1.29873417721519,
+ "grad_norm": 0.048866868019104004,
+ "learning_rate": 9.674523007856342e-05,
+ "loss": 0.021776504814624786,
+ "step": 257
+ },
+ {
+ "epoch": 1.3037974683544304,
+ "grad_norm": 0.06977155059576035,
+ "learning_rate": 9.668911335578003e-05,
+ "loss": 0.02758147194981575,
+ "step": 258
+ },
+ {
+ "epoch": 1.3088607594936708,
+ "grad_norm": 0.17602303624153137,
+ "learning_rate": 9.663299663299664e-05,
+ "loss": 0.026518259197473526,
+ "step": 259
+ },
+ {
+ "epoch": 1.3139240506329113,
+ "grad_norm": 0.08011946082115173,
+ "learning_rate": 9.657687991021325e-05,
+ "loss": 0.026240577921271324,
+ "step": 260
+ },
+ {
+ "epoch": 1.3189873417721518,
+ "grad_norm": 0.06296376883983612,
+ "learning_rate": 9.652076318742987e-05,
+ "loss": 0.03159455955028534,
+ "step": 261
+ },
+ {
+ "epoch": 1.3240506329113924,
+ "grad_norm": 0.04424722492694855,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.024151435121893883,
+ "step": 262
+ },
+ {
+ "epoch": 1.3291139240506329,
+ "grad_norm": 0.045779623091220856,
+ "learning_rate": 9.640852974186309e-05,
+ "loss": 0.018655993044376373,
+ "step": 263
+ },
+ {
+ "epoch": 1.3341772151898734,
+ "grad_norm": 0.06355931609869003,
+ "learning_rate": 9.635241301907969e-05,
+ "loss": 0.01999380812048912,
+ "step": 264
+ },
+ {
+ "epoch": 1.339240506329114,
+ "grad_norm": 0.04477616026997566,
+ "learning_rate": 9.62962962962963e-05,
+ "loss": 0.021614115685224533,
+ "step": 265
+ },
+ {
+ "epoch": 1.3443037974683545,
+ "grad_norm": 0.05851180478930473,
+ "learning_rate": 9.62401795735129e-05,
+ "loss": 0.023495908826589584,
+ "step": 266
+ },
+ {
+ "epoch": 1.349367088607595,
+ "grad_norm": 0.04724022373557091,
+ "learning_rate": 9.618406285072952e-05,
+ "loss": 0.02053767442703247,
+ "step": 267
+ },
+ {
+ "epoch": 1.3544303797468356,
+ "grad_norm": 0.12757639586925507,
+ "learning_rate": 9.612794612794614e-05,
+ "loss": 0.030612681061029434,
+ "step": 268
+ },
+ {
+ "epoch": 1.3594936708860759,
+ "grad_norm": 0.18316853046417236,
+ "learning_rate": 9.607182940516274e-05,
+ "loss": 0.039485104382038116,
+ "step": 269
+ },
+ {
+ "epoch": 1.3645569620253164,
+ "grad_norm": 0.09149223566055298,
+ "learning_rate": 9.601571268237936e-05,
+ "loss": 0.031156456097960472,
+ "step": 270
+ },
+ {
+ "epoch": 1.369620253164557,
+ "grad_norm": 0.07885908335447311,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.026395633816719055,
+ "step": 271
+ },
+ {
+ "epoch": 1.3746835443037975,
+ "grad_norm": 0.0984397754073143,
+ "learning_rate": 9.590347923681258e-05,
+ "loss": 0.02990398183465004,
+ "step": 272
+ },
+ {
+ "epoch": 1.379746835443038,
+ "grad_norm": 0.08566205203533173,
+ "learning_rate": 9.584736251402918e-05,
+ "loss": 0.024353420361876488,
+ "step": 273
+ },
+ {
+ "epoch": 1.3848101265822785,
+ "grad_norm": 0.16623689234256744,
+ "learning_rate": 9.57912457912458e-05,
+ "loss": 0.03626095876097679,
+ "step": 274
+ },
+ {
+ "epoch": 1.389873417721519,
+ "grad_norm": 0.07134243100881577,
+ "learning_rate": 9.57351290684624e-05,
+ "loss": 0.026036158204078674,
+ "step": 275
+ },
+ {
+ "epoch": 1.3949367088607594,
+ "grad_norm": 0.07753578573465347,
+ "learning_rate": 9.567901234567902e-05,
+ "loss": 0.03266923502087593,
+ "step": 276
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.07113673537969589,
+ "learning_rate": 9.562289562289563e-05,
+ "loss": 0.024128902703523636,
+ "step": 277
+ },
+ {
+ "epoch": 1.4050632911392404,
+ "grad_norm": 0.0954187884926796,
+ "learning_rate": 9.556677890011224e-05,
+ "loss": 0.03310588374733925,
+ "step": 278
+ },
+ {
+ "epoch": 1.410126582278481,
+ "grad_norm": 0.08755122870206833,
+ "learning_rate": 9.551066217732885e-05,
+ "loss": 0.030977975577116013,
+ "step": 279
+ },
+ {
+ "epoch": 1.4151898734177215,
+ "grad_norm": 0.06839736551046371,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.029557062312960625,
+ "step": 280
+ },
+ {
+ "epoch": 1.420253164556962,
+ "grad_norm": 0.051050763577222824,
+ "learning_rate": 9.539842873176207e-05,
+ "loss": 0.022091392427682877,
+ "step": 281
+ },
+ {
+ "epoch": 1.4253164556962026,
+ "grad_norm": 0.05898132920265198,
+ "learning_rate": 9.534231200897868e-05,
+ "loss": 0.024804875254631042,
+ "step": 282
+ },
+ {
+ "epoch": 1.4303797468354431,
+ "grad_norm": 0.04517035931348801,
+ "learning_rate": 9.528619528619529e-05,
+ "loss": 0.024234894663095474,
+ "step": 283
+ },
+ {
+ "epoch": 1.4354430379746836,
+ "grad_norm": 0.05625253543257713,
+ "learning_rate": 9.52300785634119e-05,
+ "loss": 0.02342807501554489,
+ "step": 284
+ },
+ {
+ "epoch": 1.4405063291139242,
+ "grad_norm": 0.047006960958242416,
+ "learning_rate": 9.517396184062851e-05,
+ "loss": 0.021819880232214928,
+ "step": 285
+ },
+ {
+ "epoch": 1.4455696202531645,
+ "grad_norm": 0.051774390041828156,
+ "learning_rate": 9.511784511784512e-05,
+ "loss": 0.020575571805238724,
+ "step": 286
+ },
+ {
+ "epoch": 1.450632911392405,
+ "grad_norm": 0.0684620812535286,
+ "learning_rate": 9.506172839506173e-05,
+ "loss": 0.025043494999408722,
+ "step": 287
+ },
+ {
+ "epoch": 1.4556962025316456,
+ "grad_norm": 0.05345604941248894,
+ "learning_rate": 9.500561167227834e-05,
+ "loss": 0.020829960703849792,
+ "step": 288
+ },
+ {
+ "epoch": 1.460759493670886,
+ "grad_norm": 0.07588688284158707,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.02842051535844803,
+ "step": 289
+ },
+ {
+ "epoch": 1.4658227848101266,
+ "grad_norm": 0.0371188148856163,
+ "learning_rate": 9.489337822671156e-05,
+ "loss": 0.020213091745972633,
+ "step": 290
+ },
+ {
+ "epoch": 1.4708860759493672,
+ "grad_norm": 0.03922685980796814,
+ "learning_rate": 9.483726150392817e-05,
+ "loss": 0.020665431395173073,
+ "step": 291
+ },
+ {
+ "epoch": 1.4759493670886075,
+ "grad_norm": 0.10213606059551239,
+ "learning_rate": 9.478114478114478e-05,
+ "loss": 0.024979032576084137,
+ "step": 292
+ },
+ {
+ "epoch": 1.481012658227848,
+ "grad_norm": 0.04574638605117798,
+ "learning_rate": 9.472502805836139e-05,
+ "loss": 0.0215127132833004,
+ "step": 293
+ },
+ {
+ "epoch": 1.4860759493670885,
+ "grad_norm": 0.0829704999923706,
+ "learning_rate": 9.4668911335578e-05,
+ "loss": 0.023608818650245667,
+ "step": 294
+ },
+ {
+ "epoch": 1.491139240506329,
+ "grad_norm": 0.036335594952106476,
+ "learning_rate": 9.461279461279463e-05,
+ "loss": 0.01993970200419426,
+ "step": 295
+ },
+ {
+ "epoch": 1.4962025316455696,
+ "grad_norm": 0.08291227370500565,
+ "learning_rate": 9.455667789001122e-05,
+ "loss": 0.02223093807697296,
+ "step": 296
+ },
+ {
+ "epoch": 1.5012658227848101,
+ "grad_norm": 0.048284996300935745,
+ "learning_rate": 9.450056116722785e-05,
+ "loss": 0.019440360367298126,
+ "step": 297
+ },
+ {
+ "epoch": 1.5063291139240507,
+ "grad_norm": 0.25126877427101135,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.030357610434293747,
+ "step": 298
+ },
+ {
+ "epoch": 1.5113924050632912,
+ "grad_norm": 0.08812759816646576,
+ "learning_rate": 9.438832772166107e-05,
+ "loss": 0.025407828390598297,
+ "step": 299
+ },
+ {
+ "epoch": 1.5164556962025317,
+ "grad_norm": 0.09417422115802765,
+ "learning_rate": 9.433221099887766e-05,
+ "loss": 0.028768496587872505,
+ "step": 300
+ },
+ {
+ "epoch": 1.5215189873417723,
+ "grad_norm": 0.10820329934358597,
+ "learning_rate": 9.427609427609429e-05,
+ "loss": 0.03250410035252571,
+ "step": 301
+ },
+ {
+ "epoch": 1.5265822784810128,
+ "grad_norm": 0.06633433699607849,
+ "learning_rate": 9.42199775533109e-05,
+ "loss": 0.019816454499959946,
+ "step": 302
+ },
+ {
+ "epoch": 1.5316455696202531,
+ "grad_norm": 0.05545264482498169,
+ "learning_rate": 9.41638608305275e-05,
+ "loss": 0.020919661968946457,
+ "step": 303
+ },
+ {
+ "epoch": 1.5367088607594936,
+ "grad_norm": 0.08201726526021957,
+ "learning_rate": 9.410774410774412e-05,
+ "loss": 0.0309453085064888,
+ "step": 304
+ },
+ {
+ "epoch": 1.5417721518987342,
+ "grad_norm": 0.047229036688804626,
+ "learning_rate": 9.405162738496073e-05,
+ "loss": 0.02079029008746147,
+ "step": 305
+ },
+ {
+ "epoch": 1.5468354430379747,
+ "grad_norm": 0.04493536427617073,
+ "learning_rate": 9.399551066217734e-05,
+ "loss": 0.020319776609539986,
+ "step": 306
+ },
+ {
+ "epoch": 1.5518987341772152,
+ "grad_norm": 0.07935966551303864,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.03144281357526779,
+ "step": 307
+ },
+ {
+ "epoch": 1.5569620253164556,
+ "grad_norm": 0.10108500719070435,
+ "learning_rate": 9.388327721661056e-05,
+ "loss": 0.029823362827301025,
+ "step": 308
+ },
+ {
+ "epoch": 1.562025316455696,
+ "grad_norm": 0.05187584087252617,
+ "learning_rate": 9.382716049382717e-05,
+ "loss": 0.029090257361531258,
+ "step": 309
+ },
+ {
+ "epoch": 1.5670886075949366,
+ "grad_norm": 0.09131086617708206,
+ "learning_rate": 9.377104377104378e-05,
+ "loss": 0.020090997219085693,
+ "step": 310
+ },
+ {
+ "epoch": 1.5721518987341772,
+ "grad_norm": 0.06874370574951172,
+ "learning_rate": 9.371492704826039e-05,
+ "loss": 0.022118568420410156,
+ "step": 311
+ },
+ {
+ "epoch": 1.5772151898734177,
+ "grad_norm": 0.07480651885271072,
+ "learning_rate": 9.3658810325477e-05,
+ "loss": 0.030924849212169647,
+ "step": 312
+ },
+ {
+ "epoch": 1.5822784810126582,
+ "grad_norm": 0.04049983248114586,
+ "learning_rate": 9.36026936026936e-05,
+ "loss": 0.02086808532476425,
+ "step": 313
+ },
+ {
+ "epoch": 1.5873417721518988,
+ "grad_norm": 0.037067580968141556,
+ "learning_rate": 9.354657687991022e-05,
+ "loss": 0.022019919008016586,
+ "step": 314
+ },
+ {
+ "epoch": 1.5924050632911393,
+ "grad_norm": 0.0599038302898407,
+ "learning_rate": 9.349046015712683e-05,
+ "loss": 0.02305535599589348,
+ "step": 315
+ },
+ {
+ "epoch": 1.5974683544303798,
+ "grad_norm": 0.056727997958660126,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.025360889732837677,
+ "step": 316
+ },
+ {
+ "epoch": 1.6025316455696204,
+ "grad_norm": 0.06659650057554245,
+ "learning_rate": 9.337822671156005e-05,
+ "loss": 0.02528395690023899,
+ "step": 317
+ },
+ {
+ "epoch": 1.6075949367088609,
+ "grad_norm": 0.06213822215795517,
+ "learning_rate": 9.332210998877666e-05,
+ "loss": 0.028841618448495865,
+ "step": 318
+ },
+ {
+ "epoch": 1.6126582278481014,
+ "grad_norm": 0.03757556155323982,
+ "learning_rate": 9.326599326599327e-05,
+ "loss": 0.02282278798520565,
+ "step": 319
+ },
+ {
+ "epoch": 1.6177215189873417,
+ "grad_norm": 0.061945486813783646,
+ "learning_rate": 9.320987654320989e-05,
+ "loss": 0.02733437530696392,
+ "step": 320
+ },
+ {
+ "epoch": 1.6227848101265823,
+ "grad_norm": 0.07904566079378128,
+ "learning_rate": 9.315375982042649e-05,
+ "loss": 0.02630138024687767,
+ "step": 321
+ },
+ {
+ "epoch": 1.6278481012658228,
+ "grad_norm": 0.07157077640295029,
+ "learning_rate": 9.309764309764311e-05,
+ "loss": 0.023403439670801163,
+ "step": 322
+ },
+ {
+ "epoch": 1.6329113924050633,
+ "grad_norm": 0.03518318012356758,
+ "learning_rate": 9.304152637485971e-05,
+ "loss": 0.021487422287464142,
+ "step": 323
+ },
+ {
+ "epoch": 1.6379746835443036,
+ "grad_norm": 0.11178159713745117,
+ "learning_rate": 9.298540965207633e-05,
+ "loss": 0.03142111003398895,
+ "step": 324
+ },
+ {
+ "epoch": 1.6430379746835442,
+ "grad_norm": 0.05046987161040306,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.020960725843906403,
+ "step": 325
+ },
+ {
+ "epoch": 1.6481012658227847,
+ "grad_norm": 0.05356504023075104,
+ "learning_rate": 9.287317620650955e-05,
+ "loss": 0.01934133842587471,
+ "step": 326
+ },
+ {
+ "epoch": 1.6531645569620252,
+ "grad_norm": 0.07995260506868362,
+ "learning_rate": 9.281705948372615e-05,
+ "loss": 0.0248265378177166,
+ "step": 327
+ },
+ {
+ "epoch": 1.6582278481012658,
+ "grad_norm": 0.08783978968858719,
+ "learning_rate": 9.276094276094277e-05,
+ "loss": 0.024171534925699234,
+ "step": 328
+ },
+ {
+ "epoch": 1.6632911392405063,
+ "grad_norm": 0.043143950402736664,
+ "learning_rate": 9.270482603815938e-05,
+ "loss": 0.021554211154580116,
+ "step": 329
+ },
+ {
+ "epoch": 1.6683544303797468,
+ "grad_norm": 0.05635169520974159,
+ "learning_rate": 9.264870931537598e-05,
+ "loss": 0.025942442938685417,
+ "step": 330
+ },
+ {
+ "epoch": 1.6734177215189874,
+ "grad_norm": 0.042691316455602646,
+ "learning_rate": 9.25925925925926e-05,
+ "loss": 0.021898634731769562,
+ "step": 331
+ },
+ {
+ "epoch": 1.678481012658228,
+ "grad_norm": 0.07666946202516556,
+ "learning_rate": 9.25364758698092e-05,
+ "loss": 0.02928568609058857,
+ "step": 332
+ },
+ {
+ "epoch": 1.6835443037974684,
+ "grad_norm": 0.04230545833706856,
+ "learning_rate": 9.248035914702582e-05,
+ "loss": 0.020812246948480606,
+ "step": 333
+ },
+ {
+ "epoch": 1.688607594936709,
+ "grad_norm": 0.1077270656824112,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.025568369776010513,
+ "step": 334
+ },
+ {
+ "epoch": 1.6936708860759495,
+ "grad_norm": 0.04277936369180679,
+ "learning_rate": 9.236812570145904e-05,
+ "loss": 0.018935058265924454,
+ "step": 335
+ },
+ {
+ "epoch": 1.6987341772151898,
+ "grad_norm": 0.04454135522246361,
+ "learning_rate": 9.231200897867565e-05,
+ "loss": 0.01933746598660946,
+ "step": 336
+ },
+ {
+ "epoch": 1.7037974683544304,
+ "grad_norm": 0.0674893856048584,
+ "learning_rate": 9.225589225589226e-05,
+ "loss": 0.021518435329198837,
+ "step": 337
+ },
+ {
+ "epoch": 1.7088607594936709,
+ "grad_norm": 0.06007042154669762,
+ "learning_rate": 9.219977553310887e-05,
+ "loss": 0.019427424296736717,
+ "step": 338
+ },
+ {
+ "epoch": 1.7139240506329114,
+ "grad_norm": 0.09564489126205444,
+ "learning_rate": 9.214365881032548e-05,
+ "loss": 0.027250545099377632,
+ "step": 339
+ },
+ {
+ "epoch": 1.7189873417721517,
+ "grad_norm": 0.053655482828617096,
+ "learning_rate": 9.208754208754209e-05,
+ "loss": 0.020125389099121094,
+ "step": 340
+ },
+ {
+ "epoch": 1.7240506329113923,
+ "grad_norm": 0.038283221423625946,
+ "learning_rate": 9.20314253647587e-05,
+ "loss": 0.017948098480701447,
+ "step": 341
+ },
+ {
+ "epoch": 1.7291139240506328,
+ "grad_norm": 0.04724166542291641,
+ "learning_rate": 9.197530864197531e-05,
+ "loss": 0.02523602545261383,
+ "step": 342
+ },
+ {
+ "epoch": 1.7341772151898733,
+ "grad_norm": 0.10365224629640579,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.035696640610694885,
+ "step": 343
+ },
+ {
+ "epoch": 1.7392405063291139,
+ "grad_norm": 0.07362233102321625,
+ "learning_rate": 9.186307519640853e-05,
+ "loss": 0.026104427874088287,
+ "step": 344
+ },
+ {
+ "epoch": 1.7443037974683544,
+ "grad_norm": 0.05976846069097519,
+ "learning_rate": 9.180695847362514e-05,
+ "loss": 0.026634451001882553,
+ "step": 345
+ },
+ {
+ "epoch": 1.749367088607595,
+ "grad_norm": 0.07387223839759827,
+ "learning_rate": 9.175084175084175e-05,
+ "loss": 0.025733446702361107,
+ "step": 346
+ },
+ {
+ "epoch": 1.7544303797468355,
+ "grad_norm": 0.04727378115057945,
+ "learning_rate": 9.169472502805838e-05,
+ "loss": 0.01889938861131668,
+ "step": 347
+ },
+ {
+ "epoch": 1.759493670886076,
+ "grad_norm": 0.10614906996488571,
+ "learning_rate": 9.163860830527497e-05,
+ "loss": 0.02275039628148079,
+ "step": 348
+ },
+ {
+ "epoch": 1.7645569620253165,
+ "grad_norm": 0.04877970367670059,
+ "learning_rate": 9.15824915824916e-05,
+ "loss": 0.022580452263355255,
+ "step": 349
+ },
+ {
+ "epoch": 1.769620253164557,
+ "grad_norm": 0.18825598061084747,
+ "learning_rate": 9.152637485970819e-05,
+ "loss": 0.03054988384246826,
+ "step": 350
+ },
+ {
+ "epoch": 1.7746835443037976,
+ "grad_norm": 0.06315254420042038,
+ "learning_rate": 9.147025813692482e-05,
+ "loss": 0.025584843009710312,
+ "step": 351
+ },
+ {
+ "epoch": 1.7797468354430381,
+ "grad_norm": 0.04519108682870865,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.0214737206697464,
+ "step": 352
+ },
+ {
+ "epoch": 1.7848101265822784,
+ "grad_norm": 0.07401937246322632,
+ "learning_rate": 9.135802469135802e-05,
+ "loss": 0.02984039857983589,
+ "step": 353
+ },
+ {
+ "epoch": 1.789873417721519,
+ "grad_norm": 0.05138625577092171,
+ "learning_rate": 9.130190796857465e-05,
+ "loss": 0.024221282452344894,
+ "step": 354
+ },
+ {
+ "epoch": 1.7949367088607595,
+ "grad_norm": 0.10182037204504013,
+ "learning_rate": 9.124579124579124e-05,
+ "loss": 0.0237903892993927,
+ "step": 355
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.056737013161182404,
+ "learning_rate": 9.118967452300787e-05,
+ "loss": 0.026514701545238495,
+ "step": 356
+ },
+ {
+ "epoch": 1.8050632911392404,
+ "grad_norm": 0.04826146364212036,
+ "learning_rate": 9.113355780022446e-05,
+ "loss": 0.021808844059705734,
+ "step": 357
+ },
+ {
+ "epoch": 1.810126582278481,
+ "grad_norm": 0.07099983841180801,
+ "learning_rate": 9.107744107744109e-05,
+ "loss": 0.028031716123223305,
+ "step": 358
+ },
+ {
+ "epoch": 1.8151898734177214,
+ "grad_norm": 0.04242753982543945,
+ "learning_rate": 9.102132435465768e-05,
+ "loss": 0.018858186900615692,
+ "step": 359
+ },
+ {
+ "epoch": 1.820253164556962,
+ "grad_norm": 0.053701240569353104,
+ "learning_rate": 9.096520763187431e-05,
+ "loss": 0.025603849440813065,
+ "step": 360
+ },
+ {
+ "epoch": 1.8253164556962025,
+ "grad_norm": 0.05277755856513977,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.021214714273810387,
+ "step": 361
+ },
+ {
+ "epoch": 1.830379746835443,
+ "grad_norm": 0.048843637108802795,
+ "learning_rate": 9.085297418630753e-05,
+ "loss": 0.024215007200837135,
+ "step": 362
+ },
+ {
+ "epoch": 1.8354430379746836,
+ "grad_norm": 0.04203329607844353,
+ "learning_rate": 9.079685746352414e-05,
+ "loss": 0.022748971357941628,
+ "step": 363
+ },
+ {
+ "epoch": 1.840506329113924,
+ "grad_norm": 0.04655196890234947,
+ "learning_rate": 9.074074074074075e-05,
+ "loss": 0.019658325240015984,
+ "step": 364
+ },
+ {
+ "epoch": 1.8455696202531646,
+ "grad_norm": 0.10654491931200027,
+ "learning_rate": 9.068462401795736e-05,
+ "loss": 0.03210999816656113,
+ "step": 365
+ },
+ {
+ "epoch": 1.8506329113924052,
+ "grad_norm": 0.04377336800098419,
+ "learning_rate": 9.062850729517397e-05,
+ "loss": 0.01867927983403206,
+ "step": 366
+ },
+ {
+ "epoch": 1.8556962025316457,
+ "grad_norm": 0.04619381204247475,
+ "learning_rate": 9.057239057239058e-05,
+ "loss": 0.01952965185046196,
+ "step": 367
+ },
+ {
+ "epoch": 1.8607594936708862,
+ "grad_norm": 0.04015986621379852,
+ "learning_rate": 9.051627384960719e-05,
+ "loss": 0.017353296279907227,
+ "step": 368
+ },
+ {
+ "epoch": 1.8658227848101265,
+ "grad_norm": 0.11403095722198486,
+ "learning_rate": 9.04601571268238e-05,
+ "loss": 0.02238992229104042,
+ "step": 369
+ },
+ {
+ "epoch": 1.870886075949367,
+ "grad_norm": 0.043767284601926804,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.02202833816409111,
+ "step": 370
+ },
+ {
+ "epoch": 1.8759493670886076,
+ "grad_norm": 0.053445883095264435,
+ "learning_rate": 9.034792368125702e-05,
+ "loss": 0.023765750229358673,
+ "step": 371
+ },
+ {
+ "epoch": 1.8810126582278481,
+ "grad_norm": 0.05750055983662605,
+ "learning_rate": 9.029180695847364e-05,
+ "loss": 0.026259474456310272,
+ "step": 372
+ },
+ {
+ "epoch": 1.8860759493670884,
+ "grad_norm": 0.04525497183203697,
+ "learning_rate": 9.023569023569024e-05,
+ "loss": 0.024194583296775818,
+ "step": 373
+ },
+ {
+ "epoch": 1.891139240506329,
+ "grad_norm": 0.04918856918811798,
+ "learning_rate": 9.017957351290685e-05,
+ "loss": 0.020951319485902786,
+ "step": 374
+ },
+ {
+ "epoch": 1.8962025316455695,
+ "grad_norm": 0.08538687229156494,
+ "learning_rate": 9.012345679012346e-05,
+ "loss": 0.022266045212745667,
+ "step": 375
+ },
+ {
+ "epoch": 1.90126582278481,
+ "grad_norm": 0.07101748883724213,
+ "learning_rate": 9.006734006734007e-05,
+ "loss": 0.028090521693229675,
+ "step": 376
+ },
+ {
+ "epoch": 1.9063291139240506,
+ "grad_norm": 0.06256446987390518,
+ "learning_rate": 9.001122334455668e-05,
+ "loss": 0.027174800634384155,
+ "step": 377
+ },
+ {
+ "epoch": 1.9113924050632911,
+ "grad_norm": 0.07588270306587219,
+ "learning_rate": 8.995510662177329e-05,
+ "loss": 0.028438206762075424,
+ "step": 378
+ },
+ {
+ "epoch": 1.9164556962025316,
+ "grad_norm": 5.8829851150512695,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.01749270409345627,
+ "step": 379
+ },
+ {
+ "epoch": 1.9215189873417722,
+ "grad_norm": 0.038905344903469086,
+ "learning_rate": 8.984287317620651e-05,
+ "loss": 0.019571108743548393,
+ "step": 380
+ },
+ {
+ "epoch": 1.9265822784810127,
+ "grad_norm": 0.05960959196090698,
+ "learning_rate": 8.978675645342313e-05,
+ "loss": 0.024591946974396706,
+ "step": 381
+ },
+ {
+ "epoch": 1.9316455696202532,
+ "grad_norm": 0.07935867458581924,
+ "learning_rate": 8.973063973063973e-05,
+ "loss": 0.020205039530992508,
+ "step": 382
+ },
+ {
+ "epoch": 1.9367088607594938,
+ "grad_norm": 0.08682888746261597,
+ "learning_rate": 8.967452300785635e-05,
+ "loss": 0.023299653083086014,
+ "step": 383
+ },
+ {
+ "epoch": 1.9417721518987343,
+ "grad_norm": 0.07220255583524704,
+ "learning_rate": 8.961840628507295e-05,
+ "loss": 0.025364618748426437,
+ "step": 384
+ },
+ {
+ "epoch": 1.9468354430379748,
+ "grad_norm": 0.08230294287204742,
+ "learning_rate": 8.956228956228957e-05,
+ "loss": 0.023587457835674286,
+ "step": 385
+ },
+ {
+ "epoch": 1.9518987341772152,
+ "grad_norm": 0.05176795646548271,
+ "learning_rate": 8.950617283950617e-05,
+ "loss": 0.018942706286907196,
+ "step": 386
+ },
+ {
+ "epoch": 1.9569620253164557,
+ "grad_norm": 0.04784144088625908,
+ "learning_rate": 8.945005611672279e-05,
+ "loss": 0.020134730264544487,
+ "step": 387
+ },
+ {
+ "epoch": 1.9620253164556962,
+ "grad_norm": 0.04668115824460983,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.022084465250372887,
+ "step": 388
+ },
+ {
+ "epoch": 1.9670886075949368,
+ "grad_norm": 0.05892647057771683,
+ "learning_rate": 8.933782267115601e-05,
+ "loss": 0.02586008608341217,
+ "step": 389
+ },
+ {
+ "epoch": 1.972151898734177,
+ "grad_norm": 0.048669006675481796,
+ "learning_rate": 8.928170594837262e-05,
+ "loss": 0.020011097192764282,
+ "step": 390
+ },
+ {
+ "epoch": 1.9772151898734176,
+ "grad_norm": 0.0973723903298378,
+ "learning_rate": 8.922558922558923e-05,
+ "loss": 0.030240919440984726,
+ "step": 391
+ },
+ {
+ "epoch": 1.9822784810126581,
+ "grad_norm": 0.090507872402668,
+ "learning_rate": 8.916947250280584e-05,
+ "loss": 0.028250183910131454,
+ "step": 392
+ },
+ {
+ "epoch": 1.9873417721518987,
+ "grad_norm": 0.03921318054199219,
+ "learning_rate": 8.911335578002245e-05,
+ "loss": 0.02076716348528862,
+ "step": 393
+ },
+ {
+ "epoch": 1.9924050632911392,
+ "grad_norm": 0.04830043017864227,
+ "learning_rate": 8.905723905723906e-05,
+ "loss": 0.02241525426506996,
+ "step": 394
+ },
+ {
+ "epoch": 1.9974683544303797,
+ "grad_norm": 0.04455797001719475,
+ "learning_rate": 8.900112233445567e-05,
+ "loss": 0.026035301387310028,
+ "step": 395
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.10931648313999176,
+ "learning_rate": 8.894500561167228e-05,
+ "loss": 0.03514251485466957,
+ "step": 396
+ },
+ {
+ "epoch": 2.0050632911392405,
+ "grad_norm": 0.07531362026929855,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.021771814674139023,
+ "step": 397
+ },
+ {
+ "epoch": 2.010126582278481,
+ "grad_norm": 0.0649140477180481,
+ "learning_rate": 8.88327721661055e-05,
+ "loss": 0.02932022325694561,
+ "step": 398
+ },
+ {
+ "epoch": 2.0151898734177216,
+ "grad_norm": 0.07461163401603699,
+ "learning_rate": 8.877665544332211e-05,
+ "loss": 0.023864082992076874,
+ "step": 399
+ },
+ {
+ "epoch": 2.020253164556962,
+ "grad_norm": 0.054510265588760376,
+ "learning_rate": 8.872053872053872e-05,
+ "loss": 0.027578316628932953,
+ "step": 400
+ },
+ {
+ "epoch": 2.0253164556962027,
+ "grad_norm": 0.04434451460838318,
+ "learning_rate": 8.866442199775533e-05,
+ "loss": 0.022873830050230026,
+ "step": 401
+ },
+ {
+ "epoch": 2.030379746835443,
+ "grad_norm": 0.052791960537433624,
+ "learning_rate": 8.860830527497194e-05,
+ "loss": 0.021092431619763374,
+ "step": 402
+ },
+ {
+ "epoch": 2.0354430379746837,
+ "grad_norm": 0.04550998657941818,
+ "learning_rate": 8.855218855218855e-05,
+ "loss": 0.022475749254226685,
+ "step": 403
+ },
+ {
+ "epoch": 2.0405063291139243,
+ "grad_norm": 0.2512972354888916,
+ "learning_rate": 8.849607182940516e-05,
+ "loss": 0.02201610803604126,
+ "step": 404
+ },
+ {
+ "epoch": 2.0455696202531644,
+ "grad_norm": 0.04554569348692894,
+ "learning_rate": 8.843995510662177e-05,
+ "loss": 0.02180359698832035,
+ "step": 405
+ },
+ {
+ "epoch": 2.050632911392405,
+ "grad_norm": 0.04094229266047478,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.01960112899541855,
+ "step": 406
+ },
+ {
+ "epoch": 2.0556962025316454,
+ "grad_norm": 0.07398641109466553,
+ "learning_rate": 8.8327721661055e-05,
+ "loss": 0.02206597849726677,
+ "step": 407
+ },
+ {
+ "epoch": 2.060759493670886,
+ "grad_norm": 0.07659231871366501,
+ "learning_rate": 8.827160493827162e-05,
+ "loss": 0.019660351797938347,
+ "step": 408
+ },
+ {
+ "epoch": 2.0658227848101265,
+ "grad_norm": 0.05986466258764267,
+ "learning_rate": 8.821548821548821e-05,
+ "loss": 0.027121691033244133,
+ "step": 409
+ },
+ {
+ "epoch": 2.070886075949367,
+ "grad_norm": 0.03376661241054535,
+ "learning_rate": 8.815937149270484e-05,
+ "loss": 0.021059338003396988,
+ "step": 410
+ },
+ {
+ "epoch": 2.0759493670886076,
+ "grad_norm": 0.081104576587677,
+ "learning_rate": 8.810325476992143e-05,
+ "loss": 0.031228341162204742,
+ "step": 411
+ },
+ {
+ "epoch": 2.081012658227848,
+ "grad_norm": 0.04295242205262184,
+ "learning_rate": 8.804713804713806e-05,
+ "loss": 0.020738180726766586,
+ "step": 412
+ },
+ {
+ "epoch": 2.0860759493670886,
+ "grad_norm": 0.03715268895030022,
+ "learning_rate": 8.799102132435467e-05,
+ "loss": 0.018579209223389626,
+ "step": 413
+ },
+ {
+ "epoch": 2.091139240506329,
+ "grad_norm": 0.06769359856843948,
+ "learning_rate": 8.793490460157128e-05,
+ "loss": 0.026761794462800026,
+ "step": 414
+ },
+ {
+ "epoch": 2.0962025316455697,
+ "grad_norm": 0.03715744614601135,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.022879980504512787,
+ "step": 415
+ },
+ {
+ "epoch": 2.1012658227848102,
+ "grad_norm": 0.04305677488446236,
+ "learning_rate": 8.78226711560045e-05,
+ "loss": 0.022773049771785736,
+ "step": 416
+ },
+ {
+ "epoch": 2.1063291139240508,
+ "grad_norm": 0.0449112169444561,
+ "learning_rate": 8.776655443322111e-05,
+ "loss": 0.022499293088912964,
+ "step": 417
+ },
+ {
+ "epoch": 2.1113924050632913,
+ "grad_norm": 0.0457427054643631,
+ "learning_rate": 8.77104377104377e-05,
+ "loss": 0.024978693574666977,
+ "step": 418
+ },
+ {
+ "epoch": 2.116455696202532,
+ "grad_norm": 0.04705161228775978,
+ "learning_rate": 8.765432098765433e-05,
+ "loss": 0.024807877838611603,
+ "step": 419
+ },
+ {
+ "epoch": 2.1215189873417724,
+ "grad_norm": 0.04377812147140503,
+ "learning_rate": 8.759820426487092e-05,
+ "loss": 0.025857431814074516,
+ "step": 420
+ },
+ {
+ "epoch": 2.1265822784810124,
+ "grad_norm": 0.08598720282316208,
+ "learning_rate": 8.754208754208755e-05,
+ "loss": 0.021972455084323883,
+ "step": 421
+ },
+ {
+ "epoch": 2.131645569620253,
+ "grad_norm": 0.4669632017612457,
+ "learning_rate": 8.748597081930416e-05,
+ "loss": 0.02055199444293976,
+ "step": 422
+ },
+ {
+ "epoch": 2.1367088607594935,
+ "grad_norm": 0.05292733013629913,
+ "learning_rate": 8.742985409652077e-05,
+ "loss": 0.020852137356996536,
+ "step": 423
+ },
+ {
+ "epoch": 2.141772151898734,
+ "grad_norm": 0.05878116562962532,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.02444305270910263,
+ "step": 424
+ },
+ {
+ "epoch": 2.1468354430379746,
+ "grad_norm": 0.05234210565686226,
+ "learning_rate": 8.731762065095399e-05,
+ "loss": 0.02202335000038147,
+ "step": 425
+ },
+ {
+ "epoch": 2.151898734177215,
+ "grad_norm": 0.04706348851323128,
+ "learning_rate": 8.72615039281706e-05,
+ "loss": 0.019998187199234962,
+ "step": 426
+ },
+ {
+ "epoch": 2.1569620253164556,
+ "grad_norm": 0.05263376981019974,
+ "learning_rate": 8.720538720538721e-05,
+ "loss": 0.028126951307058334,
+ "step": 427
+ },
+ {
+ "epoch": 2.162025316455696,
+ "grad_norm": 0.062016960233449936,
+ "learning_rate": 8.714927048260382e-05,
+ "loss": 0.0286184661090374,
+ "step": 428
+ },
+ {
+ "epoch": 2.1670886075949367,
+ "grad_norm": 0.13798244297504425,
+ "learning_rate": 8.709315375982043e-05,
+ "loss": 0.026699248701334,
+ "step": 429
+ },
+ {
+ "epoch": 2.1721518987341772,
+ "grad_norm": 0.09159042686223984,
+ "learning_rate": 8.703703703703704e-05,
+ "loss": 0.025515643879771233,
+ "step": 430
+ },
+ {
+ "epoch": 2.1772151898734178,
+ "grad_norm": 0.0828855037689209,
+ "learning_rate": 8.698092031425365e-05,
+ "loss": 0.025481123477220535,
+ "step": 431
+ },
+ {
+ "epoch": 2.1822784810126583,
+ "grad_norm": 0.09840776771306992,
+ "learning_rate": 8.692480359147026e-05,
+ "loss": 0.020968927070498466,
+ "step": 432
+ },
+ {
+ "epoch": 2.187341772151899,
+ "grad_norm": 0.10999752581119537,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.028588412329554558,
+ "step": 433
+ },
+ {
+ "epoch": 2.1924050632911394,
+ "grad_norm": 0.06938561797142029,
+ "learning_rate": 8.681257014590348e-05,
+ "loss": 0.024119220674037933,
+ "step": 434
+ },
+ {
+ "epoch": 2.19746835443038,
+ "grad_norm": 0.054689887911081314,
+ "learning_rate": 8.67564534231201e-05,
+ "loss": 0.02173299714922905,
+ "step": 435
+ },
+ {
+ "epoch": 2.2025316455696204,
+ "grad_norm": 0.09605880081653595,
+ "learning_rate": 8.67003367003367e-05,
+ "loss": 0.02312455326318741,
+ "step": 436
+ },
+ {
+ "epoch": 2.207594936708861,
+ "grad_norm": 0.06863043457269669,
+ "learning_rate": 8.664421997755332e-05,
+ "loss": 0.020868321880698204,
+ "step": 437
+ },
+ {
+ "epoch": 2.212658227848101,
+ "grad_norm": 0.11743242293596268,
+ "learning_rate": 8.658810325476992e-05,
+ "loss": 0.029748965054750443,
+ "step": 438
+ },
+ {
+ "epoch": 2.2177215189873416,
+ "grad_norm": 0.08399086445569992,
+ "learning_rate": 8.653198653198653e-05,
+ "loss": 0.02379520982503891,
+ "step": 439
+ },
+ {
+ "epoch": 2.222784810126582,
+ "grad_norm": 0.052164461463689804,
+ "learning_rate": 8.647586980920315e-05,
+ "loss": 0.02010851353406906,
+ "step": 440
+ },
+ {
+ "epoch": 2.2278481012658227,
+ "grad_norm": 0.11834696680307388,
+ "learning_rate": 8.641975308641975e-05,
+ "loss": 0.02748255990445614,
+ "step": 441
+ },
+ {
+ "epoch": 2.232911392405063,
+ "grad_norm": 0.06718999892473221,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.026828233152627945,
+ "step": 442
+ },
+ {
+ "epoch": 2.2379746835443037,
+ "grad_norm": 0.042458854615688324,
+ "learning_rate": 8.630751964085297e-05,
+ "loss": 0.021280258893966675,
+ "step": 443
+ },
+ {
+ "epoch": 2.2430379746835443,
+ "grad_norm": 0.036516617983579636,
+ "learning_rate": 8.62514029180696e-05,
+ "loss": 0.021773381158709526,
+ "step": 444
+ },
+ {
+ "epoch": 2.248101265822785,
+ "grad_norm": 0.04317261651158333,
+ "learning_rate": 8.619528619528619e-05,
+ "loss": 0.022671079263091087,
+ "step": 445
+ },
+ {
+ "epoch": 2.2531645569620253,
+ "grad_norm": 0.08610037714242935,
+ "learning_rate": 8.613916947250281e-05,
+ "loss": 0.02425701916217804,
+ "step": 446
+ },
+ {
+ "epoch": 2.258227848101266,
+ "grad_norm": 0.03478290140628815,
+ "learning_rate": 8.608305274971942e-05,
+ "loss": 0.022291556000709534,
+ "step": 447
+ },
+ {
+ "epoch": 2.2632911392405064,
+ "grad_norm": 0.04682233929634094,
+ "learning_rate": 8.602693602693603e-05,
+ "loss": 0.02036888152360916,
+ "step": 448
+ },
+ {
+ "epoch": 2.268354430379747,
+ "grad_norm": 0.0808606892824173,
+ "learning_rate": 8.597081930415264e-05,
+ "loss": 0.025470012798905373,
+ "step": 449
+ },
+ {
+ "epoch": 2.2734177215189875,
+ "grad_norm": 0.042830612510442734,
+ "learning_rate": 8.591470258136925e-05,
+ "loss": 0.020565971732139587,
+ "step": 450
+ },
+ {
+ "epoch": 2.278481012658228,
+ "grad_norm": 0.06374406069517136,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031990330666303635,
+ "step": 451
+ },
+ {
+ "epoch": 2.2835443037974685,
+ "grad_norm": 0.05716697871685028,
+ "learning_rate": 8.580246913580247e-05,
+ "loss": 0.024125374853610992,
+ "step": 452
+ },
+ {
+ "epoch": 2.2886075949367086,
+ "grad_norm": 0.04057484492659569,
+ "learning_rate": 8.574635241301908e-05,
+ "loss": 0.021739482879638672,
+ "step": 453
+ },
+ {
+ "epoch": 2.293670886075949,
+ "grad_norm": 0.07754945009946823,
+ "learning_rate": 8.56902356902357e-05,
+ "loss": 0.02694481424987316,
+ "step": 454
+ },
+ {
+ "epoch": 2.2987341772151897,
+ "grad_norm": 0.06022442877292633,
+ "learning_rate": 8.56341189674523e-05,
+ "loss": 0.021221034228801727,
+ "step": 455
+ },
+ {
+ "epoch": 2.3037974683544302,
+ "grad_norm": 0.06909896433353424,
+ "learning_rate": 8.557800224466891e-05,
+ "loss": 0.02247895672917366,
+ "step": 456
+ },
+ {
+ "epoch": 2.3088607594936708,
+ "grad_norm": 0.05362236499786377,
+ "learning_rate": 8.552188552188552e-05,
+ "loss": 0.020700538530945778,
+ "step": 457
+ },
+ {
+ "epoch": 2.3139240506329113,
+ "grad_norm": 0.09836408495903015,
+ "learning_rate": 8.546576879910215e-05,
+ "loss": 0.02611887827515602,
+ "step": 458
+ },
+ {
+ "epoch": 2.318987341772152,
+ "grad_norm": 0.036625102162361145,
+ "learning_rate": 8.540965207631874e-05,
+ "loss": 0.0196938905864954,
+ "step": 459
+ },
+ {
+ "epoch": 2.3240506329113924,
+ "grad_norm": 0.07372298091650009,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.020545657724142075,
+ "step": 460
+ },
+ {
+ "epoch": 2.329113924050633,
+ "grad_norm": 0.20502988994121552,
+ "learning_rate": 8.529741863075196e-05,
+ "loss": 0.02884715050458908,
+ "step": 461
+ },
+ {
+ "epoch": 2.3341772151898734,
+ "grad_norm": 0.04867224395275116,
+ "learning_rate": 8.524130190796857e-05,
+ "loss": 0.019854716956615448,
+ "step": 462
+ },
+ {
+ "epoch": 2.339240506329114,
+ "grad_norm": 0.029550092294812202,
+ "learning_rate": 8.518518518518518e-05,
+ "loss": 0.01884104311466217,
+ "step": 463
+ },
+ {
+ "epoch": 2.3443037974683545,
+ "grad_norm": 0.04299351945519447,
+ "learning_rate": 8.51290684624018e-05,
+ "loss": 0.01954217068850994,
+ "step": 464
+ },
+ {
+ "epoch": 2.349367088607595,
+ "grad_norm": 0.043467242270708084,
+ "learning_rate": 8.507295173961842e-05,
+ "loss": 0.024274462834000587,
+ "step": 465
+ },
+ {
+ "epoch": 2.3544303797468356,
+ "grad_norm": 0.05131510645151138,
+ "learning_rate": 8.501683501683501e-05,
+ "loss": 0.026246599853038788,
+ "step": 466
+ },
+ {
+ "epoch": 2.359493670886076,
+ "grad_norm": 0.06280570477247238,
+ "learning_rate": 8.496071829405164e-05,
+ "loss": 0.024986159056425095,
+ "step": 467
+ },
+ {
+ "epoch": 2.3645569620253166,
+ "grad_norm": 0.04968208447098732,
+ "learning_rate": 8.490460157126824e-05,
+ "loss": 0.02912936732172966,
+ "step": 468
+ },
+ {
+ "epoch": 2.369620253164557,
+ "grad_norm": 0.08504039794206619,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.027097277343273163,
+ "step": 469
+ },
+ {
+ "epoch": 2.3746835443037977,
+ "grad_norm": 0.18385924398899078,
+ "learning_rate": 8.479236812570146e-05,
+ "loss": 0.02459462732076645,
+ "step": 470
+ },
+ {
+ "epoch": 2.379746835443038,
+ "grad_norm": 0.0663745328783989,
+ "learning_rate": 8.473625140291808e-05,
+ "loss": 0.020224973559379578,
+ "step": 471
+ },
+ {
+ "epoch": 2.3848101265822783,
+ "grad_norm": 0.04759671539068222,
+ "learning_rate": 8.468013468013468e-05,
+ "loss": 0.02591642364859581,
+ "step": 472
+ },
+ {
+ "epoch": 2.389873417721519,
+ "grad_norm": 0.044010091572999954,
+ "learning_rate": 8.46240179573513e-05,
+ "loss": 0.025122515857219696,
+ "step": 473
+ },
+ {
+ "epoch": 2.3949367088607594,
+ "grad_norm": 0.035054467618465424,
+ "learning_rate": 8.456790123456791e-05,
+ "loss": 0.019854065030813217,
+ "step": 474
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.03171153366565704,
+ "learning_rate": 8.451178451178452e-05,
+ "loss": 0.02009584940969944,
+ "step": 475
+ },
+ {
+ "epoch": 2.4050632911392404,
+ "grad_norm": 0.17388089001178741,
+ "learning_rate": 8.445566778900113e-05,
+ "loss": 0.02714207023382187,
+ "step": 476
+ },
+ {
+ "epoch": 2.410126582278481,
+ "grad_norm": 0.038392502814531326,
+ "learning_rate": 8.439955106621774e-05,
+ "loss": 0.020382478833198547,
+ "step": 477
+ },
+ {
+ "epoch": 2.4151898734177215,
+ "grad_norm": 0.04264051839709282,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.022726822644472122,
+ "step": 478
+ },
+ {
+ "epoch": 2.420253164556962,
+ "grad_norm": 0.046432014554739,
+ "learning_rate": 8.428731762065096e-05,
+ "loss": 0.021431483328342438,
+ "step": 479
+ },
+ {
+ "epoch": 2.4253164556962026,
+ "grad_norm": 0.07288242876529694,
+ "learning_rate": 8.423120089786757e-05,
+ "loss": 0.026229504495859146,
+ "step": 480
+ },
+ {
+ "epoch": 2.430379746835443,
+ "grad_norm": 0.04801097884774208,
+ "learning_rate": 8.417508417508418e-05,
+ "loss": 0.020924456417560577,
+ "step": 481
+ },
+ {
+ "epoch": 2.4354430379746836,
+ "grad_norm": 0.11201190203428268,
+ "learning_rate": 8.411896745230079e-05,
+ "loss": 0.022652529180049896,
+ "step": 482
+ },
+ {
+ "epoch": 2.440506329113924,
+ "grad_norm": 0.06151285395026207,
+ "learning_rate": 8.40628507295174e-05,
+ "loss": 0.02416859194636345,
+ "step": 483
+ },
+ {
+ "epoch": 2.4455696202531647,
+ "grad_norm": 0.04006446525454521,
+ "learning_rate": 8.400673400673401e-05,
+ "loss": 0.02390255406498909,
+ "step": 484
+ },
+ {
+ "epoch": 2.4506329113924052,
+ "grad_norm": 0.027193108573555946,
+ "learning_rate": 8.395061728395062e-05,
+ "loss": 0.015282701700925827,
+ "step": 485
+ },
+ {
+ "epoch": 2.4556962025316453,
+ "grad_norm": 0.05453994497656822,
+ "learning_rate": 8.389450056116723e-05,
+ "loss": 0.025738034397363663,
+ "step": 486
+ },
+ {
+ "epoch": 2.460759493670886,
+ "grad_norm": 0.03226681798696518,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.02111941948533058,
+ "step": 487
+ },
+ {
+ "epoch": 2.4658227848101264,
+ "grad_norm": 0.0451083667576313,
+ "learning_rate": 8.378226711560045e-05,
+ "loss": 0.020694585517048836,
+ "step": 488
+ },
+ {
+ "epoch": 2.470886075949367,
+ "grad_norm": 0.0390113927423954,
+ "learning_rate": 8.372615039281706e-05,
+ "loss": 0.022557765245437622,
+ "step": 489
+ },
+ {
+ "epoch": 2.4759493670886075,
+ "grad_norm": 0.05983779951930046,
+ "learning_rate": 8.367003367003367e-05,
+ "loss": 0.02489873766899109,
+ "step": 490
+ },
+ {
+ "epoch": 2.481012658227848,
+ "grad_norm": 0.03961458057165146,
+ "learning_rate": 8.361391694725028e-05,
+ "loss": 0.021655399352312088,
+ "step": 491
+ },
+ {
+ "epoch": 2.4860759493670885,
+ "grad_norm": 0.03814523667097092,
+ "learning_rate": 8.35578002244669e-05,
+ "loss": 0.02217719703912735,
+ "step": 492
+ },
+ {
+ "epoch": 2.491139240506329,
+ "grad_norm": 0.030563514679670334,
+ "learning_rate": 8.35016835016835e-05,
+ "loss": 0.01679009571671486,
+ "step": 493
+ },
+ {
+ "epoch": 2.4962025316455696,
+ "grad_norm": 0.04566824436187744,
+ "learning_rate": 8.344556677890012e-05,
+ "loss": 0.019699417054653168,
+ "step": 494
+ },
+ {
+ "epoch": 2.50126582278481,
+ "grad_norm": 0.06117499992251396,
+ "learning_rate": 8.338945005611672e-05,
+ "loss": 0.028571851551532745,
+ "step": 495
+ },
+ {
+ "epoch": 2.5063291139240507,
+ "grad_norm": 0.03510760888457298,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.023387223482131958,
+ "step": 496
+ },
+ {
+ "epoch": 2.511392405063291,
+ "grad_norm": 0.028878437355160713,
+ "learning_rate": 8.327721661054994e-05,
+ "loss": 0.023329850286245346,
+ "step": 497
+ },
+ {
+ "epoch": 2.5164556962025317,
+ "grad_norm": 0.02818676456809044,
+ "learning_rate": 8.322109988776656e-05,
+ "loss": 0.017786618322134018,
+ "step": 498
+ },
+ {
+ "epoch": 2.5215189873417723,
+ "grad_norm": 0.06660276651382446,
+ "learning_rate": 8.316498316498317e-05,
+ "loss": 0.023636367172002792,
+ "step": 499
+ },
+ {
+ "epoch": 2.526582278481013,
+ "grad_norm": 0.05663186311721802,
+ "learning_rate": 8.310886644219978e-05,
+ "loss": 0.02607567049562931,
+ "step": 500
+ },
+ {
+ "epoch": 2.5316455696202533,
+ "grad_norm": 0.04156090319156647,
+ "learning_rate": 8.30527497194164e-05,
+ "loss": 0.024936942383646965,
+ "step": 501
+ },
+ {
+ "epoch": 2.536708860759494,
+ "grad_norm": 0.036135219037532806,
+ "learning_rate": 8.2996632996633e-05,
+ "loss": 0.023583384230732918,
+ "step": 502
+ },
+ {
+ "epoch": 2.5417721518987344,
+ "grad_norm": 0.052026644349098206,
+ "learning_rate": 8.294051627384961e-05,
+ "loss": 0.02324807643890381,
+ "step": 503
+ },
+ {
+ "epoch": 2.546835443037975,
+ "grad_norm": 0.03599514439702034,
+ "learning_rate": 8.288439955106621e-05,
+ "loss": 0.01879853755235672,
+ "step": 504
+ },
+ {
+ "epoch": 2.5518987341772155,
+ "grad_norm": 0.03505280241370201,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.017342131584882736,
+ "step": 505
+ },
+ {
+ "epoch": 2.5569620253164556,
+ "grad_norm": 0.0403706431388855,
+ "learning_rate": 8.277216610549943e-05,
+ "loss": 0.02082991972565651,
+ "step": 506
+ },
+ {
+ "epoch": 2.562025316455696,
+ "grad_norm": 0.031072309240698814,
+ "learning_rate": 8.271604938271605e-05,
+ "loss": 0.01711331121623516,
+ "step": 507
+ },
+ {
+ "epoch": 2.5670886075949366,
+ "grad_norm": 0.04118587449193001,
+ "learning_rate": 8.265993265993266e-05,
+ "loss": 0.01940922439098358,
+ "step": 508
+ },
+ {
+ "epoch": 2.572151898734177,
+ "grad_norm": 0.039908040314912796,
+ "learning_rate": 8.260381593714927e-05,
+ "loss": 0.021229952573776245,
+ "step": 509
+ },
+ {
+ "epoch": 2.5772151898734177,
+ "grad_norm": 0.02886618860065937,
+ "learning_rate": 8.254769921436589e-05,
+ "loss": 0.02004890888929367,
+ "step": 510
+ },
+ {
+ "epoch": 2.5822784810126582,
+ "grad_norm": 0.04229263588786125,
+ "learning_rate": 8.24915824915825e-05,
+ "loss": 0.019512392580509186,
+ "step": 511
+ },
+ {
+ "epoch": 2.5873417721518988,
+ "grad_norm": 0.030951635912060738,
+ "learning_rate": 8.24354657687991e-05,
+ "loss": 0.01836536079645157,
+ "step": 512
+ },
+ {
+ "epoch": 2.5924050632911393,
+ "grad_norm": 0.057054903358221054,
+ "learning_rate": 8.237934904601572e-05,
+ "loss": 0.028897594660520554,
+ "step": 513
+ },
+ {
+ "epoch": 2.59746835443038,
+ "grad_norm": 0.10734204202890396,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.024986904114484787,
+ "step": 514
+ },
+ {
+ "epoch": 2.6025316455696204,
+ "grad_norm": 0.029653102159500122,
+ "learning_rate": 8.226711560044894e-05,
+ "loss": 0.02242947742342949,
+ "step": 515
+ },
+ {
+ "epoch": 2.607594936708861,
+ "grad_norm": 0.05601462349295616,
+ "learning_rate": 8.221099887766555e-05,
+ "loss": 0.020091768354177475,
+ "step": 516
+ },
+ {
+ "epoch": 2.6126582278481014,
+ "grad_norm": 0.04170191287994385,
+ "learning_rate": 8.215488215488217e-05,
+ "loss": 0.021796470507979393,
+ "step": 517
+ },
+ {
+ "epoch": 2.6177215189873415,
+ "grad_norm": 0.06347091495990753,
+ "learning_rate": 8.209876543209877e-05,
+ "loss": 0.024338826537132263,
+ "step": 518
+ },
+ {
+ "epoch": 2.622784810126582,
+ "grad_norm": 0.06084204465150833,
+ "learning_rate": 8.204264870931539e-05,
+ "loss": 0.02493124082684517,
+ "step": 519
+ },
+ {
+ "epoch": 2.6278481012658226,
+ "grad_norm": 0.03094005584716797,
+ "learning_rate": 8.198653198653199e-05,
+ "loss": 0.021345658227801323,
+ "step": 520
+ },
+ {
+ "epoch": 2.632911392405063,
+ "grad_norm": 0.04017730429768562,
+ "learning_rate": 8.193041526374861e-05,
+ "loss": 0.019823770970106125,
+ "step": 521
+ },
+ {
+ "epoch": 2.6379746835443036,
+ "grad_norm": 0.045351576060056686,
+ "learning_rate": 8.18742985409652e-05,
+ "loss": 0.02385132387280464,
+ "step": 522
+ },
+ {
+ "epoch": 2.643037974683544,
+ "grad_norm": 0.04823896288871765,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.021753432229161263,
+ "step": 523
+ },
+ {
+ "epoch": 2.6481012658227847,
+ "grad_norm": 0.0442446693778038,
+ "learning_rate": 8.176206509539843e-05,
+ "loss": 0.022134695202112198,
+ "step": 524
+ },
+ {
+ "epoch": 2.6531645569620252,
+ "grad_norm": 0.07998359203338623,
+ "learning_rate": 8.170594837261504e-05,
+ "loss": 0.021159570664167404,
+ "step": 525
+ },
+ {
+ "epoch": 2.6582278481012658,
+ "grad_norm": 0.07844395190477371,
+ "learning_rate": 8.164983164983166e-05,
+ "loss": 0.023695990443229675,
+ "step": 526
+ },
+ {
+ "epoch": 2.6632911392405063,
+ "grad_norm": 0.025296518579125404,
+ "learning_rate": 8.159371492704826e-05,
+ "loss": 0.020914766937494278,
+ "step": 527
+ },
+ {
+ "epoch": 2.668354430379747,
+ "grad_norm": 0.337454617023468,
+ "learning_rate": 8.153759820426488e-05,
+ "loss": 0.02948678657412529,
+ "step": 528
+ },
+ {
+ "epoch": 2.6734177215189874,
+ "grad_norm": 0.03531114012002945,
+ "learning_rate": 8.148148148148148e-05,
+ "loss": 0.020608587190508842,
+ "step": 529
+ },
+ {
+ "epoch": 2.678481012658228,
+ "grad_norm": 0.0496559739112854,
+ "learning_rate": 8.14253647586981e-05,
+ "loss": 0.023600757122039795,
+ "step": 530
+ },
+ {
+ "epoch": 2.6835443037974684,
+ "grad_norm": 0.04093128815293312,
+ "learning_rate": 8.13692480359147e-05,
+ "loss": 0.022392068058252335,
+ "step": 531
+ },
+ {
+ "epoch": 2.688607594936709,
+ "grad_norm": 0.05343819782137871,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.01882098615169525,
+ "step": 532
+ },
+ {
+ "epoch": 2.6936708860759495,
+ "grad_norm": 0.0334453359246254,
+ "learning_rate": 8.125701459034793e-05,
+ "loss": 0.020492104813456535,
+ "step": 533
+ },
+ {
+ "epoch": 2.69873417721519,
+ "grad_norm": 0.045540470629930496,
+ "learning_rate": 8.120089786756454e-05,
+ "loss": 0.021309707313776016,
+ "step": 534
+ },
+ {
+ "epoch": 2.7037974683544306,
+ "grad_norm": 0.03238926827907562,
+ "learning_rate": 8.114478114478115e-05,
+ "loss": 0.01929772086441517,
+ "step": 535
+ },
+ {
+ "epoch": 2.708860759493671,
+ "grad_norm": 0.10985280573368073,
+ "learning_rate": 8.108866442199776e-05,
+ "loss": 0.02431013062596321,
+ "step": 536
+ },
+ {
+ "epoch": 2.7139240506329116,
+ "grad_norm": 0.039785534143447876,
+ "learning_rate": 8.103254769921437e-05,
+ "loss": 0.022708022966980934,
+ "step": 537
+ },
+ {
+ "epoch": 2.7189873417721517,
+ "grad_norm": 0.06239910051226616,
+ "learning_rate": 8.097643097643098e-05,
+ "loss": 0.02715257555246353,
+ "step": 538
+ },
+ {
+ "epoch": 2.7240506329113923,
+ "grad_norm": 0.03662843257188797,
+ "learning_rate": 8.092031425364759e-05,
+ "loss": 0.024876421317458153,
+ "step": 539
+ },
+ {
+ "epoch": 2.729113924050633,
+ "grad_norm": 0.05869411304593086,
+ "learning_rate": 8.08641975308642e-05,
+ "loss": 0.022937750443816185,
+ "step": 540
+ },
+ {
+ "epoch": 2.7341772151898733,
+ "grad_norm": 0.07220412790775299,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02227093279361725,
+ "step": 541
+ },
+ {
+ "epoch": 2.739240506329114,
+ "grad_norm": 0.03881363570690155,
+ "learning_rate": 8.075196408529742e-05,
+ "loss": 0.020784813910722733,
+ "step": 542
+ },
+ {
+ "epoch": 2.7443037974683544,
+ "grad_norm": 0.04756273329257965,
+ "learning_rate": 8.069584736251403e-05,
+ "loss": 0.02334344945847988,
+ "step": 543
+ },
+ {
+ "epoch": 2.749367088607595,
+ "grad_norm": 0.05327540263533592,
+ "learning_rate": 8.063973063973065e-05,
+ "loss": 0.026313351467251778,
+ "step": 544
+ },
+ {
+ "epoch": 2.7544303797468355,
+ "grad_norm": 0.1605764925479889,
+ "learning_rate": 8.058361391694725e-05,
+ "loss": 0.02474561519920826,
+ "step": 545
+ },
+ {
+ "epoch": 2.759493670886076,
+ "grad_norm": 0.044486165046691895,
+ "learning_rate": 8.052749719416387e-05,
+ "loss": 0.023557808250188828,
+ "step": 546
+ },
+ {
+ "epoch": 2.7645569620253165,
+ "grad_norm": 0.04645116999745369,
+ "learning_rate": 8.047138047138047e-05,
+ "loss": 0.017340417951345444,
+ "step": 547
+ },
+ {
+ "epoch": 2.769620253164557,
+ "grad_norm": 0.04009381681680679,
+ "learning_rate": 8.041526374859708e-05,
+ "loss": 0.018324140459299088,
+ "step": 548
+ },
+ {
+ "epoch": 2.7746835443037976,
+ "grad_norm": 0.12476589530706406,
+ "learning_rate": 8.035914702581369e-05,
+ "loss": 0.023337965831160545,
+ "step": 549
+ },
+ {
+ "epoch": 2.779746835443038,
+ "grad_norm": 0.04257349297404289,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.021878249943256378,
+ "step": 550
+ },
+ {
+ "epoch": 2.7848101265822782,
+ "grad_norm": 0.044377341866493225,
+ "learning_rate": 8.024691358024692e-05,
+ "loss": 0.019643619656562805,
+ "step": 551
+ },
+ {
+ "epoch": 2.7898734177215188,
+ "grad_norm": 0.0801771879196167,
+ "learning_rate": 8.019079685746352e-05,
+ "loss": 0.021452955901622772,
+ "step": 552
+ },
+ {
+ "epoch": 2.7949367088607593,
+ "grad_norm": 0.04462383687496185,
+ "learning_rate": 8.013468013468015e-05,
+ "loss": 0.02363801747560501,
+ "step": 553
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.05768737941980362,
+ "learning_rate": 8.007856341189674e-05,
+ "loss": 0.03572218120098114,
+ "step": 554
+ },
+ {
+ "epoch": 2.8050632911392404,
+ "grad_norm": 0.03812364116311073,
+ "learning_rate": 8.002244668911337e-05,
+ "loss": 0.01964751072227955,
+ "step": 555
+ },
+ {
+ "epoch": 2.810126582278481,
+ "grad_norm": 0.03297588974237442,
+ "learning_rate": 7.996632996632996e-05,
+ "loss": 0.019139982759952545,
+ "step": 556
+ },
+ {
+ "epoch": 2.8151898734177214,
+ "grad_norm": 0.024627596139907837,
+ "learning_rate": 7.991021324354659e-05,
+ "loss": 0.021029513329267502,
+ "step": 557
+ },
+ {
+ "epoch": 2.820253164556962,
+ "grad_norm": 0.058927983045578,
+ "learning_rate": 7.985409652076318e-05,
+ "loss": 0.03308084234595299,
+ "step": 558
+ },
+ {
+ "epoch": 2.8253164556962025,
+ "grad_norm": 0.11811497062444687,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.028271127492189407,
+ "step": 559
+ },
+ {
+ "epoch": 2.830379746835443,
+ "grad_norm": 0.043665409088134766,
+ "learning_rate": 7.974186307519642e-05,
+ "loss": 0.02708129584789276,
+ "step": 560
+ },
+ {
+ "epoch": 2.8354430379746836,
+ "grad_norm": 0.034729309380054474,
+ "learning_rate": 7.968574635241303e-05,
+ "loss": 0.023845072835683823,
+ "step": 561
+ },
+ {
+ "epoch": 2.840506329113924,
+ "grad_norm": 0.028991155326366425,
+ "learning_rate": 7.962962962962964e-05,
+ "loss": 0.018426496535539627,
+ "step": 562
+ },
+ {
+ "epoch": 2.8455696202531646,
+ "grad_norm": 0.04660327732563019,
+ "learning_rate": 7.957351290684625e-05,
+ "loss": 0.02610144019126892,
+ "step": 563
+ },
+ {
+ "epoch": 2.850632911392405,
+ "grad_norm": 0.03947063535451889,
+ "learning_rate": 7.951739618406286e-05,
+ "loss": 0.025909483432769775,
+ "step": 564
+ },
+ {
+ "epoch": 2.8556962025316457,
+ "grad_norm": 0.06056501716375351,
+ "learning_rate": 7.946127946127947e-05,
+ "loss": 0.030405592173337936,
+ "step": 565
+ },
+ {
+ "epoch": 2.8607594936708862,
+ "grad_norm": 0.03398960456252098,
+ "learning_rate": 7.940516273849608e-05,
+ "loss": 0.02486085705459118,
+ "step": 566
+ },
+ {
+ "epoch": 2.8658227848101268,
+ "grad_norm": 0.03136906027793884,
+ "learning_rate": 7.934904601571269e-05,
+ "loss": 0.020573778077960014,
+ "step": 567
+ },
+ {
+ "epoch": 2.8708860759493673,
+ "grad_norm": 0.03404523804783821,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.021034879609942436,
+ "step": 568
+ },
+ {
+ "epoch": 2.875949367088608,
+ "grad_norm": 0.02937588468194008,
+ "learning_rate": 7.92368125701459e-05,
+ "loss": 0.02275373972952366,
+ "step": 569
+ },
+ {
+ "epoch": 2.8810126582278484,
+ "grad_norm": 0.03971172124147415,
+ "learning_rate": 7.918069584736252e-05,
+ "loss": 0.021558552980422974,
+ "step": 570
+ },
+ {
+ "epoch": 2.8860759493670884,
+ "grad_norm": 0.05636494606733322,
+ "learning_rate": 7.912457912457913e-05,
+ "loss": 0.025583568960428238,
+ "step": 571
+ },
+ {
+ "epoch": 2.891139240506329,
+ "grad_norm": 0.2013683319091797,
+ "learning_rate": 7.906846240179574e-05,
+ "loss": 0.025386696681380272,
+ "step": 572
+ },
+ {
+ "epoch": 2.8962025316455695,
+ "grad_norm": 0.05875328183174133,
+ "learning_rate": 7.901234567901235e-05,
+ "loss": 0.023778585717082024,
+ "step": 573
+ },
+ {
+ "epoch": 2.90126582278481,
+ "grad_norm": 0.031178263947367668,
+ "learning_rate": 7.895622895622896e-05,
+ "loss": 0.02130977436900139,
+ "step": 574
+ },
+ {
+ "epoch": 2.9063291139240506,
+ "grad_norm": 0.028125282377004623,
+ "learning_rate": 7.890011223344557e-05,
+ "loss": 0.023941578343510628,
+ "step": 575
+ },
+ {
+ "epoch": 2.911392405063291,
+ "grad_norm": 0.03701331466436386,
+ "learning_rate": 7.884399551066218e-05,
+ "loss": 0.01856887713074684,
+ "step": 576
+ },
+ {
+ "epoch": 2.9164556962025316,
+ "grad_norm": 0.05281993746757507,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.023393619805574417,
+ "step": 577
+ },
+ {
+ "epoch": 2.921518987341772,
+ "grad_norm": 0.03958812728524208,
+ "learning_rate": 7.873176206509541e-05,
+ "loss": 0.019871000200510025,
+ "step": 578
+ },
+ {
+ "epoch": 2.9265822784810127,
+ "grad_norm": 0.0439714752137661,
+ "learning_rate": 7.867564534231201e-05,
+ "loss": 0.025316016748547554,
+ "step": 579
+ },
+ {
+ "epoch": 2.9316455696202532,
+ "grad_norm": 0.03543296083807945,
+ "learning_rate": 7.861952861952863e-05,
+ "loss": 0.022549735382199287,
+ "step": 580
+ },
+ {
+ "epoch": 2.9367088607594938,
+ "grad_norm": 0.05503656715154648,
+ "learning_rate": 7.856341189674523e-05,
+ "loss": 0.02716357260942459,
+ "step": 581
+ },
+ {
+ "epoch": 2.9417721518987343,
+ "grad_norm": 0.03273561969399452,
+ "learning_rate": 7.850729517396185e-05,
+ "loss": 0.017606684938073158,
+ "step": 582
+ },
+ {
+ "epoch": 2.946835443037975,
+ "grad_norm": 0.04668378457427025,
+ "learning_rate": 7.845117845117845e-05,
+ "loss": 0.022529952228069305,
+ "step": 583
+ },
+ {
+ "epoch": 2.951898734177215,
+ "grad_norm": 0.034348756074905396,
+ "learning_rate": 7.839506172839507e-05,
+ "loss": 0.02549612522125244,
+ "step": 584
+ },
+ {
+ "epoch": 2.9569620253164555,
+ "grad_norm": 0.03485729172825813,
+ "learning_rate": 7.833894500561168e-05,
+ "loss": 0.019362375140190125,
+ "step": 585
+ },
+ {
+ "epoch": 2.962025316455696,
+ "grad_norm": 0.034695904701948166,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.023550841957330704,
+ "step": 586
+ },
+ {
+ "epoch": 2.9670886075949365,
+ "grad_norm": 0.02703205682337284,
+ "learning_rate": 7.82267115600449e-05,
+ "loss": 0.016860410571098328,
+ "step": 587
+ },
+ {
+ "epoch": 2.972151898734177,
+ "grad_norm": 0.0694100558757782,
+ "learning_rate": 7.817059483726151e-05,
+ "loss": 0.02669605240225792,
+ "step": 588
+ },
+ {
+ "epoch": 2.9772151898734176,
+ "grad_norm": 0.02641797810792923,
+ "learning_rate": 7.811447811447812e-05,
+ "loss": 0.019620027393102646,
+ "step": 589
+ },
+ {
+ "epoch": 2.982278481012658,
+ "grad_norm": 0.03643452376127243,
+ "learning_rate": 7.805836139169473e-05,
+ "loss": 0.018797604367136955,
+ "step": 590
+ },
+ {
+ "epoch": 2.9873417721518987,
+ "grad_norm": 0.04125158116221428,
+ "learning_rate": 7.800224466891134e-05,
+ "loss": 0.020387161523103714,
+ "step": 591
+ },
+ {
+ "epoch": 2.992405063291139,
+ "grad_norm": 0.037161167711019516,
+ "learning_rate": 7.794612794612795e-05,
+ "loss": 0.02484878897666931,
+ "step": 592
+ },
+ {
+ "epoch": 2.9974683544303797,
+ "grad_norm": 0.03352266550064087,
+ "learning_rate": 7.789001122334456e-05,
+ "loss": 0.022045889869332314,
+ "step": 593
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.07333379238843918,
+ "learning_rate": 7.783389450056117e-05,
+ "loss": 0.025806350633502007,
+ "step": 594
+ },
+ {
+ "epoch": 3.0050632911392405,
+ "grad_norm": 0.05492037162184715,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.025387149304151535,
+ "step": 595
+ },
+ {
+ "epoch": 3.010126582278481,
+ "grad_norm": 0.03932039067149162,
+ "learning_rate": 7.772166105499439e-05,
+ "loss": 0.020961906760931015,
+ "step": 596
+ },
+ {
+ "epoch": 3.0151898734177216,
+ "grad_norm": 0.03346814960241318,
+ "learning_rate": 7.7665544332211e-05,
+ "loss": 0.018602946773171425,
+ "step": 597
+ },
+ {
+ "epoch": 3.020253164556962,
+ "grad_norm": 0.041588157415390015,
+ "learning_rate": 7.760942760942761e-05,
+ "loss": 0.02350936457514763,
+ "step": 598
+ },
+ {
+ "epoch": 3.0253164556962027,
+ "grad_norm": 0.0634593740105629,
+ "learning_rate": 7.755331088664422e-05,
+ "loss": 0.02807607129216194,
+ "step": 599
+ },
+ {
+ "epoch": 3.030379746835443,
+ "grad_norm": 0.037369582802057266,
+ "learning_rate": 7.749719416386083e-05,
+ "loss": 0.01987743005156517,
+ "step": 600
+ },
+ {
+ "epoch": 3.0354430379746837,
+ "grad_norm": 0.051795534789562225,
+ "learning_rate": 7.744107744107744e-05,
+ "loss": 0.02273828536272049,
+ "step": 601
+ },
+ {
+ "epoch": 3.0405063291139243,
+ "grad_norm": 0.06508016586303711,
+ "learning_rate": 7.738496071829405e-05,
+ "loss": 0.022526375949382782,
+ "step": 602
+ },
+ {
+ "epoch": 3.0455696202531644,
+ "grad_norm": 0.05076521635055542,
+ "learning_rate": 7.732884399551068e-05,
+ "loss": 0.030540699139237404,
+ "step": 603
+ },
+ {
+ "epoch": 3.050632911392405,
+ "grad_norm": 0.05223327502608299,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.025222979485988617,
+ "step": 604
+ },
+ {
+ "epoch": 3.0556962025316454,
+ "grad_norm": 0.040298622101545334,
+ "learning_rate": 7.72166105499439e-05,
+ "loss": 0.024349395185709,
+ "step": 605
+ },
+ {
+ "epoch": 3.060759493670886,
+ "grad_norm": 0.031546592712402344,
+ "learning_rate": 7.716049382716049e-05,
+ "loss": 0.022118842229247093,
+ "step": 606
+ },
+ {
+ "epoch": 3.0658227848101265,
+ "grad_norm": 0.03639276325702667,
+ "learning_rate": 7.710437710437712e-05,
+ "loss": 0.019809089601039886,
+ "step": 607
+ },
+ {
+ "epoch": 3.070886075949367,
+ "grad_norm": 0.03702636435627937,
+ "learning_rate": 7.704826038159371e-05,
+ "loss": 0.023927533999085426,
+ "step": 608
+ },
+ {
+ "epoch": 3.0759493670886076,
+ "grad_norm": 0.027585966512560844,
+ "learning_rate": 7.699214365881034e-05,
+ "loss": 0.017853228375315666,
+ "step": 609
+ },
+ {
+ "epoch": 3.081012658227848,
+ "grad_norm": 0.036372315138578415,
+ "learning_rate": 7.693602693602693e-05,
+ "loss": 0.027036674320697784,
+ "step": 610
+ },
+ {
+ "epoch": 3.0860759493670886,
+ "grad_norm": 0.03734718635678291,
+ "learning_rate": 7.687991021324356e-05,
+ "loss": 0.021930409595370293,
+ "step": 611
+ },
+ {
+ "epoch": 3.091139240506329,
+ "grad_norm": 0.04167135804891586,
+ "learning_rate": 7.682379349046017e-05,
+ "loss": 0.02211524173617363,
+ "step": 612
+ },
+ {
+ "epoch": 3.0962025316455697,
+ "grad_norm": 0.06541049480438232,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.02102654054760933,
+ "step": 613
+ },
+ {
+ "epoch": 3.1012658227848102,
+ "grad_norm": 0.03505360335111618,
+ "learning_rate": 7.671156004489339e-05,
+ "loss": 0.021799035370349884,
+ "step": 614
+ },
+ {
+ "epoch": 3.1063291139240508,
+ "grad_norm": 0.038781505078077316,
+ "learning_rate": 7.665544332210998e-05,
+ "loss": 0.020275672897696495,
+ "step": 615
+ },
+ {
+ "epoch": 3.1113924050632913,
+ "grad_norm": 0.05527551844716072,
+ "learning_rate": 7.65993265993266e-05,
+ "loss": 0.02752656675875187,
+ "step": 616
+ },
+ {
+ "epoch": 3.116455696202532,
+ "grad_norm": 0.092417873442173,
+ "learning_rate": 7.65432098765432e-05,
+ "loss": 0.034416262060403824,
+ "step": 617
+ },
+ {
+ "epoch": 3.1215189873417724,
+ "grad_norm": 0.04619184136390686,
+ "learning_rate": 7.648709315375983e-05,
+ "loss": 0.028675489127635956,
+ "step": 618
+ },
+ {
+ "epoch": 3.1265822784810124,
+ "grad_norm": 0.027103425934910774,
+ "learning_rate": 7.643097643097644e-05,
+ "loss": 0.01944906637072563,
+ "step": 619
+ },
+ {
+ "epoch": 3.131645569620253,
+ "grad_norm": 0.062025271356105804,
+ "learning_rate": 7.637485970819305e-05,
+ "loss": 0.030966270714998245,
+ "step": 620
+ },
+ {
+ "epoch": 3.1367088607594935,
+ "grad_norm": 0.029828928411006927,
+ "learning_rate": 7.631874298540966e-05,
+ "loss": 0.02199825644493103,
+ "step": 621
+ },
+ {
+ "epoch": 3.141772151898734,
+ "grad_norm": 0.029867300763726234,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.02649630233645439,
+ "step": 622
+ },
+ {
+ "epoch": 3.1468354430379746,
+ "grad_norm": 0.055938251316547394,
+ "learning_rate": 7.620650953984288e-05,
+ "loss": 0.03135379031300545,
+ "step": 623
+ },
+ {
+ "epoch": 3.151898734177215,
+ "grad_norm": 0.035160645842552185,
+ "learning_rate": 7.615039281705949e-05,
+ "loss": 0.025492198765277863,
+ "step": 624
+ },
+ {
+ "epoch": 3.1569620253164556,
+ "grad_norm": 0.0550227165222168,
+ "learning_rate": 7.60942760942761e-05,
+ "loss": 0.024527709931135178,
+ "step": 625
+ },
+ {
+ "epoch": 3.162025316455696,
+ "grad_norm": 0.045406773686409,
+ "learning_rate": 7.603815937149271e-05,
+ "loss": 0.021749500185251236,
+ "step": 626
+ },
+ {
+ "epoch": 3.1670886075949367,
+ "grad_norm": 0.03407207131385803,
+ "learning_rate": 7.598204264870932e-05,
+ "loss": 0.022218957543373108,
+ "step": 627
+ },
+ {
+ "epoch": 3.1721518987341772,
+ "grad_norm": 0.07292751222848892,
+ "learning_rate": 7.592592592592593e-05,
+ "loss": 0.027731608599424362,
+ "step": 628
+ },
+ {
+ "epoch": 3.1772151898734178,
+ "grad_norm": 0.05087915435433388,
+ "learning_rate": 7.586980920314254e-05,
+ "loss": 0.025174522772431374,
+ "step": 629
+ },
+ {
+ "epoch": 3.1822784810126583,
+ "grad_norm": 0.03146078437566757,
+ "learning_rate": 7.581369248035916e-05,
+ "loss": 0.023854102939367294,
+ "step": 630
+ },
+ {
+ "epoch": 3.187341772151899,
+ "grad_norm": 0.03517632558941841,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.021264635026454926,
+ "step": 631
+ },
+ {
+ "epoch": 3.1924050632911394,
+ "grad_norm": 0.0355447381734848,
+ "learning_rate": 7.570145903479238e-05,
+ "loss": 0.023219801485538483,
+ "step": 632
+ },
+ {
+ "epoch": 3.19746835443038,
+ "grad_norm": 0.03751067817211151,
+ "learning_rate": 7.564534231200898e-05,
+ "loss": 0.02329118922352791,
+ "step": 633
+ },
+ {
+ "epoch": 3.2025316455696204,
+ "grad_norm": 0.03923696279525757,
+ "learning_rate": 7.558922558922559e-05,
+ "loss": 0.025390561670064926,
+ "step": 634
+ },
+ {
+ "epoch": 3.207594936708861,
+ "grad_norm": 0.03601266071200371,
+ "learning_rate": 7.55331088664422e-05,
+ "loss": 0.02001899480819702,
+ "step": 635
+ },
+ {
+ "epoch": 3.212658227848101,
+ "grad_norm": 0.032203998416662216,
+ "learning_rate": 7.547699214365881e-05,
+ "loss": 0.022725094109773636,
+ "step": 636
+ },
+ {
+ "epoch": 3.2177215189873416,
+ "grad_norm": 0.040842000395059586,
+ "learning_rate": 7.542087542087543e-05,
+ "loss": 0.021683380007743835,
+ "step": 637
+ },
+ {
+ "epoch": 3.222784810126582,
+ "grad_norm": 0.03078434057533741,
+ "learning_rate": 7.536475869809203e-05,
+ "loss": 0.02051977440714836,
+ "step": 638
+ },
+ {
+ "epoch": 3.2278481012658227,
+ "grad_norm": 0.025937417522072792,
+ "learning_rate": 7.530864197530865e-05,
+ "loss": 0.01884596049785614,
+ "step": 639
+ },
+ {
+ "epoch": 3.232911392405063,
+ "grad_norm": 0.0464826263487339,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.018389636650681496,
+ "step": 640
+ },
+ {
+ "epoch": 3.2379746835443037,
+ "grad_norm": 0.04150732606649399,
+ "learning_rate": 7.519640852974187e-05,
+ "loss": 0.020952530205249786,
+ "step": 641
+ },
+ {
+ "epoch": 3.2430379746835443,
+ "grad_norm": 0.04317227005958557,
+ "learning_rate": 7.514029180695847e-05,
+ "loss": 0.024093877524137497,
+ "step": 642
+ },
+ {
+ "epoch": 3.248101265822785,
+ "grad_norm": 0.04621734470129013,
+ "learning_rate": 7.508417508417509e-05,
+ "loss": 0.029940858483314514,
+ "step": 643
+ },
+ {
+ "epoch": 3.2531645569620253,
+ "grad_norm": 0.03514556586742401,
+ "learning_rate": 7.50280583613917e-05,
+ "loss": 0.022350966930389404,
+ "step": 644
+ },
+ {
+ "epoch": 3.258227848101266,
+ "grad_norm": 0.025245223194360733,
+ "learning_rate": 7.497194163860831e-05,
+ "loss": 0.018291346728801727,
+ "step": 645
+ },
+ {
+ "epoch": 3.2632911392405064,
+ "grad_norm": 0.02498617395758629,
+ "learning_rate": 7.491582491582492e-05,
+ "loss": 0.01909235306084156,
+ "step": 646
+ },
+ {
+ "epoch": 3.268354430379747,
+ "grad_norm": 0.022831663489341736,
+ "learning_rate": 7.485970819304153e-05,
+ "loss": 0.01462332159280777,
+ "step": 647
+ },
+ {
+ "epoch": 3.2734177215189875,
+ "grad_norm": 0.03779070824384689,
+ "learning_rate": 7.480359147025814e-05,
+ "loss": 0.019472766667604446,
+ "step": 648
+ },
+ {
+ "epoch": 3.278481012658228,
+ "grad_norm": 0.030341917648911476,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.018727967515587807,
+ "step": 649
+ },
+ {
+ "epoch": 3.2835443037974685,
+ "grad_norm": 0.045589644461870193,
+ "learning_rate": 7.469135802469136e-05,
+ "loss": 0.023640938103199005,
+ "step": 650
+ },
+ {
+ "epoch": 3.2886075949367086,
+ "grad_norm": 0.023883633315563202,
+ "learning_rate": 7.463524130190797e-05,
+ "loss": 0.019227800890803337,
+ "step": 651
+ },
+ {
+ "epoch": 3.293670886075949,
+ "grad_norm": 0.03794898837804794,
+ "learning_rate": 7.457912457912458e-05,
+ "loss": 0.02445095032453537,
+ "step": 652
+ },
+ {
+ "epoch": 3.2987341772151897,
+ "grad_norm": 0.1442285180091858,
+ "learning_rate": 7.452300785634119e-05,
+ "loss": 0.023129010573029518,
+ "step": 653
+ },
+ {
+ "epoch": 3.3037974683544302,
+ "grad_norm": 0.03197013959288597,
+ "learning_rate": 7.44668911335578e-05,
+ "loss": 0.02768155373632908,
+ "step": 654
+ },
+ {
+ "epoch": 3.3088607594936708,
+ "grad_norm": 0.0434270016849041,
+ "learning_rate": 7.441077441077443e-05,
+ "loss": 0.02330004796385765,
+ "step": 655
+ },
+ {
+ "epoch": 3.3139240506329113,
+ "grad_norm": 0.03878983482718468,
+ "learning_rate": 7.435465768799102e-05,
+ "loss": 0.028383342549204826,
+ "step": 656
+ },
+ {
+ "epoch": 3.318987341772152,
+ "grad_norm": 0.035334642976522446,
+ "learning_rate": 7.429854096520763e-05,
+ "loss": 0.02583262138068676,
+ "step": 657
+ },
+ {
+ "epoch": 3.3240506329113924,
+ "grad_norm": 0.0473608672618866,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.030471306294202805,
+ "step": 658
+ },
+ {
+ "epoch": 3.329113924050633,
+ "grad_norm": 0.04193368926644325,
+ "learning_rate": 7.418630751964085e-05,
+ "loss": 0.016215423122048378,
+ "step": 659
+ },
+ {
+ "epoch": 3.3341772151898734,
+ "grad_norm": 0.023891586810350418,
+ "learning_rate": 7.413019079685746e-05,
+ "loss": 0.021040987223386765,
+ "step": 660
+ },
+ {
+ "epoch": 3.339240506329114,
+ "grad_norm": 0.029971614480018616,
+ "learning_rate": 7.407407407407407e-05,
+ "loss": 0.022258542478084564,
+ "step": 661
+ },
+ {
+ "epoch": 3.3443037974683545,
+ "grad_norm": 0.035308364778757095,
+ "learning_rate": 7.401795735129068e-05,
+ "loss": 0.02215534821152687,
+ "step": 662
+ },
+ {
+ "epoch": 3.349367088607595,
+ "grad_norm": 0.036979664117097855,
+ "learning_rate": 7.39618406285073e-05,
+ "loss": 0.027577020227909088,
+ "step": 663
+ },
+ {
+ "epoch": 3.3544303797468356,
+ "grad_norm": 0.03403281047940254,
+ "learning_rate": 7.390572390572392e-05,
+ "loss": 0.024540117010474205,
+ "step": 664
+ },
+ {
+ "epoch": 3.359493670886076,
+ "grad_norm": 0.04739405959844589,
+ "learning_rate": 7.384960718294051e-05,
+ "loss": 0.01647120714187622,
+ "step": 665
+ },
+ {
+ "epoch": 3.3645569620253166,
+ "grad_norm": 0.036933764815330505,
+ "learning_rate": 7.379349046015714e-05,
+ "loss": 0.02817656472325325,
+ "step": 666
+ },
+ {
+ "epoch": 3.369620253164557,
+ "grad_norm": 0.05966564640402794,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.028103439137339592,
+ "step": 667
+ },
+ {
+ "epoch": 3.3746835443037977,
+ "grad_norm": 0.09403033554553986,
+ "learning_rate": 7.368125701459036e-05,
+ "loss": 0.024899154901504517,
+ "step": 668
+ },
+ {
+ "epoch": 3.379746835443038,
+ "grad_norm": 0.056374453008174896,
+ "learning_rate": 7.362514029180695e-05,
+ "loss": 0.025570789352059364,
+ "step": 669
+ },
+ {
+ "epoch": 3.3848101265822783,
+ "grad_norm": 0.056454673409461975,
+ "learning_rate": 7.356902356902358e-05,
+ "loss": 0.02471453696489334,
+ "step": 670
+ },
+ {
+ "epoch": 3.389873417721519,
+ "grad_norm": 0.04115903005003929,
+ "learning_rate": 7.351290684624019e-05,
+ "loss": 0.017306309193372726,
+ "step": 671
+ },
+ {
+ "epoch": 3.3949367088607594,
+ "grad_norm": 0.030604340136051178,
+ "learning_rate": 7.34567901234568e-05,
+ "loss": 0.019510511308908463,
+ "step": 672
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.059018854051828384,
+ "learning_rate": 7.340067340067341e-05,
+ "loss": 0.02810611203312874,
+ "step": 673
+ },
+ {
+ "epoch": 3.4050632911392404,
+ "grad_norm": 0.026413513347506523,
+ "learning_rate": 7.334455667789002e-05,
+ "loss": 0.018966296687722206,
+ "step": 674
+ },
+ {
+ "epoch": 3.410126582278481,
+ "grad_norm": 0.03285476937890053,
+ "learning_rate": 7.328843995510663e-05,
+ "loss": 0.026708189398050308,
+ "step": 675
+ },
+ {
+ "epoch": 3.4151898734177215,
+ "grad_norm": 0.0392388291656971,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.022320115938782692,
+ "step": 676
+ },
+ {
+ "epoch": 3.420253164556962,
+ "grad_norm": 0.0305775236338377,
+ "learning_rate": 7.317620650953985e-05,
+ "loss": 0.018710114061832428,
+ "step": 677
+ },
+ {
+ "epoch": 3.4253164556962026,
+ "grad_norm": 0.033393554389476776,
+ "learning_rate": 7.312008978675646e-05,
+ "loss": 0.018753021955490112,
+ "step": 678
+ },
+ {
+ "epoch": 3.430379746835443,
+ "grad_norm": 0.02704286389052868,
+ "learning_rate": 7.306397306397307e-05,
+ "loss": 0.01539788581430912,
+ "step": 679
+ },
+ {
+ "epoch": 3.4354430379746836,
+ "grad_norm": 0.038779884576797485,
+ "learning_rate": 7.300785634118968e-05,
+ "loss": 0.024458929896354675,
+ "step": 680
+ },
+ {
+ "epoch": 3.440506329113924,
+ "grad_norm": 0.061135295778512955,
+ "learning_rate": 7.295173961840629e-05,
+ "loss": 0.021106259897351265,
+ "step": 681
+ },
+ {
+ "epoch": 3.4455696202531647,
+ "grad_norm": 0.02436748333275318,
+ "learning_rate": 7.28956228956229e-05,
+ "loss": 0.019037332385778427,
+ "step": 682
+ },
+ {
+ "epoch": 3.4506329113924052,
+ "grad_norm": 0.037567682564258575,
+ "learning_rate": 7.283950617283951e-05,
+ "loss": 0.02065495029091835,
+ "step": 683
+ },
+ {
+ "epoch": 3.4556962025316453,
+ "grad_norm": 0.03743781894445419,
+ "learning_rate": 7.278338945005612e-05,
+ "loss": 0.02559451386332512,
+ "step": 684
+ },
+ {
+ "epoch": 3.460759493670886,
+ "grad_norm": 0.04715351387858391,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.021420618519186974,
+ "step": 685
+ },
+ {
+ "epoch": 3.4658227848101264,
+ "grad_norm": 0.02502383477985859,
+ "learning_rate": 7.267115600448934e-05,
+ "loss": 0.019398193806409836,
+ "step": 686
+ },
+ {
+ "epoch": 3.470886075949367,
+ "grad_norm": 0.02199714072048664,
+ "learning_rate": 7.261503928170595e-05,
+ "loss": 0.019068796187639236,
+ "step": 687
+ },
+ {
+ "epoch": 3.4759493670886075,
+ "grad_norm": 0.034711211919784546,
+ "learning_rate": 7.255892255892256e-05,
+ "loss": 0.021794648841023445,
+ "step": 688
+ },
+ {
+ "epoch": 3.481012658227848,
+ "grad_norm": 0.040784433484077454,
+ "learning_rate": 7.250280583613918e-05,
+ "loss": 0.022812314331531525,
+ "step": 689
+ },
+ {
+ "epoch": 3.4860759493670885,
+ "grad_norm": 0.035993628203868866,
+ "learning_rate": 7.244668911335578e-05,
+ "loss": 0.026385463774204254,
+ "step": 690
+ },
+ {
+ "epoch": 3.491139240506329,
+ "grad_norm": 0.031834330409765244,
+ "learning_rate": 7.23905723905724e-05,
+ "loss": 0.022114556282758713,
+ "step": 691
+ },
+ {
+ "epoch": 3.4962025316455696,
+ "grad_norm": 0.025820165872573853,
+ "learning_rate": 7.2334455667789e-05,
+ "loss": 0.01813361421227455,
+ "step": 692
+ },
+ {
+ "epoch": 3.50126582278481,
+ "grad_norm": 0.04998617246747017,
+ "learning_rate": 7.227833894500562e-05,
+ "loss": 0.022573690861463547,
+ "step": 693
+ },
+ {
+ "epoch": 3.5063291139240507,
+ "grad_norm": 0.04184528812766075,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.026092834770679474,
+ "step": 694
+ },
+ {
+ "epoch": 3.511392405063291,
+ "grad_norm": 0.050683457404375076,
+ "learning_rate": 7.216610549943884e-05,
+ "loss": 0.021743692457675934,
+ "step": 695
+ },
+ {
+ "epoch": 3.5164556962025317,
+ "grad_norm": 0.07393304258584976,
+ "learning_rate": 7.210998877665545e-05,
+ "loss": 0.024253465235233307,
+ "step": 696
+ },
+ {
+ "epoch": 3.5215189873417723,
+ "grad_norm": 0.02564188838005066,
+ "learning_rate": 7.205387205387206e-05,
+ "loss": 0.019201550632715225,
+ "step": 697
+ },
+ {
+ "epoch": 3.526582278481013,
+ "grad_norm": 0.035527680069208145,
+ "learning_rate": 7.199775533108867e-05,
+ "loss": 0.02153913676738739,
+ "step": 698
+ },
+ {
+ "epoch": 3.5316455696202533,
+ "grad_norm": 0.036737874150276184,
+ "learning_rate": 7.194163860830527e-05,
+ "loss": 0.025572702288627625,
+ "step": 699
+ },
+ {
+ "epoch": 3.536708860759494,
+ "grad_norm": 0.03383871540427208,
+ "learning_rate": 7.188552188552189e-05,
+ "loss": 0.017153475433588028,
+ "step": 700
+ },
+ {
+ "epoch": 3.5417721518987344,
+ "grad_norm": 0.0350637212395668,
+ "learning_rate": 7.182940516273849e-05,
+ "loss": 0.018297579139471054,
+ "step": 701
+ },
+ {
+ "epoch": 3.546835443037975,
+ "grad_norm": 0.029637211933732033,
+ "learning_rate": 7.177328843995511e-05,
+ "loss": 0.017981912940740585,
+ "step": 702
+ },
+ {
+ "epoch": 3.5518987341772155,
+ "grad_norm": 0.03611799329519272,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.02710491605103016,
+ "step": 703
+ },
+ {
+ "epoch": 3.5569620253164556,
+ "grad_norm": 0.02008277364075184,
+ "learning_rate": 7.166105499438833e-05,
+ "loss": 0.02035117708146572,
+ "step": 704
+ },
+ {
+ "epoch": 3.562025316455696,
+ "grad_norm": 0.026698170229792595,
+ "learning_rate": 7.160493827160494e-05,
+ "loss": 0.017481079325079918,
+ "step": 705
+ },
+ {
+ "epoch": 3.5670886075949366,
+ "grad_norm": 0.036382947117090225,
+ "learning_rate": 7.154882154882155e-05,
+ "loss": 0.019109399989247322,
+ "step": 706
+ },
+ {
+ "epoch": 3.572151898734177,
+ "grad_norm": 0.04591331630945206,
+ "learning_rate": 7.149270482603816e-05,
+ "loss": 0.023143479600548744,
+ "step": 707
+ },
+ {
+ "epoch": 3.5772151898734177,
+ "grad_norm": 0.04864713177084923,
+ "learning_rate": 7.143658810325477e-05,
+ "loss": 0.022374317049980164,
+ "step": 708
+ },
+ {
+ "epoch": 3.5822784810126582,
+ "grad_norm": 0.03528938442468643,
+ "learning_rate": 7.138047138047138e-05,
+ "loss": 0.021928273141384125,
+ "step": 709
+ },
+ {
+ "epoch": 3.5873417721518988,
+ "grad_norm": 0.03548784181475639,
+ "learning_rate": 7.1324354657688e-05,
+ "loss": 0.02179766446352005,
+ "step": 710
+ },
+ {
+ "epoch": 3.5924050632911393,
+ "grad_norm": 0.041786350309848785,
+ "learning_rate": 7.12682379349046e-05,
+ "loss": 0.028576329350471497,
+ "step": 711
+ },
+ {
+ "epoch": 3.59746835443038,
+ "grad_norm": 0.03197047486901283,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.018731534481048584,
+ "step": 712
+ },
+ {
+ "epoch": 3.6025316455696204,
+ "grad_norm": 0.04037933051586151,
+ "learning_rate": 7.115600448933782e-05,
+ "loss": 0.024375513195991516,
+ "step": 713
+ },
+ {
+ "epoch": 3.607594936708861,
+ "grad_norm": 0.032266534864902496,
+ "learning_rate": 7.109988776655443e-05,
+ "loss": 0.016232451424002647,
+ "step": 714
+ },
+ {
+ "epoch": 3.6126582278481014,
+ "grad_norm": 0.02890392392873764,
+ "learning_rate": 7.104377104377104e-05,
+ "loss": 0.018303632736206055,
+ "step": 715
+ },
+ {
+ "epoch": 3.6177215189873415,
+ "grad_norm": 0.032750677317380905,
+ "learning_rate": 7.098765432098767e-05,
+ "loss": 0.021466076374053955,
+ "step": 716
+ },
+ {
+ "epoch": 3.622784810126582,
+ "grad_norm": 0.05076618492603302,
+ "learning_rate": 7.093153759820426e-05,
+ "loss": 0.022349126636981964,
+ "step": 717
+ },
+ {
+ "epoch": 3.6278481012658226,
+ "grad_norm": 0.034143563359975815,
+ "learning_rate": 7.087542087542089e-05,
+ "loss": 0.02274998091161251,
+ "step": 718
+ },
+ {
+ "epoch": 3.632911392405063,
+ "grad_norm": 0.025406064465641975,
+ "learning_rate": 7.081930415263748e-05,
+ "loss": 0.016980832442641258,
+ "step": 719
+ },
+ {
+ "epoch": 3.6379746835443036,
+ "grad_norm": 0.031938597559928894,
+ "learning_rate": 7.076318742985411e-05,
+ "loss": 0.023153938353061676,
+ "step": 720
+ },
+ {
+ "epoch": 3.643037974683544,
+ "grad_norm": 0.03354712948203087,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.018384695053100586,
+ "step": 721
+ },
+ {
+ "epoch": 3.6481012658227847,
+ "grad_norm": 0.028671689331531525,
+ "learning_rate": 7.065095398428731e-05,
+ "loss": 0.021795600652694702,
+ "step": 722
+ },
+ {
+ "epoch": 3.6531645569620252,
+ "grad_norm": 0.057982735335826874,
+ "learning_rate": 7.059483726150394e-05,
+ "loss": 0.026870068162679672,
+ "step": 723
+ },
+ {
+ "epoch": 3.6582278481012658,
+ "grad_norm": 0.036460306495428085,
+ "learning_rate": 7.053872053872053e-05,
+ "loss": 0.019742611795663834,
+ "step": 724
+ },
+ {
+ "epoch": 3.6632911392405063,
+ "grad_norm": 0.06633497029542923,
+ "learning_rate": 7.048260381593716e-05,
+ "loss": 0.01737678050994873,
+ "step": 725
+ },
+ {
+ "epoch": 3.668354430379747,
+ "grad_norm": 0.0410747192800045,
+ "learning_rate": 7.042648709315375e-05,
+ "loss": 0.023570548743009567,
+ "step": 726
+ },
+ {
+ "epoch": 3.6734177215189874,
+ "grad_norm": 0.04499414190649986,
+ "learning_rate": 7.037037037037038e-05,
+ "loss": 0.024305228143930435,
+ "step": 727
+ },
+ {
+ "epoch": 3.678481012658228,
+ "grad_norm": 0.024429699406027794,
+ "learning_rate": 7.031425364758697e-05,
+ "loss": 0.018056385219097137,
+ "step": 728
+ },
+ {
+ "epoch": 3.6835443037974684,
+ "grad_norm": 0.03042393922805786,
+ "learning_rate": 7.02581369248036e-05,
+ "loss": 0.019678741693496704,
+ "step": 729
+ },
+ {
+ "epoch": 3.688607594936709,
+ "grad_norm": 0.04088849946856499,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.026466136798262596,
+ "step": 730
+ },
+ {
+ "epoch": 3.6936708860759495,
+ "grad_norm": 0.03353559225797653,
+ "learning_rate": 7.014590347923682e-05,
+ "loss": 0.021056771278381348,
+ "step": 731
+ },
+ {
+ "epoch": 3.69873417721519,
+ "grad_norm": 0.03120904415845871,
+ "learning_rate": 7.008978675645343e-05,
+ "loss": 0.020675398409366608,
+ "step": 732
+ },
+ {
+ "epoch": 3.7037974683544306,
+ "grad_norm": 0.05723356828093529,
+ "learning_rate": 7.003367003367004e-05,
+ "loss": 0.033802516758441925,
+ "step": 733
+ },
+ {
+ "epoch": 3.708860759493671,
+ "grad_norm": 0.03580084443092346,
+ "learning_rate": 6.997755331088665e-05,
+ "loss": 0.026392754167318344,
+ "step": 734
+ },
+ {
+ "epoch": 3.7139240506329116,
+ "grad_norm": 0.05164967477321625,
+ "learning_rate": 6.992143658810326e-05,
+ "loss": 0.0241309255361557,
+ "step": 735
+ },
+ {
+ "epoch": 3.7189873417721517,
+ "grad_norm": 0.02190530300140381,
+ "learning_rate": 6.986531986531987e-05,
+ "loss": 0.018209822475910187,
+ "step": 736
+ },
+ {
+ "epoch": 3.7240506329113923,
+ "grad_norm": 0.027256503701210022,
+ "learning_rate": 6.980920314253648e-05,
+ "loss": 0.022063471376895905,
+ "step": 737
+ },
+ {
+ "epoch": 3.729113924050633,
+ "grad_norm": 0.03337831795215607,
+ "learning_rate": 6.975308641975309e-05,
+ "loss": 0.018506363034248352,
+ "step": 738
+ },
+ {
+ "epoch": 3.7341772151898733,
+ "grad_norm": 0.025730784982442856,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.016883976757526398,
+ "step": 739
+ },
+ {
+ "epoch": 3.739240506329114,
+ "grad_norm": 0.026203135028481483,
+ "learning_rate": 6.964085297418631e-05,
+ "loss": 0.023329125717282295,
+ "step": 740
+ },
+ {
+ "epoch": 3.7443037974683544,
+ "grad_norm": 0.02676830254495144,
+ "learning_rate": 6.958473625140293e-05,
+ "loss": 0.020962664857506752,
+ "step": 741
+ },
+ {
+ "epoch": 3.749367088607595,
+ "grad_norm": 0.019974667578935623,
+ "learning_rate": 6.952861952861953e-05,
+ "loss": 0.018353454768657684,
+ "step": 742
+ },
+ {
+ "epoch": 3.7544303797468355,
+ "grad_norm": 0.02399631030857563,
+ "learning_rate": 6.947250280583614e-05,
+ "loss": 0.01820143684744835,
+ "step": 743
+ },
+ {
+ "epoch": 3.759493670886076,
+ "grad_norm": 0.02083951234817505,
+ "learning_rate": 6.941638608305275e-05,
+ "loss": 0.02312408946454525,
+ "step": 744
+ },
+ {
+ "epoch": 3.7645569620253165,
+ "grad_norm": 0.025636207312345505,
+ "learning_rate": 6.936026936026936e-05,
+ "loss": 0.01757936365902424,
+ "step": 745
+ },
+ {
+ "epoch": 3.769620253164557,
+ "grad_norm": 0.036856744438409805,
+ "learning_rate": 6.930415263748597e-05,
+ "loss": 0.028933756053447723,
+ "step": 746
+ },
+ {
+ "epoch": 3.7746835443037976,
+ "grad_norm": 0.037415456026792526,
+ "learning_rate": 6.924803591470258e-05,
+ "loss": 0.022136090323328972,
+ "step": 747
+ },
+ {
+ "epoch": 3.779746835443038,
+ "grad_norm": 0.027949288487434387,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.022943630814552307,
+ "step": 748
+ },
+ {
+ "epoch": 3.7848101265822782,
+ "grad_norm": 0.037508148699998856,
+ "learning_rate": 6.91358024691358e-05,
+ "loss": 0.020460065454244614,
+ "step": 749
+ },
+ {
+ "epoch": 3.7898734177215188,
+ "grad_norm": 0.037965189665555954,
+ "learning_rate": 6.907968574635242e-05,
+ "loss": 0.024793215095996857,
+ "step": 750
+ },
+ {
+ "epoch": 3.7949367088607593,
+ "grad_norm": 0.027956753969192505,
+ "learning_rate": 6.902356902356902e-05,
+ "loss": 0.02188705839216709,
+ "step": 751
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.027417965233325958,
+ "learning_rate": 6.896745230078564e-05,
+ "loss": 0.01465995516628027,
+ "step": 752
+ },
+ {
+ "epoch": 3.8050632911392404,
+ "grad_norm": 0.036644525825977325,
+ "learning_rate": 6.891133557800224e-05,
+ "loss": 0.020246809348464012,
+ "step": 753
+ },
+ {
+ "epoch": 3.810126582278481,
+ "grad_norm": 0.027043674141168594,
+ "learning_rate": 6.885521885521886e-05,
+ "loss": 0.02293788641691208,
+ "step": 754
+ },
+ {
+ "epoch": 3.8151898734177214,
+ "grad_norm": 0.033968694508075714,
+ "learning_rate": 6.879910213243546e-05,
+ "loss": 0.024979766458272934,
+ "step": 755
+ },
+ {
+ "epoch": 3.820253164556962,
+ "grad_norm": 0.022790739312767982,
+ "learning_rate": 6.874298540965208e-05,
+ "loss": 0.019254112616181374,
+ "step": 756
+ },
+ {
+ "epoch": 3.8253164556962025,
+ "grad_norm": 0.028349611908197403,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.018624842166900635,
+ "step": 757
+ },
+ {
+ "epoch": 3.830379746835443,
+ "grad_norm": 0.034140367060899734,
+ "learning_rate": 6.86307519640853e-05,
+ "loss": 0.01691599376499653,
+ "step": 758
+ },
+ {
+ "epoch": 3.8354430379746836,
+ "grad_norm": 0.03422265127301216,
+ "learning_rate": 6.857463524130191e-05,
+ "loss": 0.01864086464047432,
+ "step": 759
+ },
+ {
+ "epoch": 3.840506329113924,
+ "grad_norm": 0.037322208285331726,
+ "learning_rate": 6.851851851851852e-05,
+ "loss": 0.024382904171943665,
+ "step": 760
+ },
+ {
+ "epoch": 3.8455696202531646,
+ "grad_norm": 0.022540392354130745,
+ "learning_rate": 6.846240179573513e-05,
+ "loss": 0.017390096560120583,
+ "step": 761
+ },
+ {
+ "epoch": 3.850632911392405,
+ "grad_norm": 0.035701289772987366,
+ "learning_rate": 6.840628507295174e-05,
+ "loss": 0.01928594335913658,
+ "step": 762
+ },
+ {
+ "epoch": 3.8556962025316457,
+ "grad_norm": 0.047425150871276855,
+ "learning_rate": 6.835016835016835e-05,
+ "loss": 0.026818927377462387,
+ "step": 763
+ },
+ {
+ "epoch": 3.8607594936708862,
+ "grad_norm": 0.0244912076741457,
+ "learning_rate": 6.829405162738496e-05,
+ "loss": 0.01811584085226059,
+ "step": 764
+ },
+ {
+ "epoch": 3.8658227848101268,
+ "grad_norm": 0.03282126039266586,
+ "learning_rate": 6.823793490460157e-05,
+ "loss": 0.01521163061261177,
+ "step": 765
+ },
+ {
+ "epoch": 3.8708860759493673,
+ "grad_norm": 0.030519530177116394,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.023735523223876953,
+ "step": 766
+ },
+ {
+ "epoch": 3.875949367088608,
+ "grad_norm": 0.03829387575387955,
+ "learning_rate": 6.81257014590348e-05,
+ "loss": 0.02391430363059044,
+ "step": 767
+ },
+ {
+ "epoch": 3.8810126582278484,
+ "grad_norm": 0.03133988752961159,
+ "learning_rate": 6.80695847362514e-05,
+ "loss": 0.022026970982551575,
+ "step": 768
+ },
+ {
+ "epoch": 3.8860759493670884,
+ "grad_norm": 0.036327920854091644,
+ "learning_rate": 6.801346801346801e-05,
+ "loss": 0.01740797609090805,
+ "step": 769
+ },
+ {
+ "epoch": 3.891139240506329,
+ "grad_norm": 0.06766671687364578,
+ "learning_rate": 6.795735129068462e-05,
+ "loss": 0.02804078534245491,
+ "step": 770
+ },
+ {
+ "epoch": 3.8962025316455695,
+ "grad_norm": 0.06390757858753204,
+ "learning_rate": 6.790123456790123e-05,
+ "loss": 0.032084181904792786,
+ "step": 771
+ },
+ {
+ "epoch": 3.90126582278481,
+ "grad_norm": 0.03238178789615631,
+ "learning_rate": 6.784511784511784e-05,
+ "loss": 0.02189403772354126,
+ "step": 772
+ },
+ {
+ "epoch": 3.9063291139240506,
+ "grad_norm": 0.03206197917461395,
+ "learning_rate": 6.778900112233445e-05,
+ "loss": 0.022829271852970123,
+ "step": 773
+ },
+ {
+ "epoch": 3.911392405063291,
+ "grad_norm": 0.030897945165634155,
+ "learning_rate": 6.773288439955107e-05,
+ "loss": 0.021807631477713585,
+ "step": 774
+ },
+ {
+ "epoch": 3.9164556962025316,
+ "grad_norm": 0.04285162314772606,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.023028545081615448,
+ "step": 775
+ },
+ {
+ "epoch": 3.921518987341772,
+ "grad_norm": 0.02819208987057209,
+ "learning_rate": 6.762065095398429e-05,
+ "loss": 0.02110828459262848,
+ "step": 776
+ },
+ {
+ "epoch": 3.9265822784810127,
+ "grad_norm": 0.03159799054265022,
+ "learning_rate": 6.756453423120091e-05,
+ "loss": 0.02116553671658039,
+ "step": 777
+ },
+ {
+ "epoch": 3.9316455696202532,
+ "grad_norm": 0.028514137491583824,
+ "learning_rate": 6.75084175084175e-05,
+ "loss": 0.020262988284230232,
+ "step": 778
+ },
+ {
+ "epoch": 3.9367088607594938,
+ "grad_norm": 0.03610249608755112,
+ "learning_rate": 6.745230078563413e-05,
+ "loss": 0.016928158700466156,
+ "step": 779
+ },
+ {
+ "epoch": 3.9417721518987343,
+ "grad_norm": 0.02753387950360775,
+ "learning_rate": 6.739618406285073e-05,
+ "loss": 0.022629719227552414,
+ "step": 780
+ },
+ {
+ "epoch": 3.946835443037975,
+ "grad_norm": 0.026071136817336082,
+ "learning_rate": 6.734006734006735e-05,
+ "loss": 0.020297978073358536,
+ "step": 781
+ },
+ {
+ "epoch": 3.951898734177215,
+ "grad_norm": 0.04774617776274681,
+ "learning_rate": 6.728395061728396e-05,
+ "loss": 0.01858438178896904,
+ "step": 782
+ },
+ {
+ "epoch": 3.9569620253164555,
+ "grad_norm": 0.03666248545050621,
+ "learning_rate": 6.722783389450057e-05,
+ "loss": 0.024037979543209076,
+ "step": 783
+ },
+ {
+ "epoch": 3.962025316455696,
+ "grad_norm": 0.04990983009338379,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.027675451710820198,
+ "step": 784
+ },
+ {
+ "epoch": 3.9670886075949365,
+ "grad_norm": 0.04734862968325615,
+ "learning_rate": 6.711560044893379e-05,
+ "loss": 0.02003151923418045,
+ "step": 785
+ },
+ {
+ "epoch": 3.972151898734177,
+ "grad_norm": 0.031911976635456085,
+ "learning_rate": 6.70594837261504e-05,
+ "loss": 0.02302616462111473,
+ "step": 786
+ },
+ {
+ "epoch": 3.9772151898734176,
+ "grad_norm": 0.03199504688382149,
+ "learning_rate": 6.7003367003367e-05,
+ "loss": 0.020066704601049423,
+ "step": 787
+ },
+ {
+ "epoch": 3.982278481012658,
+ "grad_norm": 0.02664150856435299,
+ "learning_rate": 6.694725028058362e-05,
+ "loss": 0.01888475939631462,
+ "step": 788
+ },
+ {
+ "epoch": 3.9873417721518987,
+ "grad_norm": 0.03886157646775246,
+ "learning_rate": 6.689113355780023e-05,
+ "loss": 0.016029106453061104,
+ "step": 789
+ },
+ {
+ "epoch": 3.992405063291139,
+ "grad_norm": 0.025033561512827873,
+ "learning_rate": 6.683501683501684e-05,
+ "loss": 0.01627909578382969,
+ "step": 790
+ },
+ {
+ "epoch": 3.9974683544303797,
+ "grad_norm": 0.04991500452160835,
+ "learning_rate": 6.677890011223345e-05,
+ "loss": 0.02633330039680004,
+ "step": 791
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.0552835538983345,
+ "learning_rate": 6.672278338945006e-05,
+ "loss": 0.025268658995628357,
+ "step": 792
+ },
+ {
+ "epoch": 4.0050632911392405,
+ "grad_norm": 0.04223925992846489,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.023410093039274216,
+ "step": 793
+ },
+ {
+ "epoch": 4.010126582278481,
+ "grad_norm": 0.03191488981246948,
+ "learning_rate": 6.661054994388328e-05,
+ "loss": 0.01913982629776001,
+ "step": 794
+ },
+ {
+ "epoch": 4.015189873417722,
+ "grad_norm": 0.03535325452685356,
+ "learning_rate": 6.655443322109989e-05,
+ "loss": 0.020550835877656937,
+ "step": 795
+ },
+ {
+ "epoch": 4.020253164556962,
+ "grad_norm": 0.027277838438749313,
+ "learning_rate": 6.64983164983165e-05,
+ "loss": 0.02178161032497883,
+ "step": 796
+ },
+ {
+ "epoch": 4.025316455696203,
+ "grad_norm": 0.03889140114188194,
+ "learning_rate": 6.644219977553311e-05,
+ "loss": 0.02359630912542343,
+ "step": 797
+ },
+ {
+ "epoch": 4.030379746835443,
+ "grad_norm": 0.03794289380311966,
+ "learning_rate": 6.638608305274972e-05,
+ "loss": 0.02135687693953514,
+ "step": 798
+ },
+ {
+ "epoch": 4.035443037974684,
+ "grad_norm": 0.030842013657093048,
+ "learning_rate": 6.632996632996633e-05,
+ "loss": 0.026881888508796692,
+ "step": 799
+ },
+ {
+ "epoch": 4.040506329113924,
+ "grad_norm": 0.036720771342515945,
+ "learning_rate": 6.627384960718295e-05,
+ "loss": 0.017526758834719658,
+ "step": 800
+ },
+ {
+ "epoch": 4.045569620253165,
+ "grad_norm": 0.04940621554851532,
+ "learning_rate": 6.621773288439955e-05,
+ "loss": 0.023458952084183693,
+ "step": 801
+ },
+ {
+ "epoch": 4.050632911392405,
+ "grad_norm": 0.0228698942810297,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.017165549099445343,
+ "step": 802
+ },
+ {
+ "epoch": 4.055696202531646,
+ "grad_norm": 0.0323697030544281,
+ "learning_rate": 6.610549943883277e-05,
+ "loss": 0.020573658868670464,
+ "step": 803
+ },
+ {
+ "epoch": 4.060759493670886,
+ "grad_norm": 0.03041171282529831,
+ "learning_rate": 6.60493827160494e-05,
+ "loss": 0.022557582706212997,
+ "step": 804
+ },
+ {
+ "epoch": 4.065822784810127,
+ "grad_norm": 0.030996058136224747,
+ "learning_rate": 6.599326599326599e-05,
+ "loss": 0.024344075471162796,
+ "step": 805
+ },
+ {
+ "epoch": 4.0708860759493675,
+ "grad_norm": 0.02448248863220215,
+ "learning_rate": 6.593714927048261e-05,
+ "loss": 0.018718231469392776,
+ "step": 806
+ },
+ {
+ "epoch": 4.075949367088608,
+ "grad_norm": 0.03839370980858803,
+ "learning_rate": 6.588103254769921e-05,
+ "loss": 0.02680569887161255,
+ "step": 807
+ },
+ {
+ "epoch": 4.0810126582278485,
+ "grad_norm": 0.029364196583628654,
+ "learning_rate": 6.582491582491582e-05,
+ "loss": 0.01946680247783661,
+ "step": 808
+ },
+ {
+ "epoch": 4.086075949367088,
+ "grad_norm": 0.02478131465613842,
+ "learning_rate": 6.576879910213244e-05,
+ "loss": 0.021097835153341293,
+ "step": 809
+ },
+ {
+ "epoch": 4.091139240506329,
+ "grad_norm": 0.030616244301199913,
+ "learning_rate": 6.571268237934904e-05,
+ "loss": 0.021518010646104813,
+ "step": 810
+ },
+ {
+ "epoch": 4.096202531645569,
+ "grad_norm": 0.02732054330408573,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.02008533477783203,
+ "step": 811
+ },
+ {
+ "epoch": 4.10126582278481,
+ "grad_norm": 0.0323524996638298,
+ "learning_rate": 6.560044893378226e-05,
+ "loss": 0.025486933067440987,
+ "step": 812
+ },
+ {
+ "epoch": 4.10632911392405,
+ "grad_norm": 0.026200806722044945,
+ "learning_rate": 6.554433221099888e-05,
+ "loss": 0.019320383667945862,
+ "step": 813
+ },
+ {
+ "epoch": 4.111392405063291,
+ "grad_norm": 0.03883595019578934,
+ "learning_rate": 6.548821548821548e-05,
+ "loss": 0.021837443113327026,
+ "step": 814
+ },
+ {
+ "epoch": 4.116455696202531,
+ "grad_norm": 0.037654533982276917,
+ "learning_rate": 6.54320987654321e-05,
+ "loss": 0.024574559181928635,
+ "step": 815
+ },
+ {
+ "epoch": 4.121518987341772,
+ "grad_norm": 0.04923658072948456,
+ "learning_rate": 6.537598204264871e-05,
+ "loss": 0.01940765418112278,
+ "step": 816
+ },
+ {
+ "epoch": 4.1265822784810124,
+ "grad_norm": 0.02900642342865467,
+ "learning_rate": 6.531986531986533e-05,
+ "loss": 0.019193468615412712,
+ "step": 817
+ },
+ {
+ "epoch": 4.131645569620253,
+ "grad_norm": 0.03798971325159073,
+ "learning_rate": 6.526374859708194e-05,
+ "loss": 0.022473281249403954,
+ "step": 818
+ },
+ {
+ "epoch": 4.1367088607594935,
+ "grad_norm": 0.05821327865123749,
+ "learning_rate": 6.520763187429855e-05,
+ "loss": 0.025292381644248962,
+ "step": 819
+ },
+ {
+ "epoch": 4.141772151898734,
+ "grad_norm": 0.02774794027209282,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.021283335983753204,
+ "step": 820
+ },
+ {
+ "epoch": 4.146835443037975,
+ "grad_norm": 0.03002094104886055,
+ "learning_rate": 6.509539842873177e-05,
+ "loss": 0.020336506888270378,
+ "step": 821
+ },
+ {
+ "epoch": 4.151898734177215,
+ "grad_norm": 0.02205439656972885,
+ "learning_rate": 6.503928170594838e-05,
+ "loss": 0.01669773831963539,
+ "step": 822
+ },
+ {
+ "epoch": 4.156962025316456,
+ "grad_norm": 0.023610664531588554,
+ "learning_rate": 6.498316498316499e-05,
+ "loss": 0.016195815056562424,
+ "step": 823
+ },
+ {
+ "epoch": 4.162025316455696,
+ "grad_norm": 0.02679222822189331,
+ "learning_rate": 6.49270482603816e-05,
+ "loss": 0.020671207457780838,
+ "step": 824
+ },
+ {
+ "epoch": 4.167088607594937,
+ "grad_norm": 0.043805427849292755,
+ "learning_rate": 6.48709315375982e-05,
+ "loss": 0.029262011870741844,
+ "step": 825
+ },
+ {
+ "epoch": 4.172151898734177,
+ "grad_norm": 0.024075932800769806,
+ "learning_rate": 6.481481481481482e-05,
+ "loss": 0.0180169977247715,
+ "step": 826
+ },
+ {
+ "epoch": 4.177215189873418,
+ "grad_norm": 0.027496427297592163,
+ "learning_rate": 6.475869809203144e-05,
+ "loss": 0.01985255442559719,
+ "step": 827
+ },
+ {
+ "epoch": 4.182278481012658,
+ "grad_norm": 0.028868619352579117,
+ "learning_rate": 6.470258136924804e-05,
+ "loss": 0.02416200190782547,
+ "step": 828
+ },
+ {
+ "epoch": 4.187341772151899,
+ "grad_norm": 0.026004688814282417,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.01904168725013733,
+ "step": 829
+ },
+ {
+ "epoch": 4.192405063291139,
+ "grad_norm": 0.04274019971489906,
+ "learning_rate": 6.459034792368126e-05,
+ "loss": 0.02680842950940132,
+ "step": 830
+ },
+ {
+ "epoch": 4.19746835443038,
+ "grad_norm": 0.024735039100050926,
+ "learning_rate": 6.453423120089787e-05,
+ "loss": 0.016491729766130447,
+ "step": 831
+ },
+ {
+ "epoch": 4.2025316455696204,
+ "grad_norm": 0.04336397722363472,
+ "learning_rate": 6.447811447811448e-05,
+ "loss": 0.02140970341861248,
+ "step": 832
+ },
+ {
+ "epoch": 4.207594936708861,
+ "grad_norm": 0.025922754779458046,
+ "learning_rate": 6.442199775533109e-05,
+ "loss": 0.017252741381525993,
+ "step": 833
+ },
+ {
+ "epoch": 4.2126582278481015,
+ "grad_norm": 0.0322343185544014,
+ "learning_rate": 6.436588103254771e-05,
+ "loss": 0.015862349420785904,
+ "step": 834
+ },
+ {
+ "epoch": 4.217721518987342,
+ "grad_norm": 0.033133670687675476,
+ "learning_rate": 6.43097643097643e-05,
+ "loss": 0.02029406651854515,
+ "step": 835
+ },
+ {
+ "epoch": 4.222784810126583,
+ "grad_norm": 0.044879183173179626,
+ "learning_rate": 6.425364758698093e-05,
+ "loss": 0.021223746240139008,
+ "step": 836
+ },
+ {
+ "epoch": 4.227848101265823,
+ "grad_norm": 0.031861864030361176,
+ "learning_rate": 6.419753086419753e-05,
+ "loss": 0.023331837728619576,
+ "step": 837
+ },
+ {
+ "epoch": 4.232911392405064,
+ "grad_norm": 0.03642997145652771,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.025932632386684418,
+ "step": 838
+ },
+ {
+ "epoch": 4.237974683544304,
+ "grad_norm": 0.025531062856316566,
+ "learning_rate": 6.408529741863075e-05,
+ "loss": 0.019921796396374702,
+ "step": 839
+ },
+ {
+ "epoch": 4.243037974683545,
+ "grad_norm": 0.025292333215475082,
+ "learning_rate": 6.402918069584737e-05,
+ "loss": 0.017363781109452248,
+ "step": 840
+ },
+ {
+ "epoch": 4.248101265822784,
+ "grad_norm": 0.03679105266928673,
+ "learning_rate": 6.397306397306398e-05,
+ "loss": 0.026451613754034042,
+ "step": 841
+ },
+ {
+ "epoch": 4.253164556962025,
+ "grad_norm": 0.029125263914465904,
+ "learning_rate": 6.391694725028059e-05,
+ "loss": 0.018277600407600403,
+ "step": 842
+ },
+ {
+ "epoch": 4.258227848101265,
+ "grad_norm": 0.03969479724764824,
+ "learning_rate": 6.38608305274972e-05,
+ "loss": 0.026814289391040802,
+ "step": 843
+ },
+ {
+ "epoch": 4.263291139240506,
+ "grad_norm": 0.03083009086549282,
+ "learning_rate": 6.380471380471381e-05,
+ "loss": 0.01898398995399475,
+ "step": 844
+ },
+ {
+ "epoch": 4.2683544303797465,
+ "grad_norm": 0.04128425940871239,
+ "learning_rate": 6.374859708193042e-05,
+ "loss": 0.02890118584036827,
+ "step": 845
+ },
+ {
+ "epoch": 4.273417721518987,
+ "grad_norm": 0.03675759211182594,
+ "learning_rate": 6.369248035914703e-05,
+ "loss": 0.0232902429997921,
+ "step": 846
+ },
+ {
+ "epoch": 4.2784810126582276,
+ "grad_norm": 0.035842880606651306,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.018688444048166275,
+ "step": 847
+ },
+ {
+ "epoch": 4.283544303797468,
+ "grad_norm": 0.041631679981946945,
+ "learning_rate": 6.358024691358025e-05,
+ "loss": 0.028953872621059418,
+ "step": 848
+ },
+ {
+ "epoch": 4.288607594936709,
+ "grad_norm": 0.02474270947277546,
+ "learning_rate": 6.352413019079686e-05,
+ "loss": 0.02291303500533104,
+ "step": 849
+ },
+ {
+ "epoch": 4.293670886075949,
+ "grad_norm": 0.0414784699678421,
+ "learning_rate": 6.346801346801347e-05,
+ "loss": 0.0197298601269722,
+ "step": 850
+ },
+ {
+ "epoch": 4.29873417721519,
+ "grad_norm": 0.022596480324864388,
+ "learning_rate": 6.341189674523008e-05,
+ "loss": 0.022477108985185623,
+ "step": 851
+ },
+ {
+ "epoch": 4.30379746835443,
+ "grad_norm": 0.03707405552268028,
+ "learning_rate": 6.335578002244669e-05,
+ "loss": 0.02374342642724514,
+ "step": 852
+ },
+ {
+ "epoch": 4.308860759493671,
+ "grad_norm": 0.036069657653570175,
+ "learning_rate": 6.32996632996633e-05,
+ "loss": 0.025015011429786682,
+ "step": 853
+ },
+ {
+ "epoch": 4.313924050632911,
+ "grad_norm": 0.025126038119196892,
+ "learning_rate": 6.324354657687991e-05,
+ "loss": 0.022152241319417953,
+ "step": 854
+ },
+ {
+ "epoch": 4.318987341772152,
+ "grad_norm": 0.03695147857069969,
+ "learning_rate": 6.318742985409652e-05,
+ "loss": 0.019978618249297142,
+ "step": 855
+ },
+ {
+ "epoch": 4.324050632911392,
+ "grad_norm": 0.034860849380493164,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.01976930722594261,
+ "step": 856
+ },
+ {
+ "epoch": 4.329113924050633,
+ "grad_norm": 0.029625017195940018,
+ "learning_rate": 6.307519640852974e-05,
+ "loss": 0.024136420339345932,
+ "step": 857
+ },
+ {
+ "epoch": 4.334177215189873,
+ "grad_norm": 0.03501079976558685,
+ "learning_rate": 6.301907968574635e-05,
+ "loss": 0.020777776837348938,
+ "step": 858
+ },
+ {
+ "epoch": 4.339240506329114,
+ "grad_norm": 0.037415534257888794,
+ "learning_rate": 6.296296296296296e-05,
+ "loss": 0.016332093626260757,
+ "step": 859
+ },
+ {
+ "epoch": 4.3443037974683545,
+ "grad_norm": 0.032555654644966125,
+ "learning_rate": 6.290684624017957e-05,
+ "loss": 0.02344547212123871,
+ "step": 860
+ },
+ {
+ "epoch": 4.349367088607595,
+ "grad_norm": 0.04069099947810173,
+ "learning_rate": 6.28507295173962e-05,
+ "loss": 0.019369281828403473,
+ "step": 861
+ },
+ {
+ "epoch": 4.3544303797468356,
+ "grad_norm": 0.05188984051346779,
+ "learning_rate": 6.279461279461279e-05,
+ "loss": 0.02291448414325714,
+ "step": 862
+ },
+ {
+ "epoch": 4.359493670886076,
+ "grad_norm": 0.0357513502240181,
+ "learning_rate": 6.273849607182942e-05,
+ "loss": 0.02141542360186577,
+ "step": 863
+ },
+ {
+ "epoch": 4.364556962025317,
+ "grad_norm": 0.026472769677639008,
+ "learning_rate": 6.268237934904601e-05,
+ "loss": 0.01893937960267067,
+ "step": 864
+ },
+ {
+ "epoch": 4.369620253164557,
+ "grad_norm": 0.0498812235891819,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.021839456632733345,
+ "step": 865
+ },
+ {
+ "epoch": 4.374683544303798,
+ "grad_norm": 0.05202518403530121,
+ "learning_rate": 6.257014590347923e-05,
+ "loss": 0.023422567173838615,
+ "step": 866
+ },
+ {
+ "epoch": 4.379746835443038,
+ "grad_norm": 0.024116024374961853,
+ "learning_rate": 6.251402918069586e-05,
+ "loss": 0.018288200721144676,
+ "step": 867
+ },
+ {
+ "epoch": 4.384810126582279,
+ "grad_norm": 0.02667090855538845,
+ "learning_rate": 6.245791245791247e-05,
+ "loss": 0.022375311702489853,
+ "step": 868
+ },
+ {
+ "epoch": 4.389873417721519,
+ "grad_norm": 0.02306467480957508,
+ "learning_rate": 6.240179573512908e-05,
+ "loss": 0.017447657883167267,
+ "step": 869
+ },
+ {
+ "epoch": 4.39493670886076,
+ "grad_norm": 0.031131602823734283,
+ "learning_rate": 6.234567901234569e-05,
+ "loss": 0.021768944337964058,
+ "step": 870
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.05789825692772865,
+ "learning_rate": 6.22895622895623e-05,
+ "loss": 0.02762719616293907,
+ "step": 871
+ },
+ {
+ "epoch": 4.405063291139241,
+ "grad_norm": 0.03830523043870926,
+ "learning_rate": 6.22334455667789e-05,
+ "loss": 0.023558061569929123,
+ "step": 872
+ },
+ {
+ "epoch": 4.410126582278481,
+ "grad_norm": 0.025961998850107193,
+ "learning_rate": 6.21773288439955e-05,
+ "loss": 0.022518256679177284,
+ "step": 873
+ },
+ {
+ "epoch": 4.415189873417722,
+ "grad_norm": 0.025299636647105217,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.018432877957820892,
+ "step": 874
+ },
+ {
+ "epoch": 4.4202531645569625,
+ "grad_norm": 0.027106614783406258,
+ "learning_rate": 6.206509539842874e-05,
+ "loss": 0.01614236831665039,
+ "step": 875
+ },
+ {
+ "epoch": 4.425316455696202,
+ "grad_norm": 0.04538397118449211,
+ "learning_rate": 6.200897867564535e-05,
+ "loss": 0.027474530041217804,
+ "step": 876
+ },
+ {
+ "epoch": 4.430379746835443,
+ "grad_norm": 0.041059643030166626,
+ "learning_rate": 6.195286195286196e-05,
+ "loss": 0.030840855091810226,
+ "step": 877
+ },
+ {
+ "epoch": 4.435443037974683,
+ "grad_norm": 0.055599089711904526,
+ "learning_rate": 6.189674523007857e-05,
+ "loss": 0.02877015620470047,
+ "step": 878
+ },
+ {
+ "epoch": 4.440506329113924,
+ "grad_norm": 0.023808903992176056,
+ "learning_rate": 6.184062850729518e-05,
+ "loss": 0.018071971833705902,
+ "step": 879
+ },
+ {
+ "epoch": 4.445569620253164,
+ "grad_norm": 0.04098769649863243,
+ "learning_rate": 6.178451178451179e-05,
+ "loss": 0.019321631640195847,
+ "step": 880
+ },
+ {
+ "epoch": 4.450632911392405,
+ "grad_norm": 0.0329279750585556,
+ "learning_rate": 6.17283950617284e-05,
+ "loss": 0.023013390600681305,
+ "step": 881
+ },
+ {
+ "epoch": 4.455696202531645,
+ "grad_norm": 0.030751917511224747,
+ "learning_rate": 6.1672278338945e-05,
+ "loss": 0.018062159419059753,
+ "step": 882
+ },
+ {
+ "epoch": 4.460759493670886,
+ "grad_norm": 0.025446373969316483,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.020532462745904922,
+ "step": 883
+ },
+ {
+ "epoch": 4.465822784810126,
+ "grad_norm": 0.037997085601091385,
+ "learning_rate": 6.156004489337823e-05,
+ "loss": 0.024340521544218063,
+ "step": 884
+ },
+ {
+ "epoch": 4.470886075949367,
+ "grad_norm": 0.021509790793061256,
+ "learning_rate": 6.150392817059484e-05,
+ "loss": 0.018887734040617943,
+ "step": 885
+ },
+ {
+ "epoch": 4.4759493670886075,
+ "grad_norm": 0.027931779623031616,
+ "learning_rate": 6.144781144781146e-05,
+ "loss": 0.02148054540157318,
+ "step": 886
+ },
+ {
+ "epoch": 4.481012658227848,
+ "grad_norm": 0.035554565489292145,
+ "learning_rate": 6.139169472502806e-05,
+ "loss": 0.019528254866600037,
+ "step": 887
+ },
+ {
+ "epoch": 4.4860759493670885,
+ "grad_norm": 0.02668517455458641,
+ "learning_rate": 6.133557800224468e-05,
+ "loss": 0.022182706743478775,
+ "step": 888
+ },
+ {
+ "epoch": 4.491139240506329,
+ "grad_norm": 0.0376712940633297,
+ "learning_rate": 6.127946127946128e-05,
+ "loss": 0.026006314903497696,
+ "step": 889
+ },
+ {
+ "epoch": 4.49620253164557,
+ "grad_norm": 0.02952289767563343,
+ "learning_rate": 6.12233445566779e-05,
+ "loss": 0.022582251578569412,
+ "step": 890
+ },
+ {
+ "epoch": 4.50126582278481,
+ "grad_norm": 0.05064458027482033,
+ "learning_rate": 6.11672278338945e-05,
+ "loss": 0.021709535270929337,
+ "step": 891
+ },
+ {
+ "epoch": 4.506329113924051,
+ "grad_norm": 0.021470079198479652,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.015116477385163307,
+ "step": 892
+ },
+ {
+ "epoch": 4.511392405063291,
+ "grad_norm": 0.04210078716278076,
+ "learning_rate": 6.105499438832773e-05,
+ "loss": 0.030057771131396294,
+ "step": 893
+ },
+ {
+ "epoch": 4.516455696202532,
+ "grad_norm": 0.20027652382850647,
+ "learning_rate": 6.099887766554434e-05,
+ "loss": 0.02081073820590973,
+ "step": 894
+ },
+ {
+ "epoch": 4.521518987341772,
+ "grad_norm": 0.03083370067179203,
+ "learning_rate": 6.0942760942760944e-05,
+ "loss": 0.020705904811620712,
+ "step": 895
+ },
+ {
+ "epoch": 4.526582278481013,
+ "grad_norm": 0.05921618640422821,
+ "learning_rate": 6.0886644219977554e-05,
+ "loss": 0.020449915900826454,
+ "step": 896
+ },
+ {
+ "epoch": 4.531645569620253,
+ "grad_norm": 0.02304214984178543,
+ "learning_rate": 6.0830527497194164e-05,
+ "loss": 0.01927848532795906,
+ "step": 897
+ },
+ {
+ "epoch": 4.536708860759494,
+ "grad_norm": 0.03946949169039726,
+ "learning_rate": 6.0774410774410774e-05,
+ "loss": 0.026231423020362854,
+ "step": 898
+ },
+ {
+ "epoch": 4.541772151898734,
+ "grad_norm": 0.027822930365800858,
+ "learning_rate": 6.071829405162739e-05,
+ "loss": 0.022259924560785294,
+ "step": 899
+ },
+ {
+ "epoch": 4.546835443037975,
+ "grad_norm": 0.029135817661881447,
+ "learning_rate": 6.0662177328843995e-05,
+ "loss": 0.019272884353995323,
+ "step": 900
+ },
+ {
+ "epoch": 4.5518987341772155,
+ "grad_norm": 0.03746713697910309,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.022191740572452545,
+ "step": 901
+ },
+ {
+ "epoch": 4.556962025316456,
+ "grad_norm": 0.027378680184483528,
+ "learning_rate": 6.0549943883277215e-05,
+ "loss": 0.023043492808938026,
+ "step": 902
+ },
+ {
+ "epoch": 4.5620253164556965,
+ "grad_norm": 0.047497715801000595,
+ "learning_rate": 6.049382716049383e-05,
+ "loss": 0.023993097245693207,
+ "step": 903
+ },
+ {
+ "epoch": 4.567088607594937,
+ "grad_norm": 0.02557055652141571,
+ "learning_rate": 6.0437710437710435e-05,
+ "loss": 0.020033126696944237,
+ "step": 904
+ },
+ {
+ "epoch": 4.572151898734178,
+ "grad_norm": 0.08165695518255234,
+ "learning_rate": 6.038159371492705e-05,
+ "loss": 0.02415328472852707,
+ "step": 905
+ },
+ {
+ "epoch": 4.577215189873417,
+ "grad_norm": 0.03633309155702591,
+ "learning_rate": 6.032547699214366e-05,
+ "loss": 0.02082585170865059,
+ "step": 906
+ },
+ {
+ "epoch": 4.582278481012658,
+ "grad_norm": 0.03273358196020126,
+ "learning_rate": 6.026936026936028e-05,
+ "loss": 0.020049303770065308,
+ "step": 907
+ },
+ {
+ "epoch": 4.587341772151898,
+ "grad_norm": 0.040032029151916504,
+ "learning_rate": 6.021324354657688e-05,
+ "loss": 0.02167242392897606,
+ "step": 908
+ },
+ {
+ "epoch": 4.592405063291139,
+ "grad_norm": 0.02789166197180748,
+ "learning_rate": 6.01571268237935e-05,
+ "loss": 0.01964012160897255,
+ "step": 909
+ },
+ {
+ "epoch": 4.597468354430379,
+ "grad_norm": 0.03285825625061989,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.024942882359027863,
+ "step": 910
+ },
+ {
+ "epoch": 4.60253164556962,
+ "grad_norm": 0.02894079126417637,
+ "learning_rate": 6.004489337822672e-05,
+ "loss": 0.022012561559677124,
+ "step": 911
+ },
+ {
+ "epoch": 4.6075949367088604,
+ "grad_norm": 0.03291299566626549,
+ "learning_rate": 5.998877665544332e-05,
+ "loss": 0.02291432023048401,
+ "step": 912
+ },
+ {
+ "epoch": 4.612658227848101,
+ "grad_norm": 0.05124634876847267,
+ "learning_rate": 5.993265993265994e-05,
+ "loss": 0.017874885350465775,
+ "step": 913
+ },
+ {
+ "epoch": 4.6177215189873415,
+ "grad_norm": 0.042412169277668,
+ "learning_rate": 5.987654320987654e-05,
+ "loss": 0.0233401320874691,
+ "step": 914
+ },
+ {
+ "epoch": 4.622784810126582,
+ "grad_norm": 0.03447306156158447,
+ "learning_rate": 5.982042648709316e-05,
+ "loss": 0.022503826767206192,
+ "step": 915
+ },
+ {
+ "epoch": 4.627848101265823,
+ "grad_norm": 0.022415662184357643,
+ "learning_rate": 5.976430976430977e-05,
+ "loss": 0.01659448817372322,
+ "step": 916
+ },
+ {
+ "epoch": 4.632911392405063,
+ "grad_norm": 0.04882103577256203,
+ "learning_rate": 5.970819304152637e-05,
+ "loss": 0.02342696487903595,
+ "step": 917
+ },
+ {
+ "epoch": 4.637974683544304,
+ "grad_norm": 0.0341666042804718,
+ "learning_rate": 5.965207631874299e-05,
+ "loss": 0.026119260117411613,
+ "step": 918
+ },
+ {
+ "epoch": 4.643037974683544,
+ "grad_norm": 0.03507097065448761,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.022042831405997276,
+ "step": 919
+ },
+ {
+ "epoch": 4.648101265822785,
+ "grad_norm": 0.04078570008277893,
+ "learning_rate": 5.953984287317621e-05,
+ "loss": 0.01978793554008007,
+ "step": 920
+ },
+ {
+ "epoch": 4.653164556962025,
+ "grad_norm": 0.03481799736618996,
+ "learning_rate": 5.948372615039281e-05,
+ "loss": 0.02518302947282791,
+ "step": 921
+ },
+ {
+ "epoch": 4.658227848101266,
+ "grad_norm": 0.0456753633916378,
+ "learning_rate": 5.942760942760943e-05,
+ "loss": 0.027814291417598724,
+ "step": 922
+ },
+ {
+ "epoch": 4.663291139240506,
+ "grad_norm": 0.026144322007894516,
+ "learning_rate": 5.937149270482604e-05,
+ "loss": 0.020842768251895905,
+ "step": 923
+ },
+ {
+ "epoch": 4.668354430379747,
+ "grad_norm": 0.027078162878751755,
+ "learning_rate": 5.9315375982042657e-05,
+ "loss": 0.026818346232175827,
+ "step": 924
+ },
+ {
+ "epoch": 4.673417721518987,
+ "grad_norm": 0.04505958408117294,
+ "learning_rate": 5.925925925925926e-05,
+ "loss": 0.01925778016448021,
+ "step": 925
+ },
+ {
+ "epoch": 4.678481012658228,
+ "grad_norm": 0.028921643272042274,
+ "learning_rate": 5.920314253647588e-05,
+ "loss": 0.017857741564512253,
+ "step": 926
+ },
+ {
+ "epoch": 4.6835443037974684,
+ "grad_norm": 0.021489476785063744,
+ "learning_rate": 5.914702581369248e-05,
+ "loss": 0.018585946410894394,
+ "step": 927
+ },
+ {
+ "epoch": 4.688607594936709,
+ "grad_norm": 0.02885374240577221,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.023486338555812836,
+ "step": 928
+ },
+ {
+ "epoch": 4.6936708860759495,
+ "grad_norm": 0.037063464522361755,
+ "learning_rate": 5.90347923681257e-05,
+ "loss": 0.02569335326552391,
+ "step": 929
+ },
+ {
+ "epoch": 4.69873417721519,
+ "grad_norm": 0.02460661344230175,
+ "learning_rate": 5.897867564534232e-05,
+ "loss": 0.01580418087542057,
+ "step": 930
+ },
+ {
+ "epoch": 4.703797468354431,
+ "grad_norm": 0.030016187578439713,
+ "learning_rate": 5.892255892255892e-05,
+ "loss": 0.01811431720852852,
+ "step": 931
+ },
+ {
+ "epoch": 4.708860759493671,
+ "grad_norm": 0.030638013035058975,
+ "learning_rate": 5.886644219977554e-05,
+ "loss": 0.02380264922976494,
+ "step": 932
+ },
+ {
+ "epoch": 4.713924050632912,
+ "grad_norm": 0.022593742236495018,
+ "learning_rate": 5.881032547699215e-05,
+ "loss": 0.017498169094324112,
+ "step": 933
+ },
+ {
+ "epoch": 4.718987341772152,
+ "grad_norm": 0.026072485372424126,
+ "learning_rate": 5.8754208754208764e-05,
+ "loss": 0.020261723548173904,
+ "step": 934
+ },
+ {
+ "epoch": 4.724050632911393,
+ "grad_norm": 0.020842554047703743,
+ "learning_rate": 5.869809203142537e-05,
+ "loss": 0.018765904009342194,
+ "step": 935
+ },
+ {
+ "epoch": 4.729113924050633,
+ "grad_norm": 0.02724885568022728,
+ "learning_rate": 5.8641975308641984e-05,
+ "loss": 0.01877676695585251,
+ "step": 936
+ },
+ {
+ "epoch": 4.734177215189874,
+ "grad_norm": 0.037401214241981506,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.026435203850269318,
+ "step": 937
+ },
+ {
+ "epoch": 4.739240506329114,
+ "grad_norm": 0.06131114065647125,
+ "learning_rate": 5.852974186307519e-05,
+ "loss": 0.023247163742780685,
+ "step": 938
+ },
+ {
+ "epoch": 4.744303797468355,
+ "grad_norm": 0.04543917998671532,
+ "learning_rate": 5.847362514029181e-05,
+ "loss": 0.024184830486774445,
+ "step": 939
+ },
+ {
+ "epoch": 4.749367088607595,
+ "grad_norm": 0.03184051439166069,
+ "learning_rate": 5.841750841750842e-05,
+ "loss": 0.02176564559340477,
+ "step": 940
+ },
+ {
+ "epoch": 4.754430379746836,
+ "grad_norm": 0.0309689249843359,
+ "learning_rate": 5.8361391694725034e-05,
+ "loss": 0.023136526346206665,
+ "step": 941
+ },
+ {
+ "epoch": 4.759493670886076,
+ "grad_norm": 0.024972833693027496,
+ "learning_rate": 5.830527497194164e-05,
+ "loss": 0.017270661890506744,
+ "step": 942
+ },
+ {
+ "epoch": 4.764556962025316,
+ "grad_norm": 0.03733127936720848,
+ "learning_rate": 5.8249158249158255e-05,
+ "loss": 0.022722383961081505,
+ "step": 943
+ },
+ {
+ "epoch": 4.769620253164557,
+ "grad_norm": 0.04425952583551407,
+ "learning_rate": 5.819304152637486e-05,
+ "loss": 0.02506185881793499,
+ "step": 944
+ },
+ {
+ "epoch": 4.774683544303797,
+ "grad_norm": 0.022625036537647247,
+ "learning_rate": 5.8136924803591475e-05,
+ "loss": 0.017418090254068375,
+ "step": 945
+ },
+ {
+ "epoch": 4.779746835443038,
+ "grad_norm": 0.02716260775923729,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.022329077124595642,
+ "step": 946
+ },
+ {
+ "epoch": 4.784810126582278,
+ "grad_norm": 0.03288663551211357,
+ "learning_rate": 5.8024691358024695e-05,
+ "loss": 0.02051950991153717,
+ "step": 947
+ },
+ {
+ "epoch": 4.789873417721519,
+ "grad_norm": 0.03347448632121086,
+ "learning_rate": 5.7968574635241305e-05,
+ "loss": 0.01883091777563095,
+ "step": 948
+ },
+ {
+ "epoch": 4.794936708860759,
+ "grad_norm": 0.036814238876104355,
+ "learning_rate": 5.7912457912457915e-05,
+ "loss": 0.02320999652147293,
+ "step": 949
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.030795598402619362,
+ "learning_rate": 5.7856341189674525e-05,
+ "loss": 0.01819070428609848,
+ "step": 950
+ },
+ {
+ "epoch": 4.80506329113924,
+ "grad_norm": 0.03846567124128342,
+ "learning_rate": 5.780022446689114e-05,
+ "loss": 0.01933719590306282,
+ "step": 951
+ },
+ {
+ "epoch": 4.810126582278481,
+ "grad_norm": 0.029248127713799477,
+ "learning_rate": 5.7744107744107745e-05,
+ "loss": 0.01642131432890892,
+ "step": 952
+ },
+ {
+ "epoch": 4.815189873417721,
+ "grad_norm": 0.025749213993549347,
+ "learning_rate": 5.768799102132436e-05,
+ "loss": 0.017750587314367294,
+ "step": 953
+ },
+ {
+ "epoch": 4.820253164556962,
+ "grad_norm": 0.043794333934783936,
+ "learning_rate": 5.7631874298540965e-05,
+ "loss": 0.02561376616358757,
+ "step": 954
+ },
+ {
+ "epoch": 4.8253164556962025,
+ "grad_norm": 0.04074554517865181,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.023251589387655258,
+ "step": 955
+ },
+ {
+ "epoch": 4.830379746835443,
+ "grad_norm": 0.043594326823949814,
+ "learning_rate": 5.7519640852974186e-05,
+ "loss": 0.025138206779956818,
+ "step": 956
+ },
+ {
+ "epoch": 4.8354430379746836,
+ "grad_norm": 0.05410498008131981,
+ "learning_rate": 5.74635241301908e-05,
+ "loss": 0.023706410080194473,
+ "step": 957
+ },
+ {
+ "epoch": 4.840506329113924,
+ "grad_norm": 0.0299235749989748,
+ "learning_rate": 5.740740740740741e-05,
+ "loss": 0.01801147311925888,
+ "step": 958
+ },
+ {
+ "epoch": 4.845569620253165,
+ "grad_norm": 0.02982177399098873,
+ "learning_rate": 5.735129068462403e-05,
+ "loss": 0.021112898364663124,
+ "step": 959
+ },
+ {
+ "epoch": 4.850632911392405,
+ "grad_norm": 0.04181864112615585,
+ "learning_rate": 5.729517396184063e-05,
+ "loss": 0.02110268548130989,
+ "step": 960
+ },
+ {
+ "epoch": 4.855696202531646,
+ "grad_norm": 0.040301334112882614,
+ "learning_rate": 5.7239057239057236e-05,
+ "loss": 0.020649928599596024,
+ "step": 961
+ },
+ {
+ "epoch": 4.860759493670886,
+ "grad_norm": 0.03669300675392151,
+ "learning_rate": 5.718294051627385e-05,
+ "loss": 0.023078542202711105,
+ "step": 962
+ },
+ {
+ "epoch": 4.865822784810127,
+ "grad_norm": 0.023378873243927956,
+ "learning_rate": 5.7126823793490456e-05,
+ "loss": 0.01759505085647106,
+ "step": 963
+ },
+ {
+ "epoch": 4.870886075949367,
+ "grad_norm": 0.044835980981588364,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.023342810571193695,
+ "step": 964
+ },
+ {
+ "epoch": 4.875949367088608,
+ "grad_norm": 0.03264521807432175,
+ "learning_rate": 5.701459034792368e-05,
+ "loss": 0.021122846752405167,
+ "step": 965
+ },
+ {
+ "epoch": 4.881012658227848,
+ "grad_norm": 0.036651868373155594,
+ "learning_rate": 5.695847362514029e-05,
+ "loss": 0.026279672980308533,
+ "step": 966
+ },
+ {
+ "epoch": 4.886075949367089,
+ "grad_norm": 0.023810314014554024,
+ "learning_rate": 5.69023569023569e-05,
+ "loss": 0.020299838855862617,
+ "step": 967
+ },
+ {
+ "epoch": 4.891139240506329,
+ "grad_norm": 0.028432384133338928,
+ "learning_rate": 5.684624017957352e-05,
+ "loss": 0.019828233867883682,
+ "step": 968
+ },
+ {
+ "epoch": 4.89620253164557,
+ "grad_norm": 0.02499561943113804,
+ "learning_rate": 5.679012345679012e-05,
+ "loss": 0.023105870932340622,
+ "step": 969
+ },
+ {
+ "epoch": 4.9012658227848105,
+ "grad_norm": 0.0340624563395977,
+ "learning_rate": 5.673400673400674e-05,
+ "loss": 0.023707572370767593,
+ "step": 970
+ },
+ {
+ "epoch": 4.90632911392405,
+ "grad_norm": 0.02945004589855671,
+ "learning_rate": 5.667789001122334e-05,
+ "loss": 0.019038598984479904,
+ "step": 971
+ },
+ {
+ "epoch": 4.911392405063291,
+ "grad_norm": 0.034173011779785156,
+ "learning_rate": 5.662177328843996e-05,
+ "loss": 0.02678484097123146,
+ "step": 972
+ },
+ {
+ "epoch": 4.916455696202531,
+ "grad_norm": 0.0515705943107605,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.02983126789331436,
+ "step": 973
+ },
+ {
+ "epoch": 4.921518987341772,
+ "grad_norm": 0.024027375504374504,
+ "learning_rate": 5.650953984287318e-05,
+ "loss": 0.021375803276896477,
+ "step": 974
+ },
+ {
+ "epoch": 4.926582278481012,
+ "grad_norm": 0.03331667557358742,
+ "learning_rate": 5.645342312008979e-05,
+ "loss": 0.021600808948278427,
+ "step": 975
+ },
+ {
+ "epoch": 4.931645569620253,
+ "grad_norm": 0.029174596071243286,
+ "learning_rate": 5.639730639730641e-05,
+ "loss": 0.022452034056186676,
+ "step": 976
+ },
+ {
+ "epoch": 4.936708860759493,
+ "grad_norm": 0.03323808312416077,
+ "learning_rate": 5.634118967452301e-05,
+ "loss": 0.02531963586807251,
+ "step": 977
+ },
+ {
+ "epoch": 4.941772151898734,
+ "grad_norm": 0.02238641493022442,
+ "learning_rate": 5.628507295173963e-05,
+ "loss": 0.01655597612261772,
+ "step": 978
+ },
+ {
+ "epoch": 4.946835443037974,
+ "grad_norm": 0.03279856964945793,
+ "learning_rate": 5.622895622895623e-05,
+ "loss": 0.02232341095805168,
+ "step": 979
+ },
+ {
+ "epoch": 4.951898734177215,
+ "grad_norm": 0.03852152079343796,
+ "learning_rate": 5.617283950617285e-05,
+ "loss": 0.025721147656440735,
+ "step": 980
+ },
+ {
+ "epoch": 4.9569620253164555,
+ "grad_norm": 0.039974186569452286,
+ "learning_rate": 5.611672278338945e-05,
+ "loss": 0.015438543632626534,
+ "step": 981
+ },
+ {
+ "epoch": 4.962025316455696,
+ "grad_norm": 0.0348355695605278,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.021361682564020157,
+ "step": 982
+ },
+ {
+ "epoch": 4.9670886075949365,
+ "grad_norm": 0.02576221525669098,
+ "learning_rate": 5.600448933782267e-05,
+ "loss": 0.02103075385093689,
+ "step": 983
+ },
+ {
+ "epoch": 4.972151898734177,
+ "grad_norm": 0.039421118795871735,
+ "learning_rate": 5.594837261503928e-05,
+ "loss": 0.026340002194046974,
+ "step": 984
+ },
+ {
+ "epoch": 4.977215189873418,
+ "grad_norm": 0.02953593246638775,
+ "learning_rate": 5.58922558922559e-05,
+ "loss": 0.020818116143345833,
+ "step": 985
+ },
+ {
+ "epoch": 4.982278481012658,
+ "grad_norm": 0.033213913440704346,
+ "learning_rate": 5.58361391694725e-05,
+ "loss": 0.020878788083791733,
+ "step": 986
+ },
+ {
+ "epoch": 4.987341772151899,
+ "grad_norm": 0.04450162872672081,
+ "learning_rate": 5.578002244668912e-05,
+ "loss": 0.02208695001900196,
+ "step": 987
+ },
+ {
+ "epoch": 4.992405063291139,
+ "grad_norm": 0.04752403125166893,
+ "learning_rate": 5.572390572390572e-05,
+ "loss": 0.021128743886947632,
+ "step": 988
+ },
+ {
+ "epoch": 4.99746835443038,
+ "grad_norm": 0.03401600942015648,
+ "learning_rate": 5.566778900112234e-05,
+ "loss": 0.020553182810544968,
+ "step": 989
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.031174728646874428,
+ "learning_rate": 5.561167227833894e-05,
+ "loss": 0.01929999701678753,
+ "step": 990
+ },
+ {
+ "epoch": 5.0050632911392405,
+ "grad_norm": 0.056407660245895386,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.024739203974604607,
+ "step": 991
+ },
+ {
+ "epoch": 5.010126582278481,
+ "grad_norm": 0.019481178373098373,
+ "learning_rate": 5.549943883277217e-05,
+ "loss": 0.016404341906309128,
+ "step": 992
+ },
+ {
+ "epoch": 5.015189873417722,
+ "grad_norm": 0.029707469046115875,
+ "learning_rate": 5.5443322109988785e-05,
+ "loss": 0.017014270648360252,
+ "step": 993
+ },
+ {
+ "epoch": 5.020253164556962,
+ "grad_norm": 0.039400286972522736,
+ "learning_rate": 5.538720538720539e-05,
+ "loss": 0.016073700040578842,
+ "step": 994
+ },
+ {
+ "epoch": 5.025316455696203,
+ "grad_norm": 0.047592055052518845,
+ "learning_rate": 5.5331088664422005e-05,
+ "loss": 0.02021213248372078,
+ "step": 995
+ },
+ {
+ "epoch": 5.030379746835443,
+ "grad_norm": 0.054195769131183624,
+ "learning_rate": 5.527497194163861e-05,
+ "loss": 0.027454158291220665,
+ "step": 996
+ },
+ {
+ "epoch": 5.035443037974684,
+ "grad_norm": 0.02753913588821888,
+ "learning_rate": 5.5218855218855225e-05,
+ "loss": 0.01993582770228386,
+ "step": 997
+ },
+ {
+ "epoch": 5.040506329113924,
+ "grad_norm": 0.038280900567770004,
+ "learning_rate": 5.516273849607183e-05,
+ "loss": 0.017832420766353607,
+ "step": 998
+ },
+ {
+ "epoch": 5.045569620253165,
+ "grad_norm": 0.0289705079048872,
+ "learning_rate": 5.5106621773288446e-05,
+ "loss": 0.019040051847696304,
+ "step": 999
+ },
+ {
+ "epoch": 5.050632911392405,
+ "grad_norm": 0.030929062515497208,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.02529517561197281,
+ "step": 1000
+ },
+ {
+ "epoch": 5.055696202531646,
+ "grad_norm": 0.039416536688804626,
+ "learning_rate": 5.4994388327721666e-05,
+ "loss": 0.017563793808221817,
+ "step": 1001
+ },
+ {
+ "epoch": 5.060759493670886,
+ "grad_norm": 0.039831917732954025,
+ "learning_rate": 5.4938271604938276e-05,
+ "loss": 0.022547172382473946,
+ "step": 1002
+ },
+ {
+ "epoch": 5.065822784810127,
+ "grad_norm": 0.02979891747236252,
+ "learning_rate": 5.488215488215489e-05,
+ "loss": 0.019676152616739273,
+ "step": 1003
+ },
+ {
+ "epoch": 5.0708860759493675,
+ "grad_norm": 0.025752373039722443,
+ "learning_rate": 5.4826038159371496e-05,
+ "loss": 0.016172030940651894,
+ "step": 1004
+ },
+ {
+ "epoch": 5.075949367088608,
+ "grad_norm": 0.03433040529489517,
+ "learning_rate": 5.47699214365881e-05,
+ "loss": 0.022616712376475334,
+ "step": 1005
+ },
+ {
+ "epoch": 5.0810126582278485,
+ "grad_norm": 0.04834216088056564,
+ "learning_rate": 5.4713804713804716e-05,
+ "loss": 0.02641037292778492,
+ "step": 1006
+ },
+ {
+ "epoch": 5.086075949367088,
+ "grad_norm": 0.03748583421111107,
+ "learning_rate": 5.465768799102132e-05,
+ "loss": 0.02212962508201599,
+ "step": 1007
+ },
+ {
+ "epoch": 5.091139240506329,
+ "grad_norm": 0.03406492620706558,
+ "learning_rate": 5.4601571268237936e-05,
+ "loss": 0.022490520030260086,
+ "step": 1008
+ },
+ {
+ "epoch": 5.096202531645569,
+ "grad_norm": 0.025412574410438538,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.018286626785993576,
+ "step": 1009
+ },
+ {
+ "epoch": 5.10126582278481,
+ "grad_norm": 0.030613059177994728,
+ "learning_rate": 5.448933782267116e-05,
+ "loss": 0.018090849742293358,
+ "step": 1010
+ },
+ {
+ "epoch": 5.10632911392405,
+ "grad_norm": 0.032511018216609955,
+ "learning_rate": 5.4433221099887766e-05,
+ "loss": 0.019871044903993607,
+ "step": 1011
+ },
+ {
+ "epoch": 5.111392405063291,
+ "grad_norm": 0.041535500437021255,
+ "learning_rate": 5.437710437710438e-05,
+ "loss": 0.02880081906914711,
+ "step": 1012
+ },
+ {
+ "epoch": 5.116455696202531,
+ "grad_norm": 0.053748298436403275,
+ "learning_rate": 5.4320987654320986e-05,
+ "loss": 0.024350278079509735,
+ "step": 1013
+ },
+ {
+ "epoch": 5.121518987341772,
+ "grad_norm": 0.03045419417321682,
+ "learning_rate": 5.42648709315376e-05,
+ "loss": 0.026830779388546944,
+ "step": 1014
+ },
+ {
+ "epoch": 5.1265822784810124,
+ "grad_norm": 0.02704838663339615,
+ "learning_rate": 5.420875420875421e-05,
+ "loss": 0.019440406933426857,
+ "step": 1015
+ },
+ {
+ "epoch": 5.131645569620253,
+ "grad_norm": 0.037976089864969254,
+ "learning_rate": 5.4152637485970823e-05,
+ "loss": 0.02016528509557247,
+ "step": 1016
+ },
+ {
+ "epoch": 5.1367088607594935,
+ "grad_norm": 0.04055245593190193,
+ "learning_rate": 5.4096520763187434e-05,
+ "loss": 0.021118413656949997,
+ "step": 1017
+ },
+ {
+ "epoch": 5.141772151898734,
+ "grad_norm": 0.02943083830177784,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.01882058009505272,
+ "step": 1018
+ },
+ {
+ "epoch": 5.146835443037975,
+ "grad_norm": 0.03773244097828865,
+ "learning_rate": 5.3984287317620654e-05,
+ "loss": 0.025017477571964264,
+ "step": 1019
+ },
+ {
+ "epoch": 5.151898734177215,
+ "grad_norm": 0.026969652622938156,
+ "learning_rate": 5.392817059483727e-05,
+ "loss": 0.018443236127495766,
+ "step": 1020
+ },
+ {
+ "epoch": 5.156962025316456,
+ "grad_norm": 0.032142024487257004,
+ "learning_rate": 5.3872053872053874e-05,
+ "loss": 0.02332904376089573,
+ "step": 1021
+ },
+ {
+ "epoch": 5.162025316455696,
+ "grad_norm": 0.06372297555208206,
+ "learning_rate": 5.381593714927049e-05,
+ "loss": 0.027975570410490036,
+ "step": 1022
+ },
+ {
+ "epoch": 5.167088607594937,
+ "grad_norm": 0.03120330721139908,
+ "learning_rate": 5.3759820426487094e-05,
+ "loss": 0.023697681725025177,
+ "step": 1023
+ },
+ {
+ "epoch": 5.172151898734177,
+ "grad_norm": 0.029094889760017395,
+ "learning_rate": 5.370370370370371e-05,
+ "loss": 0.01727498322725296,
+ "step": 1024
+ },
+ {
+ "epoch": 5.177215189873418,
+ "grad_norm": 0.03791336342692375,
+ "learning_rate": 5.3647586980920314e-05,
+ "loss": 0.02156408131122589,
+ "step": 1025
+ },
+ {
+ "epoch": 5.182278481012658,
+ "grad_norm": 0.028603199869394302,
+ "learning_rate": 5.3591470258136924e-05,
+ "loss": 0.01781666837632656,
+ "step": 1026
+ },
+ {
+ "epoch": 5.187341772151899,
+ "grad_norm": 0.034254368394613266,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.023422224447131157,
+ "step": 1027
+ },
+ {
+ "epoch": 5.192405063291139,
+ "grad_norm": 0.025661299005150795,
+ "learning_rate": 5.3479236812570144e-05,
+ "loss": 0.017852213233709335,
+ "step": 1028
+ },
+ {
+ "epoch": 5.19746835443038,
+ "grad_norm": 0.03156711906194687,
+ "learning_rate": 5.342312008978676e-05,
+ "loss": 0.022492870688438416,
+ "step": 1029
+ },
+ {
+ "epoch": 5.2025316455696204,
+ "grad_norm": 0.0222217608243227,
+ "learning_rate": 5.3367003367003364e-05,
+ "loss": 0.015568151138722897,
+ "step": 1030
+ },
+ {
+ "epoch": 5.207594936708861,
+ "grad_norm": 0.04563366249203682,
+ "learning_rate": 5.331088664421998e-05,
+ "loss": 0.022124778479337692,
+ "step": 1031
+ },
+ {
+ "epoch": 5.2126582278481015,
+ "grad_norm": 0.04612975940108299,
+ "learning_rate": 5.3254769921436585e-05,
+ "loss": 0.027084846049547195,
+ "step": 1032
+ },
+ {
+ "epoch": 5.217721518987342,
+ "grad_norm": 0.047278422862291336,
+ "learning_rate": 5.31986531986532e-05,
+ "loss": 0.022641438990831375,
+ "step": 1033
+ },
+ {
+ "epoch": 5.222784810126583,
+ "grad_norm": 0.030134575441479683,
+ "learning_rate": 5.314253647586981e-05,
+ "loss": 0.01842697337269783,
+ "step": 1034
+ },
+ {
+ "epoch": 5.227848101265823,
+ "grad_norm": 0.019028518348932266,
+ "learning_rate": 5.308641975308642e-05,
+ "loss": 0.017543386667966843,
+ "step": 1035
+ },
+ {
+ "epoch": 5.232911392405064,
+ "grad_norm": 0.04117404296994209,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.02185094729065895,
+ "step": 1036
+ },
+ {
+ "epoch": 5.237974683544304,
+ "grad_norm": 0.0310111902654171,
+ "learning_rate": 5.297418630751965e-05,
+ "loss": 0.02418985590338707,
+ "step": 1037
+ },
+ {
+ "epoch": 5.243037974683545,
+ "grad_norm": 0.034619491547346115,
+ "learning_rate": 5.291806958473625e-05,
+ "loss": 0.02162736840546131,
+ "step": 1038
+ },
+ {
+ "epoch": 5.248101265822784,
+ "grad_norm": 0.04028276726603508,
+ "learning_rate": 5.286195286195287e-05,
+ "loss": 0.02554975263774395,
+ "step": 1039
+ },
+ {
+ "epoch": 5.253164556962025,
+ "grad_norm": 0.0336519293487072,
+ "learning_rate": 5.280583613916947e-05,
+ "loss": 0.019465651363134384,
+ "step": 1040
+ },
+ {
+ "epoch": 5.258227848101265,
+ "grad_norm": 0.033565767109394073,
+ "learning_rate": 5.274971941638609e-05,
+ "loss": 0.020889155566692352,
+ "step": 1041
+ },
+ {
+ "epoch": 5.263291139240506,
+ "grad_norm": 0.02902410738170147,
+ "learning_rate": 5.269360269360269e-05,
+ "loss": 0.02131371572613716,
+ "step": 1042
+ },
+ {
+ "epoch": 5.2683544303797465,
+ "grad_norm": 0.03622325137257576,
+ "learning_rate": 5.263748597081931e-05,
+ "loss": 0.017162127420306206,
+ "step": 1043
+ },
+ {
+ "epoch": 5.273417721518987,
+ "grad_norm": 0.039386410266160965,
+ "learning_rate": 5.258136924803592e-05,
+ "loss": 0.016598902642726898,
+ "step": 1044
+ },
+ {
+ "epoch": 5.2784810126582276,
+ "grad_norm": 0.035566773265600204,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.022860797122120857,
+ "step": 1045
+ },
+ {
+ "epoch": 5.283544303797468,
+ "grad_norm": 0.04470687359571457,
+ "learning_rate": 5.246913580246914e-05,
+ "loss": 0.020824994891881943,
+ "step": 1046
+ },
+ {
+ "epoch": 5.288607594936709,
+ "grad_norm": 0.03889680653810501,
+ "learning_rate": 5.241301907968574e-05,
+ "loss": 0.017250075936317444,
+ "step": 1047
+ },
+ {
+ "epoch": 5.293670886075949,
+ "grad_norm": 0.02681683376431465,
+ "learning_rate": 5.235690235690236e-05,
+ "loss": 0.0191829651594162,
+ "step": 1048
+ },
+ {
+ "epoch": 5.29873417721519,
+ "grad_norm": 0.018965722993016243,
+ "learning_rate": 5.230078563411896e-05,
+ "loss": 0.02007337100803852,
+ "step": 1049
+ },
+ {
+ "epoch": 5.30379746835443,
+ "grad_norm": 0.023910261690616608,
+ "learning_rate": 5.224466891133558e-05,
+ "loss": 0.02189997211098671,
+ "step": 1050
+ },
+ {
+ "epoch": 5.308860759493671,
+ "grad_norm": 0.03607999160885811,
+ "learning_rate": 5.218855218855219e-05,
+ "loss": 0.023346582427620888,
+ "step": 1051
+ },
+ {
+ "epoch": 5.313924050632911,
+ "grad_norm": 0.02490268088877201,
+ "learning_rate": 5.2132435465768806e-05,
+ "loss": 0.017453521490097046,
+ "step": 1052
+ },
+ {
+ "epoch": 5.318987341772152,
+ "grad_norm": 0.04894902557134628,
+ "learning_rate": 5.207631874298541e-05,
+ "loss": 0.023999422788619995,
+ "step": 1053
+ },
+ {
+ "epoch": 5.324050632911392,
+ "grad_norm": 0.01724478043615818,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.013751897029578686,
+ "step": 1054
+ },
+ {
+ "epoch": 5.329113924050633,
+ "grad_norm": 0.05506094545125961,
+ "learning_rate": 5.196408529741863e-05,
+ "loss": 0.02599490061402321,
+ "step": 1055
+ },
+ {
+ "epoch": 5.334177215189873,
+ "grad_norm": 0.030050745233893394,
+ "learning_rate": 5.1907968574635247e-05,
+ "loss": 0.022996244952082634,
+ "step": 1056
+ },
+ {
+ "epoch": 5.339240506329114,
+ "grad_norm": 0.028648901730775833,
+ "learning_rate": 5.185185185185185e-05,
+ "loss": 0.024319645017385483,
+ "step": 1057
+ },
+ {
+ "epoch": 5.3443037974683545,
+ "grad_norm": 0.04159106686711311,
+ "learning_rate": 5.179573512906847e-05,
+ "loss": 0.02485204115509987,
+ "step": 1058
+ },
+ {
+ "epoch": 5.349367088607595,
+ "grad_norm": 0.04454904422163963,
+ "learning_rate": 5.173961840628507e-05,
+ "loss": 0.018921498209238052,
+ "step": 1059
+ },
+ {
+ "epoch": 5.3544303797468356,
+ "grad_norm": 0.05850376933813095,
+ "learning_rate": 5.168350168350169e-05,
+ "loss": 0.02758260816335678,
+ "step": 1060
+ },
+ {
+ "epoch": 5.359493670886076,
+ "grad_norm": 0.03319580852985382,
+ "learning_rate": 5.16273849607183e-05,
+ "loss": 0.02180345356464386,
+ "step": 1061
+ },
+ {
+ "epoch": 5.364556962025317,
+ "grad_norm": 0.046812329441308975,
+ "learning_rate": 5.1571268237934914e-05,
+ "loss": 0.021682530641555786,
+ "step": 1062
+ },
+ {
+ "epoch": 5.369620253164557,
+ "grad_norm": 0.028218183666467667,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.019677158445119858,
+ "step": 1063
+ },
+ {
+ "epoch": 5.374683544303798,
+ "grad_norm": 0.04918216913938522,
+ "learning_rate": 5.1459034792368134e-05,
+ "loss": 0.019348308444023132,
+ "step": 1064
+ },
+ {
+ "epoch": 5.379746835443038,
+ "grad_norm": 0.041713107377290726,
+ "learning_rate": 5.140291806958474e-05,
+ "loss": 0.01728012040257454,
+ "step": 1065
+ },
+ {
+ "epoch": 5.384810126582279,
+ "grad_norm": 0.034068260341882706,
+ "learning_rate": 5.1346801346801354e-05,
+ "loss": 0.020487628877162933,
+ "step": 1066
+ },
+ {
+ "epoch": 5.389873417721519,
+ "grad_norm": 0.028666919097304344,
+ "learning_rate": 5.129068462401796e-05,
+ "loss": 0.015318546444177628,
+ "step": 1067
+ },
+ {
+ "epoch": 5.39493670886076,
+ "grad_norm": 0.03828604146838188,
+ "learning_rate": 5.1234567901234574e-05,
+ "loss": 0.028930973261594772,
+ "step": 1068
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.01870056800544262,
+ "learning_rate": 5.1178451178451184e-05,
+ "loss": 0.015031076967716217,
+ "step": 1069
+ },
+ {
+ "epoch": 5.405063291139241,
+ "grad_norm": 0.02219143882393837,
+ "learning_rate": 5.112233445566779e-05,
+ "loss": 0.019569698721170425,
+ "step": 1070
+ },
+ {
+ "epoch": 5.410126582278481,
+ "grad_norm": 0.04418749734759331,
+ "learning_rate": 5.1066217732884404e-05,
+ "loss": 0.025913581252098083,
+ "step": 1071
+ },
+ {
+ "epoch": 5.415189873417722,
+ "grad_norm": 0.05946826562285423,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.03080957755446434,
+ "step": 1072
+ },
+ {
+ "epoch": 5.4202531645569625,
+ "grad_norm": 0.032025255262851715,
+ "learning_rate": 5.0953984287317624e-05,
+ "loss": 0.017155487090349197,
+ "step": 1073
+ },
+ {
+ "epoch": 5.425316455696202,
+ "grad_norm": 0.033507514744997025,
+ "learning_rate": 5.089786756453423e-05,
+ "loss": 0.022324759513139725,
+ "step": 1074
+ },
+ {
+ "epoch": 5.430379746835443,
+ "grad_norm": 0.025624485686421394,
+ "learning_rate": 5.0841750841750845e-05,
+ "loss": 0.021772298961877823,
+ "step": 1075
+ },
+ {
+ "epoch": 5.435443037974683,
+ "grad_norm": 0.055580489337444305,
+ "learning_rate": 5.078563411896745e-05,
+ "loss": 0.01938481442630291,
+ "step": 1076
+ },
+ {
+ "epoch": 5.440506329113924,
+ "grad_norm": 0.04581330716609955,
+ "learning_rate": 5.0729517396184065e-05,
+ "loss": 0.019239529967308044,
+ "step": 1077
+ },
+ {
+ "epoch": 5.445569620253164,
+ "grad_norm": 0.06254621595144272,
+ "learning_rate": 5.0673400673400675e-05,
+ "loss": 0.027182448655366898,
+ "step": 1078
+ },
+ {
+ "epoch": 5.450632911392405,
+ "grad_norm": 0.036759812384843826,
+ "learning_rate": 5.061728395061729e-05,
+ "loss": 0.027131710201501846,
+ "step": 1079
+ },
+ {
+ "epoch": 5.455696202531645,
+ "grad_norm": 0.03190915286540985,
+ "learning_rate": 5.0561167227833895e-05,
+ "loss": 0.0259249284863472,
+ "step": 1080
+ },
+ {
+ "epoch": 5.460759493670886,
+ "grad_norm": 0.03208916634321213,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.02531026303768158,
+ "step": 1081
+ },
+ {
+ "epoch": 5.465822784810126,
+ "grad_norm": 0.06676970422267914,
+ "learning_rate": 5.0448933782267115e-05,
+ "loss": 0.022145366296172142,
+ "step": 1082
+ },
+ {
+ "epoch": 5.470886075949367,
+ "grad_norm": 0.027604084461927414,
+ "learning_rate": 5.039281705948373e-05,
+ "loss": 0.018208740279078484,
+ "step": 1083
+ },
+ {
+ "epoch": 5.4759493670886075,
+ "grad_norm": 0.03812532126903534,
+ "learning_rate": 5.0336700336700335e-05,
+ "loss": 0.024251334369182587,
+ "step": 1084
+ },
+ {
+ "epoch": 5.481012658227848,
+ "grad_norm": 0.03016139566898346,
+ "learning_rate": 5.028058361391695e-05,
+ "loss": 0.02196047455072403,
+ "step": 1085
+ },
+ {
+ "epoch": 5.4860759493670885,
+ "grad_norm": 0.017749929800629616,
+ "learning_rate": 5.022446689113356e-05,
+ "loss": 0.01607266068458557,
+ "step": 1086
+ },
+ {
+ "epoch": 5.491139240506329,
+ "grad_norm": 0.023184901103377342,
+ "learning_rate": 5.016835016835017e-05,
+ "loss": 0.021226245909929276,
+ "step": 1087
+ },
+ {
+ "epoch": 5.49620253164557,
+ "grad_norm": 0.024662092328071594,
+ "learning_rate": 5.011223344556678e-05,
+ "loss": 0.019691254943609238,
+ "step": 1088
+ },
+ {
+ "epoch": 5.50126582278481,
+ "grad_norm": 0.05883142724633217,
+ "learning_rate": 5.00561167227834e-05,
+ "loss": 0.03039814904332161,
+ "step": 1089
+ },
+ {
+ "epoch": 5.506329113924051,
+ "grad_norm": 0.029918279498815536,
+ "learning_rate": 5e-05,
+ "loss": 0.022806301712989807,
+ "step": 1090
+ },
+ {
+ "epoch": 5.511392405063291,
+ "grad_norm": 0.023451462388038635,
+ "learning_rate": 4.994388327721661e-05,
+ "loss": 0.018920207396149635,
+ "step": 1091
+ },
+ {
+ "epoch": 5.516455696202532,
+ "grad_norm": 0.030591748654842377,
+ "learning_rate": 4.988776655443322e-05,
+ "loss": 0.024741975590586662,
+ "step": 1092
+ },
+ {
+ "epoch": 5.521518987341772,
+ "grad_norm": 0.020344361662864685,
+ "learning_rate": 4.983164983164983e-05,
+ "loss": 0.018007446080446243,
+ "step": 1093
+ },
+ {
+ "epoch": 5.526582278481013,
+ "grad_norm": 0.029899192973971367,
+ "learning_rate": 4.977553310886644e-05,
+ "loss": 0.02196051925420761,
+ "step": 1094
+ },
+ {
+ "epoch": 5.531645569620253,
+ "grad_norm": 0.030987054109573364,
+ "learning_rate": 4.971941638608306e-05,
+ "loss": 0.018726475536823273,
+ "step": 1095
+ },
+ {
+ "epoch": 5.536708860759494,
+ "grad_norm": 0.031603869050741196,
+ "learning_rate": 4.966329966329967e-05,
+ "loss": 0.027497179806232452,
+ "step": 1096
+ },
+ {
+ "epoch": 5.541772151898734,
+ "grad_norm": 0.041930630803108215,
+ "learning_rate": 4.960718294051628e-05,
+ "loss": 0.0274939127266407,
+ "step": 1097
+ },
+ {
+ "epoch": 5.546835443037975,
+ "grad_norm": 0.020828744396567345,
+ "learning_rate": 4.955106621773289e-05,
+ "loss": 0.020464252680540085,
+ "step": 1098
+ },
+ {
+ "epoch": 5.5518987341772155,
+ "grad_norm": 0.03408589959144592,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.024826694279909134,
+ "step": 1099
+ },
+ {
+ "epoch": 5.556962025316456,
+ "grad_norm": 0.03565233200788498,
+ "learning_rate": 4.943883277216611e-05,
+ "loss": 0.0297713503241539,
+ "step": 1100
+ },
+ {
+ "epoch": 5.5620253164556965,
+ "grad_norm": 0.03275191783905029,
+ "learning_rate": 4.938271604938271e-05,
+ "loss": 0.022985238581895828,
+ "step": 1101
+ },
+ {
+ "epoch": 5.567088607594937,
+ "grad_norm": 0.04215894266963005,
+ "learning_rate": 4.932659932659932e-05,
+ "loss": 0.020872686058282852,
+ "step": 1102
+ },
+ {
+ "epoch": 5.572151898734178,
+ "grad_norm": 0.03496193513274193,
+ "learning_rate": 4.927048260381594e-05,
+ "loss": 0.020619090646505356,
+ "step": 1103
+ },
+ {
+ "epoch": 5.577215189873417,
+ "grad_norm": 0.020121701061725616,
+ "learning_rate": 4.921436588103255e-05,
+ "loss": 0.017047466710209846,
+ "step": 1104
+ },
+ {
+ "epoch": 5.582278481012658,
+ "grad_norm": 0.02406349778175354,
+ "learning_rate": 4.915824915824916e-05,
+ "loss": 0.01753303036093712,
+ "step": 1105
+ },
+ {
+ "epoch": 5.587341772151898,
+ "grad_norm": 0.03804773837327957,
+ "learning_rate": 4.910213243546577e-05,
+ "loss": 0.026075419038534164,
+ "step": 1106
+ },
+ {
+ "epoch": 5.592405063291139,
+ "grad_norm": 0.024065209552645683,
+ "learning_rate": 4.904601571268238e-05,
+ "loss": 0.02253042347729206,
+ "step": 1107
+ },
+ {
+ "epoch": 5.597468354430379,
+ "grad_norm": 0.024677708745002747,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.02093282900750637,
+ "step": 1108
+ },
+ {
+ "epoch": 5.60253164556962,
+ "grad_norm": 0.022487351670861244,
+ "learning_rate": 4.89337822671156e-05,
+ "loss": 0.019194334745407104,
+ "step": 1109
+ },
+ {
+ "epoch": 5.6075949367088604,
+ "grad_norm": 0.023981913924217224,
+ "learning_rate": 4.887766554433221e-05,
+ "loss": 0.019715486094355583,
+ "step": 1110
+ },
+ {
+ "epoch": 5.612658227848101,
+ "grad_norm": 0.49088963866233826,
+ "learning_rate": 4.882154882154882e-05,
+ "loss": 0.01954624056816101,
+ "step": 1111
+ },
+ {
+ "epoch": 5.6177215189873415,
+ "grad_norm": 0.020698007196187973,
+ "learning_rate": 4.876543209876544e-05,
+ "loss": 0.0198826901614666,
+ "step": 1112
+ },
+ {
+ "epoch": 5.622784810126582,
+ "grad_norm": 0.030978364869952202,
+ "learning_rate": 4.870931537598205e-05,
+ "loss": 0.022201407700777054,
+ "step": 1113
+ },
+ {
+ "epoch": 5.627848101265823,
+ "grad_norm": 0.03610600158572197,
+ "learning_rate": 4.865319865319866e-05,
+ "loss": 0.020692896097898483,
+ "step": 1114
+ },
+ {
+ "epoch": 5.632911392405063,
+ "grad_norm": 0.03503869101405144,
+ "learning_rate": 4.859708193041527e-05,
+ "loss": 0.024315977469086647,
+ "step": 1115
+ },
+ {
+ "epoch": 5.637974683544304,
+ "grad_norm": 0.038263533264398575,
+ "learning_rate": 4.854096520763188e-05,
+ "loss": 0.02289794571697712,
+ "step": 1116
+ },
+ {
+ "epoch": 5.643037974683544,
+ "grad_norm": 0.06627792865037918,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.016900356858968735,
+ "step": 1117
+ },
+ {
+ "epoch": 5.648101265822785,
+ "grad_norm": 0.04108016937971115,
+ "learning_rate": 4.84287317620651e-05,
+ "loss": 0.026155930012464523,
+ "step": 1118
+ },
+ {
+ "epoch": 5.653164556962025,
+ "grad_norm": 0.027791379019618034,
+ "learning_rate": 4.837261503928171e-05,
+ "loss": 0.018122777342796326,
+ "step": 1119
+ },
+ {
+ "epoch": 5.658227848101266,
+ "grad_norm": 0.06097861006855965,
+ "learning_rate": 4.831649831649832e-05,
+ "loss": 0.022645950317382812,
+ "step": 1120
+ },
+ {
+ "epoch": 5.663291139240506,
+ "grad_norm": 0.06343472748994827,
+ "learning_rate": 4.8260381593714935e-05,
+ "loss": 0.029537659138441086,
+ "step": 1121
+ },
+ {
+ "epoch": 5.668354430379747,
+ "grad_norm": 0.05996944010257721,
+ "learning_rate": 4.8204264870931545e-05,
+ "loss": 0.02282993122935295,
+ "step": 1122
+ },
+ {
+ "epoch": 5.673417721518987,
+ "grad_norm": 0.030753644183278084,
+ "learning_rate": 4.814814814814815e-05,
+ "loss": 0.01835070736706257,
+ "step": 1123
+ },
+ {
+ "epoch": 5.678481012658228,
+ "grad_norm": 0.0284577663987875,
+ "learning_rate": 4.809203142536476e-05,
+ "loss": 0.019698038697242737,
+ "step": 1124
+ },
+ {
+ "epoch": 5.6835443037974684,
+ "grad_norm": 0.03136469051241875,
+ "learning_rate": 4.803591470258137e-05,
+ "loss": 0.018538501113653183,
+ "step": 1125
+ },
+ {
+ "epoch": 5.688607594936709,
+ "grad_norm": 0.042034219950437546,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.01609296351671219,
+ "step": 1126
+ },
+ {
+ "epoch": 5.6936708860759495,
+ "grad_norm": 0.04704117774963379,
+ "learning_rate": 4.792368125701459e-05,
+ "loss": 0.017442524433135986,
+ "step": 1127
+ },
+ {
+ "epoch": 5.69873417721519,
+ "grad_norm": 0.04261549562215805,
+ "learning_rate": 4.78675645342312e-05,
+ "loss": 0.022896092385053635,
+ "step": 1128
+ },
+ {
+ "epoch": 5.703797468354431,
+ "grad_norm": 0.035263415426015854,
+ "learning_rate": 4.7811447811447815e-05,
+ "loss": 0.02376401424407959,
+ "step": 1129
+ },
+ {
+ "epoch": 5.708860759493671,
+ "grad_norm": 0.029153654351830482,
+ "learning_rate": 4.7755331088664425e-05,
+ "loss": 0.019103601574897766,
+ "step": 1130
+ },
+ {
+ "epoch": 5.713924050632912,
+ "grad_norm": 0.024728860706090927,
+ "learning_rate": 4.7699214365881036e-05,
+ "loss": 0.019203007221221924,
+ "step": 1131
+ },
+ {
+ "epoch": 5.718987341772152,
+ "grad_norm": 0.0682872086763382,
+ "learning_rate": 4.7643097643097646e-05,
+ "loss": 0.023789528757333755,
+ "step": 1132
+ },
+ {
+ "epoch": 5.724050632911393,
+ "grad_norm": 0.03475257009267807,
+ "learning_rate": 4.7586980920314256e-05,
+ "loss": 0.01748424954712391,
+ "step": 1133
+ },
+ {
+ "epoch": 5.729113924050633,
+ "grad_norm": 0.03768116980791092,
+ "learning_rate": 4.7530864197530866e-05,
+ "loss": 0.019674118608236313,
+ "step": 1134
+ },
+ {
+ "epoch": 5.734177215189874,
+ "grad_norm": 0.06546973437070847,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.02400730922818184,
+ "step": 1135
+ },
+ {
+ "epoch": 5.739240506329114,
+ "grad_norm": 0.03348927944898605,
+ "learning_rate": 4.7418630751964086e-05,
+ "loss": 0.027110135182738304,
+ "step": 1136
+ },
+ {
+ "epoch": 5.744303797468355,
+ "grad_norm": 0.041038379073143005,
+ "learning_rate": 4.7362514029180696e-05,
+ "loss": 0.025943022221326828,
+ "step": 1137
+ },
+ {
+ "epoch": 5.749367088607595,
+ "grad_norm": 0.03094886802136898,
+ "learning_rate": 4.730639730639731e-05,
+ "loss": 0.018898673355579376,
+ "step": 1138
+ },
+ {
+ "epoch": 5.754430379746836,
+ "grad_norm": 0.03637633100152016,
+ "learning_rate": 4.725028058361392e-05,
+ "loss": 0.02247396484017372,
+ "step": 1139
+ },
+ {
+ "epoch": 5.759493670886076,
+ "grad_norm": 0.03672393038868904,
+ "learning_rate": 4.719416386083053e-05,
+ "loss": 0.02294430509209633,
+ "step": 1140
+ },
+ {
+ "epoch": 5.764556962025316,
+ "grad_norm": 0.03434748202562332,
+ "learning_rate": 4.713804713804714e-05,
+ "loss": 0.021498121321201324,
+ "step": 1141
+ },
+ {
+ "epoch": 5.769620253164557,
+ "grad_norm": 0.032241202890872955,
+ "learning_rate": 4.708193041526375e-05,
+ "loss": 0.02623910829424858,
+ "step": 1142
+ },
+ {
+ "epoch": 5.774683544303797,
+ "grad_norm": 0.028173472732305527,
+ "learning_rate": 4.702581369248036e-05,
+ "loss": 0.018390003591775894,
+ "step": 1143
+ },
+ {
+ "epoch": 5.779746835443038,
+ "grad_norm": 0.033768974244594574,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.022890064865350723,
+ "step": 1144
+ },
+ {
+ "epoch": 5.784810126582278,
+ "grad_norm": 0.03199310600757599,
+ "learning_rate": 4.691358024691358e-05,
+ "loss": 0.018634604290127754,
+ "step": 1145
+ },
+ {
+ "epoch": 5.789873417721519,
+ "grad_norm": 0.02942977100610733,
+ "learning_rate": 4.685746352413019e-05,
+ "loss": 0.021336350589990616,
+ "step": 1146
+ },
+ {
+ "epoch": 5.794936708860759,
+ "grad_norm": 0.026747260242700577,
+ "learning_rate": 4.68013468013468e-05,
+ "loss": 0.017634060233831406,
+ "step": 1147
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.052395813167095184,
+ "learning_rate": 4.6745230078563413e-05,
+ "loss": 0.019521519541740417,
+ "step": 1148
+ },
+ {
+ "epoch": 5.80506329113924,
+ "grad_norm": 0.07997749745845795,
+ "learning_rate": 4.6689113355780024e-05,
+ "loss": 0.027218502014875412,
+ "step": 1149
+ },
+ {
+ "epoch": 5.810126582278481,
+ "grad_norm": 0.04570790380239487,
+ "learning_rate": 4.6632996632996634e-05,
+ "loss": 0.027033157646656036,
+ "step": 1150
+ },
+ {
+ "epoch": 5.815189873417721,
+ "grad_norm": 0.05992640554904938,
+ "learning_rate": 4.6576879910213244e-05,
+ "loss": 0.020755816251039505,
+ "step": 1151
+ },
+ {
+ "epoch": 5.820253164556962,
+ "grad_norm": 0.03377217426896095,
+ "learning_rate": 4.6520763187429854e-05,
+ "loss": 0.019246265292167664,
+ "step": 1152
+ },
+ {
+ "epoch": 5.8253164556962025,
+ "grad_norm": 0.026675008237361908,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.019907813519239426,
+ "step": 1153
+ },
+ {
+ "epoch": 5.830379746835443,
+ "grad_norm": 0.04007306694984436,
+ "learning_rate": 4.6408529741863074e-05,
+ "loss": 0.02621765062212944,
+ "step": 1154
+ },
+ {
+ "epoch": 5.8354430379746836,
+ "grad_norm": 0.05345958471298218,
+ "learning_rate": 4.635241301907969e-05,
+ "loss": 0.021677743643522263,
+ "step": 1155
+ },
+ {
+ "epoch": 5.840506329113924,
+ "grad_norm": 0.03231236711144447,
+ "learning_rate": 4.62962962962963e-05,
+ "loss": 0.01898232102394104,
+ "step": 1156
+ },
+ {
+ "epoch": 5.845569620253165,
+ "grad_norm": 0.06332266330718994,
+ "learning_rate": 4.624017957351291e-05,
+ "loss": 0.022123044356703758,
+ "step": 1157
+ },
+ {
+ "epoch": 5.850632911392405,
+ "grad_norm": 0.017904918640851974,
+ "learning_rate": 4.618406285072952e-05,
+ "loss": 0.016008764505386353,
+ "step": 1158
+ },
+ {
+ "epoch": 5.855696202531646,
+ "grad_norm": 0.032957062125205994,
+ "learning_rate": 4.612794612794613e-05,
+ "loss": 0.026430988684296608,
+ "step": 1159
+ },
+ {
+ "epoch": 5.860759493670886,
+ "grad_norm": 0.02764013037085533,
+ "learning_rate": 4.607182940516274e-05,
+ "loss": 0.01749669760465622,
+ "step": 1160
+ },
+ {
+ "epoch": 5.865822784810127,
+ "grad_norm": 0.031616635620594025,
+ "learning_rate": 4.601571268237935e-05,
+ "loss": 0.022402513772249222,
+ "step": 1161
+ },
+ {
+ "epoch": 5.870886075949367,
+ "grad_norm": 0.026803012937307358,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.02391771227121353,
+ "step": 1162
+ },
+ {
+ "epoch": 5.875949367088608,
+ "grad_norm": 0.039992235600948334,
+ "learning_rate": 4.590347923681257e-05,
+ "loss": 0.0186441782861948,
+ "step": 1163
+ },
+ {
+ "epoch": 5.881012658227848,
+ "grad_norm": 0.034594062715768814,
+ "learning_rate": 4.584736251402919e-05,
+ "loss": 0.020437058061361313,
+ "step": 1164
+ },
+ {
+ "epoch": 5.886075949367089,
+ "grad_norm": 0.01877710409462452,
+ "learning_rate": 4.57912457912458e-05,
+ "loss": 0.01517703477293253,
+ "step": 1165
+ },
+ {
+ "epoch": 5.891139240506329,
+ "grad_norm": 0.021410809829831123,
+ "learning_rate": 4.573512906846241e-05,
+ "loss": 0.021264132112264633,
+ "step": 1166
+ },
+ {
+ "epoch": 5.89620253164557,
+ "grad_norm": 0.04017850384116173,
+ "learning_rate": 4.567901234567901e-05,
+ "loss": 0.024904146790504456,
+ "step": 1167
+ },
+ {
+ "epoch": 5.9012658227848105,
+ "grad_norm": 0.030386412516236305,
+ "learning_rate": 4.562289562289562e-05,
+ "loss": 0.02334582805633545,
+ "step": 1168
+ },
+ {
+ "epoch": 5.90632911392405,
+ "grad_norm": 0.043996457010507584,
+ "learning_rate": 4.556677890011223e-05,
+ "loss": 0.02326396480202675,
+ "step": 1169
+ },
+ {
+ "epoch": 5.911392405063291,
+ "grad_norm": 0.028154531493782997,
+ "learning_rate": 4.551066217732884e-05,
+ "loss": 0.019153760746121407,
+ "step": 1170
+ },
+ {
+ "epoch": 5.916455696202531,
+ "grad_norm": 0.02629070170223713,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.02149396575987339,
+ "step": 1171
+ },
+ {
+ "epoch": 5.921518987341772,
+ "grad_norm": 0.024712109938263893,
+ "learning_rate": 4.539842873176207e-05,
+ "loss": 0.01731209270656109,
+ "step": 1172
+ },
+ {
+ "epoch": 5.926582278481012,
+ "grad_norm": 0.027591124176979065,
+ "learning_rate": 4.534231200897868e-05,
+ "loss": 0.018549319356679916,
+ "step": 1173
+ },
+ {
+ "epoch": 5.931645569620253,
+ "grad_norm": 0.025680841878056526,
+ "learning_rate": 4.528619528619529e-05,
+ "loss": 0.019339032471179962,
+ "step": 1174
+ },
+ {
+ "epoch": 5.936708860759493,
+ "grad_norm": 0.0393349826335907,
+ "learning_rate": 4.52300785634119e-05,
+ "loss": 0.026176627725362778,
+ "step": 1175
+ },
+ {
+ "epoch": 5.941772151898734,
+ "grad_norm": 0.028960758820176125,
+ "learning_rate": 4.517396184062851e-05,
+ "loss": 0.020635023713111877,
+ "step": 1176
+ },
+ {
+ "epoch": 5.946835443037974,
+ "grad_norm": 0.038171909749507904,
+ "learning_rate": 4.511784511784512e-05,
+ "loss": 0.025552934035658836,
+ "step": 1177
+ },
+ {
+ "epoch": 5.951898734177215,
+ "grad_norm": 0.0229384396225214,
+ "learning_rate": 4.506172839506173e-05,
+ "loss": 0.016696415841579437,
+ "step": 1178
+ },
+ {
+ "epoch": 5.9569620253164555,
+ "grad_norm": 0.03247852623462677,
+ "learning_rate": 4.500561167227834e-05,
+ "loss": 0.020189210772514343,
+ "step": 1179
+ },
+ {
+ "epoch": 5.962025316455696,
+ "grad_norm": 0.09168937802314758,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.02350265346467495,
+ "step": 1180
+ },
+ {
+ "epoch": 5.9670886075949365,
+ "grad_norm": 0.0498431995511055,
+ "learning_rate": 4.4893378226711566e-05,
+ "loss": 0.025292757898569107,
+ "step": 1181
+ },
+ {
+ "epoch": 5.972151898734177,
+ "grad_norm": 0.027248093858361244,
+ "learning_rate": 4.4837261503928176e-05,
+ "loss": 0.022255534306168556,
+ "step": 1182
+ },
+ {
+ "epoch": 5.977215189873418,
+ "grad_norm": 0.0405442975461483,
+ "learning_rate": 4.4781144781144786e-05,
+ "loss": 0.029488639906048775,
+ "step": 1183
+ },
+ {
+ "epoch": 5.982278481012658,
+ "grad_norm": 0.032689113169908524,
+ "learning_rate": 4.4725028058361396e-05,
+ "loss": 0.02393949031829834,
+ "step": 1184
+ },
+ {
+ "epoch": 5.987341772151899,
+ "grad_norm": 0.0387105718255043,
+ "learning_rate": 4.4668911335578006e-05,
+ "loss": 0.02393876016139984,
+ "step": 1185
+ },
+ {
+ "epoch": 5.992405063291139,
+ "grad_norm": 0.03787006437778473,
+ "learning_rate": 4.4612794612794616e-05,
+ "loss": 0.019787393510341644,
+ "step": 1186
+ },
+ {
+ "epoch": 5.99746835443038,
+ "grad_norm": 0.07046152651309967,
+ "learning_rate": 4.4556677890011226e-05,
+ "loss": 0.02120082452893257,
+ "step": 1187
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.04410094395279884,
+ "learning_rate": 4.4500561167227837e-05,
+ "loss": 0.01791391335427761,
+ "step": 1188
+ },
+ {
+ "epoch": 6.0050632911392405,
+ "grad_norm": 0.01917901448905468,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.01695849373936653,
+ "step": 1189
+ },
+ {
+ "epoch": 6.010126582278481,
+ "grad_norm": 0.036047060042619705,
+ "learning_rate": 4.438832772166106e-05,
+ "loss": 0.019642764702439308,
+ "step": 1190
+ },
+ {
+ "epoch": 6.015189873417722,
+ "grad_norm": 0.03756589815020561,
+ "learning_rate": 4.433221099887767e-05,
+ "loss": 0.01982583850622177,
+ "step": 1191
+ },
+ {
+ "epoch": 6.020253164556962,
+ "grad_norm": 0.04311134293675423,
+ "learning_rate": 4.427609427609428e-05,
+ "loss": 0.020853077992796898,
+ "step": 1192
+ },
+ {
+ "epoch": 6.025316455696203,
+ "grad_norm": 0.03493127599358559,
+ "learning_rate": 4.421997755331089e-05,
+ "loss": 0.022622421383857727,
+ "step": 1193
+ },
+ {
+ "epoch": 6.030379746835443,
+ "grad_norm": 0.05356646701693535,
+ "learning_rate": 4.41638608305275e-05,
+ "loss": 0.029369797557592392,
+ "step": 1194
+ },
+ {
+ "epoch": 6.035443037974684,
+ "grad_norm": 0.024938970804214478,
+ "learning_rate": 4.410774410774411e-05,
+ "loss": 0.02220488339662552,
+ "step": 1195
+ },
+ {
+ "epoch": 6.040506329113924,
+ "grad_norm": 0.03809231147170067,
+ "learning_rate": 4.405162738496072e-05,
+ "loss": 0.018828250467777252,
+ "step": 1196
+ },
+ {
+ "epoch": 6.045569620253165,
+ "grad_norm": 0.026176417246460915,
+ "learning_rate": 4.3995510662177334e-05,
+ "loss": 0.020378272980451584,
+ "step": 1197
+ },
+ {
+ "epoch": 6.050632911392405,
+ "grad_norm": 0.022295907139778137,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.016497395932674408,
+ "step": 1198
+ },
+ {
+ "epoch": 6.055696202531646,
+ "grad_norm": 0.03591796010732651,
+ "learning_rate": 4.3883277216610554e-05,
+ "loss": 0.01610766164958477,
+ "step": 1199
+ },
+ {
+ "epoch": 6.060759493670886,
+ "grad_norm": 0.02228034846484661,
+ "learning_rate": 4.3827160493827164e-05,
+ "loss": 0.016445940360426903,
+ "step": 1200
+ },
+ {
+ "epoch": 6.065822784810127,
+ "grad_norm": 0.046840816736221313,
+ "learning_rate": 4.3771043771043774e-05,
+ "loss": 0.025499895215034485,
+ "step": 1201
+ },
+ {
+ "epoch": 6.0708860759493675,
+ "grad_norm": 0.032549306750297546,
+ "learning_rate": 4.3714927048260384e-05,
+ "loss": 0.019290868192911148,
+ "step": 1202
+ },
+ {
+ "epoch": 6.075949367088608,
+ "grad_norm": 0.027548272162675858,
+ "learning_rate": 4.3658810325476994e-05,
+ "loss": 0.021467119455337524,
+ "step": 1203
+ },
+ {
+ "epoch": 6.0810126582278485,
+ "grad_norm": 0.04975379258394241,
+ "learning_rate": 4.3602693602693604e-05,
+ "loss": 0.025195952504873276,
+ "step": 1204
+ },
+ {
+ "epoch": 6.086075949367088,
+ "grad_norm": 0.033716000616550446,
+ "learning_rate": 4.3546576879910214e-05,
+ "loss": 0.022922039031982422,
+ "step": 1205
+ },
+ {
+ "epoch": 6.091139240506329,
+ "grad_norm": 0.0233322661370039,
+ "learning_rate": 4.3490460157126825e-05,
+ "loss": 0.016717061400413513,
+ "step": 1206
+ },
+ {
+ "epoch": 6.096202531645569,
+ "grad_norm": 0.037477824836969376,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.026978954672813416,
+ "step": 1207
+ },
+ {
+ "epoch": 6.10126582278481,
+ "grad_norm": 0.028440799564123154,
+ "learning_rate": 4.337822671156005e-05,
+ "loss": 0.02273373492062092,
+ "step": 1208
+ },
+ {
+ "epoch": 6.10632911392405,
+ "grad_norm": 0.035822827368974686,
+ "learning_rate": 4.332210998877666e-05,
+ "loss": 0.023257501423358917,
+ "step": 1209
+ },
+ {
+ "epoch": 6.111392405063291,
+ "grad_norm": 0.04019193351268768,
+ "learning_rate": 4.3265993265993265e-05,
+ "loss": 0.023539364337921143,
+ "step": 1210
+ },
+ {
+ "epoch": 6.116455696202531,
+ "grad_norm": 0.05412938818335533,
+ "learning_rate": 4.3209876543209875e-05,
+ "loss": 0.027814611792564392,
+ "step": 1211
+ },
+ {
+ "epoch": 6.121518987341772,
+ "grad_norm": 0.02482062578201294,
+ "learning_rate": 4.3153759820426485e-05,
+ "loss": 0.02218860387802124,
+ "step": 1212
+ },
+ {
+ "epoch": 6.1265822784810124,
+ "grad_norm": 0.0334421806037426,
+ "learning_rate": 4.3097643097643095e-05,
+ "loss": 0.017350582405924797,
+ "step": 1213
+ },
+ {
+ "epoch": 6.131645569620253,
+ "grad_norm": 0.056203264743089676,
+ "learning_rate": 4.304152637485971e-05,
+ "loss": 0.02287295088171959,
+ "step": 1214
+ },
+ {
+ "epoch": 6.1367088607594935,
+ "grad_norm": 0.039818573743104935,
+ "learning_rate": 4.298540965207632e-05,
+ "loss": 0.020514609292149544,
+ "step": 1215
+ },
+ {
+ "epoch": 6.141772151898734,
+ "grad_norm": 0.04640622064471245,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.024438779801130295,
+ "step": 1216
+ },
+ {
+ "epoch": 6.146835443037975,
+ "grad_norm": 0.029660161584615707,
+ "learning_rate": 4.287317620650954e-05,
+ "loss": 0.02020389772951603,
+ "step": 1217
+ },
+ {
+ "epoch": 6.151898734177215,
+ "grad_norm": 0.03027571365237236,
+ "learning_rate": 4.281705948372615e-05,
+ "loss": 0.020769162103533745,
+ "step": 1218
+ },
+ {
+ "epoch": 6.156962025316456,
+ "grad_norm": 0.03282143920660019,
+ "learning_rate": 4.276094276094276e-05,
+ "loss": 0.02164040133357048,
+ "step": 1219
+ },
+ {
+ "epoch": 6.162025316455696,
+ "grad_norm": 0.025130681693553925,
+ "learning_rate": 4.270482603815937e-05,
+ "loss": 0.01677907630801201,
+ "step": 1220
+ },
+ {
+ "epoch": 6.167088607594937,
+ "grad_norm": 0.031690534204244614,
+ "learning_rate": 4.264870931537598e-05,
+ "loss": 0.024241283535957336,
+ "step": 1221
+ },
+ {
+ "epoch": 6.172151898734177,
+ "grad_norm": 0.03872871398925781,
+ "learning_rate": 4.259259259259259e-05,
+ "loss": 0.021466728299856186,
+ "step": 1222
+ },
+ {
+ "epoch": 6.177215189873418,
+ "grad_norm": 0.025186678394675255,
+ "learning_rate": 4.253647586980921e-05,
+ "loss": 0.01849488914012909,
+ "step": 1223
+ },
+ {
+ "epoch": 6.182278481012658,
+ "grad_norm": 0.0362236425280571,
+ "learning_rate": 4.248035914702582e-05,
+ "loss": 0.023382779210805893,
+ "step": 1224
+ },
+ {
+ "epoch": 6.187341772151899,
+ "grad_norm": 0.03484080359339714,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.02402529865503311,
+ "step": 1225
+ },
+ {
+ "epoch": 6.192405063291139,
+ "grad_norm": 0.030236870050430298,
+ "learning_rate": 4.236812570145904e-05,
+ "loss": 0.02027088962495327,
+ "step": 1226
+ },
+ {
+ "epoch": 6.19746835443038,
+ "grad_norm": 0.042696740478277206,
+ "learning_rate": 4.231200897867565e-05,
+ "loss": 0.026293184608221054,
+ "step": 1227
+ },
+ {
+ "epoch": 6.2025316455696204,
+ "grad_norm": 0.033474963158369064,
+ "learning_rate": 4.225589225589226e-05,
+ "loss": 0.0192638598382473,
+ "step": 1228
+ },
+ {
+ "epoch": 6.207594936708861,
+ "grad_norm": 0.02278994210064411,
+ "learning_rate": 4.219977553310887e-05,
+ "loss": 0.016719598323106766,
+ "step": 1229
+ },
+ {
+ "epoch": 6.2126582278481015,
+ "grad_norm": 0.02794811874628067,
+ "learning_rate": 4.214365881032548e-05,
+ "loss": 0.02083922177553177,
+ "step": 1230
+ },
+ {
+ "epoch": 6.217721518987342,
+ "grad_norm": 0.036294132471084595,
+ "learning_rate": 4.208754208754209e-05,
+ "loss": 0.019131788983941078,
+ "step": 1231
+ },
+ {
+ "epoch": 6.222784810126583,
+ "grad_norm": 0.04194558039307594,
+ "learning_rate": 4.20314253647587e-05,
+ "loss": 0.02200900763273239,
+ "step": 1232
+ },
+ {
+ "epoch": 6.227848101265823,
+ "grad_norm": 0.031245706602931023,
+ "learning_rate": 4.197530864197531e-05,
+ "loss": 0.020135007798671722,
+ "step": 1233
+ },
+ {
+ "epoch": 6.232911392405064,
+ "grad_norm": 0.28146594762802124,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.028484351933002472,
+ "step": 1234
+ },
+ {
+ "epoch": 6.237974683544304,
+ "grad_norm": 0.03472084552049637,
+ "learning_rate": 4.186307519640853e-05,
+ "loss": 0.022836994379758835,
+ "step": 1235
+ },
+ {
+ "epoch": 6.243037974683545,
+ "grad_norm": 0.03993033990263939,
+ "learning_rate": 4.180695847362514e-05,
+ "loss": 0.02047956921160221,
+ "step": 1236
+ },
+ {
+ "epoch": 6.248101265822784,
+ "grad_norm": 0.04095892980694771,
+ "learning_rate": 4.175084175084175e-05,
+ "loss": 0.02556988038122654,
+ "step": 1237
+ },
+ {
+ "epoch": 6.253164556962025,
+ "grad_norm": 0.025003930553793907,
+ "learning_rate": 4.169472502805836e-05,
+ "loss": 0.02012123167514801,
+ "step": 1238
+ },
+ {
+ "epoch": 6.258227848101265,
+ "grad_norm": 0.13136205077171326,
+ "learning_rate": 4.163860830527497e-05,
+ "loss": 0.02262711711227894,
+ "step": 1239
+ },
+ {
+ "epoch": 6.263291139240506,
+ "grad_norm": 0.030299177393317223,
+ "learning_rate": 4.158249158249159e-05,
+ "loss": 0.02208639681339264,
+ "step": 1240
+ },
+ {
+ "epoch": 6.2683544303797465,
+ "grad_norm": 0.029313303530216217,
+ "learning_rate": 4.15263748597082e-05,
+ "loss": 0.01897791400551796,
+ "step": 1241
+ },
+ {
+ "epoch": 6.273417721518987,
+ "grad_norm": 0.02532120980322361,
+ "learning_rate": 4.147025813692481e-05,
+ "loss": 0.017832642421126366,
+ "step": 1242
+ },
+ {
+ "epoch": 6.2784810126582276,
+ "grad_norm": 0.03251331299543381,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.018247608095407486,
+ "step": 1243
+ },
+ {
+ "epoch": 6.283544303797468,
+ "grad_norm": 0.022575413808226585,
+ "learning_rate": 4.135802469135803e-05,
+ "loss": 0.018954705446958542,
+ "step": 1244
+ },
+ {
+ "epoch": 6.288607594936709,
+ "grad_norm": 0.039219100028276443,
+ "learning_rate": 4.130190796857464e-05,
+ "loss": 0.024930771440267563,
+ "step": 1245
+ },
+ {
+ "epoch": 6.293670886075949,
+ "grad_norm": 0.0373169481754303,
+ "learning_rate": 4.124579124579125e-05,
+ "loss": 0.01826397515833378,
+ "step": 1246
+ },
+ {
+ "epoch": 6.29873417721519,
+ "grad_norm": 0.027518540620803833,
+ "learning_rate": 4.118967452300786e-05,
+ "loss": 0.019876884296536446,
+ "step": 1247
+ },
+ {
+ "epoch": 6.30379746835443,
+ "grad_norm": 0.0396210178732872,
+ "learning_rate": 4.113355780022447e-05,
+ "loss": 0.025219090282917023,
+ "step": 1248
+ },
+ {
+ "epoch": 6.308860759493671,
+ "grad_norm": 0.08618787676095963,
+ "learning_rate": 4.1077441077441085e-05,
+ "loss": 0.023020410910248756,
+ "step": 1249
+ },
+ {
+ "epoch": 6.313924050632911,
+ "grad_norm": 0.029861560091376305,
+ "learning_rate": 4.1021324354657695e-05,
+ "loss": 0.017338024452328682,
+ "step": 1250
+ },
+ {
+ "epoch": 6.318987341772152,
+ "grad_norm": 0.02950313501060009,
+ "learning_rate": 4.0965207631874305e-05,
+ "loss": 0.02082744613289833,
+ "step": 1251
+ },
+ {
+ "epoch": 6.324050632911392,
+ "grad_norm": 0.04144814610481262,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.022624965757131577,
+ "step": 1252
+ },
+ {
+ "epoch": 6.329113924050633,
+ "grad_norm": 0.026044249534606934,
+ "learning_rate": 4.085297418630752e-05,
+ "loss": 0.021008584648370743,
+ "step": 1253
+ },
+ {
+ "epoch": 6.334177215189873,
+ "grad_norm": 0.022971170023083687,
+ "learning_rate": 4.079685746352413e-05,
+ "loss": 0.017941180616617203,
+ "step": 1254
+ },
+ {
+ "epoch": 6.339240506329114,
+ "grad_norm": 0.06906288862228394,
+ "learning_rate": 4.074074074074074e-05,
+ "loss": 0.028001971542835236,
+ "step": 1255
+ },
+ {
+ "epoch": 6.3443037974683545,
+ "grad_norm": 0.023604001849889755,
+ "learning_rate": 4.068462401795735e-05,
+ "loss": 0.01718234084546566,
+ "step": 1256
+ },
+ {
+ "epoch": 6.349367088607595,
+ "grad_norm": 0.01937725767493248,
+ "learning_rate": 4.0628507295173965e-05,
+ "loss": 0.014251970686018467,
+ "step": 1257
+ },
+ {
+ "epoch": 6.3544303797468356,
+ "grad_norm": 0.029861370101571083,
+ "learning_rate": 4.0572390572390575e-05,
+ "loss": 0.020723488181829453,
+ "step": 1258
+ },
+ {
+ "epoch": 6.359493670886076,
+ "grad_norm": 0.021436452865600586,
+ "learning_rate": 4.0516273849607185e-05,
+ "loss": 0.017737478017807007,
+ "step": 1259
+ },
+ {
+ "epoch": 6.364556962025317,
+ "grad_norm": 0.028320396319031715,
+ "learning_rate": 4.0460157126823795e-05,
+ "loss": 0.018616296350955963,
+ "step": 1260
+ },
+ {
+ "epoch": 6.369620253164557,
+ "grad_norm": 0.06868637353181839,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.021761005744338036,
+ "step": 1261
+ },
+ {
+ "epoch": 6.374683544303798,
+ "grad_norm": 0.051593340933322906,
+ "learning_rate": 4.0347923681257015e-05,
+ "loss": 0.024777185171842575,
+ "step": 1262
+ },
+ {
+ "epoch": 6.379746835443038,
+ "grad_norm": 0.03426795080304146,
+ "learning_rate": 4.0291806958473625e-05,
+ "loss": 0.018097344785928726,
+ "step": 1263
+ },
+ {
+ "epoch": 6.384810126582279,
+ "grad_norm": 0.029523326084017754,
+ "learning_rate": 4.0235690235690236e-05,
+ "loss": 0.021459240466356277,
+ "step": 1264
+ },
+ {
+ "epoch": 6.389873417721519,
+ "grad_norm": 0.0349370501935482,
+ "learning_rate": 4.0179573512906846e-05,
+ "loss": 0.02003314346075058,
+ "step": 1265
+ },
+ {
+ "epoch": 6.39493670886076,
+ "grad_norm": 0.03242987021803856,
+ "learning_rate": 4.012345679012346e-05,
+ "loss": 0.021367881447076797,
+ "step": 1266
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.024630239233374596,
+ "learning_rate": 4.006734006734007e-05,
+ "loss": 0.018102720379829407,
+ "step": 1267
+ },
+ {
+ "epoch": 6.405063291139241,
+ "grad_norm": 0.031077086925506592,
+ "learning_rate": 4.001122334455668e-05,
+ "loss": 0.018588688224554062,
+ "step": 1268
+ },
+ {
+ "epoch": 6.410126582278481,
+ "grad_norm": 0.027421677485108376,
+ "learning_rate": 3.995510662177329e-05,
+ "loss": 0.02185939997434616,
+ "step": 1269
+ },
+ {
+ "epoch": 6.415189873417722,
+ "grad_norm": 0.025877851992845535,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.014880839735269547,
+ "step": 1270
+ },
+ {
+ "epoch": 6.4202531645569625,
+ "grad_norm": 0.06078079342842102,
+ "learning_rate": 3.984287317620651e-05,
+ "loss": 0.020707489922642708,
+ "step": 1271
+ },
+ {
+ "epoch": 6.425316455696202,
+ "grad_norm": 0.037427812814712524,
+ "learning_rate": 3.978675645342312e-05,
+ "loss": 0.019588246941566467,
+ "step": 1272
+ },
+ {
+ "epoch": 6.430379746835443,
+ "grad_norm": 0.021001679822802544,
+ "learning_rate": 3.973063973063973e-05,
+ "loss": 0.01820206455886364,
+ "step": 1273
+ },
+ {
+ "epoch": 6.435443037974683,
+ "grad_norm": 0.05302223563194275,
+ "learning_rate": 3.967452300785634e-05,
+ "loss": 0.028976645320653915,
+ "step": 1274
+ },
+ {
+ "epoch": 6.440506329113924,
+ "grad_norm": 0.021593907848000526,
+ "learning_rate": 3.961840628507295e-05,
+ "loss": 0.018273863941431046,
+ "step": 1275
+ },
+ {
+ "epoch": 6.445569620253164,
+ "grad_norm": 0.05006744712591171,
+ "learning_rate": 3.956228956228956e-05,
+ "loss": 0.020786389708518982,
+ "step": 1276
+ },
+ {
+ "epoch": 6.450632911392405,
+ "grad_norm": 0.025030262768268585,
+ "learning_rate": 3.950617283950617e-05,
+ "loss": 0.017760692164301872,
+ "step": 1277
+ },
+ {
+ "epoch": 6.455696202531645,
+ "grad_norm": 0.04701874032616615,
+ "learning_rate": 3.945005611672278e-05,
+ "loss": 0.029284045100212097,
+ "step": 1278
+ },
+ {
+ "epoch": 6.460759493670886,
+ "grad_norm": 0.032726943492889404,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.02018846571445465,
+ "step": 1279
+ },
+ {
+ "epoch": 6.465822784810126,
+ "grad_norm": 0.039836980402469635,
+ "learning_rate": 3.9337822671156003e-05,
+ "loss": 0.01897161826491356,
+ "step": 1280
+ },
+ {
+ "epoch": 6.470886075949367,
+ "grad_norm": 0.033106207847595215,
+ "learning_rate": 3.9281705948372613e-05,
+ "loss": 0.01981613039970398,
+ "step": 1281
+ },
+ {
+ "epoch": 6.4759493670886075,
+ "grad_norm": 0.024439049884676933,
+ "learning_rate": 3.9225589225589224e-05,
+ "loss": 0.018410254269838333,
+ "step": 1282
+ },
+ {
+ "epoch": 6.481012658227848,
+ "grad_norm": 0.025965489447116852,
+ "learning_rate": 3.916947250280584e-05,
+ "loss": 0.02004053071141243,
+ "step": 1283
+ },
+ {
+ "epoch": 6.4860759493670885,
+ "grad_norm": 0.02710670977830887,
+ "learning_rate": 3.911335578002245e-05,
+ "loss": 0.022794827818870544,
+ "step": 1284
+ },
+ {
+ "epoch": 6.491139240506329,
+ "grad_norm": 0.04063912108540535,
+ "learning_rate": 3.905723905723906e-05,
+ "loss": 0.022095832973718643,
+ "step": 1285
+ },
+ {
+ "epoch": 6.49620253164557,
+ "grad_norm": 0.02844894304871559,
+ "learning_rate": 3.900112233445567e-05,
+ "loss": 0.02208099141716957,
+ "step": 1286
+ },
+ {
+ "epoch": 6.50126582278481,
+ "grad_norm": 0.042183391749858856,
+ "learning_rate": 3.894500561167228e-05,
+ "loss": 0.022891748696565628,
+ "step": 1287
+ },
+ {
+ "epoch": 6.506329113924051,
+ "grad_norm": 0.03206615149974823,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.01791396550834179,
+ "step": 1288
+ },
+ {
+ "epoch": 6.511392405063291,
+ "grad_norm": 0.20604346692562103,
+ "learning_rate": 3.88327721661055e-05,
+ "loss": 0.021381299942731857,
+ "step": 1289
+ },
+ {
+ "epoch": 6.516455696202532,
+ "grad_norm": 0.040892940014600754,
+ "learning_rate": 3.877665544332211e-05,
+ "loss": 0.027452345937490463,
+ "step": 1290
+ },
+ {
+ "epoch": 6.521518987341772,
+ "grad_norm": 0.036108002066612244,
+ "learning_rate": 3.872053872053872e-05,
+ "loss": 0.02328622341156006,
+ "step": 1291
+ },
+ {
+ "epoch": 6.526582278481013,
+ "grad_norm": 0.0261856522411108,
+ "learning_rate": 3.866442199775534e-05,
+ "loss": 0.019690997898578644,
+ "step": 1292
+ },
+ {
+ "epoch": 6.531645569620253,
+ "grad_norm": 0.03961426392197609,
+ "learning_rate": 3.860830527497195e-05,
+ "loss": 0.0222979336977005,
+ "step": 1293
+ },
+ {
+ "epoch": 6.536708860759494,
+ "grad_norm": 0.04051761329174042,
+ "learning_rate": 3.855218855218856e-05,
+ "loss": 0.025474993512034416,
+ "step": 1294
+ },
+ {
+ "epoch": 6.541772151898734,
+ "grad_norm": 0.02267736941576004,
+ "learning_rate": 3.849607182940517e-05,
+ "loss": 0.022006051614880562,
+ "step": 1295
+ },
+ {
+ "epoch": 6.546835443037975,
+ "grad_norm": 0.030732441693544388,
+ "learning_rate": 3.843995510662178e-05,
+ "loss": 0.019268793985247612,
+ "step": 1296
+ },
+ {
+ "epoch": 6.5518987341772155,
+ "grad_norm": 0.028448719531297684,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.022158455103635788,
+ "step": 1297
+ },
+ {
+ "epoch": 6.556962025316456,
+ "grad_norm": 0.03139292076230049,
+ "learning_rate": 3.832772166105499e-05,
+ "loss": 0.022079430520534515,
+ "step": 1298
+ },
+ {
+ "epoch": 6.5620253164556965,
+ "grad_norm": 0.031093589961528778,
+ "learning_rate": 3.82716049382716e-05,
+ "loss": 0.018232567235827446,
+ "step": 1299
+ },
+ {
+ "epoch": 6.567088607594937,
+ "grad_norm": 0.05002875253558159,
+ "learning_rate": 3.821548821548822e-05,
+ "loss": 0.025977667421102524,
+ "step": 1300
+ },
+ {
+ "epoch": 6.572151898734178,
+ "grad_norm": 0.022760825231671333,
+ "learning_rate": 3.815937149270483e-05,
+ "loss": 0.01952279731631279,
+ "step": 1301
+ },
+ {
+ "epoch": 6.577215189873417,
+ "grad_norm": 0.038710758090019226,
+ "learning_rate": 3.810325476992144e-05,
+ "loss": 0.018337469547986984,
+ "step": 1302
+ },
+ {
+ "epoch": 6.582278481012658,
+ "grad_norm": 0.03606388345360756,
+ "learning_rate": 3.804713804713805e-05,
+ "loss": 0.022117454558610916,
+ "step": 1303
+ },
+ {
+ "epoch": 6.587341772151898,
+ "grad_norm": 0.0337548591196537,
+ "learning_rate": 3.799102132435466e-05,
+ "loss": 0.021384209394454956,
+ "step": 1304
+ },
+ {
+ "epoch": 6.592405063291139,
+ "grad_norm": 0.03523571416735649,
+ "learning_rate": 3.793490460157127e-05,
+ "loss": 0.017840903252363205,
+ "step": 1305
+ },
+ {
+ "epoch": 6.597468354430379,
+ "grad_norm": 0.06067586690187454,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.024789758026599884,
+ "step": 1306
+ },
+ {
+ "epoch": 6.60253164556962,
+ "grad_norm": 0.03350597992539406,
+ "learning_rate": 3.782267115600449e-05,
+ "loss": 0.02044159173965454,
+ "step": 1307
+ },
+ {
+ "epoch": 6.6075949367088604,
+ "grad_norm": 0.027923524379730225,
+ "learning_rate": 3.77665544332211e-05,
+ "loss": 0.016555916517972946,
+ "step": 1308
+ },
+ {
+ "epoch": 6.612658227848101,
+ "grad_norm": 0.049295879900455475,
+ "learning_rate": 3.7710437710437716e-05,
+ "loss": 0.02809835597872734,
+ "step": 1309
+ },
+ {
+ "epoch": 6.6177215189873415,
+ "grad_norm": 0.0679546371102333,
+ "learning_rate": 3.7654320987654326e-05,
+ "loss": 0.02421809732913971,
+ "step": 1310
+ },
+ {
+ "epoch": 6.622784810126582,
+ "grad_norm": 0.027567917481064796,
+ "learning_rate": 3.7598204264870936e-05,
+ "loss": 0.020084332674741745,
+ "step": 1311
+ },
+ {
+ "epoch": 6.627848101265823,
+ "grad_norm": 0.04364616423845291,
+ "learning_rate": 3.7542087542087546e-05,
+ "loss": 0.024303186684846878,
+ "step": 1312
+ },
+ {
+ "epoch": 6.632911392405063,
+ "grad_norm": 0.060693949460983276,
+ "learning_rate": 3.7485970819304156e-05,
+ "loss": 0.022462837398052216,
+ "step": 1313
+ },
+ {
+ "epoch": 6.637974683544304,
+ "grad_norm": 0.05344981327652931,
+ "learning_rate": 3.7429854096520766e-05,
+ "loss": 0.02119705080986023,
+ "step": 1314
+ },
+ {
+ "epoch": 6.643037974683544,
+ "grad_norm": 0.04188868775963783,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.02262813225388527,
+ "step": 1315
+ },
+ {
+ "epoch": 6.648101265822785,
+ "grad_norm": 0.10617388039827347,
+ "learning_rate": 3.7317620650953986e-05,
+ "loss": 0.028262268751859665,
+ "step": 1316
+ },
+ {
+ "epoch": 6.653164556962025,
+ "grad_norm": 0.028918985277414322,
+ "learning_rate": 3.7261503928170596e-05,
+ "loss": 0.018603652715682983,
+ "step": 1317
+ },
+ {
+ "epoch": 6.658227848101266,
+ "grad_norm": 0.037515874952077866,
+ "learning_rate": 3.720538720538721e-05,
+ "loss": 0.024647820740938187,
+ "step": 1318
+ },
+ {
+ "epoch": 6.663291139240506,
+ "grad_norm": 0.0347459651529789,
+ "learning_rate": 3.7149270482603816e-05,
+ "loss": 0.024235039949417114,
+ "step": 1319
+ },
+ {
+ "epoch": 6.668354430379747,
+ "grad_norm": 0.04326598346233368,
+ "learning_rate": 3.7093153759820426e-05,
+ "loss": 0.02030426263809204,
+ "step": 1320
+ },
+ {
+ "epoch": 6.673417721518987,
+ "grad_norm": 0.026792412623763084,
+ "learning_rate": 3.7037037037037037e-05,
+ "loss": 0.02184079959988594,
+ "step": 1321
+ },
+ {
+ "epoch": 6.678481012658228,
+ "grad_norm": 0.033112917095422745,
+ "learning_rate": 3.698092031425365e-05,
+ "loss": 0.019945142790675163,
+ "step": 1322
+ },
+ {
+ "epoch": 6.6835443037974684,
+ "grad_norm": 0.031808555126190186,
+ "learning_rate": 3.692480359147026e-05,
+ "loss": 0.024434339255094528,
+ "step": 1323
+ },
+ {
+ "epoch": 6.688607594936709,
+ "grad_norm": 0.03284522145986557,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.017459489405155182,
+ "step": 1324
+ },
+ {
+ "epoch": 6.6936708860759495,
+ "grad_norm": 0.029303887858986855,
+ "learning_rate": 3.681257014590348e-05,
+ "loss": 0.017790818586945534,
+ "step": 1325
+ },
+ {
+ "epoch": 6.69873417721519,
+ "grad_norm": 0.028168147429823875,
+ "learning_rate": 3.6756453423120094e-05,
+ "loss": 0.022105036303400993,
+ "step": 1326
+ },
+ {
+ "epoch": 6.703797468354431,
+ "grad_norm": 0.045645441859960556,
+ "learning_rate": 3.6700336700336704e-05,
+ "loss": 0.0288691483438015,
+ "step": 1327
+ },
+ {
+ "epoch": 6.708860759493671,
+ "grad_norm": 0.02225707843899727,
+ "learning_rate": 3.6644219977553314e-05,
+ "loss": 0.016150090843439102,
+ "step": 1328
+ },
+ {
+ "epoch": 6.713924050632912,
+ "grad_norm": 0.02501208707690239,
+ "learning_rate": 3.6588103254769924e-05,
+ "loss": 0.023236583918333054,
+ "step": 1329
+ },
+ {
+ "epoch": 6.718987341772152,
+ "grad_norm": 0.038911011070013046,
+ "learning_rate": 3.6531986531986534e-05,
+ "loss": 0.025721289217472076,
+ "step": 1330
+ },
+ {
+ "epoch": 6.724050632911393,
+ "grad_norm": 0.036257173866033554,
+ "learning_rate": 3.6475869809203144e-05,
+ "loss": 0.025515632703900337,
+ "step": 1331
+ },
+ {
+ "epoch": 6.729113924050633,
+ "grad_norm": 0.03473728895187378,
+ "learning_rate": 3.6419753086419754e-05,
+ "loss": 0.02300131320953369,
+ "step": 1332
+ },
+ {
+ "epoch": 6.734177215189874,
+ "grad_norm": 0.03154155611991882,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.024625634774565697,
+ "step": 1333
+ },
+ {
+ "epoch": 6.739240506329114,
+ "grad_norm": 0.04241670295596123,
+ "learning_rate": 3.6307519640852974e-05,
+ "loss": 0.021008290350437164,
+ "step": 1334
+ },
+ {
+ "epoch": 6.744303797468355,
+ "grad_norm": 0.027151785790920258,
+ "learning_rate": 3.625140291806959e-05,
+ "loss": 0.021018799394369125,
+ "step": 1335
+ },
+ {
+ "epoch": 6.749367088607595,
+ "grad_norm": 0.026534251868724823,
+ "learning_rate": 3.61952861952862e-05,
+ "loss": 0.018448853865265846,
+ "step": 1336
+ },
+ {
+ "epoch": 6.754430379746836,
+ "grad_norm": 0.02729695476591587,
+ "learning_rate": 3.613916947250281e-05,
+ "loss": 0.022980306297540665,
+ "step": 1337
+ },
+ {
+ "epoch": 6.759493670886076,
+ "grad_norm": 0.023642007261514664,
+ "learning_rate": 3.608305274971942e-05,
+ "loss": 0.019568361341953278,
+ "step": 1338
+ },
+ {
+ "epoch": 6.764556962025316,
+ "grad_norm": 0.03455951064825058,
+ "learning_rate": 3.602693602693603e-05,
+ "loss": 0.019078724086284637,
+ "step": 1339
+ },
+ {
+ "epoch": 6.769620253164557,
+ "grad_norm": 0.02380317822098732,
+ "learning_rate": 3.5970819304152635e-05,
+ "loss": 0.01807081699371338,
+ "step": 1340
+ },
+ {
+ "epoch": 6.774683544303797,
+ "grad_norm": 0.0337495282292366,
+ "learning_rate": 3.5914702581369245e-05,
+ "loss": 0.019128164276480675,
+ "step": 1341
+ },
+ {
+ "epoch": 6.779746835443038,
+ "grad_norm": 0.041405126452445984,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.017617477104067802,
+ "step": 1342
+ },
+ {
+ "epoch": 6.784810126582278,
+ "grad_norm": 0.028542209416627884,
+ "learning_rate": 3.580246913580247e-05,
+ "loss": 0.01781628280878067,
+ "step": 1343
+ },
+ {
+ "epoch": 6.789873417721519,
+ "grad_norm": 0.038718484342098236,
+ "learning_rate": 3.574635241301908e-05,
+ "loss": 0.025421444326639175,
+ "step": 1344
+ },
+ {
+ "epoch": 6.794936708860759,
+ "grad_norm": 0.03298761323094368,
+ "learning_rate": 3.569023569023569e-05,
+ "loss": 0.01900479383766651,
+ "step": 1345
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.024823278188705444,
+ "learning_rate": 3.56341189674523e-05,
+ "loss": 0.021245522424578667,
+ "step": 1346
+ },
+ {
+ "epoch": 6.80506329113924,
+ "grad_norm": 0.0321645587682724,
+ "learning_rate": 3.557800224466891e-05,
+ "loss": 0.01712404564023018,
+ "step": 1347
+ },
+ {
+ "epoch": 6.810126582278481,
+ "grad_norm": 0.03605357185006142,
+ "learning_rate": 3.552188552188552e-05,
+ "loss": 0.02691786363720894,
+ "step": 1348
+ },
+ {
+ "epoch": 6.815189873417721,
+ "grad_norm": 0.03685377910733223,
+ "learning_rate": 3.546576879910213e-05,
+ "loss": 0.02375425398349762,
+ "step": 1349
+ },
+ {
+ "epoch": 6.820253164556962,
+ "grad_norm": 0.022712258622050285,
+ "learning_rate": 3.540965207631874e-05,
+ "loss": 0.016492441296577454,
+ "step": 1350
+ },
+ {
+ "epoch": 6.8253164556962025,
+ "grad_norm": 0.027446497231721878,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.019083943217992783,
+ "step": 1351
+ },
+ {
+ "epoch": 6.830379746835443,
+ "grad_norm": 0.060375552624464035,
+ "learning_rate": 3.529741863075197e-05,
+ "loss": 0.021610641852021217,
+ "step": 1352
+ },
+ {
+ "epoch": 6.8354430379746836,
+ "grad_norm": 0.026175983250141144,
+ "learning_rate": 3.524130190796858e-05,
+ "loss": 0.02164904959499836,
+ "step": 1353
+ },
+ {
+ "epoch": 6.840506329113924,
+ "grad_norm": 0.04348548501729965,
+ "learning_rate": 3.518518518518519e-05,
+ "loss": 0.02257148176431656,
+ "step": 1354
+ },
+ {
+ "epoch": 6.845569620253165,
+ "grad_norm": 0.051051557064056396,
+ "learning_rate": 3.51290684624018e-05,
+ "loss": 0.027986399829387665,
+ "step": 1355
+ },
+ {
+ "epoch": 6.850632911392405,
+ "grad_norm": 0.02255374938249588,
+ "learning_rate": 3.507295173961841e-05,
+ "loss": 0.017260409891605377,
+ "step": 1356
+ },
+ {
+ "epoch": 6.855696202531646,
+ "grad_norm": 0.053478825837373734,
+ "learning_rate": 3.501683501683502e-05,
+ "loss": 0.025036044418811798,
+ "step": 1357
+ },
+ {
+ "epoch": 6.860759493670886,
+ "grad_norm": 0.03688240423798561,
+ "learning_rate": 3.496071829405163e-05,
+ "loss": 0.0243881456553936,
+ "step": 1358
+ },
+ {
+ "epoch": 6.865822784810127,
+ "grad_norm": 0.03860153257846832,
+ "learning_rate": 3.490460157126824e-05,
+ "loss": 0.018570398911833763,
+ "step": 1359
+ },
+ {
+ "epoch": 6.870886075949367,
+ "grad_norm": 0.02771756984293461,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.022013407200574875,
+ "step": 1360
+ },
+ {
+ "epoch": 6.875949367088608,
+ "grad_norm": 0.03359522670507431,
+ "learning_rate": 3.4792368125701466e-05,
+ "loss": 0.024430446326732635,
+ "step": 1361
+ },
+ {
+ "epoch": 6.881012658227848,
+ "grad_norm": 0.028827447444200516,
+ "learning_rate": 3.473625140291807e-05,
+ "loss": 0.018073707818984985,
+ "step": 1362
+ },
+ {
+ "epoch": 6.886075949367089,
+ "grad_norm": 0.03537776693701744,
+ "learning_rate": 3.468013468013468e-05,
+ "loss": 0.022164030000567436,
+ "step": 1363
+ },
+ {
+ "epoch": 6.891139240506329,
+ "grad_norm": 0.029529782012104988,
+ "learning_rate": 3.462401795735129e-05,
+ "loss": 0.02529158815741539,
+ "step": 1364
+ },
+ {
+ "epoch": 6.89620253164557,
+ "grad_norm": 0.026303067803382874,
+ "learning_rate": 3.45679012345679e-05,
+ "loss": 0.019374631345272064,
+ "step": 1365
+ },
+ {
+ "epoch": 6.9012658227848105,
+ "grad_norm": 0.039471473544836044,
+ "learning_rate": 3.451178451178451e-05,
+ "loss": 0.022283609956502914,
+ "step": 1366
+ },
+ {
+ "epoch": 6.90632911392405,
+ "grad_norm": 0.03414482623338699,
+ "learning_rate": 3.445566778900112e-05,
+ "loss": 0.024151155725121498,
+ "step": 1367
+ },
+ {
+ "epoch": 6.911392405063291,
+ "grad_norm": 0.01648244820535183,
+ "learning_rate": 3.439955106621773e-05,
+ "loss": 0.01653912290930748,
+ "step": 1368
+ },
+ {
+ "epoch": 6.916455696202531,
+ "grad_norm": 0.036713164299726486,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.01961999014019966,
+ "step": 1369
+ },
+ {
+ "epoch": 6.921518987341772,
+ "grad_norm": 0.02502237819135189,
+ "learning_rate": 3.428731762065096e-05,
+ "loss": 0.019946709275245667,
+ "step": 1370
+ },
+ {
+ "epoch": 6.926582278481012,
+ "grad_norm": 0.03062540479004383,
+ "learning_rate": 3.423120089786757e-05,
+ "loss": 0.023258816450834274,
+ "step": 1371
+ },
+ {
+ "epoch": 6.931645569620253,
+ "grad_norm": 0.021536799147725105,
+ "learning_rate": 3.417508417508418e-05,
+ "loss": 0.01964723877608776,
+ "step": 1372
+ },
+ {
+ "epoch": 6.936708860759493,
+ "grad_norm": 0.035745471715927124,
+ "learning_rate": 3.411896745230079e-05,
+ "loss": 0.026319682598114014,
+ "step": 1373
+ },
+ {
+ "epoch": 6.941772151898734,
+ "grad_norm": 0.03711705282330513,
+ "learning_rate": 3.40628507295174e-05,
+ "loss": 0.022980816662311554,
+ "step": 1374
+ },
+ {
+ "epoch": 6.946835443037974,
+ "grad_norm": 0.02977835014462471,
+ "learning_rate": 3.400673400673401e-05,
+ "loss": 0.020178712904453278,
+ "step": 1375
+ },
+ {
+ "epoch": 6.951898734177215,
+ "grad_norm": 0.122103750705719,
+ "learning_rate": 3.395061728395062e-05,
+ "loss": 0.028520341962575912,
+ "step": 1376
+ },
+ {
+ "epoch": 6.9569620253164555,
+ "grad_norm": 0.046767886728048325,
+ "learning_rate": 3.389450056116723e-05,
+ "loss": 0.0207063015550375,
+ "step": 1377
+ },
+ {
+ "epoch": 6.962025316455696,
+ "grad_norm": 0.027442077174782753,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.018590064719319344,
+ "step": 1378
+ },
+ {
+ "epoch": 6.9670886075949365,
+ "grad_norm": 0.03202109411358833,
+ "learning_rate": 3.3782267115600454e-05,
+ "loss": 0.0225562434643507,
+ "step": 1379
+ },
+ {
+ "epoch": 6.972151898734177,
+ "grad_norm": 0.024545297026634216,
+ "learning_rate": 3.3726150392817064e-05,
+ "loss": 0.020356591790914536,
+ "step": 1380
+ },
+ {
+ "epoch": 6.977215189873418,
+ "grad_norm": 0.028534026816487312,
+ "learning_rate": 3.3670033670033675e-05,
+ "loss": 0.017728019505739212,
+ "step": 1381
+ },
+ {
+ "epoch": 6.982278481012658,
+ "grad_norm": 0.04066401720046997,
+ "learning_rate": 3.3613916947250285e-05,
+ "loss": 0.02500733733177185,
+ "step": 1382
+ },
+ {
+ "epoch": 6.987341772151899,
+ "grad_norm": 0.03498203679919243,
+ "learning_rate": 3.3557800224466895e-05,
+ "loss": 0.020952323451638222,
+ "step": 1383
+ },
+ {
+ "epoch": 6.992405063291139,
+ "grad_norm": 0.024813339114189148,
+ "learning_rate": 3.35016835016835e-05,
+ "loss": 0.019022852182388306,
+ "step": 1384
+ },
+ {
+ "epoch": 6.99746835443038,
+ "grad_norm": 0.02122138813138008,
+ "learning_rate": 3.3445566778900115e-05,
+ "loss": 0.019452452659606934,
+ "step": 1385
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.025631824508309364,
+ "learning_rate": 3.3389450056116725e-05,
+ "loss": 0.01880500651896,
+ "step": 1386
+ },
+ {
+ "epoch": 7.0050632911392405,
+ "grad_norm": 0.03023305907845497,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.019060317426919937,
+ "step": 1387
+ },
+ {
+ "epoch": 7.010126582278481,
+ "grad_norm": 0.03772016614675522,
+ "learning_rate": 3.3277216610549945e-05,
+ "loss": 0.024812128394842148,
+ "step": 1388
+ },
+ {
+ "epoch": 7.015189873417722,
+ "grad_norm": 0.022726386785507202,
+ "learning_rate": 3.3221099887766555e-05,
+ "loss": 0.016584882512688637,
+ "step": 1389
+ },
+ {
+ "epoch": 7.020253164556962,
+ "grad_norm": 0.034556008875370026,
+ "learning_rate": 3.3164983164983165e-05,
+ "loss": 0.019786395132541656,
+ "step": 1390
+ },
+ {
+ "epoch": 7.025316455696203,
+ "grad_norm": 0.028575370088219643,
+ "learning_rate": 3.3108866442199775e-05,
+ "loss": 0.01822180114686489,
+ "step": 1391
+ },
+ {
+ "epoch": 7.030379746835443,
+ "grad_norm": 0.023528434336185455,
+ "learning_rate": 3.3052749719416385e-05,
+ "loss": 0.020981397479772568,
+ "step": 1392
+ },
+ {
+ "epoch": 7.035443037974684,
+ "grad_norm": 0.022872168570756912,
+ "learning_rate": 3.2996632996632995e-05,
+ "loss": 0.01915448158979416,
+ "step": 1393
+ },
+ {
+ "epoch": 7.040506329113924,
+ "grad_norm": 0.027755601331591606,
+ "learning_rate": 3.2940516273849605e-05,
+ "loss": 0.022184018045663834,
+ "step": 1394
+ },
+ {
+ "epoch": 7.045569620253165,
+ "grad_norm": 0.02798120491206646,
+ "learning_rate": 3.288439955106622e-05,
+ "loss": 0.018451202660799026,
+ "step": 1395
+ },
+ {
+ "epoch": 7.050632911392405,
+ "grad_norm": 0.03338237479329109,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.020784873515367508,
+ "step": 1396
+ },
+ {
+ "epoch": 7.055696202531646,
+ "grad_norm": 0.02282361313700676,
+ "learning_rate": 3.277216610549944e-05,
+ "loss": 0.017811089754104614,
+ "step": 1397
+ },
+ {
+ "epoch": 7.060759493670886,
+ "grad_norm": 0.03505925461649895,
+ "learning_rate": 3.271604938271605e-05,
+ "loss": 0.02735268510878086,
+ "step": 1398
+ },
+ {
+ "epoch": 7.065822784810127,
+ "grad_norm": 0.023442594334483147,
+ "learning_rate": 3.265993265993266e-05,
+ "loss": 0.017855383455753326,
+ "step": 1399
+ },
+ {
+ "epoch": 7.0708860759493675,
+ "grad_norm": 0.028511418029665947,
+ "learning_rate": 3.260381593714927e-05,
+ "loss": 0.01905960589647293,
+ "step": 1400
+ },
+ {
+ "epoch": 7.075949367088608,
+ "grad_norm": 0.027948686853051186,
+ "learning_rate": 3.254769921436588e-05,
+ "loss": 0.019588086754083633,
+ "step": 1401
+ },
+ {
+ "epoch": 7.0810126582278485,
+ "grad_norm": 0.031204944476485252,
+ "learning_rate": 3.249158249158249e-05,
+ "loss": 0.025335699319839478,
+ "step": 1402
+ },
+ {
+ "epoch": 7.086075949367088,
+ "grad_norm": 0.026365051046013832,
+ "learning_rate": 3.24354657687991e-05,
+ "loss": 0.020061418414115906,
+ "step": 1403
+ },
+ {
+ "epoch": 7.091139240506329,
+ "grad_norm": 0.02992449328303337,
+ "learning_rate": 3.237934904601572e-05,
+ "loss": 0.0207480788230896,
+ "step": 1404
+ },
+ {
+ "epoch": 7.096202531645569,
+ "grad_norm": 0.023861777037382126,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.018660075962543488,
+ "step": 1405
+ },
+ {
+ "epoch": 7.10126582278481,
+ "grad_norm": 0.029991189017891884,
+ "learning_rate": 3.226711560044893e-05,
+ "loss": 0.01724623516201973,
+ "step": 1406
+ },
+ {
+ "epoch": 7.10632911392405,
+ "grad_norm": 0.0326378308236599,
+ "learning_rate": 3.221099887766554e-05,
+ "loss": 0.02030283957719803,
+ "step": 1407
+ },
+ {
+ "epoch": 7.111392405063291,
+ "grad_norm": 0.21390174329280853,
+ "learning_rate": 3.215488215488215e-05,
+ "loss": 0.022705763578414917,
+ "step": 1408
+ },
+ {
+ "epoch": 7.116455696202531,
+ "grad_norm": 0.03886239975690842,
+ "learning_rate": 3.209876543209876e-05,
+ "loss": 0.018677497282624245,
+ "step": 1409
+ },
+ {
+ "epoch": 7.121518987341772,
+ "grad_norm": 0.08851044625043869,
+ "learning_rate": 3.204264870931537e-05,
+ "loss": 0.023592950776219368,
+ "step": 1410
+ },
+ {
+ "epoch": 7.1265822784810124,
+ "grad_norm": 0.02696068212389946,
+ "learning_rate": 3.198653198653199e-05,
+ "loss": 0.02084396779537201,
+ "step": 1411
+ },
+ {
+ "epoch": 7.131645569620253,
+ "grad_norm": 0.02673780545592308,
+ "learning_rate": 3.19304152637486e-05,
+ "loss": 0.01957092061638832,
+ "step": 1412
+ },
+ {
+ "epoch": 7.1367088607594935,
+ "grad_norm": 0.027915315702557564,
+ "learning_rate": 3.187429854096521e-05,
+ "loss": 0.017723560333251953,
+ "step": 1413
+ },
+ {
+ "epoch": 7.141772151898734,
+ "grad_norm": 0.03920222446322441,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.025390218943357468,
+ "step": 1414
+ },
+ {
+ "epoch": 7.146835443037975,
+ "grad_norm": 0.0384795181453228,
+ "learning_rate": 3.176206509539843e-05,
+ "loss": 0.01968265138566494,
+ "step": 1415
+ },
+ {
+ "epoch": 7.151898734177215,
+ "grad_norm": 0.035265080630779266,
+ "learning_rate": 3.170594837261504e-05,
+ "loss": 0.024998726323246956,
+ "step": 1416
+ },
+ {
+ "epoch": 7.156962025316456,
+ "grad_norm": 0.029263779520988464,
+ "learning_rate": 3.164983164983165e-05,
+ "loss": 0.020544305443763733,
+ "step": 1417
+ },
+ {
+ "epoch": 7.162025316455696,
+ "grad_norm": 0.04175667464733124,
+ "learning_rate": 3.159371492704826e-05,
+ "loss": 0.019445113837718964,
+ "step": 1418
+ },
+ {
+ "epoch": 7.167088607594937,
+ "grad_norm": 0.041344888508319855,
+ "learning_rate": 3.153759820426487e-05,
+ "loss": 0.02322668954730034,
+ "step": 1419
+ },
+ {
+ "epoch": 7.172151898734177,
+ "grad_norm": 0.03339385986328125,
+ "learning_rate": 3.148148148148148e-05,
+ "loss": 0.023453861474990845,
+ "step": 1420
+ },
+ {
+ "epoch": 7.177215189873418,
+ "grad_norm": 0.07248332351446152,
+ "learning_rate": 3.14253647586981e-05,
+ "loss": 0.02372308447957039,
+ "step": 1421
+ },
+ {
+ "epoch": 7.182278481012658,
+ "grad_norm": 0.03583402931690216,
+ "learning_rate": 3.136924803591471e-05,
+ "loss": 0.021252157166600227,
+ "step": 1422
+ },
+ {
+ "epoch": 7.187341772151899,
+ "grad_norm": 0.035940300673246384,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.02373434416949749,
+ "step": 1423
+ },
+ {
+ "epoch": 7.192405063291139,
+ "grad_norm": 0.037396274507045746,
+ "learning_rate": 3.125701459034793e-05,
+ "loss": 0.021743204444646835,
+ "step": 1424
+ },
+ {
+ "epoch": 7.19746835443038,
+ "grad_norm": 0.03273582085967064,
+ "learning_rate": 3.120089786756454e-05,
+ "loss": 0.021748099476099014,
+ "step": 1425
+ },
+ {
+ "epoch": 7.2025316455696204,
+ "grad_norm": 0.05356048792600632,
+ "learning_rate": 3.114478114478115e-05,
+ "loss": 0.018289824947714806,
+ "step": 1426
+ },
+ {
+ "epoch": 7.207594936708861,
+ "grad_norm": 0.08134915679693222,
+ "learning_rate": 3.108866442199775e-05,
+ "loss": 0.019879773259162903,
+ "step": 1427
+ },
+ {
+ "epoch": 7.2126582278481015,
+ "grad_norm": 0.028759760782122612,
+ "learning_rate": 3.103254769921437e-05,
+ "loss": 0.02021026611328125,
+ "step": 1428
+ },
+ {
+ "epoch": 7.217721518987342,
+ "grad_norm": 0.03647785633802414,
+ "learning_rate": 3.097643097643098e-05,
+ "loss": 0.019807487726211548,
+ "step": 1429
+ },
+ {
+ "epoch": 7.222784810126583,
+ "grad_norm": 0.04302947223186493,
+ "learning_rate": 3.092031425364759e-05,
+ "loss": 0.02610229328274727,
+ "step": 1430
+ },
+ {
+ "epoch": 7.227848101265823,
+ "grad_norm": 0.040028274059295654,
+ "learning_rate": 3.08641975308642e-05,
+ "loss": 0.020702369511127472,
+ "step": 1431
+ },
+ {
+ "epoch": 7.232911392405064,
+ "grad_norm": 0.03221731632947922,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.019945278763771057,
+ "step": 1432
+ },
+ {
+ "epoch": 7.237974683544304,
+ "grad_norm": 0.043122660368680954,
+ "learning_rate": 3.075196408529742e-05,
+ "loss": 0.01944747380912304,
+ "step": 1433
+ },
+ {
+ "epoch": 7.243037974683545,
+ "grad_norm": 0.041211001574993134,
+ "learning_rate": 3.069584736251403e-05,
+ "loss": 0.02140875533223152,
+ "step": 1434
+ },
+ {
+ "epoch": 7.248101265822784,
+ "grad_norm": 0.038251616060733795,
+ "learning_rate": 3.063973063973064e-05,
+ "loss": 0.017319878563284874,
+ "step": 1435
+ },
+ {
+ "epoch": 7.253164556962025,
+ "grad_norm": 0.023718461394309998,
+ "learning_rate": 3.058361391694725e-05,
+ "loss": 0.017003588378429413,
+ "step": 1436
+ },
+ {
+ "epoch": 7.258227848101265,
+ "grad_norm": 0.04274767264723778,
+ "learning_rate": 3.0527497194163865e-05,
+ "loss": 0.022676389664411545,
+ "step": 1437
+ },
+ {
+ "epoch": 7.263291139240506,
+ "grad_norm": 0.05663180723786354,
+ "learning_rate": 3.0471380471380472e-05,
+ "loss": 0.018122078850865364,
+ "step": 1438
+ },
+ {
+ "epoch": 7.2683544303797465,
+ "grad_norm": 0.046230170875787735,
+ "learning_rate": 3.0415263748597082e-05,
+ "loss": 0.02533666044473648,
+ "step": 1439
+ },
+ {
+ "epoch": 7.273417721518987,
+ "grad_norm": 0.029917370527982712,
+ "learning_rate": 3.0359147025813696e-05,
+ "loss": 0.017602022737264633,
+ "step": 1440
+ },
+ {
+ "epoch": 7.2784810126582276,
+ "grad_norm": 0.02992556430399418,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.018274672329425812,
+ "step": 1441
+ },
+ {
+ "epoch": 7.283544303797468,
+ "grad_norm": 0.02617500349879265,
+ "learning_rate": 3.0246913580246916e-05,
+ "loss": 0.01885201409459114,
+ "step": 1442
+ },
+ {
+ "epoch": 7.288607594936709,
+ "grad_norm": 0.065202996134758,
+ "learning_rate": 3.0190796857463526e-05,
+ "loss": 0.026795238256454468,
+ "step": 1443
+ },
+ {
+ "epoch": 7.293670886075949,
+ "grad_norm": 0.03273150697350502,
+ "learning_rate": 3.013468013468014e-05,
+ "loss": 0.021357936784625053,
+ "step": 1444
+ },
+ {
+ "epoch": 7.29873417721519,
+ "grad_norm": 0.024254770949482918,
+ "learning_rate": 3.007856341189675e-05,
+ "loss": 0.018274925649166107,
+ "step": 1445
+ },
+ {
+ "epoch": 7.30379746835443,
+ "grad_norm": 0.03504091128706932,
+ "learning_rate": 3.002244668911336e-05,
+ "loss": 0.02005249634385109,
+ "step": 1446
+ },
+ {
+ "epoch": 7.308860759493671,
+ "grad_norm": 0.03011571802198887,
+ "learning_rate": 2.996632996632997e-05,
+ "loss": 0.02488003298640251,
+ "step": 1447
+ },
+ {
+ "epoch": 7.313924050632911,
+ "grad_norm": 0.027476035058498383,
+ "learning_rate": 2.991021324354658e-05,
+ "loss": 0.01974816992878914,
+ "step": 1448
+ },
+ {
+ "epoch": 7.318987341772152,
+ "grad_norm": 0.026227811351418495,
+ "learning_rate": 2.9854096520763186e-05,
+ "loss": 0.019309503957629204,
+ "step": 1449
+ },
+ {
+ "epoch": 7.324050632911392,
+ "grad_norm": 0.03413211554288864,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.02053218148648739,
+ "step": 1450
+ },
+ {
+ "epoch": 7.329113924050633,
+ "grad_norm": 0.05214853584766388,
+ "learning_rate": 2.9741863075196406e-05,
+ "loss": 0.02286684140563011,
+ "step": 1451
+ },
+ {
+ "epoch": 7.334177215189873,
+ "grad_norm": 0.041933804750442505,
+ "learning_rate": 2.968574635241302e-05,
+ "loss": 0.025886723771691322,
+ "step": 1452
+ },
+ {
+ "epoch": 7.339240506329114,
+ "grad_norm": 0.029031161218881607,
+ "learning_rate": 2.962962962962963e-05,
+ "loss": 0.017816081643104553,
+ "step": 1453
+ },
+ {
+ "epoch": 7.3443037974683545,
+ "grad_norm": 0.02532730996608734,
+ "learning_rate": 2.957351290684624e-05,
+ "loss": 0.017425578087568283,
+ "step": 1454
+ },
+ {
+ "epoch": 7.349367088607595,
+ "grad_norm": 0.02859879471361637,
+ "learning_rate": 2.951739618406285e-05,
+ "loss": 0.02076636254787445,
+ "step": 1455
+ },
+ {
+ "epoch": 7.3544303797468356,
+ "grad_norm": 0.03137378767132759,
+ "learning_rate": 2.946127946127946e-05,
+ "loss": 0.020406391471624374,
+ "step": 1456
+ },
+ {
+ "epoch": 7.359493670886076,
+ "grad_norm": 0.032471053302288055,
+ "learning_rate": 2.9405162738496074e-05,
+ "loss": 0.01692109927535057,
+ "step": 1457
+ },
+ {
+ "epoch": 7.364556962025317,
+ "grad_norm": 0.028477061539888382,
+ "learning_rate": 2.9349046015712684e-05,
+ "loss": 0.020386110991239548,
+ "step": 1458
+ },
+ {
+ "epoch": 7.369620253164557,
+ "grad_norm": 0.022607816383242607,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.01817784458398819,
+ "step": 1459
+ },
+ {
+ "epoch": 7.374683544303798,
+ "grad_norm": 0.023832928389310837,
+ "learning_rate": 2.9236812570145904e-05,
+ "loss": 0.01865188032388687,
+ "step": 1460
+ },
+ {
+ "epoch": 7.379746835443038,
+ "grad_norm": 0.027590278536081314,
+ "learning_rate": 2.9180695847362517e-05,
+ "loss": 0.022126823663711548,
+ "step": 1461
+ },
+ {
+ "epoch": 7.384810126582279,
+ "grad_norm": 0.4172179698944092,
+ "learning_rate": 2.9124579124579127e-05,
+ "loss": 0.022308025509119034,
+ "step": 1462
+ },
+ {
+ "epoch": 7.389873417721519,
+ "grad_norm": 0.026935985311865807,
+ "learning_rate": 2.9068462401795737e-05,
+ "loss": 0.019504904747009277,
+ "step": 1463
+ },
+ {
+ "epoch": 7.39493670886076,
+ "grad_norm": 0.03200481832027435,
+ "learning_rate": 2.9012345679012347e-05,
+ "loss": 0.02669564262032509,
+ "step": 1464
+ },
+ {
+ "epoch": 7.4,
+ "grad_norm": 0.029977383092045784,
+ "learning_rate": 2.8956228956228958e-05,
+ "loss": 0.020015545189380646,
+ "step": 1465
+ },
+ {
+ "epoch": 7.405063291139241,
+ "grad_norm": 0.056856609880924225,
+ "learning_rate": 2.890011223344557e-05,
+ "loss": 0.02192942053079605,
+ "step": 1466
+ },
+ {
+ "epoch": 7.410126582278481,
+ "grad_norm": 0.025086626410484314,
+ "learning_rate": 2.884399551066218e-05,
+ "loss": 0.01919681392610073,
+ "step": 1467
+ },
+ {
+ "epoch": 7.415189873417722,
+ "grad_norm": 0.022608574479818344,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.01909647136926651,
+ "step": 1468
+ },
+ {
+ "epoch": 7.4202531645569625,
+ "grad_norm": 0.034612007439136505,
+ "learning_rate": 2.87317620650954e-05,
+ "loss": 0.01842370256781578,
+ "step": 1469
+ },
+ {
+ "epoch": 7.425316455696202,
+ "grad_norm": 0.06468075513839722,
+ "learning_rate": 2.8675645342312015e-05,
+ "loss": 0.02434670552611351,
+ "step": 1470
+ },
+ {
+ "epoch": 7.430379746835443,
+ "grad_norm": 0.03149627894163132,
+ "learning_rate": 2.8619528619528618e-05,
+ "loss": 0.019917085766792297,
+ "step": 1471
+ },
+ {
+ "epoch": 7.435443037974683,
+ "grad_norm": 0.057844966650009155,
+ "learning_rate": 2.8563411896745228e-05,
+ "loss": 0.024164216592907906,
+ "step": 1472
+ },
+ {
+ "epoch": 7.440506329113924,
+ "grad_norm": 0.026152828708291054,
+ "learning_rate": 2.850729517396184e-05,
+ "loss": 0.01977004110813141,
+ "step": 1473
+ },
+ {
+ "epoch": 7.445569620253164,
+ "grad_norm": 0.02952045202255249,
+ "learning_rate": 2.845117845117845e-05,
+ "loss": 0.017811203375458717,
+ "step": 1474
+ },
+ {
+ "epoch": 7.450632911392405,
+ "grad_norm": 0.04974228888750076,
+ "learning_rate": 2.839506172839506e-05,
+ "loss": 0.02152227610349655,
+ "step": 1475
+ },
+ {
+ "epoch": 7.455696202531645,
+ "grad_norm": 0.031569063663482666,
+ "learning_rate": 2.833894500561167e-05,
+ "loss": 0.01801261678338051,
+ "step": 1476
+ },
+ {
+ "epoch": 7.460759493670886,
+ "grad_norm": 0.027251577004790306,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.019541654735803604,
+ "step": 1477
+ },
+ {
+ "epoch": 7.465822784810126,
+ "grad_norm": 0.05990522354841232,
+ "learning_rate": 2.8226711560044895e-05,
+ "loss": 0.028783954679965973,
+ "step": 1478
+ },
+ {
+ "epoch": 7.470886075949367,
+ "grad_norm": 0.05585836246609688,
+ "learning_rate": 2.8170594837261505e-05,
+ "loss": 0.021160079166293144,
+ "step": 1479
+ },
+ {
+ "epoch": 7.4759493670886075,
+ "grad_norm": 0.07603998482227325,
+ "learning_rate": 2.8114478114478115e-05,
+ "loss": 0.020453037694096565,
+ "step": 1480
+ },
+ {
+ "epoch": 7.481012658227848,
+ "grad_norm": 0.027796803042292595,
+ "learning_rate": 2.8058361391694725e-05,
+ "loss": 0.018019884824752808,
+ "step": 1481
+ },
+ {
+ "epoch": 7.4860759493670885,
+ "grad_norm": 0.03738328441977501,
+ "learning_rate": 2.8002244668911335e-05,
+ "loss": 0.018781842663884163,
+ "step": 1482
+ },
+ {
+ "epoch": 7.491139240506329,
+ "grad_norm": 0.026894861832261086,
+ "learning_rate": 2.794612794612795e-05,
+ "loss": 0.018704136833548546,
+ "step": 1483
+ },
+ {
+ "epoch": 7.49620253164557,
+ "grad_norm": 0.04921836778521538,
+ "learning_rate": 2.789001122334456e-05,
+ "loss": 0.025394737720489502,
+ "step": 1484
+ },
+ {
+ "epoch": 7.50126582278481,
+ "grad_norm": 0.02966165542602539,
+ "learning_rate": 2.783389450056117e-05,
+ "loss": 0.018199149519205093,
+ "step": 1485
+ },
+ {
+ "epoch": 7.506329113924051,
+ "grad_norm": 0.0387556366622448,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.022723186761140823,
+ "step": 1486
+ },
+ {
+ "epoch": 7.511392405063291,
+ "grad_norm": 0.03414534777402878,
+ "learning_rate": 2.7721661054994393e-05,
+ "loss": 0.02049117535352707,
+ "step": 1487
+ },
+ {
+ "epoch": 7.516455696202532,
+ "grad_norm": 0.03540657088160515,
+ "learning_rate": 2.7665544332211003e-05,
+ "loss": 0.016004232689738274,
+ "step": 1488
+ },
+ {
+ "epoch": 7.521518987341772,
+ "grad_norm": 0.02518565021455288,
+ "learning_rate": 2.7609427609427613e-05,
+ "loss": 0.01941412314772606,
+ "step": 1489
+ },
+ {
+ "epoch": 7.526582278481013,
+ "grad_norm": 0.05959590524435043,
+ "learning_rate": 2.7553310886644223e-05,
+ "loss": 0.02951142191886902,
+ "step": 1490
+ },
+ {
+ "epoch": 7.531645569620253,
+ "grad_norm": 0.03249293565750122,
+ "learning_rate": 2.7497194163860833e-05,
+ "loss": 0.017881492152810097,
+ "step": 1491
+ },
+ {
+ "epoch": 7.536708860759494,
+ "grad_norm": 0.03257756307721138,
+ "learning_rate": 2.7441077441077446e-05,
+ "loss": 0.02113383263349533,
+ "step": 1492
+ },
+ {
+ "epoch": 7.541772151898734,
+ "grad_norm": 0.033309679478406906,
+ "learning_rate": 2.738496071829405e-05,
+ "loss": 0.026215262711048126,
+ "step": 1493
+ },
+ {
+ "epoch": 7.546835443037975,
+ "grad_norm": 0.022595476359128952,
+ "learning_rate": 2.732884399551066e-05,
+ "loss": 0.02027580887079239,
+ "step": 1494
+ },
+ {
+ "epoch": 7.5518987341772155,
+ "grad_norm": 0.031081587076187134,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.019502829760313034,
+ "step": 1495
+ },
+ {
+ "epoch": 7.556962025316456,
+ "grad_norm": 0.03038015030324459,
+ "learning_rate": 2.7216610549943883e-05,
+ "loss": 0.01952512189745903,
+ "step": 1496
+ },
+ {
+ "epoch": 7.5620253164556965,
+ "grad_norm": 0.029864326119422913,
+ "learning_rate": 2.7160493827160493e-05,
+ "loss": 0.02026083692908287,
+ "step": 1497
+ },
+ {
+ "epoch": 7.567088607594937,
+ "grad_norm": 0.040809404104948044,
+ "learning_rate": 2.7104377104377103e-05,
+ "loss": 0.026188697665929794,
+ "step": 1498
+ },
+ {
+ "epoch": 7.572151898734178,
+ "grad_norm": 0.023756515234708786,
+ "learning_rate": 2.7048260381593717e-05,
+ "loss": 0.019195934757590294,
+ "step": 1499
+ },
+ {
+ "epoch": 7.577215189873417,
+ "grad_norm": 0.04987863078713417,
+ "learning_rate": 2.6992143658810327e-05,
+ "loss": 0.02136474847793579,
+ "step": 1500
+ },
+ {
+ "epoch": 7.582278481012658,
+ "grad_norm": 0.027713749557733536,
+ "learning_rate": 2.6936026936026937e-05,
+ "loss": 0.01946287602186203,
+ "step": 1501
+ },
+ {
+ "epoch": 7.587341772151898,
+ "grad_norm": 0.039245858788490295,
+ "learning_rate": 2.6879910213243547e-05,
+ "loss": 0.02284877747297287,
+ "step": 1502
+ },
+ {
+ "epoch": 7.592405063291139,
+ "grad_norm": 0.028289446607232094,
+ "learning_rate": 2.6823793490460157e-05,
+ "loss": 0.01939627155661583,
+ "step": 1503
+ },
+ {
+ "epoch": 7.597468354430379,
+ "grad_norm": 0.032388728111982346,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.021464064717292786,
+ "step": 1504
+ },
+ {
+ "epoch": 7.60253164556962,
+ "grad_norm": 0.029117215424776077,
+ "learning_rate": 2.671156004489338e-05,
+ "loss": 0.021073060110211372,
+ "step": 1505
+ },
+ {
+ "epoch": 7.6075949367088604,
+ "grad_norm": 0.041485581547021866,
+ "learning_rate": 2.665544332210999e-05,
+ "loss": 0.022546250373125076,
+ "step": 1506
+ },
+ {
+ "epoch": 7.612658227848101,
+ "grad_norm": 0.03320342302322388,
+ "learning_rate": 2.65993265993266e-05,
+ "loss": 0.026163101196289062,
+ "step": 1507
+ },
+ {
+ "epoch": 7.6177215189873415,
+ "grad_norm": 0.021322058513760567,
+ "learning_rate": 2.654320987654321e-05,
+ "loss": 0.015460850670933723,
+ "step": 1508
+ },
+ {
+ "epoch": 7.622784810126582,
+ "grad_norm": 0.029875705018639565,
+ "learning_rate": 2.6487093153759824e-05,
+ "loss": 0.017766594886779785,
+ "step": 1509
+ },
+ {
+ "epoch": 7.627848101265823,
+ "grad_norm": 0.02629193477332592,
+ "learning_rate": 2.6430976430976434e-05,
+ "loss": 0.019405700266361237,
+ "step": 1510
+ },
+ {
+ "epoch": 7.632911392405063,
+ "grad_norm": 0.027344992384314537,
+ "learning_rate": 2.6374859708193044e-05,
+ "loss": 0.021626925095915794,
+ "step": 1511
+ },
+ {
+ "epoch": 7.637974683544304,
+ "grad_norm": 0.03218991681933403,
+ "learning_rate": 2.6318742985409654e-05,
+ "loss": 0.025306588038802147,
+ "step": 1512
+ },
+ {
+ "epoch": 7.643037974683544,
+ "grad_norm": 0.03371857479214668,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.02218639850616455,
+ "step": 1513
+ },
+ {
+ "epoch": 7.648101265822785,
+ "grad_norm": 0.033074695616960526,
+ "learning_rate": 2.620650953984287e-05,
+ "loss": 0.022175181657075882,
+ "step": 1514
+ },
+ {
+ "epoch": 7.653164556962025,
+ "grad_norm": 0.040838733315467834,
+ "learning_rate": 2.615039281705948e-05,
+ "loss": 0.024300530552864075,
+ "step": 1515
+ },
+ {
+ "epoch": 7.658227848101266,
+ "grad_norm": 0.04166492819786072,
+ "learning_rate": 2.6094276094276095e-05,
+ "loss": 0.023746581748127937,
+ "step": 1516
+ },
+ {
+ "epoch": 7.663291139240506,
+ "grad_norm": 0.024037878960371017,
+ "learning_rate": 2.6038159371492705e-05,
+ "loss": 0.014877275563776493,
+ "step": 1517
+ },
+ {
+ "epoch": 7.668354430379747,
+ "grad_norm": 0.027796877548098564,
+ "learning_rate": 2.5982042648709315e-05,
+ "loss": 0.020726773887872696,
+ "step": 1518
+ },
+ {
+ "epoch": 7.673417721518987,
+ "grad_norm": 0.027635321021080017,
+ "learning_rate": 2.5925925925925925e-05,
+ "loss": 0.01928134821355343,
+ "step": 1519
+ },
+ {
+ "epoch": 7.678481012658228,
+ "grad_norm": 0.03595967963337898,
+ "learning_rate": 2.5869809203142535e-05,
+ "loss": 0.021230777725577354,
+ "step": 1520
+ },
+ {
+ "epoch": 7.6835443037974684,
+ "grad_norm": 0.027645453810691833,
+ "learning_rate": 2.581369248035915e-05,
+ "loss": 0.020900100469589233,
+ "step": 1521
+ },
+ {
+ "epoch": 7.688607594936709,
+ "grad_norm": 0.026998694986104965,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.01859203726053238,
+ "step": 1522
+ },
+ {
+ "epoch": 7.6936708860759495,
+ "grad_norm": 0.03182216361165047,
+ "learning_rate": 2.570145903479237e-05,
+ "loss": 0.01927625760436058,
+ "step": 1523
+ },
+ {
+ "epoch": 7.69873417721519,
+ "grad_norm": 0.04432869702577591,
+ "learning_rate": 2.564534231200898e-05,
+ "loss": 0.020073015242815018,
+ "step": 1524
+ },
+ {
+ "epoch": 7.703797468354431,
+ "grad_norm": 0.03800998628139496,
+ "learning_rate": 2.5589225589225592e-05,
+ "loss": 0.0257626473903656,
+ "step": 1525
+ },
+ {
+ "epoch": 7.708860759493671,
+ "grad_norm": 0.03346885368227959,
+ "learning_rate": 2.5533108866442202e-05,
+ "loss": 0.020997589454054832,
+ "step": 1526
+ },
+ {
+ "epoch": 7.713924050632912,
+ "grad_norm": 0.031936272978782654,
+ "learning_rate": 2.5476992143658812e-05,
+ "loss": 0.018775295466184616,
+ "step": 1527
+ },
+ {
+ "epoch": 7.718987341772152,
+ "grad_norm": 0.038017526268959045,
+ "learning_rate": 2.5420875420875422e-05,
+ "loss": 0.023845292627811432,
+ "step": 1528
+ },
+ {
+ "epoch": 7.724050632911393,
+ "grad_norm": 0.0348825678229332,
+ "learning_rate": 2.5364758698092032e-05,
+ "loss": 0.018793366849422455,
+ "step": 1529
+ },
+ {
+ "epoch": 7.729113924050633,
+ "grad_norm": 0.040639717131853104,
+ "learning_rate": 2.5308641975308646e-05,
+ "loss": 0.02135619707405567,
+ "step": 1530
+ },
+ {
+ "epoch": 7.734177215189874,
+ "grad_norm": 0.03508064150810242,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.01841862127184868,
+ "step": 1531
+ },
+ {
+ "epoch": 7.739240506329114,
+ "grad_norm": 0.028800271451473236,
+ "learning_rate": 2.5196408529741866e-05,
+ "loss": 0.017473943531513214,
+ "step": 1532
+ },
+ {
+ "epoch": 7.744303797468355,
+ "grad_norm": 0.03582684323191643,
+ "learning_rate": 2.5140291806958476e-05,
+ "loss": 0.026108454912900925,
+ "step": 1533
+ },
+ {
+ "epoch": 7.749367088607595,
+ "grad_norm": 0.02528059482574463,
+ "learning_rate": 2.5084175084175086e-05,
+ "loss": 0.022859979420900345,
+ "step": 1534
+ },
+ {
+ "epoch": 7.754430379746836,
+ "grad_norm": 0.04829512536525726,
+ "learning_rate": 2.50280583613917e-05,
+ "loss": 0.027691150084137917,
+ "step": 1535
+ },
+ {
+ "epoch": 7.759493670886076,
+ "grad_norm": 0.050450246781110764,
+ "learning_rate": 2.4971941638608306e-05,
+ "loss": 0.022913554683327675,
+ "step": 1536
+ },
+ {
+ "epoch": 7.764556962025316,
+ "grad_norm": 0.045245204120874405,
+ "learning_rate": 2.4915824915824916e-05,
+ "loss": 0.02299308404326439,
+ "step": 1537
+ },
+ {
+ "epoch": 7.769620253164557,
+ "grad_norm": 0.041785869747400284,
+ "learning_rate": 2.485970819304153e-05,
+ "loss": 0.019534088671207428,
+ "step": 1538
+ },
+ {
+ "epoch": 7.774683544303797,
+ "grad_norm": 0.02439288981258869,
+ "learning_rate": 2.480359147025814e-05,
+ "loss": 0.017930708825588226,
+ "step": 1539
+ },
+ {
+ "epoch": 7.779746835443038,
+ "grad_norm": 0.08324351161718369,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.028837718069553375,
+ "step": 1540
+ },
+ {
+ "epoch": 7.784810126582278,
+ "grad_norm": 0.04910506680607796,
+ "learning_rate": 2.4691358024691357e-05,
+ "loss": 0.023599382489919662,
+ "step": 1541
+ },
+ {
+ "epoch": 7.789873417721519,
+ "grad_norm": 0.02449595369398594,
+ "learning_rate": 2.463524130190797e-05,
+ "loss": 0.017761975526809692,
+ "step": 1542
+ },
+ {
+ "epoch": 7.794936708860759,
+ "grad_norm": 0.07905204594135284,
+ "learning_rate": 2.457912457912458e-05,
+ "loss": 0.017839400097727776,
+ "step": 1543
+ },
+ {
+ "epoch": 7.8,
+ "grad_norm": 0.030506471171975136,
+ "learning_rate": 2.452300785634119e-05,
+ "loss": 0.021404195576906204,
+ "step": 1544
+ },
+ {
+ "epoch": 7.80506329113924,
+ "grad_norm": 0.03580015152692795,
+ "learning_rate": 2.44668911335578e-05,
+ "loss": 0.023948010057210922,
+ "step": 1545
+ },
+ {
+ "epoch": 7.810126582278481,
+ "grad_norm": 0.027275504544377327,
+ "learning_rate": 2.441077441077441e-05,
+ "loss": 0.01799733377993107,
+ "step": 1546
+ },
+ {
+ "epoch": 7.815189873417721,
+ "grad_norm": 0.032968342304229736,
+ "learning_rate": 2.4354657687991024e-05,
+ "loss": 0.020244449377059937,
+ "step": 1547
+ },
+ {
+ "epoch": 7.820253164556962,
+ "grad_norm": 0.04385100305080414,
+ "learning_rate": 2.4298540965207634e-05,
+ "loss": 0.022481925785541534,
+ "step": 1548
+ },
+ {
+ "epoch": 7.8253164556962025,
+ "grad_norm": 0.038451679050922394,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.01878458261489868,
+ "step": 1549
+ },
+ {
+ "epoch": 7.830379746835443,
+ "grad_norm": 0.033544667065143585,
+ "learning_rate": 2.4186307519640854e-05,
+ "loss": 0.016049742698669434,
+ "step": 1550
+ },
+ {
+ "epoch": 7.8354430379746836,
+ "grad_norm": 0.03697581961750984,
+ "learning_rate": 2.4130190796857467e-05,
+ "loss": 0.020224547013640404,
+ "step": 1551
+ },
+ {
+ "epoch": 7.840506329113924,
+ "grad_norm": 0.029879426583647728,
+ "learning_rate": 2.4074074074074074e-05,
+ "loss": 0.020256631076335907,
+ "step": 1552
+ },
+ {
+ "epoch": 7.845569620253165,
+ "grad_norm": 0.04084770381450653,
+ "learning_rate": 2.4017957351290684e-05,
+ "loss": 0.020736820995807648,
+ "step": 1553
+ },
+ {
+ "epoch": 7.850632911392405,
+ "grad_norm": 0.03414049744606018,
+ "learning_rate": 2.3961840628507294e-05,
+ "loss": 0.019767913967370987,
+ "step": 1554
+ },
+ {
+ "epoch": 7.855696202531646,
+ "grad_norm": 0.039317626506090164,
+ "learning_rate": 2.3905723905723908e-05,
+ "loss": 0.018381286412477493,
+ "step": 1555
+ },
+ {
+ "epoch": 7.860759493670886,
+ "grad_norm": 0.031546756625175476,
+ "learning_rate": 2.3849607182940518e-05,
+ "loss": 0.02302321046590805,
+ "step": 1556
+ },
+ {
+ "epoch": 7.865822784810127,
+ "grad_norm": 0.029209598898887634,
+ "learning_rate": 2.3793490460157128e-05,
+ "loss": 0.018067756667733192,
+ "step": 1557
+ },
+ {
+ "epoch": 7.870886075949367,
+ "grad_norm": 0.051513414829969406,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.022878596559166908,
+ "step": 1558
+ },
+ {
+ "epoch": 7.875949367088608,
+ "grad_norm": 0.03623906150460243,
+ "learning_rate": 2.3681257014590348e-05,
+ "loss": 0.023763731122016907,
+ "step": 1559
+ },
+ {
+ "epoch": 7.881012658227848,
+ "grad_norm": 0.07554662227630615,
+ "learning_rate": 2.362514029180696e-05,
+ "loss": 0.030443711206316948,
+ "step": 1560
+ },
+ {
+ "epoch": 7.886075949367089,
+ "grad_norm": 0.0360538624227047,
+ "learning_rate": 2.356902356902357e-05,
+ "loss": 0.021874116733670235,
+ "step": 1561
+ },
+ {
+ "epoch": 7.891139240506329,
+ "grad_norm": 0.047155726701021194,
+ "learning_rate": 2.351290684624018e-05,
+ "loss": 0.019587252289056778,
+ "step": 1562
+ },
+ {
+ "epoch": 7.89620253164557,
+ "grad_norm": 0.04118090867996216,
+ "learning_rate": 2.345679012345679e-05,
+ "loss": 0.019452955573797226,
+ "step": 1563
+ },
+ {
+ "epoch": 7.9012658227848105,
+ "grad_norm": 0.04445638135075569,
+ "learning_rate": 2.34006734006734e-05,
+ "loss": 0.021509487181901932,
+ "step": 1564
+ },
+ {
+ "epoch": 7.90632911392405,
+ "grad_norm": 0.035687156021595,
+ "learning_rate": 2.3344556677890012e-05,
+ "loss": 0.0197590384632349,
+ "step": 1565
+ },
+ {
+ "epoch": 7.911392405063291,
+ "grad_norm": 0.0370895117521286,
+ "learning_rate": 2.3288439955106622e-05,
+ "loss": 0.02165234461426735,
+ "step": 1566
+ },
+ {
+ "epoch": 7.916455696202531,
+ "grad_norm": 0.047829173505306244,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.02411428466439247,
+ "step": 1567
+ },
+ {
+ "epoch": 7.921518987341772,
+ "grad_norm": 0.04207474738359451,
+ "learning_rate": 2.3176206509539845e-05,
+ "loss": 0.01990335062146187,
+ "step": 1568
+ },
+ {
+ "epoch": 7.926582278481012,
+ "grad_norm": 0.03687848150730133,
+ "learning_rate": 2.3120089786756455e-05,
+ "loss": 0.019368968904018402,
+ "step": 1569
+ },
+ {
+ "epoch": 7.931645569620253,
+ "grad_norm": 0.05300358310341835,
+ "learning_rate": 2.3063973063973065e-05,
+ "loss": 0.023623181506991386,
+ "step": 1570
+ },
+ {
+ "epoch": 7.936708860759493,
+ "grad_norm": 0.03355899825692177,
+ "learning_rate": 2.3007856341189676e-05,
+ "loss": 0.020780185237526894,
+ "step": 1571
+ },
+ {
+ "epoch": 7.941772151898734,
+ "grad_norm": 0.03521987795829773,
+ "learning_rate": 2.2951739618406286e-05,
+ "loss": 0.02071826532483101,
+ "step": 1572
+ },
+ {
+ "epoch": 7.946835443037974,
+ "grad_norm": 0.055831391364336014,
+ "learning_rate": 2.28956228956229e-05,
+ "loss": 0.024928733706474304,
+ "step": 1573
+ },
+ {
+ "epoch": 7.951898734177215,
+ "grad_norm": 0.035024408251047134,
+ "learning_rate": 2.2839506172839506e-05,
+ "loss": 0.025659071281552315,
+ "step": 1574
+ },
+ {
+ "epoch": 7.9569620253164555,
+ "grad_norm": 0.02845335751771927,
+ "learning_rate": 2.2783389450056116e-05,
+ "loss": 0.019141599535942078,
+ "step": 1575
+ },
+ {
+ "epoch": 7.962025316455696,
+ "grad_norm": 0.04973668232560158,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.019758496433496475,
+ "step": 1576
+ },
+ {
+ "epoch": 7.9670886075949365,
+ "grad_norm": 0.03656197339296341,
+ "learning_rate": 2.267115600448934e-05,
+ "loss": 0.02074349671602249,
+ "step": 1577
+ },
+ {
+ "epoch": 7.972151898734177,
+ "grad_norm": 0.02872154489159584,
+ "learning_rate": 2.261503928170595e-05,
+ "loss": 0.021470116451382637,
+ "step": 1578
+ },
+ {
+ "epoch": 7.977215189873418,
+ "grad_norm": 0.0539005771279335,
+ "learning_rate": 2.255892255892256e-05,
+ "loss": 0.02254091575741768,
+ "step": 1579
+ },
+ {
+ "epoch": 7.982278481012658,
+ "grad_norm": 0.02891739085316658,
+ "learning_rate": 2.250280583613917e-05,
+ "loss": 0.021109875291585922,
+ "step": 1580
+ },
+ {
+ "epoch": 7.987341772151899,
+ "grad_norm": 0.04463773965835571,
+ "learning_rate": 2.2446689113355783e-05,
+ "loss": 0.01814463920891285,
+ "step": 1581
+ },
+ {
+ "epoch": 7.992405063291139,
+ "grad_norm": 0.02977980673313141,
+ "learning_rate": 2.2390572390572393e-05,
+ "loss": 0.019279852509498596,
+ "step": 1582
+ },
+ {
+ "epoch": 7.99746835443038,
+ "grad_norm": 0.05468489229679108,
+ "learning_rate": 2.2334455667789003e-05,
+ "loss": 0.02706337347626686,
+ "step": 1583
+ },
+ {
+ "epoch": 8.0,
+ "grad_norm": 0.039158184081315994,
+ "learning_rate": 2.2278338945005613e-05,
+ "loss": 0.019180098548531532,
+ "step": 1584
+ },
+ {
+ "epoch": 8.00506329113924,
+ "grad_norm": 0.03874150663614273,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.02349966950714588,
+ "step": 1585
+ },
+ {
+ "epoch": 8.010126582278481,
+ "grad_norm": 0.028303006663918495,
+ "learning_rate": 2.2166105499438833e-05,
+ "loss": 0.020042207092046738,
+ "step": 1586
+ },
+ {
+ "epoch": 8.015189873417722,
+ "grad_norm": 0.027012774720788002,
+ "learning_rate": 2.2109988776655443e-05,
+ "loss": 0.01871410757303238,
+ "step": 1587
+ },
+ {
+ "epoch": 8.020253164556962,
+ "grad_norm": 0.0347730778157711,
+ "learning_rate": 2.2053872053872053e-05,
+ "loss": 0.023310858756303787,
+ "step": 1588
+ },
+ {
+ "epoch": 8.025316455696203,
+ "grad_norm": 0.033759064972400665,
+ "learning_rate": 2.1997755331088667e-05,
+ "loss": 0.02006402425467968,
+ "step": 1589
+ },
+ {
+ "epoch": 8.030379746835443,
+ "grad_norm": 0.043490003794431686,
+ "learning_rate": 2.1941638608305277e-05,
+ "loss": 0.02252586930990219,
+ "step": 1590
+ },
+ {
+ "epoch": 8.035443037974684,
+ "grad_norm": 0.02826276421546936,
+ "learning_rate": 2.1885521885521887e-05,
+ "loss": 0.017057735472917557,
+ "step": 1591
+ },
+ {
+ "epoch": 8.040506329113924,
+ "grad_norm": 0.03614484891295433,
+ "learning_rate": 2.1829405162738497e-05,
+ "loss": 0.019878169521689415,
+ "step": 1592
+ },
+ {
+ "epoch": 8.045569620253165,
+ "grad_norm": 0.0442340224981308,
+ "learning_rate": 2.1773288439955107e-05,
+ "loss": 0.021510383114218712,
+ "step": 1593
+ },
+ {
+ "epoch": 8.050632911392405,
+ "grad_norm": 0.03986986726522446,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.02094593085348606,
+ "step": 1594
+ },
+ {
+ "epoch": 8.055696202531646,
+ "grad_norm": 0.027924973517656326,
+ "learning_rate": 2.166105499438833e-05,
+ "loss": 0.016089333221316338,
+ "step": 1595
+ },
+ {
+ "epoch": 8.060759493670886,
+ "grad_norm": 0.03711482137441635,
+ "learning_rate": 2.1604938271604937e-05,
+ "loss": 0.01916680298745632,
+ "step": 1596
+ },
+ {
+ "epoch": 8.065822784810127,
+ "grad_norm": 0.03245445713400841,
+ "learning_rate": 2.1548821548821547e-05,
+ "loss": 0.018280092626810074,
+ "step": 1597
+ },
+ {
+ "epoch": 8.070886075949367,
+ "grad_norm": 0.03527464717626572,
+ "learning_rate": 2.149270482603816e-05,
+ "loss": 0.01857042871415615,
+ "step": 1598
+ },
+ {
+ "epoch": 8.075949367088608,
+ "grad_norm": 0.04572213441133499,
+ "learning_rate": 2.143658810325477e-05,
+ "loss": 0.019725468009710312,
+ "step": 1599
+ },
+ {
+ "epoch": 8.081012658227849,
+ "grad_norm": 0.052677255123853683,
+ "learning_rate": 2.138047138047138e-05,
+ "loss": 0.020236564800143242,
+ "step": 1600
+ },
+ {
+ "epoch": 8.086075949367089,
+ "grad_norm": 0.038237541913986206,
+ "learning_rate": 2.132435465768799e-05,
+ "loss": 0.02289256826043129,
+ "step": 1601
+ },
+ {
+ "epoch": 8.09113924050633,
+ "grad_norm": 0.04814478009939194,
+ "learning_rate": 2.1268237934904605e-05,
+ "loss": 0.023208077996969223,
+ "step": 1602
+ },
+ {
+ "epoch": 8.09620253164557,
+ "grad_norm": 0.03882291167974472,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.016750838607549667,
+ "step": 1603
+ },
+ {
+ "epoch": 8.10126582278481,
+ "grad_norm": 0.03828950598835945,
+ "learning_rate": 2.1156004489337825e-05,
+ "loss": 0.02248811535537243,
+ "step": 1604
+ },
+ {
+ "epoch": 8.106329113924051,
+ "grad_norm": 0.051767073571681976,
+ "learning_rate": 2.1099887766554435e-05,
+ "loss": 0.020300567150115967,
+ "step": 1605
+ },
+ {
+ "epoch": 8.111392405063292,
+ "grad_norm": 0.03202275186777115,
+ "learning_rate": 2.1043771043771045e-05,
+ "loss": 0.020990904420614243,
+ "step": 1606
+ },
+ {
+ "epoch": 8.116455696202532,
+ "grad_norm": 0.03568022698163986,
+ "learning_rate": 2.0987654320987655e-05,
+ "loss": 0.020043212920427322,
+ "step": 1607
+ },
+ {
+ "epoch": 8.121518987341773,
+ "grad_norm": 0.042120713740587234,
+ "learning_rate": 2.0931537598204265e-05,
+ "loss": 0.018924225121736526,
+ "step": 1608
+ },
+ {
+ "epoch": 8.126582278481013,
+ "grad_norm": 0.07374672591686249,
+ "learning_rate": 2.0875420875420875e-05,
+ "loss": 0.023183997720479965,
+ "step": 1609
+ },
+ {
+ "epoch": 8.131645569620254,
+ "grad_norm": 0.048076704144477844,
+ "learning_rate": 2.0819304152637485e-05,
+ "loss": 0.022698618471622467,
+ "step": 1610
+ },
+ {
+ "epoch": 8.136708860759494,
+ "grad_norm": 0.0357067808508873,
+ "learning_rate": 2.07631874298541e-05,
+ "loss": 0.019262734800577164,
+ "step": 1611
+ },
+ {
+ "epoch": 8.141772151898735,
+ "grad_norm": 0.03643433377146721,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.019496144726872444,
+ "step": 1612
+ },
+ {
+ "epoch": 8.146835443037975,
+ "grad_norm": 0.037579167634248734,
+ "learning_rate": 2.065095398428732e-05,
+ "loss": 0.021149439737200737,
+ "step": 1613
+ },
+ {
+ "epoch": 8.151898734177216,
+ "grad_norm": 0.045883674174547195,
+ "learning_rate": 2.059483726150393e-05,
+ "loss": 0.018761437386274338,
+ "step": 1614
+ },
+ {
+ "epoch": 8.156962025316457,
+ "grad_norm": 0.0358751118183136,
+ "learning_rate": 2.0538720538720542e-05,
+ "loss": 0.017815619707107544,
+ "step": 1615
+ },
+ {
+ "epoch": 8.162025316455697,
+ "grad_norm": 0.02891910821199417,
+ "learning_rate": 2.0482603815937152e-05,
+ "loss": 0.019915573298931122,
+ "step": 1616
+ },
+ {
+ "epoch": 8.167088607594938,
+ "grad_norm": 0.04840585216879845,
+ "learning_rate": 2.042648709315376e-05,
+ "loss": 0.02655443549156189,
+ "step": 1617
+ },
+ {
+ "epoch": 8.172151898734176,
+ "grad_norm": 0.03741428256034851,
+ "learning_rate": 2.037037037037037e-05,
+ "loss": 0.02237093076109886,
+ "step": 1618
+ },
+ {
+ "epoch": 8.177215189873417,
+ "grad_norm": 0.03736718371510506,
+ "learning_rate": 2.0314253647586983e-05,
+ "loss": 0.021470289677381516,
+ "step": 1619
+ },
+ {
+ "epoch": 8.182278481012657,
+ "grad_norm": 0.034190185368061066,
+ "learning_rate": 2.0258136924803593e-05,
+ "loss": 0.01896979846060276,
+ "step": 1620
+ },
+ {
+ "epoch": 8.187341772151898,
+ "grad_norm": 0.05405646190047264,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.025164462625980377,
+ "step": 1621
+ },
+ {
+ "epoch": 8.192405063291138,
+ "grad_norm": 0.03861319646239281,
+ "learning_rate": 2.0145903479236813e-05,
+ "loss": 0.019382188096642494,
+ "step": 1622
+ },
+ {
+ "epoch": 8.197468354430379,
+ "grad_norm": 0.03321823850274086,
+ "learning_rate": 2.0089786756453423e-05,
+ "loss": 0.019713260233402252,
+ "step": 1623
+ },
+ {
+ "epoch": 8.20253164556962,
+ "grad_norm": 0.06996209919452667,
+ "learning_rate": 2.0033670033670036e-05,
+ "loss": 0.02416607365012169,
+ "step": 1624
+ },
+ {
+ "epoch": 8.20759493670886,
+ "grad_norm": 0.029993634670972824,
+ "learning_rate": 1.9977553310886646e-05,
+ "loss": 0.02143584005534649,
+ "step": 1625
+ },
+ {
+ "epoch": 8.2126582278481,
+ "grad_norm": 0.04937511682510376,
+ "learning_rate": 1.9921436588103256e-05,
+ "loss": 0.028348810970783234,
+ "step": 1626
+ },
+ {
+ "epoch": 8.217721518987341,
+ "grad_norm": 0.04342762380838394,
+ "learning_rate": 1.9865319865319866e-05,
+ "loss": 0.015720611438155174,
+ "step": 1627
+ },
+ {
+ "epoch": 8.222784810126582,
+ "grad_norm": 0.045899055898189545,
+ "learning_rate": 1.9809203142536477e-05,
+ "loss": 0.026816781610250473,
+ "step": 1628
+ },
+ {
+ "epoch": 8.227848101265822,
+ "grad_norm": 0.040222615003585815,
+ "learning_rate": 1.9753086419753087e-05,
+ "loss": 0.022753147408366203,
+ "step": 1629
+ },
+ {
+ "epoch": 8.232911392405063,
+ "grad_norm": 0.09004436433315277,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.020190425217151642,
+ "step": 1630
+ },
+ {
+ "epoch": 8.237974683544303,
+ "grad_norm": 0.02380538359284401,
+ "learning_rate": 1.9640852974186307e-05,
+ "loss": 0.018503259867429733,
+ "step": 1631
+ },
+ {
+ "epoch": 8.243037974683544,
+ "grad_norm": 0.027618510648608208,
+ "learning_rate": 1.958473625140292e-05,
+ "loss": 0.017995689064264297,
+ "step": 1632
+ },
+ {
+ "epoch": 8.248101265822784,
+ "grad_norm": 0.030420871451497078,
+ "learning_rate": 1.952861952861953e-05,
+ "loss": 0.014693077653646469,
+ "step": 1633
+ },
+ {
+ "epoch": 8.253164556962025,
+ "grad_norm": 0.04113646596670151,
+ "learning_rate": 1.947250280583614e-05,
+ "loss": 0.01770118996500969,
+ "step": 1634
+ },
+ {
+ "epoch": 8.258227848101265,
+ "grad_norm": 0.045156482607126236,
+ "learning_rate": 1.941638608305275e-05,
+ "loss": 0.020409928634762764,
+ "step": 1635
+ },
+ {
+ "epoch": 8.263291139240506,
+ "grad_norm": 0.04830678552389145,
+ "learning_rate": 1.936026936026936e-05,
+ "loss": 0.018951844424009323,
+ "step": 1636
+ },
+ {
+ "epoch": 8.268354430379746,
+ "grad_norm": 0.06338296085596085,
+ "learning_rate": 1.9304152637485974e-05,
+ "loss": 0.023953819647431374,
+ "step": 1637
+ },
+ {
+ "epoch": 8.273417721518987,
+ "grad_norm": 0.038997847586870193,
+ "learning_rate": 1.9248035914702584e-05,
+ "loss": 0.020438311621546745,
+ "step": 1638
+ },
+ {
+ "epoch": 8.278481012658228,
+ "grad_norm": 0.030472544953227043,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.02027466520667076,
+ "step": 1639
+ },
+ {
+ "epoch": 8.283544303797468,
+ "grad_norm": 0.03637097775936127,
+ "learning_rate": 1.91358024691358e-05,
+ "loss": 0.018772058188915253,
+ "step": 1640
+ },
+ {
+ "epoch": 8.288607594936709,
+ "grad_norm": 0.036580171436071396,
+ "learning_rate": 1.9079685746352414e-05,
+ "loss": 0.018405672162771225,
+ "step": 1641
+ },
+ {
+ "epoch": 8.29367088607595,
+ "grad_norm": 0.044952355325222015,
+ "learning_rate": 1.9023569023569024e-05,
+ "loss": 0.0315709188580513,
+ "step": 1642
+ },
+ {
+ "epoch": 8.29873417721519,
+ "grad_norm": 0.04381463676691055,
+ "learning_rate": 1.8967452300785634e-05,
+ "loss": 0.025517355650663376,
+ "step": 1643
+ },
+ {
+ "epoch": 8.30379746835443,
+ "grad_norm": 0.03697361797094345,
+ "learning_rate": 1.8911335578002244e-05,
+ "loss": 0.01883242279291153,
+ "step": 1644
+ },
+ {
+ "epoch": 8.30886075949367,
+ "grad_norm": 0.025049922987818718,
+ "learning_rate": 1.8855218855218858e-05,
+ "loss": 0.01739310473203659,
+ "step": 1645
+ },
+ {
+ "epoch": 8.313924050632911,
+ "grad_norm": 0.04703689366579056,
+ "learning_rate": 1.8799102132435468e-05,
+ "loss": 0.021556306630373,
+ "step": 1646
+ },
+ {
+ "epoch": 8.318987341772152,
+ "grad_norm": 0.026696166023612022,
+ "learning_rate": 1.8742985409652078e-05,
+ "loss": 0.018746083602309227,
+ "step": 1647
+ },
+ {
+ "epoch": 8.324050632911392,
+ "grad_norm": 0.04652746394276619,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.026190966367721558,
+ "step": 1648
+ },
+ {
+ "epoch": 8.329113924050633,
+ "grad_norm": 0.03909657150506973,
+ "learning_rate": 1.8630751964085298e-05,
+ "loss": 0.01834474503993988,
+ "step": 1649
+ },
+ {
+ "epoch": 8.334177215189873,
+ "grad_norm": 0.03401157632470131,
+ "learning_rate": 1.8574635241301908e-05,
+ "loss": 0.02036638930439949,
+ "step": 1650
+ },
+ {
+ "epoch": 8.339240506329114,
+ "grad_norm": 0.03521033748984337,
+ "learning_rate": 1.8518518518518518e-05,
+ "loss": 0.017022229731082916,
+ "step": 1651
+ },
+ {
+ "epoch": 8.344303797468354,
+ "grad_norm": 0.035023730248212814,
+ "learning_rate": 1.846240179573513e-05,
+ "loss": 0.020699895918369293,
+ "step": 1652
+ },
+ {
+ "epoch": 8.349367088607595,
+ "grad_norm": 0.03863868862390518,
+ "learning_rate": 1.840628507295174e-05,
+ "loss": 0.023510808125138283,
+ "step": 1653
+ },
+ {
+ "epoch": 8.354430379746836,
+ "grad_norm": 0.02204951085150242,
+ "learning_rate": 1.8350168350168352e-05,
+ "loss": 0.018996592611074448,
+ "step": 1654
+ },
+ {
+ "epoch": 8.359493670886076,
+ "grad_norm": 0.03648384287953377,
+ "learning_rate": 1.8294051627384962e-05,
+ "loss": 0.020242292433977127,
+ "step": 1655
+ },
+ {
+ "epoch": 8.364556962025317,
+ "grad_norm": 0.02552957460284233,
+ "learning_rate": 1.8237934904601572e-05,
+ "loss": 0.01911015436053276,
+ "step": 1656
+ },
+ {
+ "epoch": 8.369620253164557,
+ "grad_norm": 0.03243561089038849,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.016632333397865295,
+ "step": 1657
+ },
+ {
+ "epoch": 8.374683544303798,
+ "grad_norm": 0.03896692395210266,
+ "learning_rate": 1.8125701459034796e-05,
+ "loss": 0.021029481664299965,
+ "step": 1658
+ },
+ {
+ "epoch": 8.379746835443038,
+ "grad_norm": 0.05999606102705002,
+ "learning_rate": 1.8069584736251406e-05,
+ "loss": 0.025573844090104103,
+ "step": 1659
+ },
+ {
+ "epoch": 8.384810126582279,
+ "grad_norm": 0.025940202176570892,
+ "learning_rate": 1.8013468013468016e-05,
+ "loss": 0.016936955973505974,
+ "step": 1660
+ },
+ {
+ "epoch": 8.38987341772152,
+ "grad_norm": 0.026151031255722046,
+ "learning_rate": 1.7957351290684622e-05,
+ "loss": 0.01887635514140129,
+ "step": 1661
+ },
+ {
+ "epoch": 8.39493670886076,
+ "grad_norm": 0.0342579111456871,
+ "learning_rate": 1.7901234567901236e-05,
+ "loss": 0.01805766299366951,
+ "step": 1662
+ },
+ {
+ "epoch": 8.4,
+ "grad_norm": 0.02385263331234455,
+ "learning_rate": 1.7845117845117846e-05,
+ "loss": 0.016147712245583534,
+ "step": 1663
+ },
+ {
+ "epoch": 8.405063291139241,
+ "grad_norm": 0.031331419944763184,
+ "learning_rate": 1.7789001122334456e-05,
+ "loss": 0.021235540509223938,
+ "step": 1664
+ },
+ {
+ "epoch": 8.410126582278481,
+ "grad_norm": 0.04477498680353165,
+ "learning_rate": 1.7732884399551066e-05,
+ "loss": 0.026890354230999947,
+ "step": 1665
+ },
+ {
+ "epoch": 8.415189873417722,
+ "grad_norm": 0.022508280351758003,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.01546957716345787,
+ "step": 1666
+ },
+ {
+ "epoch": 8.420253164556962,
+ "grad_norm": 0.02612249366939068,
+ "learning_rate": 1.762065095398429e-05,
+ "loss": 0.018115274608135223,
+ "step": 1667
+ },
+ {
+ "epoch": 8.425316455696203,
+ "grad_norm": 0.03443365916609764,
+ "learning_rate": 1.75645342312009e-05,
+ "loss": 0.02186448872089386,
+ "step": 1668
+ },
+ {
+ "epoch": 8.430379746835444,
+ "grad_norm": 0.0335167795419693,
+ "learning_rate": 1.750841750841751e-05,
+ "loss": 0.022555597126483917,
+ "step": 1669
+ },
+ {
+ "epoch": 8.435443037974684,
+ "grad_norm": 0.043306734412908554,
+ "learning_rate": 1.745230078563412e-05,
+ "loss": 0.023090258240699768,
+ "step": 1670
+ },
+ {
+ "epoch": 8.440506329113925,
+ "grad_norm": 0.045756179839372635,
+ "learning_rate": 1.7396184062850733e-05,
+ "loss": 0.02251247689127922,
+ "step": 1671
+ },
+ {
+ "epoch": 8.445569620253165,
+ "grad_norm": 0.04961887747049332,
+ "learning_rate": 1.734006734006734e-05,
+ "loss": 0.023708034306764603,
+ "step": 1672
+ },
+ {
+ "epoch": 8.450632911392406,
+ "grad_norm": 0.03879154846072197,
+ "learning_rate": 1.728395061728395e-05,
+ "loss": 0.019672028720378876,
+ "step": 1673
+ },
+ {
+ "epoch": 8.455696202531646,
+ "grad_norm": 0.030347641557455063,
+ "learning_rate": 1.722783389450056e-05,
+ "loss": 0.01895594596862793,
+ "step": 1674
+ },
+ {
+ "epoch": 8.460759493670887,
+ "grad_norm": 0.05273548886179924,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.026300976052880287,
+ "step": 1675
+ },
+ {
+ "epoch": 8.465822784810127,
+ "grad_norm": 0.021372321993112564,
+ "learning_rate": 1.7115600448933784e-05,
+ "loss": 0.01731477677822113,
+ "step": 1676
+ },
+ {
+ "epoch": 8.470886075949368,
+ "grad_norm": 0.03678557649254799,
+ "learning_rate": 1.7059483726150394e-05,
+ "loss": 0.020638134330511093,
+ "step": 1677
+ },
+ {
+ "epoch": 8.475949367088608,
+ "grad_norm": 0.020072737708687782,
+ "learning_rate": 1.7003367003367004e-05,
+ "loss": 0.016518577933311462,
+ "step": 1678
+ },
+ {
+ "epoch": 8.481012658227849,
+ "grad_norm": 0.035935647785663605,
+ "learning_rate": 1.6947250280583614e-05,
+ "loss": 0.02194409817457199,
+ "step": 1679
+ },
+ {
+ "epoch": 8.48607594936709,
+ "grad_norm": 0.03272787109017372,
+ "learning_rate": 1.6891133557800227e-05,
+ "loss": 0.021359751001000404,
+ "step": 1680
+ },
+ {
+ "epoch": 8.49113924050633,
+ "grad_norm": 0.024064186960458755,
+ "learning_rate": 1.6835016835016837e-05,
+ "loss": 0.020910244435071945,
+ "step": 1681
+ },
+ {
+ "epoch": 8.496202531645569,
+ "grad_norm": 0.07355224341154099,
+ "learning_rate": 1.6778900112233447e-05,
+ "loss": 0.023593805730342865,
+ "step": 1682
+ },
+ {
+ "epoch": 8.50126582278481,
+ "grad_norm": 0.04556228592991829,
+ "learning_rate": 1.6722783389450057e-05,
+ "loss": 0.023713823407888412,
+ "step": 1683
+ },
+ {
+ "epoch": 8.50632911392405,
+ "grad_norm": 0.022360576316714287,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.015103806741535664,
+ "step": 1684
+ },
+ {
+ "epoch": 8.51139240506329,
+ "grad_norm": 0.024630824103951454,
+ "learning_rate": 1.6610549943883278e-05,
+ "loss": 0.01824590191245079,
+ "step": 1685
+ },
+ {
+ "epoch": 8.51645569620253,
+ "grad_norm": 0.02524208277463913,
+ "learning_rate": 1.6554433221099888e-05,
+ "loss": 0.01721012592315674,
+ "step": 1686
+ },
+ {
+ "epoch": 8.521518987341771,
+ "grad_norm": 0.043577272444963455,
+ "learning_rate": 1.6498316498316498e-05,
+ "loss": 0.02484818734228611,
+ "step": 1687
+ },
+ {
+ "epoch": 8.526582278481012,
+ "grad_norm": 0.040581341832876205,
+ "learning_rate": 1.644219977553311e-05,
+ "loss": 0.020861376076936722,
+ "step": 1688
+ },
+ {
+ "epoch": 8.531645569620252,
+ "grad_norm": 0.043159108608961105,
+ "learning_rate": 1.638608305274972e-05,
+ "loss": 0.024222414940595627,
+ "step": 1689
+ },
+ {
+ "epoch": 8.536708860759493,
+ "grad_norm": 0.032750554382801056,
+ "learning_rate": 1.632996632996633e-05,
+ "loss": 0.021366942673921585,
+ "step": 1690
+ },
+ {
+ "epoch": 8.541772151898734,
+ "grad_norm": 0.06848470121622086,
+ "learning_rate": 1.627384960718294e-05,
+ "loss": 0.02088351361453533,
+ "step": 1691
+ },
+ {
+ "epoch": 8.546835443037974,
+ "grad_norm": 0.018929218873381615,
+ "learning_rate": 1.621773288439955e-05,
+ "loss": 0.01409424189478159,
+ "step": 1692
+ },
+ {
+ "epoch": 8.551898734177215,
+ "grad_norm": 0.0196766946464777,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.015851899981498718,
+ "step": 1693
+ },
+ {
+ "epoch": 8.556962025316455,
+ "grad_norm": 0.04986285790801048,
+ "learning_rate": 1.610549943883277e-05,
+ "loss": 0.02252126857638359,
+ "step": 1694
+ },
+ {
+ "epoch": 8.562025316455696,
+ "grad_norm": 0.036650970578193665,
+ "learning_rate": 1.604938271604938e-05,
+ "loss": 0.025080909952521324,
+ "step": 1695
+ },
+ {
+ "epoch": 8.567088607594936,
+ "grad_norm": 0.06662989407777786,
+ "learning_rate": 1.5993265993265995e-05,
+ "loss": 0.017443537712097168,
+ "step": 1696
+ },
+ {
+ "epoch": 8.572151898734177,
+ "grad_norm": 0.033134326338768005,
+ "learning_rate": 1.5937149270482605e-05,
+ "loss": 0.01927754282951355,
+ "step": 1697
+ },
+ {
+ "epoch": 8.577215189873417,
+ "grad_norm": 0.03530196473002434,
+ "learning_rate": 1.5881032547699215e-05,
+ "loss": 0.017344174906611443,
+ "step": 1698
+ },
+ {
+ "epoch": 8.582278481012658,
+ "grad_norm": 0.04167468845844269,
+ "learning_rate": 1.5824915824915825e-05,
+ "loss": 0.017574958503246307,
+ "step": 1699
+ },
+ {
+ "epoch": 8.587341772151898,
+ "grad_norm": 0.03879455849528313,
+ "learning_rate": 1.5768799102132435e-05,
+ "loss": 0.022970087826251984,
+ "step": 1700
+ },
+ {
+ "epoch": 8.592405063291139,
+ "grad_norm": 0.039318036288022995,
+ "learning_rate": 1.571268237934905e-05,
+ "loss": 0.023542512208223343,
+ "step": 1701
+ },
+ {
+ "epoch": 8.59746835443038,
+ "grad_norm": 0.04210037738084793,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.020435117185115814,
+ "step": 1702
+ },
+ {
+ "epoch": 8.60253164556962,
+ "grad_norm": 0.05356878042221069,
+ "learning_rate": 1.560044893378227e-05,
+ "loss": 0.029099322855472565,
+ "step": 1703
+ },
+ {
+ "epoch": 8.60759493670886,
+ "grad_norm": 0.04548292234539986,
+ "learning_rate": 1.5544332210998876e-05,
+ "loss": 0.02403360977768898,
+ "step": 1704
+ },
+ {
+ "epoch": 8.612658227848101,
+ "grad_norm": 0.058599721640348434,
+ "learning_rate": 1.548821548821549e-05,
+ "loss": 0.019631415605545044,
+ "step": 1705
+ },
+ {
+ "epoch": 8.617721518987342,
+ "grad_norm": 0.048964597284793854,
+ "learning_rate": 1.54320987654321e-05,
+ "loss": 0.02591722458600998,
+ "step": 1706
+ },
+ {
+ "epoch": 8.622784810126582,
+ "grad_norm": 0.03341981768608093,
+ "learning_rate": 1.537598204264871e-05,
+ "loss": 0.01625223457813263,
+ "step": 1707
+ },
+ {
+ "epoch": 8.627848101265823,
+ "grad_norm": 0.04235633835196495,
+ "learning_rate": 1.531986531986532e-05,
+ "loss": 0.02332795225083828,
+ "step": 1708
+ },
+ {
+ "epoch": 8.632911392405063,
+ "grad_norm": 0.04729039594531059,
+ "learning_rate": 1.5263748597081933e-05,
+ "loss": 0.026190035045146942,
+ "step": 1709
+ },
+ {
+ "epoch": 8.637974683544304,
+ "grad_norm": 0.049981195479631424,
+ "learning_rate": 1.5207631874298541e-05,
+ "loss": 0.01922479085624218,
+ "step": 1710
+ },
+ {
+ "epoch": 8.643037974683544,
+ "grad_norm": 0.035248979926109314,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 0.01900644041597843,
+ "step": 1711
+ },
+ {
+ "epoch": 8.648101265822785,
+ "grad_norm": 0.026077786460518837,
+ "learning_rate": 1.5095398428731763e-05,
+ "loss": 0.01419617235660553,
+ "step": 1712
+ },
+ {
+ "epoch": 8.653164556962025,
+ "grad_norm": 0.03994458541274071,
+ "learning_rate": 1.5039281705948375e-05,
+ "loss": 0.020943276584148407,
+ "step": 1713
+ },
+ {
+ "epoch": 8.658227848101266,
+ "grad_norm": 0.040251314640045166,
+ "learning_rate": 1.4983164983164985e-05,
+ "loss": 0.018465735018253326,
+ "step": 1714
+ },
+ {
+ "epoch": 8.663291139240506,
+ "grad_norm": 0.057643208652734756,
+ "learning_rate": 1.4927048260381593e-05,
+ "loss": 0.02323145791888237,
+ "step": 1715
+ },
+ {
+ "epoch": 8.668354430379747,
+ "grad_norm": 0.035218413919210434,
+ "learning_rate": 1.4870931537598203e-05,
+ "loss": 0.021585840731859207,
+ "step": 1716
+ },
+ {
+ "epoch": 8.673417721518987,
+ "grad_norm": 0.046144526451826096,
+ "learning_rate": 1.4814814814814815e-05,
+ "loss": 0.02442515268921852,
+ "step": 1717
+ },
+ {
+ "epoch": 8.678481012658228,
+ "grad_norm": 0.04745814576745033,
+ "learning_rate": 1.4758698092031425e-05,
+ "loss": 0.02154768817126751,
+ "step": 1718
+ },
+ {
+ "epoch": 8.683544303797468,
+ "grad_norm": 0.04004049673676491,
+ "learning_rate": 1.4702581369248037e-05,
+ "loss": 0.02032260037958622,
+ "step": 1719
+ },
+ {
+ "epoch": 8.688607594936709,
+ "grad_norm": 0.049177829176187515,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 0.02218678593635559,
+ "step": 1720
+ },
+ {
+ "epoch": 8.69367088607595,
+ "grad_norm": 0.0472177118062973,
+ "learning_rate": 1.4590347923681259e-05,
+ "loss": 0.02500525861978531,
+ "step": 1721
+ },
+ {
+ "epoch": 8.69873417721519,
+ "grad_norm": 0.025222698226571083,
+ "learning_rate": 1.4534231200897869e-05,
+ "loss": 0.016689050942659378,
+ "step": 1722
+ },
+ {
+ "epoch": 8.70379746835443,
+ "grad_norm": 0.031236030161380768,
+ "learning_rate": 1.4478114478114479e-05,
+ "loss": 0.018756099045276642,
+ "step": 1723
+ },
+ {
+ "epoch": 8.708860759493671,
+ "grad_norm": 0.05628811568021774,
+ "learning_rate": 1.442199775533109e-05,
+ "loss": 0.02265356108546257,
+ "step": 1724
+ },
+ {
+ "epoch": 8.713924050632912,
+ "grad_norm": 0.04260335490107536,
+ "learning_rate": 1.43658810325477e-05,
+ "loss": 0.01870463788509369,
+ "step": 1725
+ },
+ {
+ "epoch": 8.718987341772152,
+ "grad_norm": 0.040789660066366196,
+ "learning_rate": 1.4309764309764309e-05,
+ "loss": 0.01859685778617859,
+ "step": 1726
+ },
+ {
+ "epoch": 8.724050632911393,
+ "grad_norm": 0.048222146928310394,
+ "learning_rate": 1.425364758698092e-05,
+ "loss": 0.021515006199479103,
+ "step": 1727
+ },
+ {
+ "epoch": 8.729113924050633,
+ "grad_norm": 0.04557273909449577,
+ "learning_rate": 1.419753086419753e-05,
+ "loss": 0.01895933598279953,
+ "step": 1728
+ },
+ {
+ "epoch": 8.734177215189874,
+ "grad_norm": 0.03032032586634159,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.017313968390226364,
+ "step": 1729
+ },
+ {
+ "epoch": 8.739240506329114,
+ "grad_norm": 0.03724924474954605,
+ "learning_rate": 1.4085297418630753e-05,
+ "loss": 0.019865073263645172,
+ "step": 1730
+ },
+ {
+ "epoch": 8.744303797468355,
+ "grad_norm": 0.03196002170443535,
+ "learning_rate": 1.4029180695847363e-05,
+ "loss": 0.01838015392422676,
+ "step": 1731
+ },
+ {
+ "epoch": 8.749367088607595,
+ "grad_norm": 0.04037972912192345,
+ "learning_rate": 1.3973063973063974e-05,
+ "loss": 0.018499307334423065,
+ "step": 1732
+ },
+ {
+ "epoch": 8.754430379746836,
+ "grad_norm": 0.0446816124022007,
+ "learning_rate": 1.3916947250280585e-05,
+ "loss": 0.023477882146835327,
+ "step": 1733
+ },
+ {
+ "epoch": 8.759493670886076,
+ "grad_norm": 0.05564434453845024,
+ "learning_rate": 1.3860830527497196e-05,
+ "loss": 0.02302028052508831,
+ "step": 1734
+ },
+ {
+ "epoch": 8.764556962025317,
+ "grad_norm": 0.05366382375359535,
+ "learning_rate": 1.3804713804713806e-05,
+ "loss": 0.019608285278081894,
+ "step": 1735
+ },
+ {
+ "epoch": 8.769620253164558,
+ "grad_norm": 0.026229161769151688,
+ "learning_rate": 1.3748597081930416e-05,
+ "loss": 0.017702946439385414,
+ "step": 1736
+ },
+ {
+ "epoch": 8.774683544303798,
+ "grad_norm": 0.043612100183963776,
+ "learning_rate": 1.3692480359147025e-05,
+ "loss": 0.024102207273244858,
+ "step": 1737
+ },
+ {
+ "epoch": 8.779746835443039,
+ "grad_norm": 0.06441514939069748,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.018779249861836433,
+ "step": 1738
+ },
+ {
+ "epoch": 8.784810126582279,
+ "grad_norm": 0.033235881477594376,
+ "learning_rate": 1.3580246913580247e-05,
+ "loss": 0.021414864808321,
+ "step": 1739
+ },
+ {
+ "epoch": 8.78987341772152,
+ "grad_norm": 0.06340032815933228,
+ "learning_rate": 1.3524130190796858e-05,
+ "loss": 0.028709903359413147,
+ "step": 1740
+ },
+ {
+ "epoch": 8.79493670886076,
+ "grad_norm": 0.04297724738717079,
+ "learning_rate": 1.3468013468013468e-05,
+ "loss": 0.017328426241874695,
+ "step": 1741
+ },
+ {
+ "epoch": 8.8,
+ "grad_norm": 0.05757950246334076,
+ "learning_rate": 1.3411896745230079e-05,
+ "loss": 0.020599257200956345,
+ "step": 1742
+ },
+ {
+ "epoch": 8.805063291139241,
+ "grad_norm": 0.04797070473432541,
+ "learning_rate": 1.335578002244669e-05,
+ "loss": 0.021628066897392273,
+ "step": 1743
+ },
+ {
+ "epoch": 8.810126582278482,
+ "grad_norm": 0.02652834728360176,
+ "learning_rate": 1.32996632996633e-05,
+ "loss": 0.01941632851958275,
+ "step": 1744
+ },
+ {
+ "epoch": 8.815189873417722,
+ "grad_norm": 0.03820030018687248,
+ "learning_rate": 1.3243546576879912e-05,
+ "loss": 0.026358280330896378,
+ "step": 1745
+ },
+ {
+ "epoch": 8.820253164556963,
+ "grad_norm": 0.043385930359363556,
+ "learning_rate": 1.3187429854096522e-05,
+ "loss": 0.019407518208026886,
+ "step": 1746
+ },
+ {
+ "epoch": 8.825316455696203,
+ "grad_norm": 0.15225189924240112,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.026875533163547516,
+ "step": 1747
+ },
+ {
+ "epoch": 8.830379746835444,
+ "grad_norm": 0.0693509504199028,
+ "learning_rate": 1.307519640852974e-05,
+ "loss": 0.031278014183044434,
+ "step": 1748
+ },
+ {
+ "epoch": 8.835443037974684,
+ "grad_norm": 0.039454419165849686,
+ "learning_rate": 1.3019079685746352e-05,
+ "loss": 0.022833138704299927,
+ "step": 1749
+ },
+ {
+ "epoch": 8.840506329113925,
+ "grad_norm": 0.05326049402356148,
+ "learning_rate": 1.2962962962962962e-05,
+ "loss": 0.020145760849118233,
+ "step": 1750
+ },
+ {
+ "epoch": 8.845569620253164,
+ "grad_norm": 0.054488569498062134,
+ "learning_rate": 1.2906846240179574e-05,
+ "loss": 0.020528502762317657,
+ "step": 1751
+ },
+ {
+ "epoch": 8.850632911392404,
+ "grad_norm": 0.03178486227989197,
+ "learning_rate": 1.2850729517396184e-05,
+ "loss": 0.019795618951320648,
+ "step": 1752
+ },
+ {
+ "epoch": 8.855696202531645,
+ "grad_norm": 0.03832017630338669,
+ "learning_rate": 1.2794612794612796e-05,
+ "loss": 0.021070487797260284,
+ "step": 1753
+ },
+ {
+ "epoch": 8.860759493670885,
+ "grad_norm": 0.034100815653800964,
+ "learning_rate": 1.2738496071829406e-05,
+ "loss": 0.02188778668642044,
+ "step": 1754
+ },
+ {
+ "epoch": 8.865822784810126,
+ "grad_norm": 0.04417391121387482,
+ "learning_rate": 1.2682379349046016e-05,
+ "loss": 0.02592797949910164,
+ "step": 1755
+ },
+ {
+ "epoch": 8.870886075949366,
+ "grad_norm": 0.04168103262782097,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 0.0172443687915802,
+ "step": 1756
+ },
+ {
+ "epoch": 8.875949367088607,
+ "grad_norm": 0.05162866413593292,
+ "learning_rate": 1.2570145903479238e-05,
+ "loss": 0.026856279000639915,
+ "step": 1757
+ },
+ {
+ "epoch": 8.881012658227847,
+ "grad_norm": 0.04332068935036659,
+ "learning_rate": 1.251402918069585e-05,
+ "loss": 0.019132032990455627,
+ "step": 1758
+ },
+ {
+ "epoch": 8.886075949367088,
+ "grad_norm": 0.05732255056500435,
+ "learning_rate": 1.2457912457912458e-05,
+ "loss": 0.02246692404150963,
+ "step": 1759
+ },
+ {
+ "epoch": 8.891139240506329,
+ "grad_norm": 0.03296470269560814,
+ "learning_rate": 1.240179573512907e-05,
+ "loss": 0.016651242971420288,
+ "step": 1760
+ },
+ {
+ "epoch": 8.896202531645569,
+ "grad_norm": 0.03243505209684372,
+ "learning_rate": 1.2345679012345678e-05,
+ "loss": 0.022674527019262314,
+ "step": 1761
+ },
+ {
+ "epoch": 8.90126582278481,
+ "grad_norm": 0.031305041164159775,
+ "learning_rate": 1.228956228956229e-05,
+ "loss": 0.020587362349033356,
+ "step": 1762
+ },
+ {
+ "epoch": 8.90632911392405,
+ "grad_norm": 0.032173529267311096,
+ "learning_rate": 1.22334455667789e-05,
+ "loss": 0.016672726720571518,
+ "step": 1763
+ },
+ {
+ "epoch": 8.91139240506329,
+ "grad_norm": 0.024416670203208923,
+ "learning_rate": 1.2177328843995512e-05,
+ "loss": 0.015204197727143764,
+ "step": 1764
+ },
+ {
+ "epoch": 8.916455696202531,
+ "grad_norm": 0.0479590967297554,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.024873821064829826,
+ "step": 1765
+ },
+ {
+ "epoch": 8.921518987341772,
+ "grad_norm": 0.027549419552087784,
+ "learning_rate": 1.2065095398428734e-05,
+ "loss": 0.019144555553793907,
+ "step": 1766
+ },
+ {
+ "epoch": 8.926582278481012,
+ "grad_norm": 0.024039549753069878,
+ "learning_rate": 1.2008978675645342e-05,
+ "loss": 0.017182042822241783,
+ "step": 1767
+ },
+ {
+ "epoch": 8.931645569620253,
+ "grad_norm": 0.03899740055203438,
+ "learning_rate": 1.1952861952861954e-05,
+ "loss": 0.020350690931081772,
+ "step": 1768
+ },
+ {
+ "epoch": 8.936708860759493,
+ "grad_norm": 0.03636085242033005,
+ "learning_rate": 1.1896745230078564e-05,
+ "loss": 0.020022999495267868,
+ "step": 1769
+ },
+ {
+ "epoch": 8.941772151898734,
+ "grad_norm": 0.03000877983868122,
+ "learning_rate": 1.1840628507295174e-05,
+ "loss": 0.01844680681824684,
+ "step": 1770
+ },
+ {
+ "epoch": 8.946835443037974,
+ "grad_norm": 0.03979242593050003,
+ "learning_rate": 1.1784511784511786e-05,
+ "loss": 0.02085147425532341,
+ "step": 1771
+ },
+ {
+ "epoch": 8.951898734177215,
+ "grad_norm": 0.028240645304322243,
+ "learning_rate": 1.1728395061728396e-05,
+ "loss": 0.016546549275517464,
+ "step": 1772
+ },
+ {
+ "epoch": 8.956962025316455,
+ "grad_norm": 0.033536069095134735,
+ "learning_rate": 1.1672278338945006e-05,
+ "loss": 0.01593935489654541,
+ "step": 1773
+ },
+ {
+ "epoch": 8.962025316455696,
+ "grad_norm": 0.04754582792520523,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.026883091777563095,
+ "step": 1774
+ },
+ {
+ "epoch": 8.967088607594937,
+ "grad_norm": 0.04063970968127251,
+ "learning_rate": 1.1560044893378228e-05,
+ "loss": 0.019803281873464584,
+ "step": 1775
+ },
+ {
+ "epoch": 8.972151898734177,
+ "grad_norm": 0.031503964215517044,
+ "learning_rate": 1.1503928170594838e-05,
+ "loss": 0.01680890843272209,
+ "step": 1776
+ },
+ {
+ "epoch": 8.977215189873418,
+ "grad_norm": 0.03479184955358505,
+ "learning_rate": 1.144781144781145e-05,
+ "loss": 0.02515973523259163,
+ "step": 1777
+ },
+ {
+ "epoch": 8.982278481012658,
+ "grad_norm": 0.05013234168291092,
+ "learning_rate": 1.1391694725028058e-05,
+ "loss": 0.02148749679327011,
+ "step": 1778
+ },
+ {
+ "epoch": 8.987341772151899,
+ "grad_norm": 0.03847988322377205,
+ "learning_rate": 1.133557800224467e-05,
+ "loss": 0.024204935878515244,
+ "step": 1779
+ },
+ {
+ "epoch": 8.99240506329114,
+ "grad_norm": 0.039273642003536224,
+ "learning_rate": 1.127946127946128e-05,
+ "loss": 0.020495504140853882,
+ "step": 1780
+ },
+ {
+ "epoch": 8.99746835443038,
+ "grad_norm": 0.041439611464738846,
+ "learning_rate": 1.1223344556677892e-05,
+ "loss": 0.019127510488033295,
+ "step": 1781
+ },
+ {
+ "epoch": 9.0,
+ "grad_norm": 0.05990270525217056,
+ "learning_rate": 1.1167227833894502e-05,
+ "loss": 0.023109547793865204,
+ "step": 1782
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 1980,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 1.1347430021858304e+17,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-1782/training_args.bin b/checkpoint-1782/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ce6b9228ad6cf155da5af64a370f864d5fe04e56
--- /dev/null
+++ b/checkpoint-1782/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3a4d7936dc7001e3baf6e9cead308b6188ace221538f9d436668bdf0b1d43a1
+size 5777
diff --git a/checkpoint-198/README.md b/checkpoint-198/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-198/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-198/adapter_config.json b/checkpoint-198/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..bbcc7740fbc3841db465c9aa396dca7834e891f0
--- /dev/null
+++ b/checkpoint-198/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "v_proj",
+ "q_proj",
+ "up_proj",
+ "o_proj",
+ "k_proj",
+ "down_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-198/adapter_model.safetensors b/checkpoint-198/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3728a0a26bf2016b58cedaaa6828aeed0a5d2d15
--- /dev/null
+++ b/checkpoint-198/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8363c9504c86972c3986c6ffb87102171155a7f8621260e4cdb831c7273fd27e
+size 132187888
diff --git a/checkpoint-198/chat_template.jinja b/checkpoint-198/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-198/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-198/optimizer.pt b/checkpoint-198/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..e9aefa937b3156c3739f5eef6a707f156085754f
--- /dev/null
+++ b/checkpoint-198/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e0df4ee7e14ef7f8e73a7a5f8a80c897a3e2e673070188b687e252e986c04d3
+size 67688197
diff --git a/checkpoint-198/rng_state.pth b/checkpoint-198/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..3ef66339b9befa098183fd5d69faed6838e526b0
--- /dev/null
+++ b/checkpoint-198/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1d565802a8e26c4e8a31328752b7a7fdc186d9401aa008e65697d0ad8c22e33
+size 14645
diff --git a/checkpoint-198/scheduler.pt b/checkpoint-198/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ba2623e17141bd5cf9070ac8693a02b33e7291c3
--- /dev/null
+++ b/checkpoint-198/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b8dc5505c41534580fd888ad85927fab8d0fe328fbd45dc5ad44ee60ec16b39
+size 1465
diff --git a/checkpoint-198/tokenizer.json b/checkpoint-198/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-198/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-198/tokenizer_config.json b/checkpoint-198/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-198/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-198/trainer_state.json b/checkpoint-198/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..2a7c0b8732f6f66d8a7f8bfcf59e1fc4b05bec5b
--- /dev/null
+++ b/checkpoint-198/trainer_state.json
@@ -0,0 +1,1420 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 1.0,
+ "eval_steps": 500,
+ "global_step": 198,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.541267991065979,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279298663139343,
+ "learning_rate": 2.5e-06,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.688083827495575,
+ "learning_rate": 5e-06,
+ "loss": 1.0431158542633057,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6006338000297546,
+ "learning_rate": 7.5e-06,
+ "loss": 0.8824265003204346,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5470584034919739,
+ "learning_rate": 1e-05,
+ "loss": 0.8030610084533691,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.7974609136581421,
+ "learning_rate": 1.25e-05,
+ "loss": 1.1555473804473877,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8244224190711975,
+ "learning_rate": 1.5e-05,
+ "loss": 1.2229748964309692,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6260581016540527,
+ "learning_rate": 1.75e-05,
+ "loss": 0.8904983401298523,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 2.829580307006836,
+ "learning_rate": 2e-05,
+ "loss": 0.9491637945175171,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.754757285118103,
+ "learning_rate": 2.25e-05,
+ "loss": 0.9019982814788818,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.47440305352211,
+ "learning_rate": 2.5e-05,
+ "loss": 0.6992291212081909,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6505467295646667,
+ "learning_rate": 2.7500000000000004e-05,
+ "loss": 0.889061450958252,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5768685340881348,
+ "learning_rate": 3e-05,
+ "loss": 0.8036602735519409,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5377633571624756,
+ "learning_rate": 3.2500000000000004e-05,
+ "loss": 0.7435633540153503,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9250757098197937,
+ "learning_rate": 3.5e-05,
+ "loss": 1.2175753116607666,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.5793201923370361,
+ "learning_rate": 3.7500000000000003e-05,
+ "loss": 0.7998782992362976,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.6986285448074341,
+ "learning_rate": 4e-05,
+ "loss": 0.8544966578483582,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.5201169848442078,
+ "learning_rate": 4.25e-05,
+ "loss": 0.6589094400405884,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.9791179895401001,
+ "learning_rate": 4.5e-05,
+ "loss": 0.8100125789642334,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.7219038605690002,
+ "learning_rate": 4.75e-05,
+ "loss": 0.6084234714508057,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.46535831689834595,
+ "learning_rate": 5e-05,
+ "loss": 0.6568202972412109,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.31376320123672485,
+ "learning_rate": 5.25e-05,
+ "loss": 0.5392794609069824,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.3170797526836395,
+ "learning_rate": 5.500000000000001e-05,
+ "loss": 0.5918940305709839,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.3495939373970032,
+ "learning_rate": 5.7499999999999995e-05,
+ "loss": 0.5079120397567749,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.28786471486091614,
+ "learning_rate": 6e-05,
+ "loss": 0.5341538786888123,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.3225996792316437,
+ "learning_rate": 6.25e-05,
+ "loss": 0.5839301347732544,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.2762380838394165,
+ "learning_rate": 6.500000000000001e-05,
+ "loss": 0.4959941804409027,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.3259536027908325,
+ "learning_rate": 6.750000000000001e-05,
+ "loss": 0.5259701013565063,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.28954407572746277,
+ "learning_rate": 7e-05,
+ "loss": 0.46511930227279663,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.5785516500473022,
+ "learning_rate": 7.25e-05,
+ "loss": 0.5628081560134888,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 0.5003781318664551,
+ "learning_rate": 7.500000000000001e-05,
+ "loss": 0.623978853225708,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.28861019015312195,
+ "learning_rate": 7.75e-05,
+ "loss": 0.3785879611968994,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.30062854290008545,
+ "learning_rate": 8e-05,
+ "loss": 0.3706434369087219,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.34111225605010986,
+ "learning_rate": 8.25e-05,
+ "loss": 0.31503725051879883,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.249260812997818,
+ "learning_rate": 8.5e-05,
+ "loss": 0.26614612340927124,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.2637145221233368,
+ "learning_rate": 8.75e-05,
+ "loss": 0.2552284002304077,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.2339790314435959,
+ "learning_rate": 9e-05,
+ "loss": 0.20976947247982025,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.28390422463417053,
+ "learning_rate": 9.250000000000001e-05,
+ "loss": 0.2053491771221161,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.41791704297065735,
+ "learning_rate": 9.5e-05,
+ "loss": 0.23765188455581665,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.24454724788665771,
+ "learning_rate": 9.75e-05,
+ "loss": 0.1315624713897705,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.28104257583618164,
+ "learning_rate": 0.0001,
+ "loss": 0.14484520256519318,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.2634645700454712,
+ "learning_rate": 9.971910112359551e-05,
+ "loss": 0.11667350679636002,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.2789415419101715,
+ "learning_rate": 9.943820224719102e-05,
+ "loss": 0.10495678335428238,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.3001563847064972,
+ "learning_rate": 9.915730337078653e-05,
+ "loss": 0.10101388394832611,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.29431262612342834,
+ "learning_rate": 9.887640449438202e-05,
+ "loss": 0.08859837800264359,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.2860342562198639,
+ "learning_rate": 9.859550561797754e-05,
+ "loss": 0.08720342069864273,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.32334786653518677,
+ "learning_rate": 9.831460674157303e-05,
+ "loss": 0.07764355093240738,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.24440690875053406,
+ "learning_rate": 9.803370786516854e-05,
+ "loss": 0.074679896235466,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.13819071650505066,
+ "learning_rate": 9.775280898876405e-05,
+ "loss": 0.05031510069966316,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.18470315635204315,
+ "learning_rate": 9.747191011235956e-05,
+ "loss": 0.06897856295108795,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.10861611366271973,
+ "learning_rate": 9.719101123595506e-05,
+ "loss": 0.04557918757200241,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.1305636465549469,
+ "learning_rate": 9.691011235955057e-05,
+ "loss": 0.05787051469087601,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.09878762811422348,
+ "learning_rate": 9.662921348314608e-05,
+ "loss": 0.05321773141622543,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.13962073624134064,
+ "learning_rate": 9.634831460674157e-05,
+ "loss": 0.054905012249946594,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.15637382864952087,
+ "learning_rate": 9.606741573033708e-05,
+ "loss": 0.06456616520881653,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.0993647500872612,
+ "learning_rate": 9.578651685393259e-05,
+ "loss": 0.04925356060266495,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.07598552852869034,
+ "learning_rate": 9.550561797752809e-05,
+ "loss": 0.039146192371845245,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.1472157984972,
+ "learning_rate": 9.52247191011236e-05,
+ "loss": 0.0649760514497757,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.13113828003406525,
+ "learning_rate": 9.49438202247191e-05,
+ "loss": 0.045674700289964676,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.09389159083366394,
+ "learning_rate": 9.466292134831461e-05,
+ "loss": 0.05372454971075058,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.09965600073337555,
+ "learning_rate": 9.438202247191012e-05,
+ "loss": 0.05305560678243637,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.10993317514657974,
+ "learning_rate": 9.410112359550563e-05,
+ "loss": 0.04224421828985214,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.126717209815979,
+ "learning_rate": 9.382022471910112e-05,
+ "loss": 0.05160766839981079,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.10818025469779968,
+ "learning_rate": 9.353932584269663e-05,
+ "loss": 0.04289766401052475,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.10697201639413834,
+ "learning_rate": 9.325842696629214e-05,
+ "loss": 0.04228357970714569,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.10683801025152206,
+ "learning_rate": 9.297752808988764e-05,
+ "loss": 0.04406578093767166,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.10368553549051285,
+ "learning_rate": 9.269662921348315e-05,
+ "loss": 0.04241921380162239,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.10648658126592636,
+ "learning_rate": 9.241573033707866e-05,
+ "loss": 0.04354353994131088,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.12098433077335358,
+ "learning_rate": 9.213483146067416e-05,
+ "loss": 0.039023373275995255,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.0760948583483696,
+ "learning_rate": 9.185393258426966e-05,
+ "loss": 0.03958747908473015,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.22075068950653076,
+ "learning_rate": 9.157303370786518e-05,
+ "loss": 0.060342662036418915,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.07701070606708527,
+ "learning_rate": 9.129213483146067e-05,
+ "loss": 0.03430912271142006,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.10766447335481644,
+ "learning_rate": 9.101123595505618e-05,
+ "loss": 0.041407521814107895,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.08679414540529251,
+ "learning_rate": 9.07303370786517e-05,
+ "loss": 0.030196014791727066,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.14938987791538239,
+ "learning_rate": 9.04494382022472e-05,
+ "loss": 0.0381748303771019,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.20089861750602722,
+ "learning_rate": 9.01685393258427e-05,
+ "loss": 0.051782768219709396,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.15111377835273743,
+ "learning_rate": 8.988764044943821e-05,
+ "loss": 0.03876986354589462,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.1984938383102417,
+ "learning_rate": 8.960674157303372e-05,
+ "loss": 0.0419108122587204,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.09640980511903763,
+ "learning_rate": 8.932584269662921e-05,
+ "loss": 0.033645566552877426,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.11576851457357407,
+ "learning_rate": 8.904494382022473e-05,
+ "loss": 0.035241927951574326,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.0865691527724266,
+ "learning_rate": 8.876404494382022e-05,
+ "loss": 0.030715249478816986,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.1459137350320816,
+ "learning_rate": 8.848314606741573e-05,
+ "loss": 0.043999187648296356,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.10458692163228989,
+ "learning_rate": 8.820224719101124e-05,
+ "loss": 0.03406348079442978,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.16598516702651978,
+ "learning_rate": 8.792134831460675e-05,
+ "loss": 0.049952901899814606,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.22113963961601257,
+ "learning_rate": 8.764044943820225e-05,
+ "loss": 0.051477186381816864,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.08709916472434998,
+ "learning_rate": 8.735955056179776e-05,
+ "loss": 0.02952735871076584,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.14432036876678467,
+ "learning_rate": 8.707865168539327e-05,
+ "loss": 0.041975200176239014,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.2439240962266922,
+ "learning_rate": 8.679775280898876e-05,
+ "loss": 0.0528157614171505,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.23707805573940277,
+ "learning_rate": 8.651685393258427e-05,
+ "loss": 0.03402837738394737,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.15280698239803314,
+ "learning_rate": 8.623595505617979e-05,
+ "loss": 0.04075885936617851,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.11996722221374512,
+ "learning_rate": 8.595505617977528e-05,
+ "loss": 0.03550145402550697,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.15968245267868042,
+ "learning_rate": 8.567415730337079e-05,
+ "loss": 0.04090861976146698,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.13690805435180664,
+ "learning_rate": 8.53932584269663e-05,
+ "loss": 0.028759023174643517,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.16222038865089417,
+ "learning_rate": 8.51123595505618e-05,
+ "loss": 0.04430348426103592,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.1339799463748932,
+ "learning_rate": 8.483146067415731e-05,
+ "loss": 0.02752600610256195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.21008451282978058,
+ "learning_rate": 8.455056179775282e-05,
+ "loss": 0.03405736759305,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.11415962874889374,
+ "learning_rate": 8.426966292134831e-05,
+ "loss": 0.025026924908161163,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10974401235580444,
+ "learning_rate": 8.398876404494382e-05,
+ "loss": 0.02806137129664421,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.11788799613714218,
+ "learning_rate": 8.370786516853934e-05,
+ "loss": 0.03558914363384247,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10623444616794586,
+ "learning_rate": 8.342696629213483e-05,
+ "loss": 0.02613678388297558,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.08676620572805405,
+ "learning_rate": 8.314606741573034e-05,
+ "loss": 0.025938810780644417,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.07125182449817657,
+ "learning_rate": 8.286516853932585e-05,
+ "loss": 0.021837491542100906,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.1266203671693802,
+ "learning_rate": 8.258426966292135e-05,
+ "loss": 0.03522220626473427,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.07432866096496582,
+ "learning_rate": 8.230337078651685e-05,
+ "loss": 0.026023253798484802,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.13274909555912018,
+ "learning_rate": 8.202247191011237e-05,
+ "loss": 0.03942175954580307,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.06564667820930481,
+ "learning_rate": 8.174157303370788e-05,
+ "loss": 0.026481324806809425,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.09904533624649048,
+ "learning_rate": 8.146067415730337e-05,
+ "loss": 0.034051891416311264,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.10673562437295914,
+ "learning_rate": 8.117977528089889e-05,
+ "loss": 0.037275560200214386,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.08902818709611893,
+ "learning_rate": 8.089887640449438e-05,
+ "loss": 0.033094096928834915,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.08141028136014938,
+ "learning_rate": 8.061797752808989e-05,
+ "loss": 0.026169562712311745,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.1291419267654419,
+ "learning_rate": 8.03370786516854e-05,
+ "loss": 0.027799217030405998,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.09093758463859558,
+ "learning_rate": 8.00561797752809e-05,
+ "loss": 0.028581175953149796,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.10075483471155167,
+ "learning_rate": 7.97752808988764e-05,
+ "loss": 0.025682669132947922,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.09115122258663177,
+ "learning_rate": 7.949438202247192e-05,
+ "loss": 0.02445274218916893,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.10104499012231827,
+ "learning_rate": 7.921348314606743e-05,
+ "loss": 0.03198423981666565,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.09525924921035767,
+ "learning_rate": 7.893258426966292e-05,
+ "loss": 0.03354397788643837,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.08727852255105972,
+ "learning_rate": 7.865168539325843e-05,
+ "loss": 0.024794001132249832,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.13344745337963104,
+ "learning_rate": 7.837078651685393e-05,
+ "loss": 0.027911897748708725,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10268016159534454,
+ "learning_rate": 7.808988764044944e-05,
+ "loss": 0.022515583783388138,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.10109257698059082,
+ "learning_rate": 7.780898876404495e-05,
+ "loss": 0.03221476078033447,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.16964375972747803,
+ "learning_rate": 7.752808988764046e-05,
+ "loss": 0.031795620918273926,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.13246159255504608,
+ "learning_rate": 7.724719101123596e-05,
+ "loss": 0.027082759886980057,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.06262294948101044,
+ "learning_rate": 7.696629213483147e-05,
+ "loss": 0.023925842717289925,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.06809060275554657,
+ "learning_rate": 7.668539325842698e-05,
+ "loss": 0.02438730001449585,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.07383013516664505,
+ "learning_rate": 7.640449438202247e-05,
+ "loss": 0.023031681776046753,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.10721587389707565,
+ "learning_rate": 7.612359550561798e-05,
+ "loss": 0.03192562237381935,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.06741692870855331,
+ "learning_rate": 7.584269662921349e-05,
+ "loss": 0.0246804840862751,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.08125781267881393,
+ "learning_rate": 7.556179775280899e-05,
+ "loss": 0.03119286336004734,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.06413824111223221,
+ "learning_rate": 7.52808988764045e-05,
+ "loss": 0.02655949629843235,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.07669264823198318,
+ "learning_rate": 7.500000000000001e-05,
+ "loss": 0.026687482371926308,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.09918767958879471,
+ "learning_rate": 7.471910112359551e-05,
+ "loss": 0.027516309171915054,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.10148739814758301,
+ "learning_rate": 7.443820224719101e-05,
+ "loss": 0.03195330873131752,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.08711183071136475,
+ "learning_rate": 7.415730337078653e-05,
+ "loss": 0.03217240795493126,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.07990329712629318,
+ "learning_rate": 7.387640449438202e-05,
+ "loss": 0.021410999819636345,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.07874006032943726,
+ "learning_rate": 7.359550561797753e-05,
+ "loss": 0.024128872901201248,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.07868438959121704,
+ "learning_rate": 7.331460674157304e-05,
+ "loss": 0.02699769288301468,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.06750240176916122,
+ "learning_rate": 7.303370786516854e-05,
+ "loss": 0.028122171759605408,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.08443409949541092,
+ "learning_rate": 7.275280898876404e-05,
+ "loss": 0.027627017349004745,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.08431039750576019,
+ "learning_rate": 7.247191011235956e-05,
+ "loss": 0.030967045575380325,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.07539030909538269,
+ "learning_rate": 7.219101123595507e-05,
+ "loss": 0.02236180752515793,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.10955091565847397,
+ "learning_rate": 7.191011235955056e-05,
+ "loss": 0.029895160347223282,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.07425650209188461,
+ "learning_rate": 7.162921348314608e-05,
+ "loss": 0.031453005969524384,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.10125374794006348,
+ "learning_rate": 7.134831460674157e-05,
+ "loss": 0.03458607941865921,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.0830405130982399,
+ "learning_rate": 7.106741573033708e-05,
+ "loss": 0.031049100682139397,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.11105621606111526,
+ "learning_rate": 7.078651685393259e-05,
+ "loss": 0.031229455024003983,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.06040993705391884,
+ "learning_rate": 7.05056179775281e-05,
+ "loss": 0.026813680306077003,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.07566605508327484,
+ "learning_rate": 7.02247191011236e-05,
+ "loss": 0.026412969455122948,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.0760338231921196,
+ "learning_rate": 6.994382022471911e-05,
+ "loss": 0.024791400879621506,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.1741524636745453,
+ "learning_rate": 6.966292134831462e-05,
+ "loss": 0.02279246598482132,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.05075052008032799,
+ "learning_rate": 6.938202247191011e-05,
+ "loss": 0.0200984925031662,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.07410533726215363,
+ "learning_rate": 6.910112359550562e-05,
+ "loss": 0.027529269456863403,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.18064801394939423,
+ "learning_rate": 6.882022471910112e-05,
+ "loss": 0.034961409866809845,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.06059030070900917,
+ "learning_rate": 6.853932584269663e-05,
+ "loss": 0.021033618599176407,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.11783059686422348,
+ "learning_rate": 6.825842696629214e-05,
+ "loss": 0.032214920967817307,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.047202665358781815,
+ "learning_rate": 6.797752808988765e-05,
+ "loss": 0.019470252096652985,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.09729017317295074,
+ "learning_rate": 6.769662921348315e-05,
+ "loss": 0.03214791417121887,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.0970664843916893,
+ "learning_rate": 6.741573033707866e-05,
+ "loss": 0.024394063279032707,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.1301339566707611,
+ "learning_rate": 6.713483146067417e-05,
+ "loss": 0.03639087826013565,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.05040059983730316,
+ "learning_rate": 6.685393258426966e-05,
+ "loss": 0.024697832763195038,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.09459900856018066,
+ "learning_rate": 6.657303370786517e-05,
+ "loss": 0.030857007950544357,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.07537735998630524,
+ "learning_rate": 6.629213483146067e-05,
+ "loss": 0.024350063875317574,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.08085881918668747,
+ "learning_rate": 6.601123595505618e-05,
+ "loss": 0.02919663116335869,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.5784851312637329,
+ "learning_rate": 6.573033707865169e-05,
+ "loss": 0.018593359738588333,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.06892956793308258,
+ "learning_rate": 6.54494382022472e-05,
+ "loss": 0.021966084837913513,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.0662418007850647,
+ "learning_rate": 6.51685393258427e-05,
+ "loss": 0.018197204917669296,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.10896365344524384,
+ "learning_rate": 6.48876404494382e-05,
+ "loss": 0.029372215270996094,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.044214218854904175,
+ "learning_rate": 6.460674157303372e-05,
+ "loss": 0.019298464059829712,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.11028677225112915,
+ "learning_rate": 6.432584269662921e-05,
+ "loss": 0.03576533868908882,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05379929021000862,
+ "learning_rate": 6.404494382022472e-05,
+ "loss": 0.026231547817587852,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.05860014259815216,
+ "learning_rate": 6.376404494382023e-05,
+ "loss": 0.024871408939361572,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.07418687641620636,
+ "learning_rate": 6.348314606741573e-05,
+ "loss": 0.02700434997677803,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.04909646138548851,
+ "learning_rate": 6.320224719101124e-05,
+ "loss": 0.020989028736948967,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.09649103879928589,
+ "learning_rate": 6.292134831460675e-05,
+ "loss": 0.02112525701522827,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.0951089933514595,
+ "learning_rate": 6.264044943820225e-05,
+ "loss": 0.02757953479886055,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.07255524396896362,
+ "learning_rate": 6.235955056179775e-05,
+ "loss": 0.02668045088648796,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.04738844186067581,
+ "learning_rate": 6.207865168539327e-05,
+ "loss": 0.02241366356611252,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06388459354639053,
+ "learning_rate": 6.179775280898876e-05,
+ "loss": 0.02467273734509945,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.0711316466331482,
+ "learning_rate": 6.151685393258427e-05,
+ "loss": 0.02765229530632496,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.06936055421829224,
+ "learning_rate": 6.123595505617978e-05,
+ "loss": 0.017880132421851158,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.14639973640441895,
+ "learning_rate": 6.0955056179775284e-05,
+ "loss": 0.024493057280778885,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.05399472638964653,
+ "learning_rate": 6.067415730337079e-05,
+ "loss": 0.02452176809310913,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.053885601460933685,
+ "learning_rate": 6.039325842696629e-05,
+ "loss": 0.019536789506673813,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.06340774148702621,
+ "learning_rate": 6.0112359550561805e-05,
+ "loss": 0.02424689754843712,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.0645972192287445,
+ "learning_rate": 5.9831460674157306e-05,
+ "loss": 0.022020656615495682,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.08281564712524414,
+ "learning_rate": 5.955056179775281e-05,
+ "loss": 0.028721289709210396,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.06623511761426926,
+ "learning_rate": 5.926966292134831e-05,
+ "loss": 0.024668913334608078,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.11269380897283554,
+ "learning_rate": 5.898876404494382e-05,
+ "loss": 0.026596900075674057,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.05962755158543587,
+ "learning_rate": 5.8707865168539334e-05,
+ "loss": 0.027797695249319077,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.05837902054190636,
+ "learning_rate": 5.8426966292134835e-05,
+ "loss": 0.019832894206047058,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.07743050158023834,
+ "learning_rate": 5.814606741573034e-05,
+ "loss": 0.03128945827484131,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.04493675380945206,
+ "learning_rate": 5.786516853932584e-05,
+ "loss": 0.0192718468606472,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.10079994797706604,
+ "learning_rate": 5.758426966292135e-05,
+ "loss": 0.031823039054870605,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.10614821314811707,
+ "learning_rate": 5.730337078651685e-05,
+ "loss": 0.02893644943833351,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.05476316809654236,
+ "learning_rate": 5.7022471910112364e-05,
+ "loss": 0.018997255712747574,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.05835077539086342,
+ "learning_rate": 5.674157303370787e-05,
+ "loss": 0.02261022850871086,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.04851139336824417,
+ "learning_rate": 5.646067415730337e-05,
+ "loss": 0.02165023237466812,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.07759678363800049,
+ "learning_rate": 5.6179775280898885e-05,
+ "loss": 0.03391243517398834,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09574893862009048,
+ "learning_rate": 5.5898876404494386e-05,
+ "loss": 0.022193273529410362,
+ "step": 198
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 396,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 2,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 1.260825557984256e+16,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-198/training_args.bin b/checkpoint-198/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..585183a4c04533c18e28404929b4927874575107
--- /dev/null
+++ b/checkpoint-198/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1dc0e6ca80cb4d9d0a2afbc3de58e711a6cae8afbebf68a073182b71aa7d48a
+size 5777
diff --git a/checkpoint-1980/README.md b/checkpoint-1980/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-1980/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-1980/adapter_config.json b/checkpoint-1980/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..879d59d17cdb2aff2a9fcb7e4537a4f740bf19f5
--- /dev/null
+++ b/checkpoint-1980/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "o_proj",
+ "up_proj",
+ "down_proj",
+ "v_proj",
+ "k_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-1980/adapter_model.safetensors b/checkpoint-1980/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..f12cdf75239d428ed6034d584c3175afdfa3f9cc
--- /dev/null
+++ b/checkpoint-1980/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7fba6229e7914b19530c8b1986abba89d01be6a4e677dbefa4823d93b58e2c96
+size 132187888
diff --git a/checkpoint-1980/chat_template.jinja b/checkpoint-1980/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-1980/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-1980/optimizer.pt b/checkpoint-1980/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..f60b47545572091e361eb3df2992656afc67057b
--- /dev/null
+++ b/checkpoint-1980/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ceed8ed7536ccdc59de3094463f39ebe1a24cc3756e7d57fad8070aec4049480
+size 67688645
diff --git a/checkpoint-1980/rng_state.pth b/checkpoint-1980/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..7d291e9d10e1020604acf08c246d96afb5aefcc2
--- /dev/null
+++ b/checkpoint-1980/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19b15d59b7d2f507771b26ca44b1603b8cdd22ee0992f3217d7e17b763986855
+size 14645
diff --git a/checkpoint-1980/scheduler.pt b/checkpoint-1980/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..5a215ab6c02b4fa0157c1661c7f242f807f47268
--- /dev/null
+++ b/checkpoint-1980/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd56e68b21d80aa782780721a045f951b7317c4e9d24757e3dc465c315e22244
+size 1465
diff --git a/checkpoint-1980/tokenizer.json b/checkpoint-1980/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-1980/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-1980/tokenizer_config.json b/checkpoint-1980/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-1980/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-1980/trainer_state.json b/checkpoint-1980/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..3a52e82e82f45b45183a5d60ec62bfa7ade9f12e
--- /dev/null
+++ b/checkpoint-1980/trainer_state.json
@@ -0,0 +1,13894 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 10.0,
+ "eval_steps": 500,
+ "global_step": 1980,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.54137122631073,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279057860374451,
+ "learning_rate": 5.050505050505052e-07,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.7017749547958374,
+ "learning_rate": 1.0101010101010103e-06,
+ "loss": 1.0435928106307983,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6033008098602295,
+ "learning_rate": 1.5151515151515152e-06,
+ "loss": 0.8843490481376648,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5495544672012329,
+ "learning_rate": 2.0202020202020206e-06,
+ "loss": 0.8034592866897583,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.802371621131897,
+ "learning_rate": 2.5252525252525253e-06,
+ "loss": 1.1588364839553833,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8238587975502014,
+ "learning_rate": 3.0303030303030305e-06,
+ "loss": 1.228503942489624,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6073964238166809,
+ "learning_rate": 3.5353535353535352e-06,
+ "loss": 0.8989433646202087,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 0.6492345333099365,
+ "learning_rate": 4.040404040404041e-06,
+ "loss": 0.9615614414215088,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.6880183815956116,
+ "learning_rate": 4.5454545454545455e-06,
+ "loss": 0.9233697652816772,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.470304012298584,
+ "learning_rate": 5.050505050505051e-06,
+ "loss": 0.7186562418937683,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6361913681030273,
+ "learning_rate": 5.555555555555556e-06,
+ "loss": 0.9312829375267029,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5554782152175903,
+ "learning_rate": 6.060606060606061e-06,
+ "loss": 0.8529565334320068,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5414550304412842,
+ "learning_rate": 6.565656565656567e-06,
+ "loss": 0.8071130514144897,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9267164468765259,
+ "learning_rate": 7.0707070707070704e-06,
+ "loss": 1.3577998876571655,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.6104046106338501,
+ "learning_rate": 7.5757575757575764e-06,
+ "loss": 0.923499345779419,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.7241935133934021,
+ "learning_rate": 8.080808080808082e-06,
+ "loss": 1.0400190353393555,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.6026384830474854,
+ "learning_rate": 8.585858585858587e-06,
+ "loss": 0.8413939476013184,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.7690514922142029,
+ "learning_rate": 9.090909090909091e-06,
+ "loss": 1.0870859622955322,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.5940403342247009,
+ "learning_rate": 9.595959595959595e-06,
+ "loss": 0.8468416929244995,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.669230580329895,
+ "learning_rate": 1.0101010101010101e-05,
+ "loss": 0.9340983629226685,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.5750640034675598,
+ "learning_rate": 1.0606060606060607e-05,
+ "loss": 0.8230171799659729,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.6579262614250183,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.9293508529663086,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.5956451296806335,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.8316305875778198,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.7270558476448059,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.9129499197006226,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.7505611777305603,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 1.0138367414474487,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.6870062947273254,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.901283860206604,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.7679643630981445,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.9833810329437256,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.866938591003418,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.8958402872085571,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.8687500357627869,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 1.1289801597595215,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 4.008030891418457,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 1.2739044427871704,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.7689681053161621,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.8514111638069153,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.7880434393882751,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.8862775564193726,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.6183183789253235,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.7857811450958252,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.6437809467315674,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.7093011736869812,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.5481512546539307,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.7350327968597412,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.4838634729385376,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.6584650874137878,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.523994505405426,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.7211161851882935,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.6523379683494568,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.9044773578643799,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.4274725615978241,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.568337082862854,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.5060272812843323,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.7201821208000183,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.3760877251625061,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.5880123376846313,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.3715391457080841,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.5693179368972778,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.4332570731639862,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.7277271151542664,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.38201987743377686,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.6458995938301086,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.4358846843242645,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.7559939026832581,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.4566098749637604,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.7792297601699829,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.3864676356315613,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.6894873380661011,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.31187522411346436,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.545581579208374,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.3325943350791931,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.5917496085166931,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.6410307884216309,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.44281136989593506,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.36323168873786926,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.6426926851272583,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.31924113631248474,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.5482619404792786,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.3632371723651886,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.6188253164291382,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.375381201505661,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.5487836003303528,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.3163473606109619,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.5367064476013184,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.42646294832229614,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.41221165657043457,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.41622766852378845,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.5274936556816101,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.30204030871391296,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.44855833053588867,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.3178975582122803,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.4036139249801636,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.2893930673599243,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.39234185218811035,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.2833489775657654,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.37406405806541443,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.3216562867164612,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.3938276767730713,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.26721706986427307,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.30402088165283203,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.3702670931816101,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.30594947934150696,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.2632184326648712,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.2691727876663208,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.36898860335350037,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.33992528915405273,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.2976086735725403,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.27603086829185486,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.32201430201530457,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.25665703415870667,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.35001808404922485,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.24190445244312286,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.5106059908866882,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.3093336820602417,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.3261374831199646,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.18783289194107056,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.38757652044296265,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.19549766182899475,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.4723363518714905,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.15751558542251587,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.36796173453330994,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.14514681696891785,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.3855208456516266,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.14030519127845764,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.5906668305397034,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.1478388011455536,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.2658001780509949,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.13253600895404816,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.33554506301879883,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.12156252562999725,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.2643960416316986,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.1089208647608757,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.19129537045955658,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.08515600860118866,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.22168858349323273,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.09310197830200195,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.16676382720470428,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.07711787521839142,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.23891882598400116,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.09763285517692566,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.28446146845817566,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.08980057388544083,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.146108940243721,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.06573648750782013,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.2007656991481781,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.0699995830655098,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.3082621395587921,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.0885838121175766,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.1624963879585266,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.06935172528028488,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.1562737673521042,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.07147250324487686,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.1660323292016983,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.0672944188117981,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.21427564322948456,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.07051930576562881,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.16495929658412933,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.05429624393582344,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.1978198140859604,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.07144488394260406,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.15077605843544006,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.055798254907131195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.2806876301765442,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.06058178097009659,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.1219187006354332,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.05044667422771454,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10286939144134521,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.048498690128326416,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.12813609838485718,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.06252863258123398,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10565406829118729,
+ "learning_rate": 5e-05,
+ "loss": 0.051401108503341675,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.09147113561630249,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.047376491129398346,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.08723224699497223,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.039745647460222244,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.16071128845214844,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.058398712426424026,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.1370300054550171,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.05132289230823517,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.19449608027935028,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.06682188808917999,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.13085028529167175,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.049861155450344086,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.1768050193786621,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.055694688111543655,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.2819313704967499,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.062391363084316254,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.10738537460565567,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.05093343183398247,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.11759619414806366,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.044827841222286224,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.21941131353378296,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.05238347500562668,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.1697252243757248,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.04869212955236435,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.19701889157295227,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.04484856128692627,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.11779771000146866,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.04135368764400482,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.19823911786079407,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.05097956955432892,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.17355702817440033,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.05781872197985649,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.13029292225837708,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.041528262197971344,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.1292058229446411,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.0442211888730526,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10058800131082535,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.03813612461090088,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.22936487197875977,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.056090980768203735,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.13063806295394897,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.04347142577171326,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.167104110121727,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.04442849010229111,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.11942817270755768,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.03964124619960785,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.17906631529331207,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.04372458904981613,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.13760331273078918,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.03980286419391632,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.18043340742588043,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.05500294268131256,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.31386223435401917,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.04253799840807915,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.1428707093000412,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.047894880175590515,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.11010178923606873,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.04534825310111046,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.10444525629281998,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.041347943246364594,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.18076039850711823,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.04535853862762451,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.19424672424793243,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.05037602037191391,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.1457783728837967,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.047546930611133575,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.1189681887626648,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.03254905715584755,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.18887822329998016,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.04018670320510864,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.12217189371585846,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.03981504589319229,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.10866257548332214,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.04322533681988716,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.15904399752616882,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.04488902539014816,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.12598516047000885,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.04718853533267975,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.22092872858047485,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.03646199405193329,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.1717238426208496,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.04607801511883736,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.16268078982830048,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.04759417474269867,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.19621087610721588,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.051741112023591995,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.15362979471683502,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.04363569617271423,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.1404130607843399,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.045428819954395294,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.12262272834777832,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.03828439861536026,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.10626570880413055,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.03420639410614967,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.12686072289943695,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.03474457561969757,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.153709277510643,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.03174472972750664,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.13035084307193756,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.02982976846396923,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.12288431823253632,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.03588784486055374,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.19307470321655273,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.04750734567642212,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.0996781438589096,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.027098631486296654,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.16898290812969208,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.040447790175676346,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.10996036231517792,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.02525201067328453,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.16161896288394928,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.04199359938502312,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.1536172777414322,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.02943507581949234,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.18457260727882385,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.04093889892101288,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.11232347041368484,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.029609719291329384,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.19080978631973267,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.0357801653444767,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.16634301841259003,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02980419248342514,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.28601372241973877,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.032849978655576706,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.1359848529100418,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.0230826735496521,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.11285015195608139,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.02447221614420414,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.14712421596050262,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.022657420486211777,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.18246804177761078,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.035991013050079346,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.143621563911438,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.024444863200187683,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.12458691000938416,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.039701592177152634,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05614984780550003,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.029840555042028427,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.06097931042313576,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.027426715940237045,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.09883654862642288,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031690437346696854,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.0700431764125824,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.024079838767647743,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.05957406386733055,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.02303817868232727,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.14374858140945435,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.031183632090687752,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.09187919646501541,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.031176958233118057,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.0540630929172039,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.024949276819825172,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06875574588775635,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.02890622243285179,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.10081329196691513,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.03019360452890396,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.11833225935697556,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.020365778356790543,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.08700298517942429,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.027046984061598778,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.08660133928060532,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.027088070288300514,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.06983930617570877,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.019332535564899445,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.09463227540254593,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.02780212089419365,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.10251298546791077,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.026878856122493744,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.15963847935199738,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.03437665104866028,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.11342372000217438,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.02877948433160782,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.0937543660402298,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.02759186364710331,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.07137084752321243,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.02941890060901642,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.3511611819267273,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.024331524968147278,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.12344356626272202,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.0348694771528244,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.07144290208816528,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.021711278706789017,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.09835992008447647,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.03408564254641533,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.4978399872779846,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.03810017928481102,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.06314591318368912,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.0201277956366539,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.07504695653915405,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.025770913809537888,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.1028534397482872,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.02469150349497795,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.09341974556446075,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.036506302654743195,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09348680078983307,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02507903426885605,
+ "step": 198
+ },
+ {
+ "epoch": 1.0050632911392405,
+ "grad_norm": 0.06890113651752472,
+ "learning_rate": 0.0001,
+ "loss": 0.028374083340168,
+ "step": 199
+ },
+ {
+ "epoch": 1.010126582278481,
+ "grad_norm": 0.051041170954704285,
+ "learning_rate": 9.994388327721661e-05,
+ "loss": 0.022860335186123848,
+ "step": 200
+ },
+ {
+ "epoch": 1.0151898734177216,
+ "grad_norm": 0.10253743082284927,
+ "learning_rate": 9.988776655443322e-05,
+ "loss": 0.02864072285592556,
+ "step": 201
+ },
+ {
+ "epoch": 1.0202531645569621,
+ "grad_norm": 0.08295776695013046,
+ "learning_rate": 9.983164983164983e-05,
+ "loss": 0.0327395498752594,
+ "step": 202
+ },
+ {
+ "epoch": 1.0253164556962024,
+ "grad_norm": 0.07240694016218185,
+ "learning_rate": 9.977553310886645e-05,
+ "loss": 0.029215697199106216,
+ "step": 203
+ },
+ {
+ "epoch": 1.030379746835443,
+ "grad_norm": 0.0688897892832756,
+ "learning_rate": 9.971941638608306e-05,
+ "loss": 0.027594968676567078,
+ "step": 204
+ },
+ {
+ "epoch": 1.0354430379746835,
+ "grad_norm": 0.08463896065950394,
+ "learning_rate": 9.966329966329967e-05,
+ "loss": 0.02292536199092865,
+ "step": 205
+ },
+ {
+ "epoch": 1.040506329113924,
+ "grad_norm": 0.062013301998376846,
+ "learning_rate": 9.960718294051628e-05,
+ "loss": 0.023678191006183624,
+ "step": 206
+ },
+ {
+ "epoch": 1.0455696202531646,
+ "grad_norm": 0.08735264092683792,
+ "learning_rate": 9.955106621773289e-05,
+ "loss": 0.022060325369238853,
+ "step": 207
+ },
+ {
+ "epoch": 1.0506329113924051,
+ "grad_norm": 0.07634295523166656,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02764434739947319,
+ "step": 208
+ },
+ {
+ "epoch": 1.0556962025316456,
+ "grad_norm": 0.09735682606697083,
+ "learning_rate": 9.943883277216612e-05,
+ "loss": 0.03304428607225418,
+ "step": 209
+ },
+ {
+ "epoch": 1.0607594936708862,
+ "grad_norm": 0.06860044598579407,
+ "learning_rate": 9.938271604938272e-05,
+ "loss": 0.0340178906917572,
+ "step": 210
+ },
+ {
+ "epoch": 1.0658227848101265,
+ "grad_norm": 0.3715139627456665,
+ "learning_rate": 9.932659932659934e-05,
+ "loss": 0.02541016787290573,
+ "step": 211
+ },
+ {
+ "epoch": 1.070886075949367,
+ "grad_norm": 0.07673332840204239,
+ "learning_rate": 9.927048260381594e-05,
+ "loss": 0.025950253009796143,
+ "step": 212
+ },
+ {
+ "epoch": 1.0759493670886076,
+ "grad_norm": 0.07359500974416733,
+ "learning_rate": 9.921436588103256e-05,
+ "loss": 0.024356549605727196,
+ "step": 213
+ },
+ {
+ "epoch": 1.081012658227848,
+ "grad_norm": 0.07760954648256302,
+ "learning_rate": 9.915824915824916e-05,
+ "loss": 0.02338298037648201,
+ "step": 214
+ },
+ {
+ "epoch": 1.0860759493670886,
+ "grad_norm": 0.09183681756258011,
+ "learning_rate": 9.910213243546578e-05,
+ "loss": 0.020955465734004974,
+ "step": 215
+ },
+ {
+ "epoch": 1.0911392405063292,
+ "grad_norm": 0.21278677880764008,
+ "learning_rate": 9.904601571268239e-05,
+ "loss": 0.028164055198431015,
+ "step": 216
+ },
+ {
+ "epoch": 1.0962025316455697,
+ "grad_norm": 0.22437937557697296,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.03543347865343094,
+ "step": 217
+ },
+ {
+ "epoch": 1.1012658227848102,
+ "grad_norm": 0.08677598088979721,
+ "learning_rate": 9.893378226711561e-05,
+ "loss": 0.031265974044799805,
+ "step": 218
+ },
+ {
+ "epoch": 1.1063291139240505,
+ "grad_norm": 0.09595583379268646,
+ "learning_rate": 9.887766554433222e-05,
+ "loss": 0.02384507656097412,
+ "step": 219
+ },
+ {
+ "epoch": 1.111392405063291,
+ "grad_norm": 0.08256062865257263,
+ "learning_rate": 9.882154882154883e-05,
+ "loss": 0.022209012880921364,
+ "step": 220
+ },
+ {
+ "epoch": 1.1164556962025316,
+ "grad_norm": 0.07712455838918686,
+ "learning_rate": 9.876543209876543e-05,
+ "loss": 0.025278344750404358,
+ "step": 221
+ },
+ {
+ "epoch": 1.1215189873417721,
+ "grad_norm": 0.09704182296991348,
+ "learning_rate": 9.870931537598205e-05,
+ "loss": 0.024904735386371613,
+ "step": 222
+ },
+ {
+ "epoch": 1.1265822784810127,
+ "grad_norm": 0.09094078838825226,
+ "learning_rate": 9.865319865319865e-05,
+ "loss": 0.0280012097209692,
+ "step": 223
+ },
+ {
+ "epoch": 1.1316455696202532,
+ "grad_norm": 0.07607442885637283,
+ "learning_rate": 9.859708193041527e-05,
+ "loss": 0.026181645691394806,
+ "step": 224
+ },
+ {
+ "epoch": 1.1367088607594937,
+ "grad_norm": 0.06568697839975357,
+ "learning_rate": 9.854096520763188e-05,
+ "loss": 0.02883346565067768,
+ "step": 225
+ },
+ {
+ "epoch": 1.1417721518987343,
+ "grad_norm": 0.07192376255989075,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.027345171198248863,
+ "step": 226
+ },
+ {
+ "epoch": 1.1468354430379746,
+ "grad_norm": 0.1464017778635025,
+ "learning_rate": 9.84287317620651e-05,
+ "loss": 0.03213154152035713,
+ "step": 227
+ },
+ {
+ "epoch": 1.1518987341772151,
+ "grad_norm": 0.06766578555107117,
+ "learning_rate": 9.837261503928171e-05,
+ "loss": 0.02554963156580925,
+ "step": 228
+ },
+ {
+ "epoch": 1.1569620253164556,
+ "grad_norm": 0.09428609162569046,
+ "learning_rate": 9.831649831649832e-05,
+ "loss": 0.02484097331762314,
+ "step": 229
+ },
+ {
+ "epoch": 1.1620253164556962,
+ "grad_norm": 0.1648297905921936,
+ "learning_rate": 9.826038159371493e-05,
+ "loss": 0.03450813889503479,
+ "step": 230
+ },
+ {
+ "epoch": 1.1670886075949367,
+ "grad_norm": 0.06389904767274857,
+ "learning_rate": 9.820426487093154e-05,
+ "loss": 0.02957337349653244,
+ "step": 231
+ },
+ {
+ "epoch": 1.1721518987341772,
+ "grad_norm": 0.11517420411109924,
+ "learning_rate": 9.814814814814815e-05,
+ "loss": 0.024299729615449905,
+ "step": 232
+ },
+ {
+ "epoch": 1.1772151898734178,
+ "grad_norm": 0.06960142403841019,
+ "learning_rate": 9.809203142536476e-05,
+ "loss": 0.025762220844626427,
+ "step": 233
+ },
+ {
+ "epoch": 1.1822784810126583,
+ "grad_norm": 0.11682946234941483,
+ "learning_rate": 9.803591470258137e-05,
+ "loss": 0.02457268163561821,
+ "step": 234
+ },
+ {
+ "epoch": 1.1873417721518988,
+ "grad_norm": 0.07964848726987839,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.027285631746053696,
+ "step": 235
+ },
+ {
+ "epoch": 1.1924050632911392,
+ "grad_norm": 0.053044773638248444,
+ "learning_rate": 9.79236812570146e-05,
+ "loss": 0.020997609943151474,
+ "step": 236
+ },
+ {
+ "epoch": 1.1974683544303797,
+ "grad_norm": 0.13531149923801422,
+ "learning_rate": 9.78675645342312e-05,
+ "loss": 0.02474522590637207,
+ "step": 237
+ },
+ {
+ "epoch": 1.2025316455696202,
+ "grad_norm": 0.0774424746632576,
+ "learning_rate": 9.781144781144782e-05,
+ "loss": 0.025272740051150322,
+ "step": 238
+ },
+ {
+ "epoch": 1.2075949367088608,
+ "grad_norm": 0.042708419263362885,
+ "learning_rate": 9.775533108866442e-05,
+ "loss": 0.019522909075021744,
+ "step": 239
+ },
+ {
+ "epoch": 1.2126582278481013,
+ "grad_norm": 0.10364090651273727,
+ "learning_rate": 9.769921436588104e-05,
+ "loss": 0.02728935517370701,
+ "step": 240
+ },
+ {
+ "epoch": 1.2177215189873418,
+ "grad_norm": 0.0756702646613121,
+ "learning_rate": 9.764309764309764e-05,
+ "loss": 0.02659972943365574,
+ "step": 241
+ },
+ {
+ "epoch": 1.2227848101265824,
+ "grad_norm": 0.07232004404067993,
+ "learning_rate": 9.758698092031426e-05,
+ "loss": 0.017723949626088142,
+ "step": 242
+ },
+ {
+ "epoch": 1.2278481012658227,
+ "grad_norm": 0.058345306664705276,
+ "learning_rate": 9.753086419753087e-05,
+ "loss": 0.019348861649632454,
+ "step": 243
+ },
+ {
+ "epoch": 1.2329113924050632,
+ "grad_norm": 0.14832371473312378,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.03227488696575165,
+ "step": 244
+ },
+ {
+ "epoch": 1.2379746835443037,
+ "grad_norm": 0.05343412607908249,
+ "learning_rate": 9.74186307519641e-05,
+ "loss": 0.0210015457123518,
+ "step": 245
+ },
+ {
+ "epoch": 1.2430379746835443,
+ "grad_norm": 0.054104797542095184,
+ "learning_rate": 9.736251402918069e-05,
+ "loss": 0.02430287003517151,
+ "step": 246
+ },
+ {
+ "epoch": 1.2481012658227848,
+ "grad_norm": 0.11686044931411743,
+ "learning_rate": 9.730639730639732e-05,
+ "loss": 0.029372017830610275,
+ "step": 247
+ },
+ {
+ "epoch": 1.2531645569620253,
+ "grad_norm": 0.05970177799463272,
+ "learning_rate": 9.725028058361391e-05,
+ "loss": 0.024995045736432076,
+ "step": 248
+ },
+ {
+ "epoch": 1.2582278481012659,
+ "grad_norm": 0.06506923586130142,
+ "learning_rate": 9.719416386083054e-05,
+ "loss": 0.024779727682471275,
+ "step": 249
+ },
+ {
+ "epoch": 1.2632911392405064,
+ "grad_norm": 0.12711220979690552,
+ "learning_rate": 9.713804713804715e-05,
+ "loss": 0.026196476072072983,
+ "step": 250
+ },
+ {
+ "epoch": 1.268354430379747,
+ "grad_norm": 0.056023694574832916,
+ "learning_rate": 9.708193041526376e-05,
+ "loss": 0.01813146471977234,
+ "step": 251
+ },
+ {
+ "epoch": 1.2734177215189875,
+ "grad_norm": 0.04508040472865105,
+ "learning_rate": 9.702581369248037e-05,
+ "loss": 0.019225183874368668,
+ "step": 252
+ },
+ {
+ "epoch": 1.2784810126582278,
+ "grad_norm": 0.10354425758123398,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.02940209209918976,
+ "step": 253
+ },
+ {
+ "epoch": 1.2835443037974683,
+ "grad_norm": 0.06974297761917114,
+ "learning_rate": 9.691358024691359e-05,
+ "loss": 0.02482295036315918,
+ "step": 254
+ },
+ {
+ "epoch": 1.2886075949367088,
+ "grad_norm": 0.06940010190010071,
+ "learning_rate": 9.68574635241302e-05,
+ "loss": 0.020605089142918587,
+ "step": 255
+ },
+ {
+ "epoch": 1.2936708860759494,
+ "grad_norm": 0.09167850762605667,
+ "learning_rate": 9.68013468013468e-05,
+ "loss": 0.02429921180009842,
+ "step": 256
+ },
+ {
+ "epoch": 1.29873417721519,
+ "grad_norm": 0.048866868019104004,
+ "learning_rate": 9.674523007856342e-05,
+ "loss": 0.021776504814624786,
+ "step": 257
+ },
+ {
+ "epoch": 1.3037974683544304,
+ "grad_norm": 0.06977155059576035,
+ "learning_rate": 9.668911335578003e-05,
+ "loss": 0.02758147194981575,
+ "step": 258
+ },
+ {
+ "epoch": 1.3088607594936708,
+ "grad_norm": 0.17602303624153137,
+ "learning_rate": 9.663299663299664e-05,
+ "loss": 0.026518259197473526,
+ "step": 259
+ },
+ {
+ "epoch": 1.3139240506329113,
+ "grad_norm": 0.08011946082115173,
+ "learning_rate": 9.657687991021325e-05,
+ "loss": 0.026240577921271324,
+ "step": 260
+ },
+ {
+ "epoch": 1.3189873417721518,
+ "grad_norm": 0.06296376883983612,
+ "learning_rate": 9.652076318742987e-05,
+ "loss": 0.03159455955028534,
+ "step": 261
+ },
+ {
+ "epoch": 1.3240506329113924,
+ "grad_norm": 0.04424722492694855,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.024151435121893883,
+ "step": 262
+ },
+ {
+ "epoch": 1.3291139240506329,
+ "grad_norm": 0.045779623091220856,
+ "learning_rate": 9.640852974186309e-05,
+ "loss": 0.018655993044376373,
+ "step": 263
+ },
+ {
+ "epoch": 1.3341772151898734,
+ "grad_norm": 0.06355931609869003,
+ "learning_rate": 9.635241301907969e-05,
+ "loss": 0.01999380812048912,
+ "step": 264
+ },
+ {
+ "epoch": 1.339240506329114,
+ "grad_norm": 0.04477616026997566,
+ "learning_rate": 9.62962962962963e-05,
+ "loss": 0.021614115685224533,
+ "step": 265
+ },
+ {
+ "epoch": 1.3443037974683545,
+ "grad_norm": 0.05851180478930473,
+ "learning_rate": 9.62401795735129e-05,
+ "loss": 0.023495908826589584,
+ "step": 266
+ },
+ {
+ "epoch": 1.349367088607595,
+ "grad_norm": 0.04724022373557091,
+ "learning_rate": 9.618406285072952e-05,
+ "loss": 0.02053767442703247,
+ "step": 267
+ },
+ {
+ "epoch": 1.3544303797468356,
+ "grad_norm": 0.12757639586925507,
+ "learning_rate": 9.612794612794614e-05,
+ "loss": 0.030612681061029434,
+ "step": 268
+ },
+ {
+ "epoch": 1.3594936708860759,
+ "grad_norm": 0.18316853046417236,
+ "learning_rate": 9.607182940516274e-05,
+ "loss": 0.039485104382038116,
+ "step": 269
+ },
+ {
+ "epoch": 1.3645569620253164,
+ "grad_norm": 0.09149223566055298,
+ "learning_rate": 9.601571268237936e-05,
+ "loss": 0.031156456097960472,
+ "step": 270
+ },
+ {
+ "epoch": 1.369620253164557,
+ "grad_norm": 0.07885908335447311,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.026395633816719055,
+ "step": 271
+ },
+ {
+ "epoch": 1.3746835443037975,
+ "grad_norm": 0.0984397754073143,
+ "learning_rate": 9.590347923681258e-05,
+ "loss": 0.02990398183465004,
+ "step": 272
+ },
+ {
+ "epoch": 1.379746835443038,
+ "grad_norm": 0.08566205203533173,
+ "learning_rate": 9.584736251402918e-05,
+ "loss": 0.024353420361876488,
+ "step": 273
+ },
+ {
+ "epoch": 1.3848101265822785,
+ "grad_norm": 0.16623689234256744,
+ "learning_rate": 9.57912457912458e-05,
+ "loss": 0.03626095876097679,
+ "step": 274
+ },
+ {
+ "epoch": 1.389873417721519,
+ "grad_norm": 0.07134243100881577,
+ "learning_rate": 9.57351290684624e-05,
+ "loss": 0.026036158204078674,
+ "step": 275
+ },
+ {
+ "epoch": 1.3949367088607594,
+ "grad_norm": 0.07753578573465347,
+ "learning_rate": 9.567901234567902e-05,
+ "loss": 0.03266923502087593,
+ "step": 276
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.07113673537969589,
+ "learning_rate": 9.562289562289563e-05,
+ "loss": 0.024128902703523636,
+ "step": 277
+ },
+ {
+ "epoch": 1.4050632911392404,
+ "grad_norm": 0.0954187884926796,
+ "learning_rate": 9.556677890011224e-05,
+ "loss": 0.03310588374733925,
+ "step": 278
+ },
+ {
+ "epoch": 1.410126582278481,
+ "grad_norm": 0.08755122870206833,
+ "learning_rate": 9.551066217732885e-05,
+ "loss": 0.030977975577116013,
+ "step": 279
+ },
+ {
+ "epoch": 1.4151898734177215,
+ "grad_norm": 0.06839736551046371,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.029557062312960625,
+ "step": 280
+ },
+ {
+ "epoch": 1.420253164556962,
+ "grad_norm": 0.051050763577222824,
+ "learning_rate": 9.539842873176207e-05,
+ "loss": 0.022091392427682877,
+ "step": 281
+ },
+ {
+ "epoch": 1.4253164556962026,
+ "grad_norm": 0.05898132920265198,
+ "learning_rate": 9.534231200897868e-05,
+ "loss": 0.024804875254631042,
+ "step": 282
+ },
+ {
+ "epoch": 1.4303797468354431,
+ "grad_norm": 0.04517035931348801,
+ "learning_rate": 9.528619528619529e-05,
+ "loss": 0.024234894663095474,
+ "step": 283
+ },
+ {
+ "epoch": 1.4354430379746836,
+ "grad_norm": 0.05625253543257713,
+ "learning_rate": 9.52300785634119e-05,
+ "loss": 0.02342807501554489,
+ "step": 284
+ },
+ {
+ "epoch": 1.4405063291139242,
+ "grad_norm": 0.047006960958242416,
+ "learning_rate": 9.517396184062851e-05,
+ "loss": 0.021819880232214928,
+ "step": 285
+ },
+ {
+ "epoch": 1.4455696202531645,
+ "grad_norm": 0.051774390041828156,
+ "learning_rate": 9.511784511784512e-05,
+ "loss": 0.020575571805238724,
+ "step": 286
+ },
+ {
+ "epoch": 1.450632911392405,
+ "grad_norm": 0.0684620812535286,
+ "learning_rate": 9.506172839506173e-05,
+ "loss": 0.025043494999408722,
+ "step": 287
+ },
+ {
+ "epoch": 1.4556962025316456,
+ "grad_norm": 0.05345604941248894,
+ "learning_rate": 9.500561167227834e-05,
+ "loss": 0.020829960703849792,
+ "step": 288
+ },
+ {
+ "epoch": 1.460759493670886,
+ "grad_norm": 0.07588688284158707,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.02842051535844803,
+ "step": 289
+ },
+ {
+ "epoch": 1.4658227848101266,
+ "grad_norm": 0.0371188148856163,
+ "learning_rate": 9.489337822671156e-05,
+ "loss": 0.020213091745972633,
+ "step": 290
+ },
+ {
+ "epoch": 1.4708860759493672,
+ "grad_norm": 0.03922685980796814,
+ "learning_rate": 9.483726150392817e-05,
+ "loss": 0.020665431395173073,
+ "step": 291
+ },
+ {
+ "epoch": 1.4759493670886075,
+ "grad_norm": 0.10213606059551239,
+ "learning_rate": 9.478114478114478e-05,
+ "loss": 0.024979032576084137,
+ "step": 292
+ },
+ {
+ "epoch": 1.481012658227848,
+ "grad_norm": 0.04574638605117798,
+ "learning_rate": 9.472502805836139e-05,
+ "loss": 0.0215127132833004,
+ "step": 293
+ },
+ {
+ "epoch": 1.4860759493670885,
+ "grad_norm": 0.0829704999923706,
+ "learning_rate": 9.4668911335578e-05,
+ "loss": 0.023608818650245667,
+ "step": 294
+ },
+ {
+ "epoch": 1.491139240506329,
+ "grad_norm": 0.036335594952106476,
+ "learning_rate": 9.461279461279463e-05,
+ "loss": 0.01993970200419426,
+ "step": 295
+ },
+ {
+ "epoch": 1.4962025316455696,
+ "grad_norm": 0.08291227370500565,
+ "learning_rate": 9.455667789001122e-05,
+ "loss": 0.02223093807697296,
+ "step": 296
+ },
+ {
+ "epoch": 1.5012658227848101,
+ "grad_norm": 0.048284996300935745,
+ "learning_rate": 9.450056116722785e-05,
+ "loss": 0.019440360367298126,
+ "step": 297
+ },
+ {
+ "epoch": 1.5063291139240507,
+ "grad_norm": 0.25126877427101135,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.030357610434293747,
+ "step": 298
+ },
+ {
+ "epoch": 1.5113924050632912,
+ "grad_norm": 0.08812759816646576,
+ "learning_rate": 9.438832772166107e-05,
+ "loss": 0.025407828390598297,
+ "step": 299
+ },
+ {
+ "epoch": 1.5164556962025317,
+ "grad_norm": 0.09417422115802765,
+ "learning_rate": 9.433221099887766e-05,
+ "loss": 0.028768496587872505,
+ "step": 300
+ },
+ {
+ "epoch": 1.5215189873417723,
+ "grad_norm": 0.10820329934358597,
+ "learning_rate": 9.427609427609429e-05,
+ "loss": 0.03250410035252571,
+ "step": 301
+ },
+ {
+ "epoch": 1.5265822784810128,
+ "grad_norm": 0.06633433699607849,
+ "learning_rate": 9.42199775533109e-05,
+ "loss": 0.019816454499959946,
+ "step": 302
+ },
+ {
+ "epoch": 1.5316455696202531,
+ "grad_norm": 0.05545264482498169,
+ "learning_rate": 9.41638608305275e-05,
+ "loss": 0.020919661968946457,
+ "step": 303
+ },
+ {
+ "epoch": 1.5367088607594936,
+ "grad_norm": 0.08201726526021957,
+ "learning_rate": 9.410774410774412e-05,
+ "loss": 0.0309453085064888,
+ "step": 304
+ },
+ {
+ "epoch": 1.5417721518987342,
+ "grad_norm": 0.047229036688804626,
+ "learning_rate": 9.405162738496073e-05,
+ "loss": 0.02079029008746147,
+ "step": 305
+ },
+ {
+ "epoch": 1.5468354430379747,
+ "grad_norm": 0.04493536427617073,
+ "learning_rate": 9.399551066217734e-05,
+ "loss": 0.020319776609539986,
+ "step": 306
+ },
+ {
+ "epoch": 1.5518987341772152,
+ "grad_norm": 0.07935966551303864,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.03144281357526779,
+ "step": 307
+ },
+ {
+ "epoch": 1.5569620253164556,
+ "grad_norm": 0.10108500719070435,
+ "learning_rate": 9.388327721661056e-05,
+ "loss": 0.029823362827301025,
+ "step": 308
+ },
+ {
+ "epoch": 1.562025316455696,
+ "grad_norm": 0.05187584087252617,
+ "learning_rate": 9.382716049382717e-05,
+ "loss": 0.029090257361531258,
+ "step": 309
+ },
+ {
+ "epoch": 1.5670886075949366,
+ "grad_norm": 0.09131086617708206,
+ "learning_rate": 9.377104377104378e-05,
+ "loss": 0.020090997219085693,
+ "step": 310
+ },
+ {
+ "epoch": 1.5721518987341772,
+ "grad_norm": 0.06874370574951172,
+ "learning_rate": 9.371492704826039e-05,
+ "loss": 0.022118568420410156,
+ "step": 311
+ },
+ {
+ "epoch": 1.5772151898734177,
+ "grad_norm": 0.07480651885271072,
+ "learning_rate": 9.3658810325477e-05,
+ "loss": 0.030924849212169647,
+ "step": 312
+ },
+ {
+ "epoch": 1.5822784810126582,
+ "grad_norm": 0.04049983248114586,
+ "learning_rate": 9.36026936026936e-05,
+ "loss": 0.02086808532476425,
+ "step": 313
+ },
+ {
+ "epoch": 1.5873417721518988,
+ "grad_norm": 0.037067580968141556,
+ "learning_rate": 9.354657687991022e-05,
+ "loss": 0.022019919008016586,
+ "step": 314
+ },
+ {
+ "epoch": 1.5924050632911393,
+ "grad_norm": 0.0599038302898407,
+ "learning_rate": 9.349046015712683e-05,
+ "loss": 0.02305535599589348,
+ "step": 315
+ },
+ {
+ "epoch": 1.5974683544303798,
+ "grad_norm": 0.056727997958660126,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.025360889732837677,
+ "step": 316
+ },
+ {
+ "epoch": 1.6025316455696204,
+ "grad_norm": 0.06659650057554245,
+ "learning_rate": 9.337822671156005e-05,
+ "loss": 0.02528395690023899,
+ "step": 317
+ },
+ {
+ "epoch": 1.6075949367088609,
+ "grad_norm": 0.06213822215795517,
+ "learning_rate": 9.332210998877666e-05,
+ "loss": 0.028841618448495865,
+ "step": 318
+ },
+ {
+ "epoch": 1.6126582278481014,
+ "grad_norm": 0.03757556155323982,
+ "learning_rate": 9.326599326599327e-05,
+ "loss": 0.02282278798520565,
+ "step": 319
+ },
+ {
+ "epoch": 1.6177215189873417,
+ "grad_norm": 0.061945486813783646,
+ "learning_rate": 9.320987654320989e-05,
+ "loss": 0.02733437530696392,
+ "step": 320
+ },
+ {
+ "epoch": 1.6227848101265823,
+ "grad_norm": 0.07904566079378128,
+ "learning_rate": 9.315375982042649e-05,
+ "loss": 0.02630138024687767,
+ "step": 321
+ },
+ {
+ "epoch": 1.6278481012658228,
+ "grad_norm": 0.07157077640295029,
+ "learning_rate": 9.309764309764311e-05,
+ "loss": 0.023403439670801163,
+ "step": 322
+ },
+ {
+ "epoch": 1.6329113924050633,
+ "grad_norm": 0.03518318012356758,
+ "learning_rate": 9.304152637485971e-05,
+ "loss": 0.021487422287464142,
+ "step": 323
+ },
+ {
+ "epoch": 1.6379746835443036,
+ "grad_norm": 0.11178159713745117,
+ "learning_rate": 9.298540965207633e-05,
+ "loss": 0.03142111003398895,
+ "step": 324
+ },
+ {
+ "epoch": 1.6430379746835442,
+ "grad_norm": 0.05046987161040306,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.020960725843906403,
+ "step": 325
+ },
+ {
+ "epoch": 1.6481012658227847,
+ "grad_norm": 0.05356504023075104,
+ "learning_rate": 9.287317620650955e-05,
+ "loss": 0.01934133842587471,
+ "step": 326
+ },
+ {
+ "epoch": 1.6531645569620252,
+ "grad_norm": 0.07995260506868362,
+ "learning_rate": 9.281705948372615e-05,
+ "loss": 0.0248265378177166,
+ "step": 327
+ },
+ {
+ "epoch": 1.6582278481012658,
+ "grad_norm": 0.08783978968858719,
+ "learning_rate": 9.276094276094277e-05,
+ "loss": 0.024171534925699234,
+ "step": 328
+ },
+ {
+ "epoch": 1.6632911392405063,
+ "grad_norm": 0.043143950402736664,
+ "learning_rate": 9.270482603815938e-05,
+ "loss": 0.021554211154580116,
+ "step": 329
+ },
+ {
+ "epoch": 1.6683544303797468,
+ "grad_norm": 0.05635169520974159,
+ "learning_rate": 9.264870931537598e-05,
+ "loss": 0.025942442938685417,
+ "step": 330
+ },
+ {
+ "epoch": 1.6734177215189874,
+ "grad_norm": 0.042691316455602646,
+ "learning_rate": 9.25925925925926e-05,
+ "loss": 0.021898634731769562,
+ "step": 331
+ },
+ {
+ "epoch": 1.678481012658228,
+ "grad_norm": 0.07666946202516556,
+ "learning_rate": 9.25364758698092e-05,
+ "loss": 0.02928568609058857,
+ "step": 332
+ },
+ {
+ "epoch": 1.6835443037974684,
+ "grad_norm": 0.04230545833706856,
+ "learning_rate": 9.248035914702582e-05,
+ "loss": 0.020812246948480606,
+ "step": 333
+ },
+ {
+ "epoch": 1.688607594936709,
+ "grad_norm": 0.1077270656824112,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.025568369776010513,
+ "step": 334
+ },
+ {
+ "epoch": 1.6936708860759495,
+ "grad_norm": 0.04277936369180679,
+ "learning_rate": 9.236812570145904e-05,
+ "loss": 0.018935058265924454,
+ "step": 335
+ },
+ {
+ "epoch": 1.6987341772151898,
+ "grad_norm": 0.04454135522246361,
+ "learning_rate": 9.231200897867565e-05,
+ "loss": 0.01933746598660946,
+ "step": 336
+ },
+ {
+ "epoch": 1.7037974683544304,
+ "grad_norm": 0.0674893856048584,
+ "learning_rate": 9.225589225589226e-05,
+ "loss": 0.021518435329198837,
+ "step": 337
+ },
+ {
+ "epoch": 1.7088607594936709,
+ "grad_norm": 0.06007042154669762,
+ "learning_rate": 9.219977553310887e-05,
+ "loss": 0.019427424296736717,
+ "step": 338
+ },
+ {
+ "epoch": 1.7139240506329114,
+ "grad_norm": 0.09564489126205444,
+ "learning_rate": 9.214365881032548e-05,
+ "loss": 0.027250545099377632,
+ "step": 339
+ },
+ {
+ "epoch": 1.7189873417721517,
+ "grad_norm": 0.053655482828617096,
+ "learning_rate": 9.208754208754209e-05,
+ "loss": 0.020125389099121094,
+ "step": 340
+ },
+ {
+ "epoch": 1.7240506329113923,
+ "grad_norm": 0.038283221423625946,
+ "learning_rate": 9.20314253647587e-05,
+ "loss": 0.017948098480701447,
+ "step": 341
+ },
+ {
+ "epoch": 1.7291139240506328,
+ "grad_norm": 0.04724166542291641,
+ "learning_rate": 9.197530864197531e-05,
+ "loss": 0.02523602545261383,
+ "step": 342
+ },
+ {
+ "epoch": 1.7341772151898733,
+ "grad_norm": 0.10365224629640579,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.035696640610694885,
+ "step": 343
+ },
+ {
+ "epoch": 1.7392405063291139,
+ "grad_norm": 0.07362233102321625,
+ "learning_rate": 9.186307519640853e-05,
+ "loss": 0.026104427874088287,
+ "step": 344
+ },
+ {
+ "epoch": 1.7443037974683544,
+ "grad_norm": 0.05976846069097519,
+ "learning_rate": 9.180695847362514e-05,
+ "loss": 0.026634451001882553,
+ "step": 345
+ },
+ {
+ "epoch": 1.749367088607595,
+ "grad_norm": 0.07387223839759827,
+ "learning_rate": 9.175084175084175e-05,
+ "loss": 0.025733446702361107,
+ "step": 346
+ },
+ {
+ "epoch": 1.7544303797468355,
+ "grad_norm": 0.04727378115057945,
+ "learning_rate": 9.169472502805838e-05,
+ "loss": 0.01889938861131668,
+ "step": 347
+ },
+ {
+ "epoch": 1.759493670886076,
+ "grad_norm": 0.10614906996488571,
+ "learning_rate": 9.163860830527497e-05,
+ "loss": 0.02275039628148079,
+ "step": 348
+ },
+ {
+ "epoch": 1.7645569620253165,
+ "grad_norm": 0.04877970367670059,
+ "learning_rate": 9.15824915824916e-05,
+ "loss": 0.022580452263355255,
+ "step": 349
+ },
+ {
+ "epoch": 1.769620253164557,
+ "grad_norm": 0.18825598061084747,
+ "learning_rate": 9.152637485970819e-05,
+ "loss": 0.03054988384246826,
+ "step": 350
+ },
+ {
+ "epoch": 1.7746835443037976,
+ "grad_norm": 0.06315254420042038,
+ "learning_rate": 9.147025813692482e-05,
+ "loss": 0.025584843009710312,
+ "step": 351
+ },
+ {
+ "epoch": 1.7797468354430381,
+ "grad_norm": 0.04519108682870865,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.0214737206697464,
+ "step": 352
+ },
+ {
+ "epoch": 1.7848101265822784,
+ "grad_norm": 0.07401937246322632,
+ "learning_rate": 9.135802469135802e-05,
+ "loss": 0.02984039857983589,
+ "step": 353
+ },
+ {
+ "epoch": 1.789873417721519,
+ "grad_norm": 0.05138625577092171,
+ "learning_rate": 9.130190796857465e-05,
+ "loss": 0.024221282452344894,
+ "step": 354
+ },
+ {
+ "epoch": 1.7949367088607595,
+ "grad_norm": 0.10182037204504013,
+ "learning_rate": 9.124579124579124e-05,
+ "loss": 0.0237903892993927,
+ "step": 355
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.056737013161182404,
+ "learning_rate": 9.118967452300787e-05,
+ "loss": 0.026514701545238495,
+ "step": 356
+ },
+ {
+ "epoch": 1.8050632911392404,
+ "grad_norm": 0.04826146364212036,
+ "learning_rate": 9.113355780022446e-05,
+ "loss": 0.021808844059705734,
+ "step": 357
+ },
+ {
+ "epoch": 1.810126582278481,
+ "grad_norm": 0.07099983841180801,
+ "learning_rate": 9.107744107744109e-05,
+ "loss": 0.028031716123223305,
+ "step": 358
+ },
+ {
+ "epoch": 1.8151898734177214,
+ "grad_norm": 0.04242753982543945,
+ "learning_rate": 9.102132435465768e-05,
+ "loss": 0.018858186900615692,
+ "step": 359
+ },
+ {
+ "epoch": 1.820253164556962,
+ "grad_norm": 0.053701240569353104,
+ "learning_rate": 9.096520763187431e-05,
+ "loss": 0.025603849440813065,
+ "step": 360
+ },
+ {
+ "epoch": 1.8253164556962025,
+ "grad_norm": 0.05277755856513977,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.021214714273810387,
+ "step": 361
+ },
+ {
+ "epoch": 1.830379746835443,
+ "grad_norm": 0.048843637108802795,
+ "learning_rate": 9.085297418630753e-05,
+ "loss": 0.024215007200837135,
+ "step": 362
+ },
+ {
+ "epoch": 1.8354430379746836,
+ "grad_norm": 0.04203329607844353,
+ "learning_rate": 9.079685746352414e-05,
+ "loss": 0.022748971357941628,
+ "step": 363
+ },
+ {
+ "epoch": 1.840506329113924,
+ "grad_norm": 0.04655196890234947,
+ "learning_rate": 9.074074074074075e-05,
+ "loss": 0.019658325240015984,
+ "step": 364
+ },
+ {
+ "epoch": 1.8455696202531646,
+ "grad_norm": 0.10654491931200027,
+ "learning_rate": 9.068462401795736e-05,
+ "loss": 0.03210999816656113,
+ "step": 365
+ },
+ {
+ "epoch": 1.8506329113924052,
+ "grad_norm": 0.04377336800098419,
+ "learning_rate": 9.062850729517397e-05,
+ "loss": 0.01867927983403206,
+ "step": 366
+ },
+ {
+ "epoch": 1.8556962025316457,
+ "grad_norm": 0.04619381204247475,
+ "learning_rate": 9.057239057239058e-05,
+ "loss": 0.01952965185046196,
+ "step": 367
+ },
+ {
+ "epoch": 1.8607594936708862,
+ "grad_norm": 0.04015986621379852,
+ "learning_rate": 9.051627384960719e-05,
+ "loss": 0.017353296279907227,
+ "step": 368
+ },
+ {
+ "epoch": 1.8658227848101265,
+ "grad_norm": 0.11403095722198486,
+ "learning_rate": 9.04601571268238e-05,
+ "loss": 0.02238992229104042,
+ "step": 369
+ },
+ {
+ "epoch": 1.870886075949367,
+ "grad_norm": 0.043767284601926804,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.02202833816409111,
+ "step": 370
+ },
+ {
+ "epoch": 1.8759493670886076,
+ "grad_norm": 0.053445883095264435,
+ "learning_rate": 9.034792368125702e-05,
+ "loss": 0.023765750229358673,
+ "step": 371
+ },
+ {
+ "epoch": 1.8810126582278481,
+ "grad_norm": 0.05750055983662605,
+ "learning_rate": 9.029180695847364e-05,
+ "loss": 0.026259474456310272,
+ "step": 372
+ },
+ {
+ "epoch": 1.8860759493670884,
+ "grad_norm": 0.04525497183203697,
+ "learning_rate": 9.023569023569024e-05,
+ "loss": 0.024194583296775818,
+ "step": 373
+ },
+ {
+ "epoch": 1.891139240506329,
+ "grad_norm": 0.04918856918811798,
+ "learning_rate": 9.017957351290685e-05,
+ "loss": 0.020951319485902786,
+ "step": 374
+ },
+ {
+ "epoch": 1.8962025316455695,
+ "grad_norm": 0.08538687229156494,
+ "learning_rate": 9.012345679012346e-05,
+ "loss": 0.022266045212745667,
+ "step": 375
+ },
+ {
+ "epoch": 1.90126582278481,
+ "grad_norm": 0.07101748883724213,
+ "learning_rate": 9.006734006734007e-05,
+ "loss": 0.028090521693229675,
+ "step": 376
+ },
+ {
+ "epoch": 1.9063291139240506,
+ "grad_norm": 0.06256446987390518,
+ "learning_rate": 9.001122334455668e-05,
+ "loss": 0.027174800634384155,
+ "step": 377
+ },
+ {
+ "epoch": 1.9113924050632911,
+ "grad_norm": 0.07588270306587219,
+ "learning_rate": 8.995510662177329e-05,
+ "loss": 0.028438206762075424,
+ "step": 378
+ },
+ {
+ "epoch": 1.9164556962025316,
+ "grad_norm": 5.8829851150512695,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.01749270409345627,
+ "step": 379
+ },
+ {
+ "epoch": 1.9215189873417722,
+ "grad_norm": 0.038905344903469086,
+ "learning_rate": 8.984287317620651e-05,
+ "loss": 0.019571108743548393,
+ "step": 380
+ },
+ {
+ "epoch": 1.9265822784810127,
+ "grad_norm": 0.05960959196090698,
+ "learning_rate": 8.978675645342313e-05,
+ "loss": 0.024591946974396706,
+ "step": 381
+ },
+ {
+ "epoch": 1.9316455696202532,
+ "grad_norm": 0.07935867458581924,
+ "learning_rate": 8.973063973063973e-05,
+ "loss": 0.020205039530992508,
+ "step": 382
+ },
+ {
+ "epoch": 1.9367088607594938,
+ "grad_norm": 0.08682888746261597,
+ "learning_rate": 8.967452300785635e-05,
+ "loss": 0.023299653083086014,
+ "step": 383
+ },
+ {
+ "epoch": 1.9417721518987343,
+ "grad_norm": 0.07220255583524704,
+ "learning_rate": 8.961840628507295e-05,
+ "loss": 0.025364618748426437,
+ "step": 384
+ },
+ {
+ "epoch": 1.9468354430379748,
+ "grad_norm": 0.08230294287204742,
+ "learning_rate": 8.956228956228957e-05,
+ "loss": 0.023587457835674286,
+ "step": 385
+ },
+ {
+ "epoch": 1.9518987341772152,
+ "grad_norm": 0.05176795646548271,
+ "learning_rate": 8.950617283950617e-05,
+ "loss": 0.018942706286907196,
+ "step": 386
+ },
+ {
+ "epoch": 1.9569620253164557,
+ "grad_norm": 0.04784144088625908,
+ "learning_rate": 8.945005611672279e-05,
+ "loss": 0.020134730264544487,
+ "step": 387
+ },
+ {
+ "epoch": 1.9620253164556962,
+ "grad_norm": 0.04668115824460983,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.022084465250372887,
+ "step": 388
+ },
+ {
+ "epoch": 1.9670886075949368,
+ "grad_norm": 0.05892647057771683,
+ "learning_rate": 8.933782267115601e-05,
+ "loss": 0.02586008608341217,
+ "step": 389
+ },
+ {
+ "epoch": 1.972151898734177,
+ "grad_norm": 0.048669006675481796,
+ "learning_rate": 8.928170594837262e-05,
+ "loss": 0.020011097192764282,
+ "step": 390
+ },
+ {
+ "epoch": 1.9772151898734176,
+ "grad_norm": 0.0973723903298378,
+ "learning_rate": 8.922558922558923e-05,
+ "loss": 0.030240919440984726,
+ "step": 391
+ },
+ {
+ "epoch": 1.9822784810126581,
+ "grad_norm": 0.090507872402668,
+ "learning_rate": 8.916947250280584e-05,
+ "loss": 0.028250183910131454,
+ "step": 392
+ },
+ {
+ "epoch": 1.9873417721518987,
+ "grad_norm": 0.03921318054199219,
+ "learning_rate": 8.911335578002245e-05,
+ "loss": 0.02076716348528862,
+ "step": 393
+ },
+ {
+ "epoch": 1.9924050632911392,
+ "grad_norm": 0.04830043017864227,
+ "learning_rate": 8.905723905723906e-05,
+ "loss": 0.02241525426506996,
+ "step": 394
+ },
+ {
+ "epoch": 1.9974683544303797,
+ "grad_norm": 0.04455797001719475,
+ "learning_rate": 8.900112233445567e-05,
+ "loss": 0.026035301387310028,
+ "step": 395
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.10931648313999176,
+ "learning_rate": 8.894500561167228e-05,
+ "loss": 0.03514251485466957,
+ "step": 396
+ },
+ {
+ "epoch": 2.0050632911392405,
+ "grad_norm": 0.07531362026929855,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.021771814674139023,
+ "step": 397
+ },
+ {
+ "epoch": 2.010126582278481,
+ "grad_norm": 0.0649140477180481,
+ "learning_rate": 8.88327721661055e-05,
+ "loss": 0.02932022325694561,
+ "step": 398
+ },
+ {
+ "epoch": 2.0151898734177216,
+ "grad_norm": 0.07461163401603699,
+ "learning_rate": 8.877665544332211e-05,
+ "loss": 0.023864082992076874,
+ "step": 399
+ },
+ {
+ "epoch": 2.020253164556962,
+ "grad_norm": 0.054510265588760376,
+ "learning_rate": 8.872053872053872e-05,
+ "loss": 0.027578316628932953,
+ "step": 400
+ },
+ {
+ "epoch": 2.0253164556962027,
+ "grad_norm": 0.04434451460838318,
+ "learning_rate": 8.866442199775533e-05,
+ "loss": 0.022873830050230026,
+ "step": 401
+ },
+ {
+ "epoch": 2.030379746835443,
+ "grad_norm": 0.052791960537433624,
+ "learning_rate": 8.860830527497194e-05,
+ "loss": 0.021092431619763374,
+ "step": 402
+ },
+ {
+ "epoch": 2.0354430379746837,
+ "grad_norm": 0.04550998657941818,
+ "learning_rate": 8.855218855218855e-05,
+ "loss": 0.022475749254226685,
+ "step": 403
+ },
+ {
+ "epoch": 2.0405063291139243,
+ "grad_norm": 0.2512972354888916,
+ "learning_rate": 8.849607182940516e-05,
+ "loss": 0.02201610803604126,
+ "step": 404
+ },
+ {
+ "epoch": 2.0455696202531644,
+ "grad_norm": 0.04554569348692894,
+ "learning_rate": 8.843995510662177e-05,
+ "loss": 0.02180359698832035,
+ "step": 405
+ },
+ {
+ "epoch": 2.050632911392405,
+ "grad_norm": 0.04094229266047478,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.01960112899541855,
+ "step": 406
+ },
+ {
+ "epoch": 2.0556962025316454,
+ "grad_norm": 0.07398641109466553,
+ "learning_rate": 8.8327721661055e-05,
+ "loss": 0.02206597849726677,
+ "step": 407
+ },
+ {
+ "epoch": 2.060759493670886,
+ "grad_norm": 0.07659231871366501,
+ "learning_rate": 8.827160493827162e-05,
+ "loss": 0.019660351797938347,
+ "step": 408
+ },
+ {
+ "epoch": 2.0658227848101265,
+ "grad_norm": 0.05986466258764267,
+ "learning_rate": 8.821548821548821e-05,
+ "loss": 0.027121691033244133,
+ "step": 409
+ },
+ {
+ "epoch": 2.070886075949367,
+ "grad_norm": 0.03376661241054535,
+ "learning_rate": 8.815937149270484e-05,
+ "loss": 0.021059338003396988,
+ "step": 410
+ },
+ {
+ "epoch": 2.0759493670886076,
+ "grad_norm": 0.081104576587677,
+ "learning_rate": 8.810325476992143e-05,
+ "loss": 0.031228341162204742,
+ "step": 411
+ },
+ {
+ "epoch": 2.081012658227848,
+ "grad_norm": 0.04295242205262184,
+ "learning_rate": 8.804713804713806e-05,
+ "loss": 0.020738180726766586,
+ "step": 412
+ },
+ {
+ "epoch": 2.0860759493670886,
+ "grad_norm": 0.03715268895030022,
+ "learning_rate": 8.799102132435467e-05,
+ "loss": 0.018579209223389626,
+ "step": 413
+ },
+ {
+ "epoch": 2.091139240506329,
+ "grad_norm": 0.06769359856843948,
+ "learning_rate": 8.793490460157128e-05,
+ "loss": 0.026761794462800026,
+ "step": 414
+ },
+ {
+ "epoch": 2.0962025316455697,
+ "grad_norm": 0.03715744614601135,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.022879980504512787,
+ "step": 415
+ },
+ {
+ "epoch": 2.1012658227848102,
+ "grad_norm": 0.04305677488446236,
+ "learning_rate": 8.78226711560045e-05,
+ "loss": 0.022773049771785736,
+ "step": 416
+ },
+ {
+ "epoch": 2.1063291139240508,
+ "grad_norm": 0.0449112169444561,
+ "learning_rate": 8.776655443322111e-05,
+ "loss": 0.022499293088912964,
+ "step": 417
+ },
+ {
+ "epoch": 2.1113924050632913,
+ "grad_norm": 0.0457427054643631,
+ "learning_rate": 8.77104377104377e-05,
+ "loss": 0.024978693574666977,
+ "step": 418
+ },
+ {
+ "epoch": 2.116455696202532,
+ "grad_norm": 0.04705161228775978,
+ "learning_rate": 8.765432098765433e-05,
+ "loss": 0.024807877838611603,
+ "step": 419
+ },
+ {
+ "epoch": 2.1215189873417724,
+ "grad_norm": 0.04377812147140503,
+ "learning_rate": 8.759820426487092e-05,
+ "loss": 0.025857431814074516,
+ "step": 420
+ },
+ {
+ "epoch": 2.1265822784810124,
+ "grad_norm": 0.08598720282316208,
+ "learning_rate": 8.754208754208755e-05,
+ "loss": 0.021972455084323883,
+ "step": 421
+ },
+ {
+ "epoch": 2.131645569620253,
+ "grad_norm": 0.4669632017612457,
+ "learning_rate": 8.748597081930416e-05,
+ "loss": 0.02055199444293976,
+ "step": 422
+ },
+ {
+ "epoch": 2.1367088607594935,
+ "grad_norm": 0.05292733013629913,
+ "learning_rate": 8.742985409652077e-05,
+ "loss": 0.020852137356996536,
+ "step": 423
+ },
+ {
+ "epoch": 2.141772151898734,
+ "grad_norm": 0.05878116562962532,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.02444305270910263,
+ "step": 424
+ },
+ {
+ "epoch": 2.1468354430379746,
+ "grad_norm": 0.05234210565686226,
+ "learning_rate": 8.731762065095399e-05,
+ "loss": 0.02202335000038147,
+ "step": 425
+ },
+ {
+ "epoch": 2.151898734177215,
+ "grad_norm": 0.04706348851323128,
+ "learning_rate": 8.72615039281706e-05,
+ "loss": 0.019998187199234962,
+ "step": 426
+ },
+ {
+ "epoch": 2.1569620253164556,
+ "grad_norm": 0.05263376981019974,
+ "learning_rate": 8.720538720538721e-05,
+ "loss": 0.028126951307058334,
+ "step": 427
+ },
+ {
+ "epoch": 2.162025316455696,
+ "grad_norm": 0.062016960233449936,
+ "learning_rate": 8.714927048260382e-05,
+ "loss": 0.0286184661090374,
+ "step": 428
+ },
+ {
+ "epoch": 2.1670886075949367,
+ "grad_norm": 0.13798244297504425,
+ "learning_rate": 8.709315375982043e-05,
+ "loss": 0.026699248701334,
+ "step": 429
+ },
+ {
+ "epoch": 2.1721518987341772,
+ "grad_norm": 0.09159042686223984,
+ "learning_rate": 8.703703703703704e-05,
+ "loss": 0.025515643879771233,
+ "step": 430
+ },
+ {
+ "epoch": 2.1772151898734178,
+ "grad_norm": 0.0828855037689209,
+ "learning_rate": 8.698092031425365e-05,
+ "loss": 0.025481123477220535,
+ "step": 431
+ },
+ {
+ "epoch": 2.1822784810126583,
+ "grad_norm": 0.09840776771306992,
+ "learning_rate": 8.692480359147026e-05,
+ "loss": 0.020968927070498466,
+ "step": 432
+ },
+ {
+ "epoch": 2.187341772151899,
+ "grad_norm": 0.10999752581119537,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.028588412329554558,
+ "step": 433
+ },
+ {
+ "epoch": 2.1924050632911394,
+ "grad_norm": 0.06938561797142029,
+ "learning_rate": 8.681257014590348e-05,
+ "loss": 0.024119220674037933,
+ "step": 434
+ },
+ {
+ "epoch": 2.19746835443038,
+ "grad_norm": 0.054689887911081314,
+ "learning_rate": 8.67564534231201e-05,
+ "loss": 0.02173299714922905,
+ "step": 435
+ },
+ {
+ "epoch": 2.2025316455696204,
+ "grad_norm": 0.09605880081653595,
+ "learning_rate": 8.67003367003367e-05,
+ "loss": 0.02312455326318741,
+ "step": 436
+ },
+ {
+ "epoch": 2.207594936708861,
+ "grad_norm": 0.06863043457269669,
+ "learning_rate": 8.664421997755332e-05,
+ "loss": 0.020868321880698204,
+ "step": 437
+ },
+ {
+ "epoch": 2.212658227848101,
+ "grad_norm": 0.11743242293596268,
+ "learning_rate": 8.658810325476992e-05,
+ "loss": 0.029748965054750443,
+ "step": 438
+ },
+ {
+ "epoch": 2.2177215189873416,
+ "grad_norm": 0.08399086445569992,
+ "learning_rate": 8.653198653198653e-05,
+ "loss": 0.02379520982503891,
+ "step": 439
+ },
+ {
+ "epoch": 2.222784810126582,
+ "grad_norm": 0.052164461463689804,
+ "learning_rate": 8.647586980920315e-05,
+ "loss": 0.02010851353406906,
+ "step": 440
+ },
+ {
+ "epoch": 2.2278481012658227,
+ "grad_norm": 0.11834696680307388,
+ "learning_rate": 8.641975308641975e-05,
+ "loss": 0.02748255990445614,
+ "step": 441
+ },
+ {
+ "epoch": 2.232911392405063,
+ "grad_norm": 0.06718999892473221,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.026828233152627945,
+ "step": 442
+ },
+ {
+ "epoch": 2.2379746835443037,
+ "grad_norm": 0.042458854615688324,
+ "learning_rate": 8.630751964085297e-05,
+ "loss": 0.021280258893966675,
+ "step": 443
+ },
+ {
+ "epoch": 2.2430379746835443,
+ "grad_norm": 0.036516617983579636,
+ "learning_rate": 8.62514029180696e-05,
+ "loss": 0.021773381158709526,
+ "step": 444
+ },
+ {
+ "epoch": 2.248101265822785,
+ "grad_norm": 0.04317261651158333,
+ "learning_rate": 8.619528619528619e-05,
+ "loss": 0.022671079263091087,
+ "step": 445
+ },
+ {
+ "epoch": 2.2531645569620253,
+ "grad_norm": 0.08610037714242935,
+ "learning_rate": 8.613916947250281e-05,
+ "loss": 0.02425701916217804,
+ "step": 446
+ },
+ {
+ "epoch": 2.258227848101266,
+ "grad_norm": 0.03478290140628815,
+ "learning_rate": 8.608305274971942e-05,
+ "loss": 0.022291556000709534,
+ "step": 447
+ },
+ {
+ "epoch": 2.2632911392405064,
+ "grad_norm": 0.04682233929634094,
+ "learning_rate": 8.602693602693603e-05,
+ "loss": 0.02036888152360916,
+ "step": 448
+ },
+ {
+ "epoch": 2.268354430379747,
+ "grad_norm": 0.0808606892824173,
+ "learning_rate": 8.597081930415264e-05,
+ "loss": 0.025470012798905373,
+ "step": 449
+ },
+ {
+ "epoch": 2.2734177215189875,
+ "grad_norm": 0.042830612510442734,
+ "learning_rate": 8.591470258136925e-05,
+ "loss": 0.020565971732139587,
+ "step": 450
+ },
+ {
+ "epoch": 2.278481012658228,
+ "grad_norm": 0.06374406069517136,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031990330666303635,
+ "step": 451
+ },
+ {
+ "epoch": 2.2835443037974685,
+ "grad_norm": 0.05716697871685028,
+ "learning_rate": 8.580246913580247e-05,
+ "loss": 0.024125374853610992,
+ "step": 452
+ },
+ {
+ "epoch": 2.2886075949367086,
+ "grad_norm": 0.04057484492659569,
+ "learning_rate": 8.574635241301908e-05,
+ "loss": 0.021739482879638672,
+ "step": 453
+ },
+ {
+ "epoch": 2.293670886075949,
+ "grad_norm": 0.07754945009946823,
+ "learning_rate": 8.56902356902357e-05,
+ "loss": 0.02694481424987316,
+ "step": 454
+ },
+ {
+ "epoch": 2.2987341772151897,
+ "grad_norm": 0.06022442877292633,
+ "learning_rate": 8.56341189674523e-05,
+ "loss": 0.021221034228801727,
+ "step": 455
+ },
+ {
+ "epoch": 2.3037974683544302,
+ "grad_norm": 0.06909896433353424,
+ "learning_rate": 8.557800224466891e-05,
+ "loss": 0.02247895672917366,
+ "step": 456
+ },
+ {
+ "epoch": 2.3088607594936708,
+ "grad_norm": 0.05362236499786377,
+ "learning_rate": 8.552188552188552e-05,
+ "loss": 0.020700538530945778,
+ "step": 457
+ },
+ {
+ "epoch": 2.3139240506329113,
+ "grad_norm": 0.09836408495903015,
+ "learning_rate": 8.546576879910215e-05,
+ "loss": 0.02611887827515602,
+ "step": 458
+ },
+ {
+ "epoch": 2.318987341772152,
+ "grad_norm": 0.036625102162361145,
+ "learning_rate": 8.540965207631874e-05,
+ "loss": 0.0196938905864954,
+ "step": 459
+ },
+ {
+ "epoch": 2.3240506329113924,
+ "grad_norm": 0.07372298091650009,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.020545657724142075,
+ "step": 460
+ },
+ {
+ "epoch": 2.329113924050633,
+ "grad_norm": 0.20502988994121552,
+ "learning_rate": 8.529741863075196e-05,
+ "loss": 0.02884715050458908,
+ "step": 461
+ },
+ {
+ "epoch": 2.3341772151898734,
+ "grad_norm": 0.04867224395275116,
+ "learning_rate": 8.524130190796857e-05,
+ "loss": 0.019854716956615448,
+ "step": 462
+ },
+ {
+ "epoch": 2.339240506329114,
+ "grad_norm": 0.029550092294812202,
+ "learning_rate": 8.518518518518518e-05,
+ "loss": 0.01884104311466217,
+ "step": 463
+ },
+ {
+ "epoch": 2.3443037974683545,
+ "grad_norm": 0.04299351945519447,
+ "learning_rate": 8.51290684624018e-05,
+ "loss": 0.01954217068850994,
+ "step": 464
+ },
+ {
+ "epoch": 2.349367088607595,
+ "grad_norm": 0.043467242270708084,
+ "learning_rate": 8.507295173961842e-05,
+ "loss": 0.024274462834000587,
+ "step": 465
+ },
+ {
+ "epoch": 2.3544303797468356,
+ "grad_norm": 0.05131510645151138,
+ "learning_rate": 8.501683501683501e-05,
+ "loss": 0.026246599853038788,
+ "step": 466
+ },
+ {
+ "epoch": 2.359493670886076,
+ "grad_norm": 0.06280570477247238,
+ "learning_rate": 8.496071829405164e-05,
+ "loss": 0.024986159056425095,
+ "step": 467
+ },
+ {
+ "epoch": 2.3645569620253166,
+ "grad_norm": 0.04968208447098732,
+ "learning_rate": 8.490460157126824e-05,
+ "loss": 0.02912936732172966,
+ "step": 468
+ },
+ {
+ "epoch": 2.369620253164557,
+ "grad_norm": 0.08504039794206619,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.027097277343273163,
+ "step": 469
+ },
+ {
+ "epoch": 2.3746835443037977,
+ "grad_norm": 0.18385924398899078,
+ "learning_rate": 8.479236812570146e-05,
+ "loss": 0.02459462732076645,
+ "step": 470
+ },
+ {
+ "epoch": 2.379746835443038,
+ "grad_norm": 0.0663745328783989,
+ "learning_rate": 8.473625140291808e-05,
+ "loss": 0.020224973559379578,
+ "step": 471
+ },
+ {
+ "epoch": 2.3848101265822783,
+ "grad_norm": 0.04759671539068222,
+ "learning_rate": 8.468013468013468e-05,
+ "loss": 0.02591642364859581,
+ "step": 472
+ },
+ {
+ "epoch": 2.389873417721519,
+ "grad_norm": 0.044010091572999954,
+ "learning_rate": 8.46240179573513e-05,
+ "loss": 0.025122515857219696,
+ "step": 473
+ },
+ {
+ "epoch": 2.3949367088607594,
+ "grad_norm": 0.035054467618465424,
+ "learning_rate": 8.456790123456791e-05,
+ "loss": 0.019854065030813217,
+ "step": 474
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.03171153366565704,
+ "learning_rate": 8.451178451178452e-05,
+ "loss": 0.02009584940969944,
+ "step": 475
+ },
+ {
+ "epoch": 2.4050632911392404,
+ "grad_norm": 0.17388089001178741,
+ "learning_rate": 8.445566778900113e-05,
+ "loss": 0.02714207023382187,
+ "step": 476
+ },
+ {
+ "epoch": 2.410126582278481,
+ "grad_norm": 0.038392502814531326,
+ "learning_rate": 8.439955106621774e-05,
+ "loss": 0.020382478833198547,
+ "step": 477
+ },
+ {
+ "epoch": 2.4151898734177215,
+ "grad_norm": 0.04264051839709282,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.022726822644472122,
+ "step": 478
+ },
+ {
+ "epoch": 2.420253164556962,
+ "grad_norm": 0.046432014554739,
+ "learning_rate": 8.428731762065096e-05,
+ "loss": 0.021431483328342438,
+ "step": 479
+ },
+ {
+ "epoch": 2.4253164556962026,
+ "grad_norm": 0.07288242876529694,
+ "learning_rate": 8.423120089786757e-05,
+ "loss": 0.026229504495859146,
+ "step": 480
+ },
+ {
+ "epoch": 2.430379746835443,
+ "grad_norm": 0.04801097884774208,
+ "learning_rate": 8.417508417508418e-05,
+ "loss": 0.020924456417560577,
+ "step": 481
+ },
+ {
+ "epoch": 2.4354430379746836,
+ "grad_norm": 0.11201190203428268,
+ "learning_rate": 8.411896745230079e-05,
+ "loss": 0.022652529180049896,
+ "step": 482
+ },
+ {
+ "epoch": 2.440506329113924,
+ "grad_norm": 0.06151285395026207,
+ "learning_rate": 8.40628507295174e-05,
+ "loss": 0.02416859194636345,
+ "step": 483
+ },
+ {
+ "epoch": 2.4455696202531647,
+ "grad_norm": 0.04006446525454521,
+ "learning_rate": 8.400673400673401e-05,
+ "loss": 0.02390255406498909,
+ "step": 484
+ },
+ {
+ "epoch": 2.4506329113924052,
+ "grad_norm": 0.027193108573555946,
+ "learning_rate": 8.395061728395062e-05,
+ "loss": 0.015282701700925827,
+ "step": 485
+ },
+ {
+ "epoch": 2.4556962025316453,
+ "grad_norm": 0.05453994497656822,
+ "learning_rate": 8.389450056116723e-05,
+ "loss": 0.025738034397363663,
+ "step": 486
+ },
+ {
+ "epoch": 2.460759493670886,
+ "grad_norm": 0.03226681798696518,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.02111941948533058,
+ "step": 487
+ },
+ {
+ "epoch": 2.4658227848101264,
+ "grad_norm": 0.0451083667576313,
+ "learning_rate": 8.378226711560045e-05,
+ "loss": 0.020694585517048836,
+ "step": 488
+ },
+ {
+ "epoch": 2.470886075949367,
+ "grad_norm": 0.0390113927423954,
+ "learning_rate": 8.372615039281706e-05,
+ "loss": 0.022557765245437622,
+ "step": 489
+ },
+ {
+ "epoch": 2.4759493670886075,
+ "grad_norm": 0.05983779951930046,
+ "learning_rate": 8.367003367003367e-05,
+ "loss": 0.02489873766899109,
+ "step": 490
+ },
+ {
+ "epoch": 2.481012658227848,
+ "grad_norm": 0.03961458057165146,
+ "learning_rate": 8.361391694725028e-05,
+ "loss": 0.021655399352312088,
+ "step": 491
+ },
+ {
+ "epoch": 2.4860759493670885,
+ "grad_norm": 0.03814523667097092,
+ "learning_rate": 8.35578002244669e-05,
+ "loss": 0.02217719703912735,
+ "step": 492
+ },
+ {
+ "epoch": 2.491139240506329,
+ "grad_norm": 0.030563514679670334,
+ "learning_rate": 8.35016835016835e-05,
+ "loss": 0.01679009571671486,
+ "step": 493
+ },
+ {
+ "epoch": 2.4962025316455696,
+ "grad_norm": 0.04566824436187744,
+ "learning_rate": 8.344556677890012e-05,
+ "loss": 0.019699417054653168,
+ "step": 494
+ },
+ {
+ "epoch": 2.50126582278481,
+ "grad_norm": 0.06117499992251396,
+ "learning_rate": 8.338945005611672e-05,
+ "loss": 0.028571851551532745,
+ "step": 495
+ },
+ {
+ "epoch": 2.5063291139240507,
+ "grad_norm": 0.03510760888457298,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.023387223482131958,
+ "step": 496
+ },
+ {
+ "epoch": 2.511392405063291,
+ "grad_norm": 0.028878437355160713,
+ "learning_rate": 8.327721661054994e-05,
+ "loss": 0.023329850286245346,
+ "step": 497
+ },
+ {
+ "epoch": 2.5164556962025317,
+ "grad_norm": 0.02818676456809044,
+ "learning_rate": 8.322109988776656e-05,
+ "loss": 0.017786618322134018,
+ "step": 498
+ },
+ {
+ "epoch": 2.5215189873417723,
+ "grad_norm": 0.06660276651382446,
+ "learning_rate": 8.316498316498317e-05,
+ "loss": 0.023636367172002792,
+ "step": 499
+ },
+ {
+ "epoch": 2.526582278481013,
+ "grad_norm": 0.05663186311721802,
+ "learning_rate": 8.310886644219978e-05,
+ "loss": 0.02607567049562931,
+ "step": 500
+ },
+ {
+ "epoch": 2.5316455696202533,
+ "grad_norm": 0.04156090319156647,
+ "learning_rate": 8.30527497194164e-05,
+ "loss": 0.024936942383646965,
+ "step": 501
+ },
+ {
+ "epoch": 2.536708860759494,
+ "grad_norm": 0.036135219037532806,
+ "learning_rate": 8.2996632996633e-05,
+ "loss": 0.023583384230732918,
+ "step": 502
+ },
+ {
+ "epoch": 2.5417721518987344,
+ "grad_norm": 0.052026644349098206,
+ "learning_rate": 8.294051627384961e-05,
+ "loss": 0.02324807643890381,
+ "step": 503
+ },
+ {
+ "epoch": 2.546835443037975,
+ "grad_norm": 0.03599514439702034,
+ "learning_rate": 8.288439955106621e-05,
+ "loss": 0.01879853755235672,
+ "step": 504
+ },
+ {
+ "epoch": 2.5518987341772155,
+ "grad_norm": 0.03505280241370201,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.017342131584882736,
+ "step": 505
+ },
+ {
+ "epoch": 2.5569620253164556,
+ "grad_norm": 0.0403706431388855,
+ "learning_rate": 8.277216610549943e-05,
+ "loss": 0.02082991972565651,
+ "step": 506
+ },
+ {
+ "epoch": 2.562025316455696,
+ "grad_norm": 0.031072309240698814,
+ "learning_rate": 8.271604938271605e-05,
+ "loss": 0.01711331121623516,
+ "step": 507
+ },
+ {
+ "epoch": 2.5670886075949366,
+ "grad_norm": 0.04118587449193001,
+ "learning_rate": 8.265993265993266e-05,
+ "loss": 0.01940922439098358,
+ "step": 508
+ },
+ {
+ "epoch": 2.572151898734177,
+ "grad_norm": 0.039908040314912796,
+ "learning_rate": 8.260381593714927e-05,
+ "loss": 0.021229952573776245,
+ "step": 509
+ },
+ {
+ "epoch": 2.5772151898734177,
+ "grad_norm": 0.02886618860065937,
+ "learning_rate": 8.254769921436589e-05,
+ "loss": 0.02004890888929367,
+ "step": 510
+ },
+ {
+ "epoch": 2.5822784810126582,
+ "grad_norm": 0.04229263588786125,
+ "learning_rate": 8.24915824915825e-05,
+ "loss": 0.019512392580509186,
+ "step": 511
+ },
+ {
+ "epoch": 2.5873417721518988,
+ "grad_norm": 0.030951635912060738,
+ "learning_rate": 8.24354657687991e-05,
+ "loss": 0.01836536079645157,
+ "step": 512
+ },
+ {
+ "epoch": 2.5924050632911393,
+ "grad_norm": 0.057054903358221054,
+ "learning_rate": 8.237934904601572e-05,
+ "loss": 0.028897594660520554,
+ "step": 513
+ },
+ {
+ "epoch": 2.59746835443038,
+ "grad_norm": 0.10734204202890396,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.024986904114484787,
+ "step": 514
+ },
+ {
+ "epoch": 2.6025316455696204,
+ "grad_norm": 0.029653102159500122,
+ "learning_rate": 8.226711560044894e-05,
+ "loss": 0.02242947742342949,
+ "step": 515
+ },
+ {
+ "epoch": 2.607594936708861,
+ "grad_norm": 0.05601462349295616,
+ "learning_rate": 8.221099887766555e-05,
+ "loss": 0.020091768354177475,
+ "step": 516
+ },
+ {
+ "epoch": 2.6126582278481014,
+ "grad_norm": 0.04170191287994385,
+ "learning_rate": 8.215488215488217e-05,
+ "loss": 0.021796470507979393,
+ "step": 517
+ },
+ {
+ "epoch": 2.6177215189873415,
+ "grad_norm": 0.06347091495990753,
+ "learning_rate": 8.209876543209877e-05,
+ "loss": 0.024338826537132263,
+ "step": 518
+ },
+ {
+ "epoch": 2.622784810126582,
+ "grad_norm": 0.06084204465150833,
+ "learning_rate": 8.204264870931539e-05,
+ "loss": 0.02493124082684517,
+ "step": 519
+ },
+ {
+ "epoch": 2.6278481012658226,
+ "grad_norm": 0.03094005584716797,
+ "learning_rate": 8.198653198653199e-05,
+ "loss": 0.021345658227801323,
+ "step": 520
+ },
+ {
+ "epoch": 2.632911392405063,
+ "grad_norm": 0.04017730429768562,
+ "learning_rate": 8.193041526374861e-05,
+ "loss": 0.019823770970106125,
+ "step": 521
+ },
+ {
+ "epoch": 2.6379746835443036,
+ "grad_norm": 0.045351576060056686,
+ "learning_rate": 8.18742985409652e-05,
+ "loss": 0.02385132387280464,
+ "step": 522
+ },
+ {
+ "epoch": 2.643037974683544,
+ "grad_norm": 0.04823896288871765,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.021753432229161263,
+ "step": 523
+ },
+ {
+ "epoch": 2.6481012658227847,
+ "grad_norm": 0.0442446693778038,
+ "learning_rate": 8.176206509539843e-05,
+ "loss": 0.022134695202112198,
+ "step": 524
+ },
+ {
+ "epoch": 2.6531645569620252,
+ "grad_norm": 0.07998359203338623,
+ "learning_rate": 8.170594837261504e-05,
+ "loss": 0.021159570664167404,
+ "step": 525
+ },
+ {
+ "epoch": 2.6582278481012658,
+ "grad_norm": 0.07844395190477371,
+ "learning_rate": 8.164983164983166e-05,
+ "loss": 0.023695990443229675,
+ "step": 526
+ },
+ {
+ "epoch": 2.6632911392405063,
+ "grad_norm": 0.025296518579125404,
+ "learning_rate": 8.159371492704826e-05,
+ "loss": 0.020914766937494278,
+ "step": 527
+ },
+ {
+ "epoch": 2.668354430379747,
+ "grad_norm": 0.337454617023468,
+ "learning_rate": 8.153759820426488e-05,
+ "loss": 0.02948678657412529,
+ "step": 528
+ },
+ {
+ "epoch": 2.6734177215189874,
+ "grad_norm": 0.03531114012002945,
+ "learning_rate": 8.148148148148148e-05,
+ "loss": 0.020608587190508842,
+ "step": 529
+ },
+ {
+ "epoch": 2.678481012658228,
+ "grad_norm": 0.0496559739112854,
+ "learning_rate": 8.14253647586981e-05,
+ "loss": 0.023600757122039795,
+ "step": 530
+ },
+ {
+ "epoch": 2.6835443037974684,
+ "grad_norm": 0.04093128815293312,
+ "learning_rate": 8.13692480359147e-05,
+ "loss": 0.022392068058252335,
+ "step": 531
+ },
+ {
+ "epoch": 2.688607594936709,
+ "grad_norm": 0.05343819782137871,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.01882098615169525,
+ "step": 532
+ },
+ {
+ "epoch": 2.6936708860759495,
+ "grad_norm": 0.0334453359246254,
+ "learning_rate": 8.125701459034793e-05,
+ "loss": 0.020492104813456535,
+ "step": 533
+ },
+ {
+ "epoch": 2.69873417721519,
+ "grad_norm": 0.045540470629930496,
+ "learning_rate": 8.120089786756454e-05,
+ "loss": 0.021309707313776016,
+ "step": 534
+ },
+ {
+ "epoch": 2.7037974683544306,
+ "grad_norm": 0.03238926827907562,
+ "learning_rate": 8.114478114478115e-05,
+ "loss": 0.01929772086441517,
+ "step": 535
+ },
+ {
+ "epoch": 2.708860759493671,
+ "grad_norm": 0.10985280573368073,
+ "learning_rate": 8.108866442199776e-05,
+ "loss": 0.02431013062596321,
+ "step": 536
+ },
+ {
+ "epoch": 2.7139240506329116,
+ "grad_norm": 0.039785534143447876,
+ "learning_rate": 8.103254769921437e-05,
+ "loss": 0.022708022966980934,
+ "step": 537
+ },
+ {
+ "epoch": 2.7189873417721517,
+ "grad_norm": 0.06239910051226616,
+ "learning_rate": 8.097643097643098e-05,
+ "loss": 0.02715257555246353,
+ "step": 538
+ },
+ {
+ "epoch": 2.7240506329113923,
+ "grad_norm": 0.03662843257188797,
+ "learning_rate": 8.092031425364759e-05,
+ "loss": 0.024876421317458153,
+ "step": 539
+ },
+ {
+ "epoch": 2.729113924050633,
+ "grad_norm": 0.05869411304593086,
+ "learning_rate": 8.08641975308642e-05,
+ "loss": 0.022937750443816185,
+ "step": 540
+ },
+ {
+ "epoch": 2.7341772151898733,
+ "grad_norm": 0.07220412790775299,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02227093279361725,
+ "step": 541
+ },
+ {
+ "epoch": 2.739240506329114,
+ "grad_norm": 0.03881363570690155,
+ "learning_rate": 8.075196408529742e-05,
+ "loss": 0.020784813910722733,
+ "step": 542
+ },
+ {
+ "epoch": 2.7443037974683544,
+ "grad_norm": 0.04756273329257965,
+ "learning_rate": 8.069584736251403e-05,
+ "loss": 0.02334344945847988,
+ "step": 543
+ },
+ {
+ "epoch": 2.749367088607595,
+ "grad_norm": 0.05327540263533592,
+ "learning_rate": 8.063973063973065e-05,
+ "loss": 0.026313351467251778,
+ "step": 544
+ },
+ {
+ "epoch": 2.7544303797468355,
+ "grad_norm": 0.1605764925479889,
+ "learning_rate": 8.058361391694725e-05,
+ "loss": 0.02474561519920826,
+ "step": 545
+ },
+ {
+ "epoch": 2.759493670886076,
+ "grad_norm": 0.044486165046691895,
+ "learning_rate": 8.052749719416387e-05,
+ "loss": 0.023557808250188828,
+ "step": 546
+ },
+ {
+ "epoch": 2.7645569620253165,
+ "grad_norm": 0.04645116999745369,
+ "learning_rate": 8.047138047138047e-05,
+ "loss": 0.017340417951345444,
+ "step": 547
+ },
+ {
+ "epoch": 2.769620253164557,
+ "grad_norm": 0.04009381681680679,
+ "learning_rate": 8.041526374859708e-05,
+ "loss": 0.018324140459299088,
+ "step": 548
+ },
+ {
+ "epoch": 2.7746835443037976,
+ "grad_norm": 0.12476589530706406,
+ "learning_rate": 8.035914702581369e-05,
+ "loss": 0.023337965831160545,
+ "step": 549
+ },
+ {
+ "epoch": 2.779746835443038,
+ "grad_norm": 0.04257349297404289,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.021878249943256378,
+ "step": 550
+ },
+ {
+ "epoch": 2.7848101265822782,
+ "grad_norm": 0.044377341866493225,
+ "learning_rate": 8.024691358024692e-05,
+ "loss": 0.019643619656562805,
+ "step": 551
+ },
+ {
+ "epoch": 2.7898734177215188,
+ "grad_norm": 0.0801771879196167,
+ "learning_rate": 8.019079685746352e-05,
+ "loss": 0.021452955901622772,
+ "step": 552
+ },
+ {
+ "epoch": 2.7949367088607593,
+ "grad_norm": 0.04462383687496185,
+ "learning_rate": 8.013468013468015e-05,
+ "loss": 0.02363801747560501,
+ "step": 553
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.05768737941980362,
+ "learning_rate": 8.007856341189674e-05,
+ "loss": 0.03572218120098114,
+ "step": 554
+ },
+ {
+ "epoch": 2.8050632911392404,
+ "grad_norm": 0.03812364116311073,
+ "learning_rate": 8.002244668911337e-05,
+ "loss": 0.01964751072227955,
+ "step": 555
+ },
+ {
+ "epoch": 2.810126582278481,
+ "grad_norm": 0.03297588974237442,
+ "learning_rate": 7.996632996632996e-05,
+ "loss": 0.019139982759952545,
+ "step": 556
+ },
+ {
+ "epoch": 2.8151898734177214,
+ "grad_norm": 0.024627596139907837,
+ "learning_rate": 7.991021324354659e-05,
+ "loss": 0.021029513329267502,
+ "step": 557
+ },
+ {
+ "epoch": 2.820253164556962,
+ "grad_norm": 0.058927983045578,
+ "learning_rate": 7.985409652076318e-05,
+ "loss": 0.03308084234595299,
+ "step": 558
+ },
+ {
+ "epoch": 2.8253164556962025,
+ "grad_norm": 0.11811497062444687,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.028271127492189407,
+ "step": 559
+ },
+ {
+ "epoch": 2.830379746835443,
+ "grad_norm": 0.043665409088134766,
+ "learning_rate": 7.974186307519642e-05,
+ "loss": 0.02708129584789276,
+ "step": 560
+ },
+ {
+ "epoch": 2.8354430379746836,
+ "grad_norm": 0.034729309380054474,
+ "learning_rate": 7.968574635241303e-05,
+ "loss": 0.023845072835683823,
+ "step": 561
+ },
+ {
+ "epoch": 2.840506329113924,
+ "grad_norm": 0.028991155326366425,
+ "learning_rate": 7.962962962962964e-05,
+ "loss": 0.018426496535539627,
+ "step": 562
+ },
+ {
+ "epoch": 2.8455696202531646,
+ "grad_norm": 0.04660327732563019,
+ "learning_rate": 7.957351290684625e-05,
+ "loss": 0.02610144019126892,
+ "step": 563
+ },
+ {
+ "epoch": 2.850632911392405,
+ "grad_norm": 0.03947063535451889,
+ "learning_rate": 7.951739618406286e-05,
+ "loss": 0.025909483432769775,
+ "step": 564
+ },
+ {
+ "epoch": 2.8556962025316457,
+ "grad_norm": 0.06056501716375351,
+ "learning_rate": 7.946127946127947e-05,
+ "loss": 0.030405592173337936,
+ "step": 565
+ },
+ {
+ "epoch": 2.8607594936708862,
+ "grad_norm": 0.03398960456252098,
+ "learning_rate": 7.940516273849608e-05,
+ "loss": 0.02486085705459118,
+ "step": 566
+ },
+ {
+ "epoch": 2.8658227848101268,
+ "grad_norm": 0.03136906027793884,
+ "learning_rate": 7.934904601571269e-05,
+ "loss": 0.020573778077960014,
+ "step": 567
+ },
+ {
+ "epoch": 2.8708860759493673,
+ "grad_norm": 0.03404523804783821,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.021034879609942436,
+ "step": 568
+ },
+ {
+ "epoch": 2.875949367088608,
+ "grad_norm": 0.02937588468194008,
+ "learning_rate": 7.92368125701459e-05,
+ "loss": 0.02275373972952366,
+ "step": 569
+ },
+ {
+ "epoch": 2.8810126582278484,
+ "grad_norm": 0.03971172124147415,
+ "learning_rate": 7.918069584736252e-05,
+ "loss": 0.021558552980422974,
+ "step": 570
+ },
+ {
+ "epoch": 2.8860759493670884,
+ "grad_norm": 0.05636494606733322,
+ "learning_rate": 7.912457912457913e-05,
+ "loss": 0.025583568960428238,
+ "step": 571
+ },
+ {
+ "epoch": 2.891139240506329,
+ "grad_norm": 0.2013683319091797,
+ "learning_rate": 7.906846240179574e-05,
+ "loss": 0.025386696681380272,
+ "step": 572
+ },
+ {
+ "epoch": 2.8962025316455695,
+ "grad_norm": 0.05875328183174133,
+ "learning_rate": 7.901234567901235e-05,
+ "loss": 0.023778585717082024,
+ "step": 573
+ },
+ {
+ "epoch": 2.90126582278481,
+ "grad_norm": 0.031178263947367668,
+ "learning_rate": 7.895622895622896e-05,
+ "loss": 0.02130977436900139,
+ "step": 574
+ },
+ {
+ "epoch": 2.9063291139240506,
+ "grad_norm": 0.028125282377004623,
+ "learning_rate": 7.890011223344557e-05,
+ "loss": 0.023941578343510628,
+ "step": 575
+ },
+ {
+ "epoch": 2.911392405063291,
+ "grad_norm": 0.03701331466436386,
+ "learning_rate": 7.884399551066218e-05,
+ "loss": 0.01856887713074684,
+ "step": 576
+ },
+ {
+ "epoch": 2.9164556962025316,
+ "grad_norm": 0.05281993746757507,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.023393619805574417,
+ "step": 577
+ },
+ {
+ "epoch": 2.921518987341772,
+ "grad_norm": 0.03958812728524208,
+ "learning_rate": 7.873176206509541e-05,
+ "loss": 0.019871000200510025,
+ "step": 578
+ },
+ {
+ "epoch": 2.9265822784810127,
+ "grad_norm": 0.0439714752137661,
+ "learning_rate": 7.867564534231201e-05,
+ "loss": 0.025316016748547554,
+ "step": 579
+ },
+ {
+ "epoch": 2.9316455696202532,
+ "grad_norm": 0.03543296083807945,
+ "learning_rate": 7.861952861952863e-05,
+ "loss": 0.022549735382199287,
+ "step": 580
+ },
+ {
+ "epoch": 2.9367088607594938,
+ "grad_norm": 0.05503656715154648,
+ "learning_rate": 7.856341189674523e-05,
+ "loss": 0.02716357260942459,
+ "step": 581
+ },
+ {
+ "epoch": 2.9417721518987343,
+ "grad_norm": 0.03273561969399452,
+ "learning_rate": 7.850729517396185e-05,
+ "loss": 0.017606684938073158,
+ "step": 582
+ },
+ {
+ "epoch": 2.946835443037975,
+ "grad_norm": 0.04668378457427025,
+ "learning_rate": 7.845117845117845e-05,
+ "loss": 0.022529952228069305,
+ "step": 583
+ },
+ {
+ "epoch": 2.951898734177215,
+ "grad_norm": 0.034348756074905396,
+ "learning_rate": 7.839506172839507e-05,
+ "loss": 0.02549612522125244,
+ "step": 584
+ },
+ {
+ "epoch": 2.9569620253164555,
+ "grad_norm": 0.03485729172825813,
+ "learning_rate": 7.833894500561168e-05,
+ "loss": 0.019362375140190125,
+ "step": 585
+ },
+ {
+ "epoch": 2.962025316455696,
+ "grad_norm": 0.034695904701948166,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.023550841957330704,
+ "step": 586
+ },
+ {
+ "epoch": 2.9670886075949365,
+ "grad_norm": 0.02703205682337284,
+ "learning_rate": 7.82267115600449e-05,
+ "loss": 0.016860410571098328,
+ "step": 587
+ },
+ {
+ "epoch": 2.972151898734177,
+ "grad_norm": 0.0694100558757782,
+ "learning_rate": 7.817059483726151e-05,
+ "loss": 0.02669605240225792,
+ "step": 588
+ },
+ {
+ "epoch": 2.9772151898734176,
+ "grad_norm": 0.02641797810792923,
+ "learning_rate": 7.811447811447812e-05,
+ "loss": 0.019620027393102646,
+ "step": 589
+ },
+ {
+ "epoch": 2.982278481012658,
+ "grad_norm": 0.03643452376127243,
+ "learning_rate": 7.805836139169473e-05,
+ "loss": 0.018797604367136955,
+ "step": 590
+ },
+ {
+ "epoch": 2.9873417721518987,
+ "grad_norm": 0.04125158116221428,
+ "learning_rate": 7.800224466891134e-05,
+ "loss": 0.020387161523103714,
+ "step": 591
+ },
+ {
+ "epoch": 2.992405063291139,
+ "grad_norm": 0.037161167711019516,
+ "learning_rate": 7.794612794612795e-05,
+ "loss": 0.02484878897666931,
+ "step": 592
+ },
+ {
+ "epoch": 2.9974683544303797,
+ "grad_norm": 0.03352266550064087,
+ "learning_rate": 7.789001122334456e-05,
+ "loss": 0.022045889869332314,
+ "step": 593
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.07333379238843918,
+ "learning_rate": 7.783389450056117e-05,
+ "loss": 0.025806350633502007,
+ "step": 594
+ },
+ {
+ "epoch": 3.0050632911392405,
+ "grad_norm": 0.05492037162184715,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.025387149304151535,
+ "step": 595
+ },
+ {
+ "epoch": 3.010126582278481,
+ "grad_norm": 0.03932039067149162,
+ "learning_rate": 7.772166105499439e-05,
+ "loss": 0.020961906760931015,
+ "step": 596
+ },
+ {
+ "epoch": 3.0151898734177216,
+ "grad_norm": 0.03346814960241318,
+ "learning_rate": 7.7665544332211e-05,
+ "loss": 0.018602946773171425,
+ "step": 597
+ },
+ {
+ "epoch": 3.020253164556962,
+ "grad_norm": 0.041588157415390015,
+ "learning_rate": 7.760942760942761e-05,
+ "loss": 0.02350936457514763,
+ "step": 598
+ },
+ {
+ "epoch": 3.0253164556962027,
+ "grad_norm": 0.0634593740105629,
+ "learning_rate": 7.755331088664422e-05,
+ "loss": 0.02807607129216194,
+ "step": 599
+ },
+ {
+ "epoch": 3.030379746835443,
+ "grad_norm": 0.037369582802057266,
+ "learning_rate": 7.749719416386083e-05,
+ "loss": 0.01987743005156517,
+ "step": 600
+ },
+ {
+ "epoch": 3.0354430379746837,
+ "grad_norm": 0.051795534789562225,
+ "learning_rate": 7.744107744107744e-05,
+ "loss": 0.02273828536272049,
+ "step": 601
+ },
+ {
+ "epoch": 3.0405063291139243,
+ "grad_norm": 0.06508016586303711,
+ "learning_rate": 7.738496071829405e-05,
+ "loss": 0.022526375949382782,
+ "step": 602
+ },
+ {
+ "epoch": 3.0455696202531644,
+ "grad_norm": 0.05076521635055542,
+ "learning_rate": 7.732884399551068e-05,
+ "loss": 0.030540699139237404,
+ "step": 603
+ },
+ {
+ "epoch": 3.050632911392405,
+ "grad_norm": 0.05223327502608299,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.025222979485988617,
+ "step": 604
+ },
+ {
+ "epoch": 3.0556962025316454,
+ "grad_norm": 0.040298622101545334,
+ "learning_rate": 7.72166105499439e-05,
+ "loss": 0.024349395185709,
+ "step": 605
+ },
+ {
+ "epoch": 3.060759493670886,
+ "grad_norm": 0.031546592712402344,
+ "learning_rate": 7.716049382716049e-05,
+ "loss": 0.022118842229247093,
+ "step": 606
+ },
+ {
+ "epoch": 3.0658227848101265,
+ "grad_norm": 0.03639276325702667,
+ "learning_rate": 7.710437710437712e-05,
+ "loss": 0.019809089601039886,
+ "step": 607
+ },
+ {
+ "epoch": 3.070886075949367,
+ "grad_norm": 0.03702636435627937,
+ "learning_rate": 7.704826038159371e-05,
+ "loss": 0.023927533999085426,
+ "step": 608
+ },
+ {
+ "epoch": 3.0759493670886076,
+ "grad_norm": 0.027585966512560844,
+ "learning_rate": 7.699214365881034e-05,
+ "loss": 0.017853228375315666,
+ "step": 609
+ },
+ {
+ "epoch": 3.081012658227848,
+ "grad_norm": 0.036372315138578415,
+ "learning_rate": 7.693602693602693e-05,
+ "loss": 0.027036674320697784,
+ "step": 610
+ },
+ {
+ "epoch": 3.0860759493670886,
+ "grad_norm": 0.03734718635678291,
+ "learning_rate": 7.687991021324356e-05,
+ "loss": 0.021930409595370293,
+ "step": 611
+ },
+ {
+ "epoch": 3.091139240506329,
+ "grad_norm": 0.04167135804891586,
+ "learning_rate": 7.682379349046017e-05,
+ "loss": 0.02211524173617363,
+ "step": 612
+ },
+ {
+ "epoch": 3.0962025316455697,
+ "grad_norm": 0.06541049480438232,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.02102654054760933,
+ "step": 613
+ },
+ {
+ "epoch": 3.1012658227848102,
+ "grad_norm": 0.03505360335111618,
+ "learning_rate": 7.671156004489339e-05,
+ "loss": 0.021799035370349884,
+ "step": 614
+ },
+ {
+ "epoch": 3.1063291139240508,
+ "grad_norm": 0.038781505078077316,
+ "learning_rate": 7.665544332210998e-05,
+ "loss": 0.020275672897696495,
+ "step": 615
+ },
+ {
+ "epoch": 3.1113924050632913,
+ "grad_norm": 0.05527551844716072,
+ "learning_rate": 7.65993265993266e-05,
+ "loss": 0.02752656675875187,
+ "step": 616
+ },
+ {
+ "epoch": 3.116455696202532,
+ "grad_norm": 0.092417873442173,
+ "learning_rate": 7.65432098765432e-05,
+ "loss": 0.034416262060403824,
+ "step": 617
+ },
+ {
+ "epoch": 3.1215189873417724,
+ "grad_norm": 0.04619184136390686,
+ "learning_rate": 7.648709315375983e-05,
+ "loss": 0.028675489127635956,
+ "step": 618
+ },
+ {
+ "epoch": 3.1265822784810124,
+ "grad_norm": 0.027103425934910774,
+ "learning_rate": 7.643097643097644e-05,
+ "loss": 0.01944906637072563,
+ "step": 619
+ },
+ {
+ "epoch": 3.131645569620253,
+ "grad_norm": 0.062025271356105804,
+ "learning_rate": 7.637485970819305e-05,
+ "loss": 0.030966270714998245,
+ "step": 620
+ },
+ {
+ "epoch": 3.1367088607594935,
+ "grad_norm": 0.029828928411006927,
+ "learning_rate": 7.631874298540966e-05,
+ "loss": 0.02199825644493103,
+ "step": 621
+ },
+ {
+ "epoch": 3.141772151898734,
+ "grad_norm": 0.029867300763726234,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.02649630233645439,
+ "step": 622
+ },
+ {
+ "epoch": 3.1468354430379746,
+ "grad_norm": 0.055938251316547394,
+ "learning_rate": 7.620650953984288e-05,
+ "loss": 0.03135379031300545,
+ "step": 623
+ },
+ {
+ "epoch": 3.151898734177215,
+ "grad_norm": 0.035160645842552185,
+ "learning_rate": 7.615039281705949e-05,
+ "loss": 0.025492198765277863,
+ "step": 624
+ },
+ {
+ "epoch": 3.1569620253164556,
+ "grad_norm": 0.0550227165222168,
+ "learning_rate": 7.60942760942761e-05,
+ "loss": 0.024527709931135178,
+ "step": 625
+ },
+ {
+ "epoch": 3.162025316455696,
+ "grad_norm": 0.045406773686409,
+ "learning_rate": 7.603815937149271e-05,
+ "loss": 0.021749500185251236,
+ "step": 626
+ },
+ {
+ "epoch": 3.1670886075949367,
+ "grad_norm": 0.03407207131385803,
+ "learning_rate": 7.598204264870932e-05,
+ "loss": 0.022218957543373108,
+ "step": 627
+ },
+ {
+ "epoch": 3.1721518987341772,
+ "grad_norm": 0.07292751222848892,
+ "learning_rate": 7.592592592592593e-05,
+ "loss": 0.027731608599424362,
+ "step": 628
+ },
+ {
+ "epoch": 3.1772151898734178,
+ "grad_norm": 0.05087915435433388,
+ "learning_rate": 7.586980920314254e-05,
+ "loss": 0.025174522772431374,
+ "step": 629
+ },
+ {
+ "epoch": 3.1822784810126583,
+ "grad_norm": 0.03146078437566757,
+ "learning_rate": 7.581369248035916e-05,
+ "loss": 0.023854102939367294,
+ "step": 630
+ },
+ {
+ "epoch": 3.187341772151899,
+ "grad_norm": 0.03517632558941841,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.021264635026454926,
+ "step": 631
+ },
+ {
+ "epoch": 3.1924050632911394,
+ "grad_norm": 0.0355447381734848,
+ "learning_rate": 7.570145903479238e-05,
+ "loss": 0.023219801485538483,
+ "step": 632
+ },
+ {
+ "epoch": 3.19746835443038,
+ "grad_norm": 0.03751067817211151,
+ "learning_rate": 7.564534231200898e-05,
+ "loss": 0.02329118922352791,
+ "step": 633
+ },
+ {
+ "epoch": 3.2025316455696204,
+ "grad_norm": 0.03923696279525757,
+ "learning_rate": 7.558922558922559e-05,
+ "loss": 0.025390561670064926,
+ "step": 634
+ },
+ {
+ "epoch": 3.207594936708861,
+ "grad_norm": 0.03601266071200371,
+ "learning_rate": 7.55331088664422e-05,
+ "loss": 0.02001899480819702,
+ "step": 635
+ },
+ {
+ "epoch": 3.212658227848101,
+ "grad_norm": 0.032203998416662216,
+ "learning_rate": 7.547699214365881e-05,
+ "loss": 0.022725094109773636,
+ "step": 636
+ },
+ {
+ "epoch": 3.2177215189873416,
+ "grad_norm": 0.040842000395059586,
+ "learning_rate": 7.542087542087543e-05,
+ "loss": 0.021683380007743835,
+ "step": 637
+ },
+ {
+ "epoch": 3.222784810126582,
+ "grad_norm": 0.03078434057533741,
+ "learning_rate": 7.536475869809203e-05,
+ "loss": 0.02051977440714836,
+ "step": 638
+ },
+ {
+ "epoch": 3.2278481012658227,
+ "grad_norm": 0.025937417522072792,
+ "learning_rate": 7.530864197530865e-05,
+ "loss": 0.01884596049785614,
+ "step": 639
+ },
+ {
+ "epoch": 3.232911392405063,
+ "grad_norm": 0.0464826263487339,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.018389636650681496,
+ "step": 640
+ },
+ {
+ "epoch": 3.2379746835443037,
+ "grad_norm": 0.04150732606649399,
+ "learning_rate": 7.519640852974187e-05,
+ "loss": 0.020952530205249786,
+ "step": 641
+ },
+ {
+ "epoch": 3.2430379746835443,
+ "grad_norm": 0.04317227005958557,
+ "learning_rate": 7.514029180695847e-05,
+ "loss": 0.024093877524137497,
+ "step": 642
+ },
+ {
+ "epoch": 3.248101265822785,
+ "grad_norm": 0.04621734470129013,
+ "learning_rate": 7.508417508417509e-05,
+ "loss": 0.029940858483314514,
+ "step": 643
+ },
+ {
+ "epoch": 3.2531645569620253,
+ "grad_norm": 0.03514556586742401,
+ "learning_rate": 7.50280583613917e-05,
+ "loss": 0.022350966930389404,
+ "step": 644
+ },
+ {
+ "epoch": 3.258227848101266,
+ "grad_norm": 0.025245223194360733,
+ "learning_rate": 7.497194163860831e-05,
+ "loss": 0.018291346728801727,
+ "step": 645
+ },
+ {
+ "epoch": 3.2632911392405064,
+ "grad_norm": 0.02498617395758629,
+ "learning_rate": 7.491582491582492e-05,
+ "loss": 0.01909235306084156,
+ "step": 646
+ },
+ {
+ "epoch": 3.268354430379747,
+ "grad_norm": 0.022831663489341736,
+ "learning_rate": 7.485970819304153e-05,
+ "loss": 0.01462332159280777,
+ "step": 647
+ },
+ {
+ "epoch": 3.2734177215189875,
+ "grad_norm": 0.03779070824384689,
+ "learning_rate": 7.480359147025814e-05,
+ "loss": 0.019472766667604446,
+ "step": 648
+ },
+ {
+ "epoch": 3.278481012658228,
+ "grad_norm": 0.030341917648911476,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.018727967515587807,
+ "step": 649
+ },
+ {
+ "epoch": 3.2835443037974685,
+ "grad_norm": 0.045589644461870193,
+ "learning_rate": 7.469135802469136e-05,
+ "loss": 0.023640938103199005,
+ "step": 650
+ },
+ {
+ "epoch": 3.2886075949367086,
+ "grad_norm": 0.023883633315563202,
+ "learning_rate": 7.463524130190797e-05,
+ "loss": 0.019227800890803337,
+ "step": 651
+ },
+ {
+ "epoch": 3.293670886075949,
+ "grad_norm": 0.03794898837804794,
+ "learning_rate": 7.457912457912458e-05,
+ "loss": 0.02445095032453537,
+ "step": 652
+ },
+ {
+ "epoch": 3.2987341772151897,
+ "grad_norm": 0.1442285180091858,
+ "learning_rate": 7.452300785634119e-05,
+ "loss": 0.023129010573029518,
+ "step": 653
+ },
+ {
+ "epoch": 3.3037974683544302,
+ "grad_norm": 0.03197013959288597,
+ "learning_rate": 7.44668911335578e-05,
+ "loss": 0.02768155373632908,
+ "step": 654
+ },
+ {
+ "epoch": 3.3088607594936708,
+ "grad_norm": 0.0434270016849041,
+ "learning_rate": 7.441077441077443e-05,
+ "loss": 0.02330004796385765,
+ "step": 655
+ },
+ {
+ "epoch": 3.3139240506329113,
+ "grad_norm": 0.03878983482718468,
+ "learning_rate": 7.435465768799102e-05,
+ "loss": 0.028383342549204826,
+ "step": 656
+ },
+ {
+ "epoch": 3.318987341772152,
+ "grad_norm": 0.035334642976522446,
+ "learning_rate": 7.429854096520763e-05,
+ "loss": 0.02583262138068676,
+ "step": 657
+ },
+ {
+ "epoch": 3.3240506329113924,
+ "grad_norm": 0.0473608672618866,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.030471306294202805,
+ "step": 658
+ },
+ {
+ "epoch": 3.329113924050633,
+ "grad_norm": 0.04193368926644325,
+ "learning_rate": 7.418630751964085e-05,
+ "loss": 0.016215423122048378,
+ "step": 659
+ },
+ {
+ "epoch": 3.3341772151898734,
+ "grad_norm": 0.023891586810350418,
+ "learning_rate": 7.413019079685746e-05,
+ "loss": 0.021040987223386765,
+ "step": 660
+ },
+ {
+ "epoch": 3.339240506329114,
+ "grad_norm": 0.029971614480018616,
+ "learning_rate": 7.407407407407407e-05,
+ "loss": 0.022258542478084564,
+ "step": 661
+ },
+ {
+ "epoch": 3.3443037974683545,
+ "grad_norm": 0.035308364778757095,
+ "learning_rate": 7.401795735129068e-05,
+ "loss": 0.02215534821152687,
+ "step": 662
+ },
+ {
+ "epoch": 3.349367088607595,
+ "grad_norm": 0.036979664117097855,
+ "learning_rate": 7.39618406285073e-05,
+ "loss": 0.027577020227909088,
+ "step": 663
+ },
+ {
+ "epoch": 3.3544303797468356,
+ "grad_norm": 0.03403281047940254,
+ "learning_rate": 7.390572390572392e-05,
+ "loss": 0.024540117010474205,
+ "step": 664
+ },
+ {
+ "epoch": 3.359493670886076,
+ "grad_norm": 0.04739405959844589,
+ "learning_rate": 7.384960718294051e-05,
+ "loss": 0.01647120714187622,
+ "step": 665
+ },
+ {
+ "epoch": 3.3645569620253166,
+ "grad_norm": 0.036933764815330505,
+ "learning_rate": 7.379349046015714e-05,
+ "loss": 0.02817656472325325,
+ "step": 666
+ },
+ {
+ "epoch": 3.369620253164557,
+ "grad_norm": 0.05966564640402794,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.028103439137339592,
+ "step": 667
+ },
+ {
+ "epoch": 3.3746835443037977,
+ "grad_norm": 0.09403033554553986,
+ "learning_rate": 7.368125701459036e-05,
+ "loss": 0.024899154901504517,
+ "step": 668
+ },
+ {
+ "epoch": 3.379746835443038,
+ "grad_norm": 0.056374453008174896,
+ "learning_rate": 7.362514029180695e-05,
+ "loss": 0.025570789352059364,
+ "step": 669
+ },
+ {
+ "epoch": 3.3848101265822783,
+ "grad_norm": 0.056454673409461975,
+ "learning_rate": 7.356902356902358e-05,
+ "loss": 0.02471453696489334,
+ "step": 670
+ },
+ {
+ "epoch": 3.389873417721519,
+ "grad_norm": 0.04115903005003929,
+ "learning_rate": 7.351290684624019e-05,
+ "loss": 0.017306309193372726,
+ "step": 671
+ },
+ {
+ "epoch": 3.3949367088607594,
+ "grad_norm": 0.030604340136051178,
+ "learning_rate": 7.34567901234568e-05,
+ "loss": 0.019510511308908463,
+ "step": 672
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.059018854051828384,
+ "learning_rate": 7.340067340067341e-05,
+ "loss": 0.02810611203312874,
+ "step": 673
+ },
+ {
+ "epoch": 3.4050632911392404,
+ "grad_norm": 0.026413513347506523,
+ "learning_rate": 7.334455667789002e-05,
+ "loss": 0.018966296687722206,
+ "step": 674
+ },
+ {
+ "epoch": 3.410126582278481,
+ "grad_norm": 0.03285476937890053,
+ "learning_rate": 7.328843995510663e-05,
+ "loss": 0.026708189398050308,
+ "step": 675
+ },
+ {
+ "epoch": 3.4151898734177215,
+ "grad_norm": 0.0392388291656971,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.022320115938782692,
+ "step": 676
+ },
+ {
+ "epoch": 3.420253164556962,
+ "grad_norm": 0.0305775236338377,
+ "learning_rate": 7.317620650953985e-05,
+ "loss": 0.018710114061832428,
+ "step": 677
+ },
+ {
+ "epoch": 3.4253164556962026,
+ "grad_norm": 0.033393554389476776,
+ "learning_rate": 7.312008978675646e-05,
+ "loss": 0.018753021955490112,
+ "step": 678
+ },
+ {
+ "epoch": 3.430379746835443,
+ "grad_norm": 0.02704286389052868,
+ "learning_rate": 7.306397306397307e-05,
+ "loss": 0.01539788581430912,
+ "step": 679
+ },
+ {
+ "epoch": 3.4354430379746836,
+ "grad_norm": 0.038779884576797485,
+ "learning_rate": 7.300785634118968e-05,
+ "loss": 0.024458929896354675,
+ "step": 680
+ },
+ {
+ "epoch": 3.440506329113924,
+ "grad_norm": 0.061135295778512955,
+ "learning_rate": 7.295173961840629e-05,
+ "loss": 0.021106259897351265,
+ "step": 681
+ },
+ {
+ "epoch": 3.4455696202531647,
+ "grad_norm": 0.02436748333275318,
+ "learning_rate": 7.28956228956229e-05,
+ "loss": 0.019037332385778427,
+ "step": 682
+ },
+ {
+ "epoch": 3.4506329113924052,
+ "grad_norm": 0.037567682564258575,
+ "learning_rate": 7.283950617283951e-05,
+ "loss": 0.02065495029091835,
+ "step": 683
+ },
+ {
+ "epoch": 3.4556962025316453,
+ "grad_norm": 0.03743781894445419,
+ "learning_rate": 7.278338945005612e-05,
+ "loss": 0.02559451386332512,
+ "step": 684
+ },
+ {
+ "epoch": 3.460759493670886,
+ "grad_norm": 0.04715351387858391,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.021420618519186974,
+ "step": 685
+ },
+ {
+ "epoch": 3.4658227848101264,
+ "grad_norm": 0.02502383477985859,
+ "learning_rate": 7.267115600448934e-05,
+ "loss": 0.019398193806409836,
+ "step": 686
+ },
+ {
+ "epoch": 3.470886075949367,
+ "grad_norm": 0.02199714072048664,
+ "learning_rate": 7.261503928170595e-05,
+ "loss": 0.019068796187639236,
+ "step": 687
+ },
+ {
+ "epoch": 3.4759493670886075,
+ "grad_norm": 0.034711211919784546,
+ "learning_rate": 7.255892255892256e-05,
+ "loss": 0.021794648841023445,
+ "step": 688
+ },
+ {
+ "epoch": 3.481012658227848,
+ "grad_norm": 0.040784433484077454,
+ "learning_rate": 7.250280583613918e-05,
+ "loss": 0.022812314331531525,
+ "step": 689
+ },
+ {
+ "epoch": 3.4860759493670885,
+ "grad_norm": 0.035993628203868866,
+ "learning_rate": 7.244668911335578e-05,
+ "loss": 0.026385463774204254,
+ "step": 690
+ },
+ {
+ "epoch": 3.491139240506329,
+ "grad_norm": 0.031834330409765244,
+ "learning_rate": 7.23905723905724e-05,
+ "loss": 0.022114556282758713,
+ "step": 691
+ },
+ {
+ "epoch": 3.4962025316455696,
+ "grad_norm": 0.025820165872573853,
+ "learning_rate": 7.2334455667789e-05,
+ "loss": 0.01813361421227455,
+ "step": 692
+ },
+ {
+ "epoch": 3.50126582278481,
+ "grad_norm": 0.04998617246747017,
+ "learning_rate": 7.227833894500562e-05,
+ "loss": 0.022573690861463547,
+ "step": 693
+ },
+ {
+ "epoch": 3.5063291139240507,
+ "grad_norm": 0.04184528812766075,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.026092834770679474,
+ "step": 694
+ },
+ {
+ "epoch": 3.511392405063291,
+ "grad_norm": 0.050683457404375076,
+ "learning_rate": 7.216610549943884e-05,
+ "loss": 0.021743692457675934,
+ "step": 695
+ },
+ {
+ "epoch": 3.5164556962025317,
+ "grad_norm": 0.07393304258584976,
+ "learning_rate": 7.210998877665545e-05,
+ "loss": 0.024253465235233307,
+ "step": 696
+ },
+ {
+ "epoch": 3.5215189873417723,
+ "grad_norm": 0.02564188838005066,
+ "learning_rate": 7.205387205387206e-05,
+ "loss": 0.019201550632715225,
+ "step": 697
+ },
+ {
+ "epoch": 3.526582278481013,
+ "grad_norm": 0.035527680069208145,
+ "learning_rate": 7.199775533108867e-05,
+ "loss": 0.02153913676738739,
+ "step": 698
+ },
+ {
+ "epoch": 3.5316455696202533,
+ "grad_norm": 0.036737874150276184,
+ "learning_rate": 7.194163860830527e-05,
+ "loss": 0.025572702288627625,
+ "step": 699
+ },
+ {
+ "epoch": 3.536708860759494,
+ "grad_norm": 0.03383871540427208,
+ "learning_rate": 7.188552188552189e-05,
+ "loss": 0.017153475433588028,
+ "step": 700
+ },
+ {
+ "epoch": 3.5417721518987344,
+ "grad_norm": 0.0350637212395668,
+ "learning_rate": 7.182940516273849e-05,
+ "loss": 0.018297579139471054,
+ "step": 701
+ },
+ {
+ "epoch": 3.546835443037975,
+ "grad_norm": 0.029637211933732033,
+ "learning_rate": 7.177328843995511e-05,
+ "loss": 0.017981912940740585,
+ "step": 702
+ },
+ {
+ "epoch": 3.5518987341772155,
+ "grad_norm": 0.03611799329519272,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.02710491605103016,
+ "step": 703
+ },
+ {
+ "epoch": 3.5569620253164556,
+ "grad_norm": 0.02008277364075184,
+ "learning_rate": 7.166105499438833e-05,
+ "loss": 0.02035117708146572,
+ "step": 704
+ },
+ {
+ "epoch": 3.562025316455696,
+ "grad_norm": 0.026698170229792595,
+ "learning_rate": 7.160493827160494e-05,
+ "loss": 0.017481079325079918,
+ "step": 705
+ },
+ {
+ "epoch": 3.5670886075949366,
+ "grad_norm": 0.036382947117090225,
+ "learning_rate": 7.154882154882155e-05,
+ "loss": 0.019109399989247322,
+ "step": 706
+ },
+ {
+ "epoch": 3.572151898734177,
+ "grad_norm": 0.04591331630945206,
+ "learning_rate": 7.149270482603816e-05,
+ "loss": 0.023143479600548744,
+ "step": 707
+ },
+ {
+ "epoch": 3.5772151898734177,
+ "grad_norm": 0.04864713177084923,
+ "learning_rate": 7.143658810325477e-05,
+ "loss": 0.022374317049980164,
+ "step": 708
+ },
+ {
+ "epoch": 3.5822784810126582,
+ "grad_norm": 0.03528938442468643,
+ "learning_rate": 7.138047138047138e-05,
+ "loss": 0.021928273141384125,
+ "step": 709
+ },
+ {
+ "epoch": 3.5873417721518988,
+ "grad_norm": 0.03548784181475639,
+ "learning_rate": 7.1324354657688e-05,
+ "loss": 0.02179766446352005,
+ "step": 710
+ },
+ {
+ "epoch": 3.5924050632911393,
+ "grad_norm": 0.041786350309848785,
+ "learning_rate": 7.12682379349046e-05,
+ "loss": 0.028576329350471497,
+ "step": 711
+ },
+ {
+ "epoch": 3.59746835443038,
+ "grad_norm": 0.03197047486901283,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.018731534481048584,
+ "step": 712
+ },
+ {
+ "epoch": 3.6025316455696204,
+ "grad_norm": 0.04037933051586151,
+ "learning_rate": 7.115600448933782e-05,
+ "loss": 0.024375513195991516,
+ "step": 713
+ },
+ {
+ "epoch": 3.607594936708861,
+ "grad_norm": 0.032266534864902496,
+ "learning_rate": 7.109988776655443e-05,
+ "loss": 0.016232451424002647,
+ "step": 714
+ },
+ {
+ "epoch": 3.6126582278481014,
+ "grad_norm": 0.02890392392873764,
+ "learning_rate": 7.104377104377104e-05,
+ "loss": 0.018303632736206055,
+ "step": 715
+ },
+ {
+ "epoch": 3.6177215189873415,
+ "grad_norm": 0.032750677317380905,
+ "learning_rate": 7.098765432098767e-05,
+ "loss": 0.021466076374053955,
+ "step": 716
+ },
+ {
+ "epoch": 3.622784810126582,
+ "grad_norm": 0.05076618492603302,
+ "learning_rate": 7.093153759820426e-05,
+ "loss": 0.022349126636981964,
+ "step": 717
+ },
+ {
+ "epoch": 3.6278481012658226,
+ "grad_norm": 0.034143563359975815,
+ "learning_rate": 7.087542087542089e-05,
+ "loss": 0.02274998091161251,
+ "step": 718
+ },
+ {
+ "epoch": 3.632911392405063,
+ "grad_norm": 0.025406064465641975,
+ "learning_rate": 7.081930415263748e-05,
+ "loss": 0.016980832442641258,
+ "step": 719
+ },
+ {
+ "epoch": 3.6379746835443036,
+ "grad_norm": 0.031938597559928894,
+ "learning_rate": 7.076318742985411e-05,
+ "loss": 0.023153938353061676,
+ "step": 720
+ },
+ {
+ "epoch": 3.643037974683544,
+ "grad_norm": 0.03354712948203087,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.018384695053100586,
+ "step": 721
+ },
+ {
+ "epoch": 3.6481012658227847,
+ "grad_norm": 0.028671689331531525,
+ "learning_rate": 7.065095398428731e-05,
+ "loss": 0.021795600652694702,
+ "step": 722
+ },
+ {
+ "epoch": 3.6531645569620252,
+ "grad_norm": 0.057982735335826874,
+ "learning_rate": 7.059483726150394e-05,
+ "loss": 0.026870068162679672,
+ "step": 723
+ },
+ {
+ "epoch": 3.6582278481012658,
+ "grad_norm": 0.036460306495428085,
+ "learning_rate": 7.053872053872053e-05,
+ "loss": 0.019742611795663834,
+ "step": 724
+ },
+ {
+ "epoch": 3.6632911392405063,
+ "grad_norm": 0.06633497029542923,
+ "learning_rate": 7.048260381593716e-05,
+ "loss": 0.01737678050994873,
+ "step": 725
+ },
+ {
+ "epoch": 3.668354430379747,
+ "grad_norm": 0.0410747192800045,
+ "learning_rate": 7.042648709315375e-05,
+ "loss": 0.023570548743009567,
+ "step": 726
+ },
+ {
+ "epoch": 3.6734177215189874,
+ "grad_norm": 0.04499414190649986,
+ "learning_rate": 7.037037037037038e-05,
+ "loss": 0.024305228143930435,
+ "step": 727
+ },
+ {
+ "epoch": 3.678481012658228,
+ "grad_norm": 0.024429699406027794,
+ "learning_rate": 7.031425364758697e-05,
+ "loss": 0.018056385219097137,
+ "step": 728
+ },
+ {
+ "epoch": 3.6835443037974684,
+ "grad_norm": 0.03042393922805786,
+ "learning_rate": 7.02581369248036e-05,
+ "loss": 0.019678741693496704,
+ "step": 729
+ },
+ {
+ "epoch": 3.688607594936709,
+ "grad_norm": 0.04088849946856499,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.026466136798262596,
+ "step": 730
+ },
+ {
+ "epoch": 3.6936708860759495,
+ "grad_norm": 0.03353559225797653,
+ "learning_rate": 7.014590347923682e-05,
+ "loss": 0.021056771278381348,
+ "step": 731
+ },
+ {
+ "epoch": 3.69873417721519,
+ "grad_norm": 0.03120904415845871,
+ "learning_rate": 7.008978675645343e-05,
+ "loss": 0.020675398409366608,
+ "step": 732
+ },
+ {
+ "epoch": 3.7037974683544306,
+ "grad_norm": 0.05723356828093529,
+ "learning_rate": 7.003367003367004e-05,
+ "loss": 0.033802516758441925,
+ "step": 733
+ },
+ {
+ "epoch": 3.708860759493671,
+ "grad_norm": 0.03580084443092346,
+ "learning_rate": 6.997755331088665e-05,
+ "loss": 0.026392754167318344,
+ "step": 734
+ },
+ {
+ "epoch": 3.7139240506329116,
+ "grad_norm": 0.05164967477321625,
+ "learning_rate": 6.992143658810326e-05,
+ "loss": 0.0241309255361557,
+ "step": 735
+ },
+ {
+ "epoch": 3.7189873417721517,
+ "grad_norm": 0.02190530300140381,
+ "learning_rate": 6.986531986531987e-05,
+ "loss": 0.018209822475910187,
+ "step": 736
+ },
+ {
+ "epoch": 3.7240506329113923,
+ "grad_norm": 0.027256503701210022,
+ "learning_rate": 6.980920314253648e-05,
+ "loss": 0.022063471376895905,
+ "step": 737
+ },
+ {
+ "epoch": 3.729113924050633,
+ "grad_norm": 0.03337831795215607,
+ "learning_rate": 6.975308641975309e-05,
+ "loss": 0.018506363034248352,
+ "step": 738
+ },
+ {
+ "epoch": 3.7341772151898733,
+ "grad_norm": 0.025730784982442856,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.016883976757526398,
+ "step": 739
+ },
+ {
+ "epoch": 3.739240506329114,
+ "grad_norm": 0.026203135028481483,
+ "learning_rate": 6.964085297418631e-05,
+ "loss": 0.023329125717282295,
+ "step": 740
+ },
+ {
+ "epoch": 3.7443037974683544,
+ "grad_norm": 0.02676830254495144,
+ "learning_rate": 6.958473625140293e-05,
+ "loss": 0.020962664857506752,
+ "step": 741
+ },
+ {
+ "epoch": 3.749367088607595,
+ "grad_norm": 0.019974667578935623,
+ "learning_rate": 6.952861952861953e-05,
+ "loss": 0.018353454768657684,
+ "step": 742
+ },
+ {
+ "epoch": 3.7544303797468355,
+ "grad_norm": 0.02399631030857563,
+ "learning_rate": 6.947250280583614e-05,
+ "loss": 0.01820143684744835,
+ "step": 743
+ },
+ {
+ "epoch": 3.759493670886076,
+ "grad_norm": 0.02083951234817505,
+ "learning_rate": 6.941638608305275e-05,
+ "loss": 0.02312408946454525,
+ "step": 744
+ },
+ {
+ "epoch": 3.7645569620253165,
+ "grad_norm": 0.025636207312345505,
+ "learning_rate": 6.936026936026936e-05,
+ "loss": 0.01757936365902424,
+ "step": 745
+ },
+ {
+ "epoch": 3.769620253164557,
+ "grad_norm": 0.036856744438409805,
+ "learning_rate": 6.930415263748597e-05,
+ "loss": 0.028933756053447723,
+ "step": 746
+ },
+ {
+ "epoch": 3.7746835443037976,
+ "grad_norm": 0.037415456026792526,
+ "learning_rate": 6.924803591470258e-05,
+ "loss": 0.022136090323328972,
+ "step": 747
+ },
+ {
+ "epoch": 3.779746835443038,
+ "grad_norm": 0.027949288487434387,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.022943630814552307,
+ "step": 748
+ },
+ {
+ "epoch": 3.7848101265822782,
+ "grad_norm": 0.037508148699998856,
+ "learning_rate": 6.91358024691358e-05,
+ "loss": 0.020460065454244614,
+ "step": 749
+ },
+ {
+ "epoch": 3.7898734177215188,
+ "grad_norm": 0.037965189665555954,
+ "learning_rate": 6.907968574635242e-05,
+ "loss": 0.024793215095996857,
+ "step": 750
+ },
+ {
+ "epoch": 3.7949367088607593,
+ "grad_norm": 0.027956753969192505,
+ "learning_rate": 6.902356902356902e-05,
+ "loss": 0.02188705839216709,
+ "step": 751
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.027417965233325958,
+ "learning_rate": 6.896745230078564e-05,
+ "loss": 0.01465995516628027,
+ "step": 752
+ },
+ {
+ "epoch": 3.8050632911392404,
+ "grad_norm": 0.036644525825977325,
+ "learning_rate": 6.891133557800224e-05,
+ "loss": 0.020246809348464012,
+ "step": 753
+ },
+ {
+ "epoch": 3.810126582278481,
+ "grad_norm": 0.027043674141168594,
+ "learning_rate": 6.885521885521886e-05,
+ "loss": 0.02293788641691208,
+ "step": 754
+ },
+ {
+ "epoch": 3.8151898734177214,
+ "grad_norm": 0.033968694508075714,
+ "learning_rate": 6.879910213243546e-05,
+ "loss": 0.024979766458272934,
+ "step": 755
+ },
+ {
+ "epoch": 3.820253164556962,
+ "grad_norm": 0.022790739312767982,
+ "learning_rate": 6.874298540965208e-05,
+ "loss": 0.019254112616181374,
+ "step": 756
+ },
+ {
+ "epoch": 3.8253164556962025,
+ "grad_norm": 0.028349611908197403,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.018624842166900635,
+ "step": 757
+ },
+ {
+ "epoch": 3.830379746835443,
+ "grad_norm": 0.034140367060899734,
+ "learning_rate": 6.86307519640853e-05,
+ "loss": 0.01691599376499653,
+ "step": 758
+ },
+ {
+ "epoch": 3.8354430379746836,
+ "grad_norm": 0.03422265127301216,
+ "learning_rate": 6.857463524130191e-05,
+ "loss": 0.01864086464047432,
+ "step": 759
+ },
+ {
+ "epoch": 3.840506329113924,
+ "grad_norm": 0.037322208285331726,
+ "learning_rate": 6.851851851851852e-05,
+ "loss": 0.024382904171943665,
+ "step": 760
+ },
+ {
+ "epoch": 3.8455696202531646,
+ "grad_norm": 0.022540392354130745,
+ "learning_rate": 6.846240179573513e-05,
+ "loss": 0.017390096560120583,
+ "step": 761
+ },
+ {
+ "epoch": 3.850632911392405,
+ "grad_norm": 0.035701289772987366,
+ "learning_rate": 6.840628507295174e-05,
+ "loss": 0.01928594335913658,
+ "step": 762
+ },
+ {
+ "epoch": 3.8556962025316457,
+ "grad_norm": 0.047425150871276855,
+ "learning_rate": 6.835016835016835e-05,
+ "loss": 0.026818927377462387,
+ "step": 763
+ },
+ {
+ "epoch": 3.8607594936708862,
+ "grad_norm": 0.0244912076741457,
+ "learning_rate": 6.829405162738496e-05,
+ "loss": 0.01811584085226059,
+ "step": 764
+ },
+ {
+ "epoch": 3.8658227848101268,
+ "grad_norm": 0.03282126039266586,
+ "learning_rate": 6.823793490460157e-05,
+ "loss": 0.01521163061261177,
+ "step": 765
+ },
+ {
+ "epoch": 3.8708860759493673,
+ "grad_norm": 0.030519530177116394,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.023735523223876953,
+ "step": 766
+ },
+ {
+ "epoch": 3.875949367088608,
+ "grad_norm": 0.03829387575387955,
+ "learning_rate": 6.81257014590348e-05,
+ "loss": 0.02391430363059044,
+ "step": 767
+ },
+ {
+ "epoch": 3.8810126582278484,
+ "grad_norm": 0.03133988752961159,
+ "learning_rate": 6.80695847362514e-05,
+ "loss": 0.022026970982551575,
+ "step": 768
+ },
+ {
+ "epoch": 3.8860759493670884,
+ "grad_norm": 0.036327920854091644,
+ "learning_rate": 6.801346801346801e-05,
+ "loss": 0.01740797609090805,
+ "step": 769
+ },
+ {
+ "epoch": 3.891139240506329,
+ "grad_norm": 0.06766671687364578,
+ "learning_rate": 6.795735129068462e-05,
+ "loss": 0.02804078534245491,
+ "step": 770
+ },
+ {
+ "epoch": 3.8962025316455695,
+ "grad_norm": 0.06390757858753204,
+ "learning_rate": 6.790123456790123e-05,
+ "loss": 0.032084181904792786,
+ "step": 771
+ },
+ {
+ "epoch": 3.90126582278481,
+ "grad_norm": 0.03238178789615631,
+ "learning_rate": 6.784511784511784e-05,
+ "loss": 0.02189403772354126,
+ "step": 772
+ },
+ {
+ "epoch": 3.9063291139240506,
+ "grad_norm": 0.03206197917461395,
+ "learning_rate": 6.778900112233445e-05,
+ "loss": 0.022829271852970123,
+ "step": 773
+ },
+ {
+ "epoch": 3.911392405063291,
+ "grad_norm": 0.030897945165634155,
+ "learning_rate": 6.773288439955107e-05,
+ "loss": 0.021807631477713585,
+ "step": 774
+ },
+ {
+ "epoch": 3.9164556962025316,
+ "grad_norm": 0.04285162314772606,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.023028545081615448,
+ "step": 775
+ },
+ {
+ "epoch": 3.921518987341772,
+ "grad_norm": 0.02819208987057209,
+ "learning_rate": 6.762065095398429e-05,
+ "loss": 0.02110828459262848,
+ "step": 776
+ },
+ {
+ "epoch": 3.9265822784810127,
+ "grad_norm": 0.03159799054265022,
+ "learning_rate": 6.756453423120091e-05,
+ "loss": 0.02116553671658039,
+ "step": 777
+ },
+ {
+ "epoch": 3.9316455696202532,
+ "grad_norm": 0.028514137491583824,
+ "learning_rate": 6.75084175084175e-05,
+ "loss": 0.020262988284230232,
+ "step": 778
+ },
+ {
+ "epoch": 3.9367088607594938,
+ "grad_norm": 0.03610249608755112,
+ "learning_rate": 6.745230078563413e-05,
+ "loss": 0.016928158700466156,
+ "step": 779
+ },
+ {
+ "epoch": 3.9417721518987343,
+ "grad_norm": 0.02753387950360775,
+ "learning_rate": 6.739618406285073e-05,
+ "loss": 0.022629719227552414,
+ "step": 780
+ },
+ {
+ "epoch": 3.946835443037975,
+ "grad_norm": 0.026071136817336082,
+ "learning_rate": 6.734006734006735e-05,
+ "loss": 0.020297978073358536,
+ "step": 781
+ },
+ {
+ "epoch": 3.951898734177215,
+ "grad_norm": 0.04774617776274681,
+ "learning_rate": 6.728395061728396e-05,
+ "loss": 0.01858438178896904,
+ "step": 782
+ },
+ {
+ "epoch": 3.9569620253164555,
+ "grad_norm": 0.03666248545050621,
+ "learning_rate": 6.722783389450057e-05,
+ "loss": 0.024037979543209076,
+ "step": 783
+ },
+ {
+ "epoch": 3.962025316455696,
+ "grad_norm": 0.04990983009338379,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.027675451710820198,
+ "step": 784
+ },
+ {
+ "epoch": 3.9670886075949365,
+ "grad_norm": 0.04734862968325615,
+ "learning_rate": 6.711560044893379e-05,
+ "loss": 0.02003151923418045,
+ "step": 785
+ },
+ {
+ "epoch": 3.972151898734177,
+ "grad_norm": 0.031911976635456085,
+ "learning_rate": 6.70594837261504e-05,
+ "loss": 0.02302616462111473,
+ "step": 786
+ },
+ {
+ "epoch": 3.9772151898734176,
+ "grad_norm": 0.03199504688382149,
+ "learning_rate": 6.7003367003367e-05,
+ "loss": 0.020066704601049423,
+ "step": 787
+ },
+ {
+ "epoch": 3.982278481012658,
+ "grad_norm": 0.02664150856435299,
+ "learning_rate": 6.694725028058362e-05,
+ "loss": 0.01888475939631462,
+ "step": 788
+ },
+ {
+ "epoch": 3.9873417721518987,
+ "grad_norm": 0.03886157646775246,
+ "learning_rate": 6.689113355780023e-05,
+ "loss": 0.016029106453061104,
+ "step": 789
+ },
+ {
+ "epoch": 3.992405063291139,
+ "grad_norm": 0.025033561512827873,
+ "learning_rate": 6.683501683501684e-05,
+ "loss": 0.01627909578382969,
+ "step": 790
+ },
+ {
+ "epoch": 3.9974683544303797,
+ "grad_norm": 0.04991500452160835,
+ "learning_rate": 6.677890011223345e-05,
+ "loss": 0.02633330039680004,
+ "step": 791
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.0552835538983345,
+ "learning_rate": 6.672278338945006e-05,
+ "loss": 0.025268658995628357,
+ "step": 792
+ },
+ {
+ "epoch": 4.0050632911392405,
+ "grad_norm": 0.04223925992846489,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.023410093039274216,
+ "step": 793
+ },
+ {
+ "epoch": 4.010126582278481,
+ "grad_norm": 0.03191488981246948,
+ "learning_rate": 6.661054994388328e-05,
+ "loss": 0.01913982629776001,
+ "step": 794
+ },
+ {
+ "epoch": 4.015189873417722,
+ "grad_norm": 0.03535325452685356,
+ "learning_rate": 6.655443322109989e-05,
+ "loss": 0.020550835877656937,
+ "step": 795
+ },
+ {
+ "epoch": 4.020253164556962,
+ "grad_norm": 0.027277838438749313,
+ "learning_rate": 6.64983164983165e-05,
+ "loss": 0.02178161032497883,
+ "step": 796
+ },
+ {
+ "epoch": 4.025316455696203,
+ "grad_norm": 0.03889140114188194,
+ "learning_rate": 6.644219977553311e-05,
+ "loss": 0.02359630912542343,
+ "step": 797
+ },
+ {
+ "epoch": 4.030379746835443,
+ "grad_norm": 0.03794289380311966,
+ "learning_rate": 6.638608305274972e-05,
+ "loss": 0.02135687693953514,
+ "step": 798
+ },
+ {
+ "epoch": 4.035443037974684,
+ "grad_norm": 0.030842013657093048,
+ "learning_rate": 6.632996632996633e-05,
+ "loss": 0.026881888508796692,
+ "step": 799
+ },
+ {
+ "epoch": 4.040506329113924,
+ "grad_norm": 0.036720771342515945,
+ "learning_rate": 6.627384960718295e-05,
+ "loss": 0.017526758834719658,
+ "step": 800
+ },
+ {
+ "epoch": 4.045569620253165,
+ "grad_norm": 0.04940621554851532,
+ "learning_rate": 6.621773288439955e-05,
+ "loss": 0.023458952084183693,
+ "step": 801
+ },
+ {
+ "epoch": 4.050632911392405,
+ "grad_norm": 0.0228698942810297,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.017165549099445343,
+ "step": 802
+ },
+ {
+ "epoch": 4.055696202531646,
+ "grad_norm": 0.0323697030544281,
+ "learning_rate": 6.610549943883277e-05,
+ "loss": 0.020573658868670464,
+ "step": 803
+ },
+ {
+ "epoch": 4.060759493670886,
+ "grad_norm": 0.03041171282529831,
+ "learning_rate": 6.60493827160494e-05,
+ "loss": 0.022557582706212997,
+ "step": 804
+ },
+ {
+ "epoch": 4.065822784810127,
+ "grad_norm": 0.030996058136224747,
+ "learning_rate": 6.599326599326599e-05,
+ "loss": 0.024344075471162796,
+ "step": 805
+ },
+ {
+ "epoch": 4.0708860759493675,
+ "grad_norm": 0.02448248863220215,
+ "learning_rate": 6.593714927048261e-05,
+ "loss": 0.018718231469392776,
+ "step": 806
+ },
+ {
+ "epoch": 4.075949367088608,
+ "grad_norm": 0.03839370980858803,
+ "learning_rate": 6.588103254769921e-05,
+ "loss": 0.02680569887161255,
+ "step": 807
+ },
+ {
+ "epoch": 4.0810126582278485,
+ "grad_norm": 0.029364196583628654,
+ "learning_rate": 6.582491582491582e-05,
+ "loss": 0.01946680247783661,
+ "step": 808
+ },
+ {
+ "epoch": 4.086075949367088,
+ "grad_norm": 0.02478131465613842,
+ "learning_rate": 6.576879910213244e-05,
+ "loss": 0.021097835153341293,
+ "step": 809
+ },
+ {
+ "epoch": 4.091139240506329,
+ "grad_norm": 0.030616244301199913,
+ "learning_rate": 6.571268237934904e-05,
+ "loss": 0.021518010646104813,
+ "step": 810
+ },
+ {
+ "epoch": 4.096202531645569,
+ "grad_norm": 0.02732054330408573,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.02008533477783203,
+ "step": 811
+ },
+ {
+ "epoch": 4.10126582278481,
+ "grad_norm": 0.0323524996638298,
+ "learning_rate": 6.560044893378226e-05,
+ "loss": 0.025486933067440987,
+ "step": 812
+ },
+ {
+ "epoch": 4.10632911392405,
+ "grad_norm": 0.026200806722044945,
+ "learning_rate": 6.554433221099888e-05,
+ "loss": 0.019320383667945862,
+ "step": 813
+ },
+ {
+ "epoch": 4.111392405063291,
+ "grad_norm": 0.03883595019578934,
+ "learning_rate": 6.548821548821548e-05,
+ "loss": 0.021837443113327026,
+ "step": 814
+ },
+ {
+ "epoch": 4.116455696202531,
+ "grad_norm": 0.037654533982276917,
+ "learning_rate": 6.54320987654321e-05,
+ "loss": 0.024574559181928635,
+ "step": 815
+ },
+ {
+ "epoch": 4.121518987341772,
+ "grad_norm": 0.04923658072948456,
+ "learning_rate": 6.537598204264871e-05,
+ "loss": 0.01940765418112278,
+ "step": 816
+ },
+ {
+ "epoch": 4.1265822784810124,
+ "grad_norm": 0.02900642342865467,
+ "learning_rate": 6.531986531986533e-05,
+ "loss": 0.019193468615412712,
+ "step": 817
+ },
+ {
+ "epoch": 4.131645569620253,
+ "grad_norm": 0.03798971325159073,
+ "learning_rate": 6.526374859708194e-05,
+ "loss": 0.022473281249403954,
+ "step": 818
+ },
+ {
+ "epoch": 4.1367088607594935,
+ "grad_norm": 0.05821327865123749,
+ "learning_rate": 6.520763187429855e-05,
+ "loss": 0.025292381644248962,
+ "step": 819
+ },
+ {
+ "epoch": 4.141772151898734,
+ "grad_norm": 0.02774794027209282,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.021283335983753204,
+ "step": 820
+ },
+ {
+ "epoch": 4.146835443037975,
+ "grad_norm": 0.03002094104886055,
+ "learning_rate": 6.509539842873177e-05,
+ "loss": 0.020336506888270378,
+ "step": 821
+ },
+ {
+ "epoch": 4.151898734177215,
+ "grad_norm": 0.02205439656972885,
+ "learning_rate": 6.503928170594838e-05,
+ "loss": 0.01669773831963539,
+ "step": 822
+ },
+ {
+ "epoch": 4.156962025316456,
+ "grad_norm": 0.023610664531588554,
+ "learning_rate": 6.498316498316499e-05,
+ "loss": 0.016195815056562424,
+ "step": 823
+ },
+ {
+ "epoch": 4.162025316455696,
+ "grad_norm": 0.02679222822189331,
+ "learning_rate": 6.49270482603816e-05,
+ "loss": 0.020671207457780838,
+ "step": 824
+ },
+ {
+ "epoch": 4.167088607594937,
+ "grad_norm": 0.043805427849292755,
+ "learning_rate": 6.48709315375982e-05,
+ "loss": 0.029262011870741844,
+ "step": 825
+ },
+ {
+ "epoch": 4.172151898734177,
+ "grad_norm": 0.024075932800769806,
+ "learning_rate": 6.481481481481482e-05,
+ "loss": 0.0180169977247715,
+ "step": 826
+ },
+ {
+ "epoch": 4.177215189873418,
+ "grad_norm": 0.027496427297592163,
+ "learning_rate": 6.475869809203144e-05,
+ "loss": 0.01985255442559719,
+ "step": 827
+ },
+ {
+ "epoch": 4.182278481012658,
+ "grad_norm": 0.028868619352579117,
+ "learning_rate": 6.470258136924804e-05,
+ "loss": 0.02416200190782547,
+ "step": 828
+ },
+ {
+ "epoch": 4.187341772151899,
+ "grad_norm": 0.026004688814282417,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.01904168725013733,
+ "step": 829
+ },
+ {
+ "epoch": 4.192405063291139,
+ "grad_norm": 0.04274019971489906,
+ "learning_rate": 6.459034792368126e-05,
+ "loss": 0.02680842950940132,
+ "step": 830
+ },
+ {
+ "epoch": 4.19746835443038,
+ "grad_norm": 0.024735039100050926,
+ "learning_rate": 6.453423120089787e-05,
+ "loss": 0.016491729766130447,
+ "step": 831
+ },
+ {
+ "epoch": 4.2025316455696204,
+ "grad_norm": 0.04336397722363472,
+ "learning_rate": 6.447811447811448e-05,
+ "loss": 0.02140970341861248,
+ "step": 832
+ },
+ {
+ "epoch": 4.207594936708861,
+ "grad_norm": 0.025922754779458046,
+ "learning_rate": 6.442199775533109e-05,
+ "loss": 0.017252741381525993,
+ "step": 833
+ },
+ {
+ "epoch": 4.2126582278481015,
+ "grad_norm": 0.0322343185544014,
+ "learning_rate": 6.436588103254771e-05,
+ "loss": 0.015862349420785904,
+ "step": 834
+ },
+ {
+ "epoch": 4.217721518987342,
+ "grad_norm": 0.033133670687675476,
+ "learning_rate": 6.43097643097643e-05,
+ "loss": 0.02029406651854515,
+ "step": 835
+ },
+ {
+ "epoch": 4.222784810126583,
+ "grad_norm": 0.044879183173179626,
+ "learning_rate": 6.425364758698093e-05,
+ "loss": 0.021223746240139008,
+ "step": 836
+ },
+ {
+ "epoch": 4.227848101265823,
+ "grad_norm": 0.031861864030361176,
+ "learning_rate": 6.419753086419753e-05,
+ "loss": 0.023331837728619576,
+ "step": 837
+ },
+ {
+ "epoch": 4.232911392405064,
+ "grad_norm": 0.03642997145652771,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.025932632386684418,
+ "step": 838
+ },
+ {
+ "epoch": 4.237974683544304,
+ "grad_norm": 0.025531062856316566,
+ "learning_rate": 6.408529741863075e-05,
+ "loss": 0.019921796396374702,
+ "step": 839
+ },
+ {
+ "epoch": 4.243037974683545,
+ "grad_norm": 0.025292333215475082,
+ "learning_rate": 6.402918069584737e-05,
+ "loss": 0.017363781109452248,
+ "step": 840
+ },
+ {
+ "epoch": 4.248101265822784,
+ "grad_norm": 0.03679105266928673,
+ "learning_rate": 6.397306397306398e-05,
+ "loss": 0.026451613754034042,
+ "step": 841
+ },
+ {
+ "epoch": 4.253164556962025,
+ "grad_norm": 0.029125263914465904,
+ "learning_rate": 6.391694725028059e-05,
+ "loss": 0.018277600407600403,
+ "step": 842
+ },
+ {
+ "epoch": 4.258227848101265,
+ "grad_norm": 0.03969479724764824,
+ "learning_rate": 6.38608305274972e-05,
+ "loss": 0.026814289391040802,
+ "step": 843
+ },
+ {
+ "epoch": 4.263291139240506,
+ "grad_norm": 0.03083009086549282,
+ "learning_rate": 6.380471380471381e-05,
+ "loss": 0.01898398995399475,
+ "step": 844
+ },
+ {
+ "epoch": 4.2683544303797465,
+ "grad_norm": 0.04128425940871239,
+ "learning_rate": 6.374859708193042e-05,
+ "loss": 0.02890118584036827,
+ "step": 845
+ },
+ {
+ "epoch": 4.273417721518987,
+ "grad_norm": 0.03675759211182594,
+ "learning_rate": 6.369248035914703e-05,
+ "loss": 0.0232902429997921,
+ "step": 846
+ },
+ {
+ "epoch": 4.2784810126582276,
+ "grad_norm": 0.035842880606651306,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.018688444048166275,
+ "step": 847
+ },
+ {
+ "epoch": 4.283544303797468,
+ "grad_norm": 0.041631679981946945,
+ "learning_rate": 6.358024691358025e-05,
+ "loss": 0.028953872621059418,
+ "step": 848
+ },
+ {
+ "epoch": 4.288607594936709,
+ "grad_norm": 0.02474270947277546,
+ "learning_rate": 6.352413019079686e-05,
+ "loss": 0.02291303500533104,
+ "step": 849
+ },
+ {
+ "epoch": 4.293670886075949,
+ "grad_norm": 0.0414784699678421,
+ "learning_rate": 6.346801346801347e-05,
+ "loss": 0.0197298601269722,
+ "step": 850
+ },
+ {
+ "epoch": 4.29873417721519,
+ "grad_norm": 0.022596480324864388,
+ "learning_rate": 6.341189674523008e-05,
+ "loss": 0.022477108985185623,
+ "step": 851
+ },
+ {
+ "epoch": 4.30379746835443,
+ "grad_norm": 0.03707405552268028,
+ "learning_rate": 6.335578002244669e-05,
+ "loss": 0.02374342642724514,
+ "step": 852
+ },
+ {
+ "epoch": 4.308860759493671,
+ "grad_norm": 0.036069657653570175,
+ "learning_rate": 6.32996632996633e-05,
+ "loss": 0.025015011429786682,
+ "step": 853
+ },
+ {
+ "epoch": 4.313924050632911,
+ "grad_norm": 0.025126038119196892,
+ "learning_rate": 6.324354657687991e-05,
+ "loss": 0.022152241319417953,
+ "step": 854
+ },
+ {
+ "epoch": 4.318987341772152,
+ "grad_norm": 0.03695147857069969,
+ "learning_rate": 6.318742985409652e-05,
+ "loss": 0.019978618249297142,
+ "step": 855
+ },
+ {
+ "epoch": 4.324050632911392,
+ "grad_norm": 0.034860849380493164,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.01976930722594261,
+ "step": 856
+ },
+ {
+ "epoch": 4.329113924050633,
+ "grad_norm": 0.029625017195940018,
+ "learning_rate": 6.307519640852974e-05,
+ "loss": 0.024136420339345932,
+ "step": 857
+ },
+ {
+ "epoch": 4.334177215189873,
+ "grad_norm": 0.03501079976558685,
+ "learning_rate": 6.301907968574635e-05,
+ "loss": 0.020777776837348938,
+ "step": 858
+ },
+ {
+ "epoch": 4.339240506329114,
+ "grad_norm": 0.037415534257888794,
+ "learning_rate": 6.296296296296296e-05,
+ "loss": 0.016332093626260757,
+ "step": 859
+ },
+ {
+ "epoch": 4.3443037974683545,
+ "grad_norm": 0.032555654644966125,
+ "learning_rate": 6.290684624017957e-05,
+ "loss": 0.02344547212123871,
+ "step": 860
+ },
+ {
+ "epoch": 4.349367088607595,
+ "grad_norm": 0.04069099947810173,
+ "learning_rate": 6.28507295173962e-05,
+ "loss": 0.019369281828403473,
+ "step": 861
+ },
+ {
+ "epoch": 4.3544303797468356,
+ "grad_norm": 0.05188984051346779,
+ "learning_rate": 6.279461279461279e-05,
+ "loss": 0.02291448414325714,
+ "step": 862
+ },
+ {
+ "epoch": 4.359493670886076,
+ "grad_norm": 0.0357513502240181,
+ "learning_rate": 6.273849607182942e-05,
+ "loss": 0.02141542360186577,
+ "step": 863
+ },
+ {
+ "epoch": 4.364556962025317,
+ "grad_norm": 0.026472769677639008,
+ "learning_rate": 6.268237934904601e-05,
+ "loss": 0.01893937960267067,
+ "step": 864
+ },
+ {
+ "epoch": 4.369620253164557,
+ "grad_norm": 0.0498812235891819,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.021839456632733345,
+ "step": 865
+ },
+ {
+ "epoch": 4.374683544303798,
+ "grad_norm": 0.05202518403530121,
+ "learning_rate": 6.257014590347923e-05,
+ "loss": 0.023422567173838615,
+ "step": 866
+ },
+ {
+ "epoch": 4.379746835443038,
+ "grad_norm": 0.024116024374961853,
+ "learning_rate": 6.251402918069586e-05,
+ "loss": 0.018288200721144676,
+ "step": 867
+ },
+ {
+ "epoch": 4.384810126582279,
+ "grad_norm": 0.02667090855538845,
+ "learning_rate": 6.245791245791247e-05,
+ "loss": 0.022375311702489853,
+ "step": 868
+ },
+ {
+ "epoch": 4.389873417721519,
+ "grad_norm": 0.02306467480957508,
+ "learning_rate": 6.240179573512908e-05,
+ "loss": 0.017447657883167267,
+ "step": 869
+ },
+ {
+ "epoch": 4.39493670886076,
+ "grad_norm": 0.031131602823734283,
+ "learning_rate": 6.234567901234569e-05,
+ "loss": 0.021768944337964058,
+ "step": 870
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.05789825692772865,
+ "learning_rate": 6.22895622895623e-05,
+ "loss": 0.02762719616293907,
+ "step": 871
+ },
+ {
+ "epoch": 4.405063291139241,
+ "grad_norm": 0.03830523043870926,
+ "learning_rate": 6.22334455667789e-05,
+ "loss": 0.023558061569929123,
+ "step": 872
+ },
+ {
+ "epoch": 4.410126582278481,
+ "grad_norm": 0.025961998850107193,
+ "learning_rate": 6.21773288439955e-05,
+ "loss": 0.022518256679177284,
+ "step": 873
+ },
+ {
+ "epoch": 4.415189873417722,
+ "grad_norm": 0.025299636647105217,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.018432877957820892,
+ "step": 874
+ },
+ {
+ "epoch": 4.4202531645569625,
+ "grad_norm": 0.027106614783406258,
+ "learning_rate": 6.206509539842874e-05,
+ "loss": 0.01614236831665039,
+ "step": 875
+ },
+ {
+ "epoch": 4.425316455696202,
+ "grad_norm": 0.04538397118449211,
+ "learning_rate": 6.200897867564535e-05,
+ "loss": 0.027474530041217804,
+ "step": 876
+ },
+ {
+ "epoch": 4.430379746835443,
+ "grad_norm": 0.041059643030166626,
+ "learning_rate": 6.195286195286196e-05,
+ "loss": 0.030840855091810226,
+ "step": 877
+ },
+ {
+ "epoch": 4.435443037974683,
+ "grad_norm": 0.055599089711904526,
+ "learning_rate": 6.189674523007857e-05,
+ "loss": 0.02877015620470047,
+ "step": 878
+ },
+ {
+ "epoch": 4.440506329113924,
+ "grad_norm": 0.023808903992176056,
+ "learning_rate": 6.184062850729518e-05,
+ "loss": 0.018071971833705902,
+ "step": 879
+ },
+ {
+ "epoch": 4.445569620253164,
+ "grad_norm": 0.04098769649863243,
+ "learning_rate": 6.178451178451179e-05,
+ "loss": 0.019321631640195847,
+ "step": 880
+ },
+ {
+ "epoch": 4.450632911392405,
+ "grad_norm": 0.0329279750585556,
+ "learning_rate": 6.17283950617284e-05,
+ "loss": 0.023013390600681305,
+ "step": 881
+ },
+ {
+ "epoch": 4.455696202531645,
+ "grad_norm": 0.030751917511224747,
+ "learning_rate": 6.1672278338945e-05,
+ "loss": 0.018062159419059753,
+ "step": 882
+ },
+ {
+ "epoch": 4.460759493670886,
+ "grad_norm": 0.025446373969316483,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.020532462745904922,
+ "step": 883
+ },
+ {
+ "epoch": 4.465822784810126,
+ "grad_norm": 0.037997085601091385,
+ "learning_rate": 6.156004489337823e-05,
+ "loss": 0.024340521544218063,
+ "step": 884
+ },
+ {
+ "epoch": 4.470886075949367,
+ "grad_norm": 0.021509790793061256,
+ "learning_rate": 6.150392817059484e-05,
+ "loss": 0.018887734040617943,
+ "step": 885
+ },
+ {
+ "epoch": 4.4759493670886075,
+ "grad_norm": 0.027931779623031616,
+ "learning_rate": 6.144781144781146e-05,
+ "loss": 0.02148054540157318,
+ "step": 886
+ },
+ {
+ "epoch": 4.481012658227848,
+ "grad_norm": 0.035554565489292145,
+ "learning_rate": 6.139169472502806e-05,
+ "loss": 0.019528254866600037,
+ "step": 887
+ },
+ {
+ "epoch": 4.4860759493670885,
+ "grad_norm": 0.02668517455458641,
+ "learning_rate": 6.133557800224468e-05,
+ "loss": 0.022182706743478775,
+ "step": 888
+ },
+ {
+ "epoch": 4.491139240506329,
+ "grad_norm": 0.0376712940633297,
+ "learning_rate": 6.127946127946128e-05,
+ "loss": 0.026006314903497696,
+ "step": 889
+ },
+ {
+ "epoch": 4.49620253164557,
+ "grad_norm": 0.02952289767563343,
+ "learning_rate": 6.12233445566779e-05,
+ "loss": 0.022582251578569412,
+ "step": 890
+ },
+ {
+ "epoch": 4.50126582278481,
+ "grad_norm": 0.05064458027482033,
+ "learning_rate": 6.11672278338945e-05,
+ "loss": 0.021709535270929337,
+ "step": 891
+ },
+ {
+ "epoch": 4.506329113924051,
+ "grad_norm": 0.021470079198479652,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.015116477385163307,
+ "step": 892
+ },
+ {
+ "epoch": 4.511392405063291,
+ "grad_norm": 0.04210078716278076,
+ "learning_rate": 6.105499438832773e-05,
+ "loss": 0.030057771131396294,
+ "step": 893
+ },
+ {
+ "epoch": 4.516455696202532,
+ "grad_norm": 0.20027652382850647,
+ "learning_rate": 6.099887766554434e-05,
+ "loss": 0.02081073820590973,
+ "step": 894
+ },
+ {
+ "epoch": 4.521518987341772,
+ "grad_norm": 0.03083370067179203,
+ "learning_rate": 6.0942760942760944e-05,
+ "loss": 0.020705904811620712,
+ "step": 895
+ },
+ {
+ "epoch": 4.526582278481013,
+ "grad_norm": 0.05921618640422821,
+ "learning_rate": 6.0886644219977554e-05,
+ "loss": 0.020449915900826454,
+ "step": 896
+ },
+ {
+ "epoch": 4.531645569620253,
+ "grad_norm": 0.02304214984178543,
+ "learning_rate": 6.0830527497194164e-05,
+ "loss": 0.01927848532795906,
+ "step": 897
+ },
+ {
+ "epoch": 4.536708860759494,
+ "grad_norm": 0.03946949169039726,
+ "learning_rate": 6.0774410774410774e-05,
+ "loss": 0.026231423020362854,
+ "step": 898
+ },
+ {
+ "epoch": 4.541772151898734,
+ "grad_norm": 0.027822930365800858,
+ "learning_rate": 6.071829405162739e-05,
+ "loss": 0.022259924560785294,
+ "step": 899
+ },
+ {
+ "epoch": 4.546835443037975,
+ "grad_norm": 0.029135817661881447,
+ "learning_rate": 6.0662177328843995e-05,
+ "loss": 0.019272884353995323,
+ "step": 900
+ },
+ {
+ "epoch": 4.5518987341772155,
+ "grad_norm": 0.03746713697910309,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.022191740572452545,
+ "step": 901
+ },
+ {
+ "epoch": 4.556962025316456,
+ "grad_norm": 0.027378680184483528,
+ "learning_rate": 6.0549943883277215e-05,
+ "loss": 0.023043492808938026,
+ "step": 902
+ },
+ {
+ "epoch": 4.5620253164556965,
+ "grad_norm": 0.047497715801000595,
+ "learning_rate": 6.049382716049383e-05,
+ "loss": 0.023993097245693207,
+ "step": 903
+ },
+ {
+ "epoch": 4.567088607594937,
+ "grad_norm": 0.02557055652141571,
+ "learning_rate": 6.0437710437710435e-05,
+ "loss": 0.020033126696944237,
+ "step": 904
+ },
+ {
+ "epoch": 4.572151898734178,
+ "grad_norm": 0.08165695518255234,
+ "learning_rate": 6.038159371492705e-05,
+ "loss": 0.02415328472852707,
+ "step": 905
+ },
+ {
+ "epoch": 4.577215189873417,
+ "grad_norm": 0.03633309155702591,
+ "learning_rate": 6.032547699214366e-05,
+ "loss": 0.02082585170865059,
+ "step": 906
+ },
+ {
+ "epoch": 4.582278481012658,
+ "grad_norm": 0.03273358196020126,
+ "learning_rate": 6.026936026936028e-05,
+ "loss": 0.020049303770065308,
+ "step": 907
+ },
+ {
+ "epoch": 4.587341772151898,
+ "grad_norm": 0.040032029151916504,
+ "learning_rate": 6.021324354657688e-05,
+ "loss": 0.02167242392897606,
+ "step": 908
+ },
+ {
+ "epoch": 4.592405063291139,
+ "grad_norm": 0.02789166197180748,
+ "learning_rate": 6.01571268237935e-05,
+ "loss": 0.01964012160897255,
+ "step": 909
+ },
+ {
+ "epoch": 4.597468354430379,
+ "grad_norm": 0.03285825625061989,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.024942882359027863,
+ "step": 910
+ },
+ {
+ "epoch": 4.60253164556962,
+ "grad_norm": 0.02894079126417637,
+ "learning_rate": 6.004489337822672e-05,
+ "loss": 0.022012561559677124,
+ "step": 911
+ },
+ {
+ "epoch": 4.6075949367088604,
+ "grad_norm": 0.03291299566626549,
+ "learning_rate": 5.998877665544332e-05,
+ "loss": 0.02291432023048401,
+ "step": 912
+ },
+ {
+ "epoch": 4.612658227848101,
+ "grad_norm": 0.05124634876847267,
+ "learning_rate": 5.993265993265994e-05,
+ "loss": 0.017874885350465775,
+ "step": 913
+ },
+ {
+ "epoch": 4.6177215189873415,
+ "grad_norm": 0.042412169277668,
+ "learning_rate": 5.987654320987654e-05,
+ "loss": 0.0233401320874691,
+ "step": 914
+ },
+ {
+ "epoch": 4.622784810126582,
+ "grad_norm": 0.03447306156158447,
+ "learning_rate": 5.982042648709316e-05,
+ "loss": 0.022503826767206192,
+ "step": 915
+ },
+ {
+ "epoch": 4.627848101265823,
+ "grad_norm": 0.022415662184357643,
+ "learning_rate": 5.976430976430977e-05,
+ "loss": 0.01659448817372322,
+ "step": 916
+ },
+ {
+ "epoch": 4.632911392405063,
+ "grad_norm": 0.04882103577256203,
+ "learning_rate": 5.970819304152637e-05,
+ "loss": 0.02342696487903595,
+ "step": 917
+ },
+ {
+ "epoch": 4.637974683544304,
+ "grad_norm": 0.0341666042804718,
+ "learning_rate": 5.965207631874299e-05,
+ "loss": 0.026119260117411613,
+ "step": 918
+ },
+ {
+ "epoch": 4.643037974683544,
+ "grad_norm": 0.03507097065448761,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.022042831405997276,
+ "step": 919
+ },
+ {
+ "epoch": 4.648101265822785,
+ "grad_norm": 0.04078570008277893,
+ "learning_rate": 5.953984287317621e-05,
+ "loss": 0.01978793554008007,
+ "step": 920
+ },
+ {
+ "epoch": 4.653164556962025,
+ "grad_norm": 0.03481799736618996,
+ "learning_rate": 5.948372615039281e-05,
+ "loss": 0.02518302947282791,
+ "step": 921
+ },
+ {
+ "epoch": 4.658227848101266,
+ "grad_norm": 0.0456753633916378,
+ "learning_rate": 5.942760942760943e-05,
+ "loss": 0.027814291417598724,
+ "step": 922
+ },
+ {
+ "epoch": 4.663291139240506,
+ "grad_norm": 0.026144322007894516,
+ "learning_rate": 5.937149270482604e-05,
+ "loss": 0.020842768251895905,
+ "step": 923
+ },
+ {
+ "epoch": 4.668354430379747,
+ "grad_norm": 0.027078162878751755,
+ "learning_rate": 5.9315375982042657e-05,
+ "loss": 0.026818346232175827,
+ "step": 924
+ },
+ {
+ "epoch": 4.673417721518987,
+ "grad_norm": 0.04505958408117294,
+ "learning_rate": 5.925925925925926e-05,
+ "loss": 0.01925778016448021,
+ "step": 925
+ },
+ {
+ "epoch": 4.678481012658228,
+ "grad_norm": 0.028921643272042274,
+ "learning_rate": 5.920314253647588e-05,
+ "loss": 0.017857741564512253,
+ "step": 926
+ },
+ {
+ "epoch": 4.6835443037974684,
+ "grad_norm": 0.021489476785063744,
+ "learning_rate": 5.914702581369248e-05,
+ "loss": 0.018585946410894394,
+ "step": 927
+ },
+ {
+ "epoch": 4.688607594936709,
+ "grad_norm": 0.02885374240577221,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.023486338555812836,
+ "step": 928
+ },
+ {
+ "epoch": 4.6936708860759495,
+ "grad_norm": 0.037063464522361755,
+ "learning_rate": 5.90347923681257e-05,
+ "loss": 0.02569335326552391,
+ "step": 929
+ },
+ {
+ "epoch": 4.69873417721519,
+ "grad_norm": 0.02460661344230175,
+ "learning_rate": 5.897867564534232e-05,
+ "loss": 0.01580418087542057,
+ "step": 930
+ },
+ {
+ "epoch": 4.703797468354431,
+ "grad_norm": 0.030016187578439713,
+ "learning_rate": 5.892255892255892e-05,
+ "loss": 0.01811431720852852,
+ "step": 931
+ },
+ {
+ "epoch": 4.708860759493671,
+ "grad_norm": 0.030638013035058975,
+ "learning_rate": 5.886644219977554e-05,
+ "loss": 0.02380264922976494,
+ "step": 932
+ },
+ {
+ "epoch": 4.713924050632912,
+ "grad_norm": 0.022593742236495018,
+ "learning_rate": 5.881032547699215e-05,
+ "loss": 0.017498169094324112,
+ "step": 933
+ },
+ {
+ "epoch": 4.718987341772152,
+ "grad_norm": 0.026072485372424126,
+ "learning_rate": 5.8754208754208764e-05,
+ "loss": 0.020261723548173904,
+ "step": 934
+ },
+ {
+ "epoch": 4.724050632911393,
+ "grad_norm": 0.020842554047703743,
+ "learning_rate": 5.869809203142537e-05,
+ "loss": 0.018765904009342194,
+ "step": 935
+ },
+ {
+ "epoch": 4.729113924050633,
+ "grad_norm": 0.02724885568022728,
+ "learning_rate": 5.8641975308641984e-05,
+ "loss": 0.01877676695585251,
+ "step": 936
+ },
+ {
+ "epoch": 4.734177215189874,
+ "grad_norm": 0.037401214241981506,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.026435203850269318,
+ "step": 937
+ },
+ {
+ "epoch": 4.739240506329114,
+ "grad_norm": 0.06131114065647125,
+ "learning_rate": 5.852974186307519e-05,
+ "loss": 0.023247163742780685,
+ "step": 938
+ },
+ {
+ "epoch": 4.744303797468355,
+ "grad_norm": 0.04543917998671532,
+ "learning_rate": 5.847362514029181e-05,
+ "loss": 0.024184830486774445,
+ "step": 939
+ },
+ {
+ "epoch": 4.749367088607595,
+ "grad_norm": 0.03184051439166069,
+ "learning_rate": 5.841750841750842e-05,
+ "loss": 0.02176564559340477,
+ "step": 940
+ },
+ {
+ "epoch": 4.754430379746836,
+ "grad_norm": 0.0309689249843359,
+ "learning_rate": 5.8361391694725034e-05,
+ "loss": 0.023136526346206665,
+ "step": 941
+ },
+ {
+ "epoch": 4.759493670886076,
+ "grad_norm": 0.024972833693027496,
+ "learning_rate": 5.830527497194164e-05,
+ "loss": 0.017270661890506744,
+ "step": 942
+ },
+ {
+ "epoch": 4.764556962025316,
+ "grad_norm": 0.03733127936720848,
+ "learning_rate": 5.8249158249158255e-05,
+ "loss": 0.022722383961081505,
+ "step": 943
+ },
+ {
+ "epoch": 4.769620253164557,
+ "grad_norm": 0.04425952583551407,
+ "learning_rate": 5.819304152637486e-05,
+ "loss": 0.02506185881793499,
+ "step": 944
+ },
+ {
+ "epoch": 4.774683544303797,
+ "grad_norm": 0.022625036537647247,
+ "learning_rate": 5.8136924803591475e-05,
+ "loss": 0.017418090254068375,
+ "step": 945
+ },
+ {
+ "epoch": 4.779746835443038,
+ "grad_norm": 0.02716260775923729,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.022329077124595642,
+ "step": 946
+ },
+ {
+ "epoch": 4.784810126582278,
+ "grad_norm": 0.03288663551211357,
+ "learning_rate": 5.8024691358024695e-05,
+ "loss": 0.02051950991153717,
+ "step": 947
+ },
+ {
+ "epoch": 4.789873417721519,
+ "grad_norm": 0.03347448632121086,
+ "learning_rate": 5.7968574635241305e-05,
+ "loss": 0.01883091777563095,
+ "step": 948
+ },
+ {
+ "epoch": 4.794936708860759,
+ "grad_norm": 0.036814238876104355,
+ "learning_rate": 5.7912457912457915e-05,
+ "loss": 0.02320999652147293,
+ "step": 949
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.030795598402619362,
+ "learning_rate": 5.7856341189674525e-05,
+ "loss": 0.01819070428609848,
+ "step": 950
+ },
+ {
+ "epoch": 4.80506329113924,
+ "grad_norm": 0.03846567124128342,
+ "learning_rate": 5.780022446689114e-05,
+ "loss": 0.01933719590306282,
+ "step": 951
+ },
+ {
+ "epoch": 4.810126582278481,
+ "grad_norm": 0.029248127713799477,
+ "learning_rate": 5.7744107744107745e-05,
+ "loss": 0.01642131432890892,
+ "step": 952
+ },
+ {
+ "epoch": 4.815189873417721,
+ "grad_norm": 0.025749213993549347,
+ "learning_rate": 5.768799102132436e-05,
+ "loss": 0.017750587314367294,
+ "step": 953
+ },
+ {
+ "epoch": 4.820253164556962,
+ "grad_norm": 0.043794333934783936,
+ "learning_rate": 5.7631874298540965e-05,
+ "loss": 0.02561376616358757,
+ "step": 954
+ },
+ {
+ "epoch": 4.8253164556962025,
+ "grad_norm": 0.04074554517865181,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.023251589387655258,
+ "step": 955
+ },
+ {
+ "epoch": 4.830379746835443,
+ "grad_norm": 0.043594326823949814,
+ "learning_rate": 5.7519640852974186e-05,
+ "loss": 0.025138206779956818,
+ "step": 956
+ },
+ {
+ "epoch": 4.8354430379746836,
+ "grad_norm": 0.05410498008131981,
+ "learning_rate": 5.74635241301908e-05,
+ "loss": 0.023706410080194473,
+ "step": 957
+ },
+ {
+ "epoch": 4.840506329113924,
+ "grad_norm": 0.0299235749989748,
+ "learning_rate": 5.740740740740741e-05,
+ "loss": 0.01801147311925888,
+ "step": 958
+ },
+ {
+ "epoch": 4.845569620253165,
+ "grad_norm": 0.02982177399098873,
+ "learning_rate": 5.735129068462403e-05,
+ "loss": 0.021112898364663124,
+ "step": 959
+ },
+ {
+ "epoch": 4.850632911392405,
+ "grad_norm": 0.04181864112615585,
+ "learning_rate": 5.729517396184063e-05,
+ "loss": 0.02110268548130989,
+ "step": 960
+ },
+ {
+ "epoch": 4.855696202531646,
+ "grad_norm": 0.040301334112882614,
+ "learning_rate": 5.7239057239057236e-05,
+ "loss": 0.020649928599596024,
+ "step": 961
+ },
+ {
+ "epoch": 4.860759493670886,
+ "grad_norm": 0.03669300675392151,
+ "learning_rate": 5.718294051627385e-05,
+ "loss": 0.023078542202711105,
+ "step": 962
+ },
+ {
+ "epoch": 4.865822784810127,
+ "grad_norm": 0.023378873243927956,
+ "learning_rate": 5.7126823793490456e-05,
+ "loss": 0.01759505085647106,
+ "step": 963
+ },
+ {
+ "epoch": 4.870886075949367,
+ "grad_norm": 0.044835980981588364,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.023342810571193695,
+ "step": 964
+ },
+ {
+ "epoch": 4.875949367088608,
+ "grad_norm": 0.03264521807432175,
+ "learning_rate": 5.701459034792368e-05,
+ "loss": 0.021122846752405167,
+ "step": 965
+ },
+ {
+ "epoch": 4.881012658227848,
+ "grad_norm": 0.036651868373155594,
+ "learning_rate": 5.695847362514029e-05,
+ "loss": 0.026279672980308533,
+ "step": 966
+ },
+ {
+ "epoch": 4.886075949367089,
+ "grad_norm": 0.023810314014554024,
+ "learning_rate": 5.69023569023569e-05,
+ "loss": 0.020299838855862617,
+ "step": 967
+ },
+ {
+ "epoch": 4.891139240506329,
+ "grad_norm": 0.028432384133338928,
+ "learning_rate": 5.684624017957352e-05,
+ "loss": 0.019828233867883682,
+ "step": 968
+ },
+ {
+ "epoch": 4.89620253164557,
+ "grad_norm": 0.02499561943113804,
+ "learning_rate": 5.679012345679012e-05,
+ "loss": 0.023105870932340622,
+ "step": 969
+ },
+ {
+ "epoch": 4.9012658227848105,
+ "grad_norm": 0.0340624563395977,
+ "learning_rate": 5.673400673400674e-05,
+ "loss": 0.023707572370767593,
+ "step": 970
+ },
+ {
+ "epoch": 4.90632911392405,
+ "grad_norm": 0.02945004589855671,
+ "learning_rate": 5.667789001122334e-05,
+ "loss": 0.019038598984479904,
+ "step": 971
+ },
+ {
+ "epoch": 4.911392405063291,
+ "grad_norm": 0.034173011779785156,
+ "learning_rate": 5.662177328843996e-05,
+ "loss": 0.02678484097123146,
+ "step": 972
+ },
+ {
+ "epoch": 4.916455696202531,
+ "grad_norm": 0.0515705943107605,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.02983126789331436,
+ "step": 973
+ },
+ {
+ "epoch": 4.921518987341772,
+ "grad_norm": 0.024027375504374504,
+ "learning_rate": 5.650953984287318e-05,
+ "loss": 0.021375803276896477,
+ "step": 974
+ },
+ {
+ "epoch": 4.926582278481012,
+ "grad_norm": 0.03331667557358742,
+ "learning_rate": 5.645342312008979e-05,
+ "loss": 0.021600808948278427,
+ "step": 975
+ },
+ {
+ "epoch": 4.931645569620253,
+ "grad_norm": 0.029174596071243286,
+ "learning_rate": 5.639730639730641e-05,
+ "loss": 0.022452034056186676,
+ "step": 976
+ },
+ {
+ "epoch": 4.936708860759493,
+ "grad_norm": 0.03323808312416077,
+ "learning_rate": 5.634118967452301e-05,
+ "loss": 0.02531963586807251,
+ "step": 977
+ },
+ {
+ "epoch": 4.941772151898734,
+ "grad_norm": 0.02238641493022442,
+ "learning_rate": 5.628507295173963e-05,
+ "loss": 0.01655597612261772,
+ "step": 978
+ },
+ {
+ "epoch": 4.946835443037974,
+ "grad_norm": 0.03279856964945793,
+ "learning_rate": 5.622895622895623e-05,
+ "loss": 0.02232341095805168,
+ "step": 979
+ },
+ {
+ "epoch": 4.951898734177215,
+ "grad_norm": 0.03852152079343796,
+ "learning_rate": 5.617283950617285e-05,
+ "loss": 0.025721147656440735,
+ "step": 980
+ },
+ {
+ "epoch": 4.9569620253164555,
+ "grad_norm": 0.039974186569452286,
+ "learning_rate": 5.611672278338945e-05,
+ "loss": 0.015438543632626534,
+ "step": 981
+ },
+ {
+ "epoch": 4.962025316455696,
+ "grad_norm": 0.0348355695605278,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.021361682564020157,
+ "step": 982
+ },
+ {
+ "epoch": 4.9670886075949365,
+ "grad_norm": 0.02576221525669098,
+ "learning_rate": 5.600448933782267e-05,
+ "loss": 0.02103075385093689,
+ "step": 983
+ },
+ {
+ "epoch": 4.972151898734177,
+ "grad_norm": 0.039421118795871735,
+ "learning_rate": 5.594837261503928e-05,
+ "loss": 0.026340002194046974,
+ "step": 984
+ },
+ {
+ "epoch": 4.977215189873418,
+ "grad_norm": 0.02953593246638775,
+ "learning_rate": 5.58922558922559e-05,
+ "loss": 0.020818116143345833,
+ "step": 985
+ },
+ {
+ "epoch": 4.982278481012658,
+ "grad_norm": 0.033213913440704346,
+ "learning_rate": 5.58361391694725e-05,
+ "loss": 0.020878788083791733,
+ "step": 986
+ },
+ {
+ "epoch": 4.987341772151899,
+ "grad_norm": 0.04450162872672081,
+ "learning_rate": 5.578002244668912e-05,
+ "loss": 0.02208695001900196,
+ "step": 987
+ },
+ {
+ "epoch": 4.992405063291139,
+ "grad_norm": 0.04752403125166893,
+ "learning_rate": 5.572390572390572e-05,
+ "loss": 0.021128743886947632,
+ "step": 988
+ },
+ {
+ "epoch": 4.99746835443038,
+ "grad_norm": 0.03401600942015648,
+ "learning_rate": 5.566778900112234e-05,
+ "loss": 0.020553182810544968,
+ "step": 989
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.031174728646874428,
+ "learning_rate": 5.561167227833894e-05,
+ "loss": 0.01929999701678753,
+ "step": 990
+ },
+ {
+ "epoch": 5.0050632911392405,
+ "grad_norm": 0.056407660245895386,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.024739203974604607,
+ "step": 991
+ },
+ {
+ "epoch": 5.010126582278481,
+ "grad_norm": 0.019481178373098373,
+ "learning_rate": 5.549943883277217e-05,
+ "loss": 0.016404341906309128,
+ "step": 992
+ },
+ {
+ "epoch": 5.015189873417722,
+ "grad_norm": 0.029707469046115875,
+ "learning_rate": 5.5443322109988785e-05,
+ "loss": 0.017014270648360252,
+ "step": 993
+ },
+ {
+ "epoch": 5.020253164556962,
+ "grad_norm": 0.039400286972522736,
+ "learning_rate": 5.538720538720539e-05,
+ "loss": 0.016073700040578842,
+ "step": 994
+ },
+ {
+ "epoch": 5.025316455696203,
+ "grad_norm": 0.047592055052518845,
+ "learning_rate": 5.5331088664422005e-05,
+ "loss": 0.02021213248372078,
+ "step": 995
+ },
+ {
+ "epoch": 5.030379746835443,
+ "grad_norm": 0.054195769131183624,
+ "learning_rate": 5.527497194163861e-05,
+ "loss": 0.027454158291220665,
+ "step": 996
+ },
+ {
+ "epoch": 5.035443037974684,
+ "grad_norm": 0.02753913588821888,
+ "learning_rate": 5.5218855218855225e-05,
+ "loss": 0.01993582770228386,
+ "step": 997
+ },
+ {
+ "epoch": 5.040506329113924,
+ "grad_norm": 0.038280900567770004,
+ "learning_rate": 5.516273849607183e-05,
+ "loss": 0.017832420766353607,
+ "step": 998
+ },
+ {
+ "epoch": 5.045569620253165,
+ "grad_norm": 0.0289705079048872,
+ "learning_rate": 5.5106621773288446e-05,
+ "loss": 0.019040051847696304,
+ "step": 999
+ },
+ {
+ "epoch": 5.050632911392405,
+ "grad_norm": 0.030929062515497208,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.02529517561197281,
+ "step": 1000
+ },
+ {
+ "epoch": 5.055696202531646,
+ "grad_norm": 0.039416536688804626,
+ "learning_rate": 5.4994388327721666e-05,
+ "loss": 0.017563793808221817,
+ "step": 1001
+ },
+ {
+ "epoch": 5.060759493670886,
+ "grad_norm": 0.039831917732954025,
+ "learning_rate": 5.4938271604938276e-05,
+ "loss": 0.022547172382473946,
+ "step": 1002
+ },
+ {
+ "epoch": 5.065822784810127,
+ "grad_norm": 0.02979891747236252,
+ "learning_rate": 5.488215488215489e-05,
+ "loss": 0.019676152616739273,
+ "step": 1003
+ },
+ {
+ "epoch": 5.0708860759493675,
+ "grad_norm": 0.025752373039722443,
+ "learning_rate": 5.4826038159371496e-05,
+ "loss": 0.016172030940651894,
+ "step": 1004
+ },
+ {
+ "epoch": 5.075949367088608,
+ "grad_norm": 0.03433040529489517,
+ "learning_rate": 5.47699214365881e-05,
+ "loss": 0.022616712376475334,
+ "step": 1005
+ },
+ {
+ "epoch": 5.0810126582278485,
+ "grad_norm": 0.04834216088056564,
+ "learning_rate": 5.4713804713804716e-05,
+ "loss": 0.02641037292778492,
+ "step": 1006
+ },
+ {
+ "epoch": 5.086075949367088,
+ "grad_norm": 0.03748583421111107,
+ "learning_rate": 5.465768799102132e-05,
+ "loss": 0.02212962508201599,
+ "step": 1007
+ },
+ {
+ "epoch": 5.091139240506329,
+ "grad_norm": 0.03406492620706558,
+ "learning_rate": 5.4601571268237936e-05,
+ "loss": 0.022490520030260086,
+ "step": 1008
+ },
+ {
+ "epoch": 5.096202531645569,
+ "grad_norm": 0.025412574410438538,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.018286626785993576,
+ "step": 1009
+ },
+ {
+ "epoch": 5.10126582278481,
+ "grad_norm": 0.030613059177994728,
+ "learning_rate": 5.448933782267116e-05,
+ "loss": 0.018090849742293358,
+ "step": 1010
+ },
+ {
+ "epoch": 5.10632911392405,
+ "grad_norm": 0.032511018216609955,
+ "learning_rate": 5.4433221099887766e-05,
+ "loss": 0.019871044903993607,
+ "step": 1011
+ },
+ {
+ "epoch": 5.111392405063291,
+ "grad_norm": 0.041535500437021255,
+ "learning_rate": 5.437710437710438e-05,
+ "loss": 0.02880081906914711,
+ "step": 1012
+ },
+ {
+ "epoch": 5.116455696202531,
+ "grad_norm": 0.053748298436403275,
+ "learning_rate": 5.4320987654320986e-05,
+ "loss": 0.024350278079509735,
+ "step": 1013
+ },
+ {
+ "epoch": 5.121518987341772,
+ "grad_norm": 0.03045419417321682,
+ "learning_rate": 5.42648709315376e-05,
+ "loss": 0.026830779388546944,
+ "step": 1014
+ },
+ {
+ "epoch": 5.1265822784810124,
+ "grad_norm": 0.02704838663339615,
+ "learning_rate": 5.420875420875421e-05,
+ "loss": 0.019440406933426857,
+ "step": 1015
+ },
+ {
+ "epoch": 5.131645569620253,
+ "grad_norm": 0.037976089864969254,
+ "learning_rate": 5.4152637485970823e-05,
+ "loss": 0.02016528509557247,
+ "step": 1016
+ },
+ {
+ "epoch": 5.1367088607594935,
+ "grad_norm": 0.04055245593190193,
+ "learning_rate": 5.4096520763187434e-05,
+ "loss": 0.021118413656949997,
+ "step": 1017
+ },
+ {
+ "epoch": 5.141772151898734,
+ "grad_norm": 0.02943083830177784,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.01882058009505272,
+ "step": 1018
+ },
+ {
+ "epoch": 5.146835443037975,
+ "grad_norm": 0.03773244097828865,
+ "learning_rate": 5.3984287317620654e-05,
+ "loss": 0.025017477571964264,
+ "step": 1019
+ },
+ {
+ "epoch": 5.151898734177215,
+ "grad_norm": 0.026969652622938156,
+ "learning_rate": 5.392817059483727e-05,
+ "loss": 0.018443236127495766,
+ "step": 1020
+ },
+ {
+ "epoch": 5.156962025316456,
+ "grad_norm": 0.032142024487257004,
+ "learning_rate": 5.3872053872053874e-05,
+ "loss": 0.02332904376089573,
+ "step": 1021
+ },
+ {
+ "epoch": 5.162025316455696,
+ "grad_norm": 0.06372297555208206,
+ "learning_rate": 5.381593714927049e-05,
+ "loss": 0.027975570410490036,
+ "step": 1022
+ },
+ {
+ "epoch": 5.167088607594937,
+ "grad_norm": 0.03120330721139908,
+ "learning_rate": 5.3759820426487094e-05,
+ "loss": 0.023697681725025177,
+ "step": 1023
+ },
+ {
+ "epoch": 5.172151898734177,
+ "grad_norm": 0.029094889760017395,
+ "learning_rate": 5.370370370370371e-05,
+ "loss": 0.01727498322725296,
+ "step": 1024
+ },
+ {
+ "epoch": 5.177215189873418,
+ "grad_norm": 0.03791336342692375,
+ "learning_rate": 5.3647586980920314e-05,
+ "loss": 0.02156408131122589,
+ "step": 1025
+ },
+ {
+ "epoch": 5.182278481012658,
+ "grad_norm": 0.028603199869394302,
+ "learning_rate": 5.3591470258136924e-05,
+ "loss": 0.01781666837632656,
+ "step": 1026
+ },
+ {
+ "epoch": 5.187341772151899,
+ "grad_norm": 0.034254368394613266,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.023422224447131157,
+ "step": 1027
+ },
+ {
+ "epoch": 5.192405063291139,
+ "grad_norm": 0.025661299005150795,
+ "learning_rate": 5.3479236812570144e-05,
+ "loss": 0.017852213233709335,
+ "step": 1028
+ },
+ {
+ "epoch": 5.19746835443038,
+ "grad_norm": 0.03156711906194687,
+ "learning_rate": 5.342312008978676e-05,
+ "loss": 0.022492870688438416,
+ "step": 1029
+ },
+ {
+ "epoch": 5.2025316455696204,
+ "grad_norm": 0.0222217608243227,
+ "learning_rate": 5.3367003367003364e-05,
+ "loss": 0.015568151138722897,
+ "step": 1030
+ },
+ {
+ "epoch": 5.207594936708861,
+ "grad_norm": 0.04563366249203682,
+ "learning_rate": 5.331088664421998e-05,
+ "loss": 0.022124778479337692,
+ "step": 1031
+ },
+ {
+ "epoch": 5.2126582278481015,
+ "grad_norm": 0.04612975940108299,
+ "learning_rate": 5.3254769921436585e-05,
+ "loss": 0.027084846049547195,
+ "step": 1032
+ },
+ {
+ "epoch": 5.217721518987342,
+ "grad_norm": 0.047278422862291336,
+ "learning_rate": 5.31986531986532e-05,
+ "loss": 0.022641438990831375,
+ "step": 1033
+ },
+ {
+ "epoch": 5.222784810126583,
+ "grad_norm": 0.030134575441479683,
+ "learning_rate": 5.314253647586981e-05,
+ "loss": 0.01842697337269783,
+ "step": 1034
+ },
+ {
+ "epoch": 5.227848101265823,
+ "grad_norm": 0.019028518348932266,
+ "learning_rate": 5.308641975308642e-05,
+ "loss": 0.017543386667966843,
+ "step": 1035
+ },
+ {
+ "epoch": 5.232911392405064,
+ "grad_norm": 0.04117404296994209,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.02185094729065895,
+ "step": 1036
+ },
+ {
+ "epoch": 5.237974683544304,
+ "grad_norm": 0.0310111902654171,
+ "learning_rate": 5.297418630751965e-05,
+ "loss": 0.02418985590338707,
+ "step": 1037
+ },
+ {
+ "epoch": 5.243037974683545,
+ "grad_norm": 0.034619491547346115,
+ "learning_rate": 5.291806958473625e-05,
+ "loss": 0.02162736840546131,
+ "step": 1038
+ },
+ {
+ "epoch": 5.248101265822784,
+ "grad_norm": 0.04028276726603508,
+ "learning_rate": 5.286195286195287e-05,
+ "loss": 0.02554975263774395,
+ "step": 1039
+ },
+ {
+ "epoch": 5.253164556962025,
+ "grad_norm": 0.0336519293487072,
+ "learning_rate": 5.280583613916947e-05,
+ "loss": 0.019465651363134384,
+ "step": 1040
+ },
+ {
+ "epoch": 5.258227848101265,
+ "grad_norm": 0.033565767109394073,
+ "learning_rate": 5.274971941638609e-05,
+ "loss": 0.020889155566692352,
+ "step": 1041
+ },
+ {
+ "epoch": 5.263291139240506,
+ "grad_norm": 0.02902410738170147,
+ "learning_rate": 5.269360269360269e-05,
+ "loss": 0.02131371572613716,
+ "step": 1042
+ },
+ {
+ "epoch": 5.2683544303797465,
+ "grad_norm": 0.03622325137257576,
+ "learning_rate": 5.263748597081931e-05,
+ "loss": 0.017162127420306206,
+ "step": 1043
+ },
+ {
+ "epoch": 5.273417721518987,
+ "grad_norm": 0.039386410266160965,
+ "learning_rate": 5.258136924803592e-05,
+ "loss": 0.016598902642726898,
+ "step": 1044
+ },
+ {
+ "epoch": 5.2784810126582276,
+ "grad_norm": 0.035566773265600204,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.022860797122120857,
+ "step": 1045
+ },
+ {
+ "epoch": 5.283544303797468,
+ "grad_norm": 0.04470687359571457,
+ "learning_rate": 5.246913580246914e-05,
+ "loss": 0.020824994891881943,
+ "step": 1046
+ },
+ {
+ "epoch": 5.288607594936709,
+ "grad_norm": 0.03889680653810501,
+ "learning_rate": 5.241301907968574e-05,
+ "loss": 0.017250075936317444,
+ "step": 1047
+ },
+ {
+ "epoch": 5.293670886075949,
+ "grad_norm": 0.02681683376431465,
+ "learning_rate": 5.235690235690236e-05,
+ "loss": 0.0191829651594162,
+ "step": 1048
+ },
+ {
+ "epoch": 5.29873417721519,
+ "grad_norm": 0.018965722993016243,
+ "learning_rate": 5.230078563411896e-05,
+ "loss": 0.02007337100803852,
+ "step": 1049
+ },
+ {
+ "epoch": 5.30379746835443,
+ "grad_norm": 0.023910261690616608,
+ "learning_rate": 5.224466891133558e-05,
+ "loss": 0.02189997211098671,
+ "step": 1050
+ },
+ {
+ "epoch": 5.308860759493671,
+ "grad_norm": 0.03607999160885811,
+ "learning_rate": 5.218855218855219e-05,
+ "loss": 0.023346582427620888,
+ "step": 1051
+ },
+ {
+ "epoch": 5.313924050632911,
+ "grad_norm": 0.02490268088877201,
+ "learning_rate": 5.2132435465768806e-05,
+ "loss": 0.017453521490097046,
+ "step": 1052
+ },
+ {
+ "epoch": 5.318987341772152,
+ "grad_norm": 0.04894902557134628,
+ "learning_rate": 5.207631874298541e-05,
+ "loss": 0.023999422788619995,
+ "step": 1053
+ },
+ {
+ "epoch": 5.324050632911392,
+ "grad_norm": 0.01724478043615818,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.013751897029578686,
+ "step": 1054
+ },
+ {
+ "epoch": 5.329113924050633,
+ "grad_norm": 0.05506094545125961,
+ "learning_rate": 5.196408529741863e-05,
+ "loss": 0.02599490061402321,
+ "step": 1055
+ },
+ {
+ "epoch": 5.334177215189873,
+ "grad_norm": 0.030050745233893394,
+ "learning_rate": 5.1907968574635247e-05,
+ "loss": 0.022996244952082634,
+ "step": 1056
+ },
+ {
+ "epoch": 5.339240506329114,
+ "grad_norm": 0.028648901730775833,
+ "learning_rate": 5.185185185185185e-05,
+ "loss": 0.024319645017385483,
+ "step": 1057
+ },
+ {
+ "epoch": 5.3443037974683545,
+ "grad_norm": 0.04159106686711311,
+ "learning_rate": 5.179573512906847e-05,
+ "loss": 0.02485204115509987,
+ "step": 1058
+ },
+ {
+ "epoch": 5.349367088607595,
+ "grad_norm": 0.04454904422163963,
+ "learning_rate": 5.173961840628507e-05,
+ "loss": 0.018921498209238052,
+ "step": 1059
+ },
+ {
+ "epoch": 5.3544303797468356,
+ "grad_norm": 0.05850376933813095,
+ "learning_rate": 5.168350168350169e-05,
+ "loss": 0.02758260816335678,
+ "step": 1060
+ },
+ {
+ "epoch": 5.359493670886076,
+ "grad_norm": 0.03319580852985382,
+ "learning_rate": 5.16273849607183e-05,
+ "loss": 0.02180345356464386,
+ "step": 1061
+ },
+ {
+ "epoch": 5.364556962025317,
+ "grad_norm": 0.046812329441308975,
+ "learning_rate": 5.1571268237934914e-05,
+ "loss": 0.021682530641555786,
+ "step": 1062
+ },
+ {
+ "epoch": 5.369620253164557,
+ "grad_norm": 0.028218183666467667,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.019677158445119858,
+ "step": 1063
+ },
+ {
+ "epoch": 5.374683544303798,
+ "grad_norm": 0.04918216913938522,
+ "learning_rate": 5.1459034792368134e-05,
+ "loss": 0.019348308444023132,
+ "step": 1064
+ },
+ {
+ "epoch": 5.379746835443038,
+ "grad_norm": 0.041713107377290726,
+ "learning_rate": 5.140291806958474e-05,
+ "loss": 0.01728012040257454,
+ "step": 1065
+ },
+ {
+ "epoch": 5.384810126582279,
+ "grad_norm": 0.034068260341882706,
+ "learning_rate": 5.1346801346801354e-05,
+ "loss": 0.020487628877162933,
+ "step": 1066
+ },
+ {
+ "epoch": 5.389873417721519,
+ "grad_norm": 0.028666919097304344,
+ "learning_rate": 5.129068462401796e-05,
+ "loss": 0.015318546444177628,
+ "step": 1067
+ },
+ {
+ "epoch": 5.39493670886076,
+ "grad_norm": 0.03828604146838188,
+ "learning_rate": 5.1234567901234574e-05,
+ "loss": 0.028930973261594772,
+ "step": 1068
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.01870056800544262,
+ "learning_rate": 5.1178451178451184e-05,
+ "loss": 0.015031076967716217,
+ "step": 1069
+ },
+ {
+ "epoch": 5.405063291139241,
+ "grad_norm": 0.02219143882393837,
+ "learning_rate": 5.112233445566779e-05,
+ "loss": 0.019569698721170425,
+ "step": 1070
+ },
+ {
+ "epoch": 5.410126582278481,
+ "grad_norm": 0.04418749734759331,
+ "learning_rate": 5.1066217732884404e-05,
+ "loss": 0.025913581252098083,
+ "step": 1071
+ },
+ {
+ "epoch": 5.415189873417722,
+ "grad_norm": 0.05946826562285423,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.03080957755446434,
+ "step": 1072
+ },
+ {
+ "epoch": 5.4202531645569625,
+ "grad_norm": 0.032025255262851715,
+ "learning_rate": 5.0953984287317624e-05,
+ "loss": 0.017155487090349197,
+ "step": 1073
+ },
+ {
+ "epoch": 5.425316455696202,
+ "grad_norm": 0.033507514744997025,
+ "learning_rate": 5.089786756453423e-05,
+ "loss": 0.022324759513139725,
+ "step": 1074
+ },
+ {
+ "epoch": 5.430379746835443,
+ "grad_norm": 0.025624485686421394,
+ "learning_rate": 5.0841750841750845e-05,
+ "loss": 0.021772298961877823,
+ "step": 1075
+ },
+ {
+ "epoch": 5.435443037974683,
+ "grad_norm": 0.055580489337444305,
+ "learning_rate": 5.078563411896745e-05,
+ "loss": 0.01938481442630291,
+ "step": 1076
+ },
+ {
+ "epoch": 5.440506329113924,
+ "grad_norm": 0.04581330716609955,
+ "learning_rate": 5.0729517396184065e-05,
+ "loss": 0.019239529967308044,
+ "step": 1077
+ },
+ {
+ "epoch": 5.445569620253164,
+ "grad_norm": 0.06254621595144272,
+ "learning_rate": 5.0673400673400675e-05,
+ "loss": 0.027182448655366898,
+ "step": 1078
+ },
+ {
+ "epoch": 5.450632911392405,
+ "grad_norm": 0.036759812384843826,
+ "learning_rate": 5.061728395061729e-05,
+ "loss": 0.027131710201501846,
+ "step": 1079
+ },
+ {
+ "epoch": 5.455696202531645,
+ "grad_norm": 0.03190915286540985,
+ "learning_rate": 5.0561167227833895e-05,
+ "loss": 0.0259249284863472,
+ "step": 1080
+ },
+ {
+ "epoch": 5.460759493670886,
+ "grad_norm": 0.03208916634321213,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.02531026303768158,
+ "step": 1081
+ },
+ {
+ "epoch": 5.465822784810126,
+ "grad_norm": 0.06676970422267914,
+ "learning_rate": 5.0448933782267115e-05,
+ "loss": 0.022145366296172142,
+ "step": 1082
+ },
+ {
+ "epoch": 5.470886075949367,
+ "grad_norm": 0.027604084461927414,
+ "learning_rate": 5.039281705948373e-05,
+ "loss": 0.018208740279078484,
+ "step": 1083
+ },
+ {
+ "epoch": 5.4759493670886075,
+ "grad_norm": 0.03812532126903534,
+ "learning_rate": 5.0336700336700335e-05,
+ "loss": 0.024251334369182587,
+ "step": 1084
+ },
+ {
+ "epoch": 5.481012658227848,
+ "grad_norm": 0.03016139566898346,
+ "learning_rate": 5.028058361391695e-05,
+ "loss": 0.02196047455072403,
+ "step": 1085
+ },
+ {
+ "epoch": 5.4860759493670885,
+ "grad_norm": 0.017749929800629616,
+ "learning_rate": 5.022446689113356e-05,
+ "loss": 0.01607266068458557,
+ "step": 1086
+ },
+ {
+ "epoch": 5.491139240506329,
+ "grad_norm": 0.023184901103377342,
+ "learning_rate": 5.016835016835017e-05,
+ "loss": 0.021226245909929276,
+ "step": 1087
+ },
+ {
+ "epoch": 5.49620253164557,
+ "grad_norm": 0.024662092328071594,
+ "learning_rate": 5.011223344556678e-05,
+ "loss": 0.019691254943609238,
+ "step": 1088
+ },
+ {
+ "epoch": 5.50126582278481,
+ "grad_norm": 0.05883142724633217,
+ "learning_rate": 5.00561167227834e-05,
+ "loss": 0.03039814904332161,
+ "step": 1089
+ },
+ {
+ "epoch": 5.506329113924051,
+ "grad_norm": 0.029918279498815536,
+ "learning_rate": 5e-05,
+ "loss": 0.022806301712989807,
+ "step": 1090
+ },
+ {
+ "epoch": 5.511392405063291,
+ "grad_norm": 0.023451462388038635,
+ "learning_rate": 4.994388327721661e-05,
+ "loss": 0.018920207396149635,
+ "step": 1091
+ },
+ {
+ "epoch": 5.516455696202532,
+ "grad_norm": 0.030591748654842377,
+ "learning_rate": 4.988776655443322e-05,
+ "loss": 0.024741975590586662,
+ "step": 1092
+ },
+ {
+ "epoch": 5.521518987341772,
+ "grad_norm": 0.020344361662864685,
+ "learning_rate": 4.983164983164983e-05,
+ "loss": 0.018007446080446243,
+ "step": 1093
+ },
+ {
+ "epoch": 5.526582278481013,
+ "grad_norm": 0.029899192973971367,
+ "learning_rate": 4.977553310886644e-05,
+ "loss": 0.02196051925420761,
+ "step": 1094
+ },
+ {
+ "epoch": 5.531645569620253,
+ "grad_norm": 0.030987054109573364,
+ "learning_rate": 4.971941638608306e-05,
+ "loss": 0.018726475536823273,
+ "step": 1095
+ },
+ {
+ "epoch": 5.536708860759494,
+ "grad_norm": 0.031603869050741196,
+ "learning_rate": 4.966329966329967e-05,
+ "loss": 0.027497179806232452,
+ "step": 1096
+ },
+ {
+ "epoch": 5.541772151898734,
+ "grad_norm": 0.041930630803108215,
+ "learning_rate": 4.960718294051628e-05,
+ "loss": 0.0274939127266407,
+ "step": 1097
+ },
+ {
+ "epoch": 5.546835443037975,
+ "grad_norm": 0.020828744396567345,
+ "learning_rate": 4.955106621773289e-05,
+ "loss": 0.020464252680540085,
+ "step": 1098
+ },
+ {
+ "epoch": 5.5518987341772155,
+ "grad_norm": 0.03408589959144592,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.024826694279909134,
+ "step": 1099
+ },
+ {
+ "epoch": 5.556962025316456,
+ "grad_norm": 0.03565233200788498,
+ "learning_rate": 4.943883277216611e-05,
+ "loss": 0.0297713503241539,
+ "step": 1100
+ },
+ {
+ "epoch": 5.5620253164556965,
+ "grad_norm": 0.03275191783905029,
+ "learning_rate": 4.938271604938271e-05,
+ "loss": 0.022985238581895828,
+ "step": 1101
+ },
+ {
+ "epoch": 5.567088607594937,
+ "grad_norm": 0.04215894266963005,
+ "learning_rate": 4.932659932659932e-05,
+ "loss": 0.020872686058282852,
+ "step": 1102
+ },
+ {
+ "epoch": 5.572151898734178,
+ "grad_norm": 0.03496193513274193,
+ "learning_rate": 4.927048260381594e-05,
+ "loss": 0.020619090646505356,
+ "step": 1103
+ },
+ {
+ "epoch": 5.577215189873417,
+ "grad_norm": 0.020121701061725616,
+ "learning_rate": 4.921436588103255e-05,
+ "loss": 0.017047466710209846,
+ "step": 1104
+ },
+ {
+ "epoch": 5.582278481012658,
+ "grad_norm": 0.02406349778175354,
+ "learning_rate": 4.915824915824916e-05,
+ "loss": 0.01753303036093712,
+ "step": 1105
+ },
+ {
+ "epoch": 5.587341772151898,
+ "grad_norm": 0.03804773837327957,
+ "learning_rate": 4.910213243546577e-05,
+ "loss": 0.026075419038534164,
+ "step": 1106
+ },
+ {
+ "epoch": 5.592405063291139,
+ "grad_norm": 0.024065209552645683,
+ "learning_rate": 4.904601571268238e-05,
+ "loss": 0.02253042347729206,
+ "step": 1107
+ },
+ {
+ "epoch": 5.597468354430379,
+ "grad_norm": 0.024677708745002747,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.02093282900750637,
+ "step": 1108
+ },
+ {
+ "epoch": 5.60253164556962,
+ "grad_norm": 0.022487351670861244,
+ "learning_rate": 4.89337822671156e-05,
+ "loss": 0.019194334745407104,
+ "step": 1109
+ },
+ {
+ "epoch": 5.6075949367088604,
+ "grad_norm": 0.023981913924217224,
+ "learning_rate": 4.887766554433221e-05,
+ "loss": 0.019715486094355583,
+ "step": 1110
+ },
+ {
+ "epoch": 5.612658227848101,
+ "grad_norm": 0.49088963866233826,
+ "learning_rate": 4.882154882154882e-05,
+ "loss": 0.01954624056816101,
+ "step": 1111
+ },
+ {
+ "epoch": 5.6177215189873415,
+ "grad_norm": 0.020698007196187973,
+ "learning_rate": 4.876543209876544e-05,
+ "loss": 0.0198826901614666,
+ "step": 1112
+ },
+ {
+ "epoch": 5.622784810126582,
+ "grad_norm": 0.030978364869952202,
+ "learning_rate": 4.870931537598205e-05,
+ "loss": 0.022201407700777054,
+ "step": 1113
+ },
+ {
+ "epoch": 5.627848101265823,
+ "grad_norm": 0.03610600158572197,
+ "learning_rate": 4.865319865319866e-05,
+ "loss": 0.020692896097898483,
+ "step": 1114
+ },
+ {
+ "epoch": 5.632911392405063,
+ "grad_norm": 0.03503869101405144,
+ "learning_rate": 4.859708193041527e-05,
+ "loss": 0.024315977469086647,
+ "step": 1115
+ },
+ {
+ "epoch": 5.637974683544304,
+ "grad_norm": 0.038263533264398575,
+ "learning_rate": 4.854096520763188e-05,
+ "loss": 0.02289794571697712,
+ "step": 1116
+ },
+ {
+ "epoch": 5.643037974683544,
+ "grad_norm": 0.06627792865037918,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.016900356858968735,
+ "step": 1117
+ },
+ {
+ "epoch": 5.648101265822785,
+ "grad_norm": 0.04108016937971115,
+ "learning_rate": 4.84287317620651e-05,
+ "loss": 0.026155930012464523,
+ "step": 1118
+ },
+ {
+ "epoch": 5.653164556962025,
+ "grad_norm": 0.027791379019618034,
+ "learning_rate": 4.837261503928171e-05,
+ "loss": 0.018122777342796326,
+ "step": 1119
+ },
+ {
+ "epoch": 5.658227848101266,
+ "grad_norm": 0.06097861006855965,
+ "learning_rate": 4.831649831649832e-05,
+ "loss": 0.022645950317382812,
+ "step": 1120
+ },
+ {
+ "epoch": 5.663291139240506,
+ "grad_norm": 0.06343472748994827,
+ "learning_rate": 4.8260381593714935e-05,
+ "loss": 0.029537659138441086,
+ "step": 1121
+ },
+ {
+ "epoch": 5.668354430379747,
+ "grad_norm": 0.05996944010257721,
+ "learning_rate": 4.8204264870931545e-05,
+ "loss": 0.02282993122935295,
+ "step": 1122
+ },
+ {
+ "epoch": 5.673417721518987,
+ "grad_norm": 0.030753644183278084,
+ "learning_rate": 4.814814814814815e-05,
+ "loss": 0.01835070736706257,
+ "step": 1123
+ },
+ {
+ "epoch": 5.678481012658228,
+ "grad_norm": 0.0284577663987875,
+ "learning_rate": 4.809203142536476e-05,
+ "loss": 0.019698038697242737,
+ "step": 1124
+ },
+ {
+ "epoch": 5.6835443037974684,
+ "grad_norm": 0.03136469051241875,
+ "learning_rate": 4.803591470258137e-05,
+ "loss": 0.018538501113653183,
+ "step": 1125
+ },
+ {
+ "epoch": 5.688607594936709,
+ "grad_norm": 0.042034219950437546,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.01609296351671219,
+ "step": 1126
+ },
+ {
+ "epoch": 5.6936708860759495,
+ "grad_norm": 0.04704117774963379,
+ "learning_rate": 4.792368125701459e-05,
+ "loss": 0.017442524433135986,
+ "step": 1127
+ },
+ {
+ "epoch": 5.69873417721519,
+ "grad_norm": 0.04261549562215805,
+ "learning_rate": 4.78675645342312e-05,
+ "loss": 0.022896092385053635,
+ "step": 1128
+ },
+ {
+ "epoch": 5.703797468354431,
+ "grad_norm": 0.035263415426015854,
+ "learning_rate": 4.7811447811447815e-05,
+ "loss": 0.02376401424407959,
+ "step": 1129
+ },
+ {
+ "epoch": 5.708860759493671,
+ "grad_norm": 0.029153654351830482,
+ "learning_rate": 4.7755331088664425e-05,
+ "loss": 0.019103601574897766,
+ "step": 1130
+ },
+ {
+ "epoch": 5.713924050632912,
+ "grad_norm": 0.024728860706090927,
+ "learning_rate": 4.7699214365881036e-05,
+ "loss": 0.019203007221221924,
+ "step": 1131
+ },
+ {
+ "epoch": 5.718987341772152,
+ "grad_norm": 0.0682872086763382,
+ "learning_rate": 4.7643097643097646e-05,
+ "loss": 0.023789528757333755,
+ "step": 1132
+ },
+ {
+ "epoch": 5.724050632911393,
+ "grad_norm": 0.03475257009267807,
+ "learning_rate": 4.7586980920314256e-05,
+ "loss": 0.01748424954712391,
+ "step": 1133
+ },
+ {
+ "epoch": 5.729113924050633,
+ "grad_norm": 0.03768116980791092,
+ "learning_rate": 4.7530864197530866e-05,
+ "loss": 0.019674118608236313,
+ "step": 1134
+ },
+ {
+ "epoch": 5.734177215189874,
+ "grad_norm": 0.06546973437070847,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.02400730922818184,
+ "step": 1135
+ },
+ {
+ "epoch": 5.739240506329114,
+ "grad_norm": 0.03348927944898605,
+ "learning_rate": 4.7418630751964086e-05,
+ "loss": 0.027110135182738304,
+ "step": 1136
+ },
+ {
+ "epoch": 5.744303797468355,
+ "grad_norm": 0.041038379073143005,
+ "learning_rate": 4.7362514029180696e-05,
+ "loss": 0.025943022221326828,
+ "step": 1137
+ },
+ {
+ "epoch": 5.749367088607595,
+ "grad_norm": 0.03094886802136898,
+ "learning_rate": 4.730639730639731e-05,
+ "loss": 0.018898673355579376,
+ "step": 1138
+ },
+ {
+ "epoch": 5.754430379746836,
+ "grad_norm": 0.03637633100152016,
+ "learning_rate": 4.725028058361392e-05,
+ "loss": 0.02247396484017372,
+ "step": 1139
+ },
+ {
+ "epoch": 5.759493670886076,
+ "grad_norm": 0.03672393038868904,
+ "learning_rate": 4.719416386083053e-05,
+ "loss": 0.02294430509209633,
+ "step": 1140
+ },
+ {
+ "epoch": 5.764556962025316,
+ "grad_norm": 0.03434748202562332,
+ "learning_rate": 4.713804713804714e-05,
+ "loss": 0.021498121321201324,
+ "step": 1141
+ },
+ {
+ "epoch": 5.769620253164557,
+ "grad_norm": 0.032241202890872955,
+ "learning_rate": 4.708193041526375e-05,
+ "loss": 0.02623910829424858,
+ "step": 1142
+ },
+ {
+ "epoch": 5.774683544303797,
+ "grad_norm": 0.028173472732305527,
+ "learning_rate": 4.702581369248036e-05,
+ "loss": 0.018390003591775894,
+ "step": 1143
+ },
+ {
+ "epoch": 5.779746835443038,
+ "grad_norm": 0.033768974244594574,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.022890064865350723,
+ "step": 1144
+ },
+ {
+ "epoch": 5.784810126582278,
+ "grad_norm": 0.03199310600757599,
+ "learning_rate": 4.691358024691358e-05,
+ "loss": 0.018634604290127754,
+ "step": 1145
+ },
+ {
+ "epoch": 5.789873417721519,
+ "grad_norm": 0.02942977100610733,
+ "learning_rate": 4.685746352413019e-05,
+ "loss": 0.021336350589990616,
+ "step": 1146
+ },
+ {
+ "epoch": 5.794936708860759,
+ "grad_norm": 0.026747260242700577,
+ "learning_rate": 4.68013468013468e-05,
+ "loss": 0.017634060233831406,
+ "step": 1147
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.052395813167095184,
+ "learning_rate": 4.6745230078563413e-05,
+ "loss": 0.019521519541740417,
+ "step": 1148
+ },
+ {
+ "epoch": 5.80506329113924,
+ "grad_norm": 0.07997749745845795,
+ "learning_rate": 4.6689113355780024e-05,
+ "loss": 0.027218502014875412,
+ "step": 1149
+ },
+ {
+ "epoch": 5.810126582278481,
+ "grad_norm": 0.04570790380239487,
+ "learning_rate": 4.6632996632996634e-05,
+ "loss": 0.027033157646656036,
+ "step": 1150
+ },
+ {
+ "epoch": 5.815189873417721,
+ "grad_norm": 0.05992640554904938,
+ "learning_rate": 4.6576879910213244e-05,
+ "loss": 0.020755816251039505,
+ "step": 1151
+ },
+ {
+ "epoch": 5.820253164556962,
+ "grad_norm": 0.03377217426896095,
+ "learning_rate": 4.6520763187429854e-05,
+ "loss": 0.019246265292167664,
+ "step": 1152
+ },
+ {
+ "epoch": 5.8253164556962025,
+ "grad_norm": 0.026675008237361908,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.019907813519239426,
+ "step": 1153
+ },
+ {
+ "epoch": 5.830379746835443,
+ "grad_norm": 0.04007306694984436,
+ "learning_rate": 4.6408529741863074e-05,
+ "loss": 0.02621765062212944,
+ "step": 1154
+ },
+ {
+ "epoch": 5.8354430379746836,
+ "grad_norm": 0.05345958471298218,
+ "learning_rate": 4.635241301907969e-05,
+ "loss": 0.021677743643522263,
+ "step": 1155
+ },
+ {
+ "epoch": 5.840506329113924,
+ "grad_norm": 0.03231236711144447,
+ "learning_rate": 4.62962962962963e-05,
+ "loss": 0.01898232102394104,
+ "step": 1156
+ },
+ {
+ "epoch": 5.845569620253165,
+ "grad_norm": 0.06332266330718994,
+ "learning_rate": 4.624017957351291e-05,
+ "loss": 0.022123044356703758,
+ "step": 1157
+ },
+ {
+ "epoch": 5.850632911392405,
+ "grad_norm": 0.017904918640851974,
+ "learning_rate": 4.618406285072952e-05,
+ "loss": 0.016008764505386353,
+ "step": 1158
+ },
+ {
+ "epoch": 5.855696202531646,
+ "grad_norm": 0.032957062125205994,
+ "learning_rate": 4.612794612794613e-05,
+ "loss": 0.026430988684296608,
+ "step": 1159
+ },
+ {
+ "epoch": 5.860759493670886,
+ "grad_norm": 0.02764013037085533,
+ "learning_rate": 4.607182940516274e-05,
+ "loss": 0.01749669760465622,
+ "step": 1160
+ },
+ {
+ "epoch": 5.865822784810127,
+ "grad_norm": 0.031616635620594025,
+ "learning_rate": 4.601571268237935e-05,
+ "loss": 0.022402513772249222,
+ "step": 1161
+ },
+ {
+ "epoch": 5.870886075949367,
+ "grad_norm": 0.026803012937307358,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.02391771227121353,
+ "step": 1162
+ },
+ {
+ "epoch": 5.875949367088608,
+ "grad_norm": 0.039992235600948334,
+ "learning_rate": 4.590347923681257e-05,
+ "loss": 0.0186441782861948,
+ "step": 1163
+ },
+ {
+ "epoch": 5.881012658227848,
+ "grad_norm": 0.034594062715768814,
+ "learning_rate": 4.584736251402919e-05,
+ "loss": 0.020437058061361313,
+ "step": 1164
+ },
+ {
+ "epoch": 5.886075949367089,
+ "grad_norm": 0.01877710409462452,
+ "learning_rate": 4.57912457912458e-05,
+ "loss": 0.01517703477293253,
+ "step": 1165
+ },
+ {
+ "epoch": 5.891139240506329,
+ "grad_norm": 0.021410809829831123,
+ "learning_rate": 4.573512906846241e-05,
+ "loss": 0.021264132112264633,
+ "step": 1166
+ },
+ {
+ "epoch": 5.89620253164557,
+ "grad_norm": 0.04017850384116173,
+ "learning_rate": 4.567901234567901e-05,
+ "loss": 0.024904146790504456,
+ "step": 1167
+ },
+ {
+ "epoch": 5.9012658227848105,
+ "grad_norm": 0.030386412516236305,
+ "learning_rate": 4.562289562289562e-05,
+ "loss": 0.02334582805633545,
+ "step": 1168
+ },
+ {
+ "epoch": 5.90632911392405,
+ "grad_norm": 0.043996457010507584,
+ "learning_rate": 4.556677890011223e-05,
+ "loss": 0.02326396480202675,
+ "step": 1169
+ },
+ {
+ "epoch": 5.911392405063291,
+ "grad_norm": 0.028154531493782997,
+ "learning_rate": 4.551066217732884e-05,
+ "loss": 0.019153760746121407,
+ "step": 1170
+ },
+ {
+ "epoch": 5.916455696202531,
+ "grad_norm": 0.02629070170223713,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.02149396575987339,
+ "step": 1171
+ },
+ {
+ "epoch": 5.921518987341772,
+ "grad_norm": 0.024712109938263893,
+ "learning_rate": 4.539842873176207e-05,
+ "loss": 0.01731209270656109,
+ "step": 1172
+ },
+ {
+ "epoch": 5.926582278481012,
+ "grad_norm": 0.027591124176979065,
+ "learning_rate": 4.534231200897868e-05,
+ "loss": 0.018549319356679916,
+ "step": 1173
+ },
+ {
+ "epoch": 5.931645569620253,
+ "grad_norm": 0.025680841878056526,
+ "learning_rate": 4.528619528619529e-05,
+ "loss": 0.019339032471179962,
+ "step": 1174
+ },
+ {
+ "epoch": 5.936708860759493,
+ "grad_norm": 0.0393349826335907,
+ "learning_rate": 4.52300785634119e-05,
+ "loss": 0.026176627725362778,
+ "step": 1175
+ },
+ {
+ "epoch": 5.941772151898734,
+ "grad_norm": 0.028960758820176125,
+ "learning_rate": 4.517396184062851e-05,
+ "loss": 0.020635023713111877,
+ "step": 1176
+ },
+ {
+ "epoch": 5.946835443037974,
+ "grad_norm": 0.038171909749507904,
+ "learning_rate": 4.511784511784512e-05,
+ "loss": 0.025552934035658836,
+ "step": 1177
+ },
+ {
+ "epoch": 5.951898734177215,
+ "grad_norm": 0.0229384396225214,
+ "learning_rate": 4.506172839506173e-05,
+ "loss": 0.016696415841579437,
+ "step": 1178
+ },
+ {
+ "epoch": 5.9569620253164555,
+ "grad_norm": 0.03247852623462677,
+ "learning_rate": 4.500561167227834e-05,
+ "loss": 0.020189210772514343,
+ "step": 1179
+ },
+ {
+ "epoch": 5.962025316455696,
+ "grad_norm": 0.09168937802314758,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.02350265346467495,
+ "step": 1180
+ },
+ {
+ "epoch": 5.9670886075949365,
+ "grad_norm": 0.0498431995511055,
+ "learning_rate": 4.4893378226711566e-05,
+ "loss": 0.025292757898569107,
+ "step": 1181
+ },
+ {
+ "epoch": 5.972151898734177,
+ "grad_norm": 0.027248093858361244,
+ "learning_rate": 4.4837261503928176e-05,
+ "loss": 0.022255534306168556,
+ "step": 1182
+ },
+ {
+ "epoch": 5.977215189873418,
+ "grad_norm": 0.0405442975461483,
+ "learning_rate": 4.4781144781144786e-05,
+ "loss": 0.029488639906048775,
+ "step": 1183
+ },
+ {
+ "epoch": 5.982278481012658,
+ "grad_norm": 0.032689113169908524,
+ "learning_rate": 4.4725028058361396e-05,
+ "loss": 0.02393949031829834,
+ "step": 1184
+ },
+ {
+ "epoch": 5.987341772151899,
+ "grad_norm": 0.0387105718255043,
+ "learning_rate": 4.4668911335578006e-05,
+ "loss": 0.02393876016139984,
+ "step": 1185
+ },
+ {
+ "epoch": 5.992405063291139,
+ "grad_norm": 0.03787006437778473,
+ "learning_rate": 4.4612794612794616e-05,
+ "loss": 0.019787393510341644,
+ "step": 1186
+ },
+ {
+ "epoch": 5.99746835443038,
+ "grad_norm": 0.07046152651309967,
+ "learning_rate": 4.4556677890011226e-05,
+ "loss": 0.02120082452893257,
+ "step": 1187
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.04410094395279884,
+ "learning_rate": 4.4500561167227837e-05,
+ "loss": 0.01791391335427761,
+ "step": 1188
+ },
+ {
+ "epoch": 6.0050632911392405,
+ "grad_norm": 0.01917901448905468,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.01695849373936653,
+ "step": 1189
+ },
+ {
+ "epoch": 6.010126582278481,
+ "grad_norm": 0.036047060042619705,
+ "learning_rate": 4.438832772166106e-05,
+ "loss": 0.019642764702439308,
+ "step": 1190
+ },
+ {
+ "epoch": 6.015189873417722,
+ "grad_norm": 0.03756589815020561,
+ "learning_rate": 4.433221099887767e-05,
+ "loss": 0.01982583850622177,
+ "step": 1191
+ },
+ {
+ "epoch": 6.020253164556962,
+ "grad_norm": 0.04311134293675423,
+ "learning_rate": 4.427609427609428e-05,
+ "loss": 0.020853077992796898,
+ "step": 1192
+ },
+ {
+ "epoch": 6.025316455696203,
+ "grad_norm": 0.03493127599358559,
+ "learning_rate": 4.421997755331089e-05,
+ "loss": 0.022622421383857727,
+ "step": 1193
+ },
+ {
+ "epoch": 6.030379746835443,
+ "grad_norm": 0.05356646701693535,
+ "learning_rate": 4.41638608305275e-05,
+ "loss": 0.029369797557592392,
+ "step": 1194
+ },
+ {
+ "epoch": 6.035443037974684,
+ "grad_norm": 0.024938970804214478,
+ "learning_rate": 4.410774410774411e-05,
+ "loss": 0.02220488339662552,
+ "step": 1195
+ },
+ {
+ "epoch": 6.040506329113924,
+ "grad_norm": 0.03809231147170067,
+ "learning_rate": 4.405162738496072e-05,
+ "loss": 0.018828250467777252,
+ "step": 1196
+ },
+ {
+ "epoch": 6.045569620253165,
+ "grad_norm": 0.026176417246460915,
+ "learning_rate": 4.3995510662177334e-05,
+ "loss": 0.020378272980451584,
+ "step": 1197
+ },
+ {
+ "epoch": 6.050632911392405,
+ "grad_norm": 0.022295907139778137,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.016497395932674408,
+ "step": 1198
+ },
+ {
+ "epoch": 6.055696202531646,
+ "grad_norm": 0.03591796010732651,
+ "learning_rate": 4.3883277216610554e-05,
+ "loss": 0.01610766164958477,
+ "step": 1199
+ },
+ {
+ "epoch": 6.060759493670886,
+ "grad_norm": 0.02228034846484661,
+ "learning_rate": 4.3827160493827164e-05,
+ "loss": 0.016445940360426903,
+ "step": 1200
+ },
+ {
+ "epoch": 6.065822784810127,
+ "grad_norm": 0.046840816736221313,
+ "learning_rate": 4.3771043771043774e-05,
+ "loss": 0.025499895215034485,
+ "step": 1201
+ },
+ {
+ "epoch": 6.0708860759493675,
+ "grad_norm": 0.032549306750297546,
+ "learning_rate": 4.3714927048260384e-05,
+ "loss": 0.019290868192911148,
+ "step": 1202
+ },
+ {
+ "epoch": 6.075949367088608,
+ "grad_norm": 0.027548272162675858,
+ "learning_rate": 4.3658810325476994e-05,
+ "loss": 0.021467119455337524,
+ "step": 1203
+ },
+ {
+ "epoch": 6.0810126582278485,
+ "grad_norm": 0.04975379258394241,
+ "learning_rate": 4.3602693602693604e-05,
+ "loss": 0.025195952504873276,
+ "step": 1204
+ },
+ {
+ "epoch": 6.086075949367088,
+ "grad_norm": 0.033716000616550446,
+ "learning_rate": 4.3546576879910214e-05,
+ "loss": 0.022922039031982422,
+ "step": 1205
+ },
+ {
+ "epoch": 6.091139240506329,
+ "grad_norm": 0.0233322661370039,
+ "learning_rate": 4.3490460157126825e-05,
+ "loss": 0.016717061400413513,
+ "step": 1206
+ },
+ {
+ "epoch": 6.096202531645569,
+ "grad_norm": 0.037477824836969376,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.026978954672813416,
+ "step": 1207
+ },
+ {
+ "epoch": 6.10126582278481,
+ "grad_norm": 0.028440799564123154,
+ "learning_rate": 4.337822671156005e-05,
+ "loss": 0.02273373492062092,
+ "step": 1208
+ },
+ {
+ "epoch": 6.10632911392405,
+ "grad_norm": 0.035822827368974686,
+ "learning_rate": 4.332210998877666e-05,
+ "loss": 0.023257501423358917,
+ "step": 1209
+ },
+ {
+ "epoch": 6.111392405063291,
+ "grad_norm": 0.04019193351268768,
+ "learning_rate": 4.3265993265993265e-05,
+ "loss": 0.023539364337921143,
+ "step": 1210
+ },
+ {
+ "epoch": 6.116455696202531,
+ "grad_norm": 0.05412938818335533,
+ "learning_rate": 4.3209876543209875e-05,
+ "loss": 0.027814611792564392,
+ "step": 1211
+ },
+ {
+ "epoch": 6.121518987341772,
+ "grad_norm": 0.02482062578201294,
+ "learning_rate": 4.3153759820426485e-05,
+ "loss": 0.02218860387802124,
+ "step": 1212
+ },
+ {
+ "epoch": 6.1265822784810124,
+ "grad_norm": 0.0334421806037426,
+ "learning_rate": 4.3097643097643095e-05,
+ "loss": 0.017350582405924797,
+ "step": 1213
+ },
+ {
+ "epoch": 6.131645569620253,
+ "grad_norm": 0.056203264743089676,
+ "learning_rate": 4.304152637485971e-05,
+ "loss": 0.02287295088171959,
+ "step": 1214
+ },
+ {
+ "epoch": 6.1367088607594935,
+ "grad_norm": 0.039818573743104935,
+ "learning_rate": 4.298540965207632e-05,
+ "loss": 0.020514609292149544,
+ "step": 1215
+ },
+ {
+ "epoch": 6.141772151898734,
+ "grad_norm": 0.04640622064471245,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.024438779801130295,
+ "step": 1216
+ },
+ {
+ "epoch": 6.146835443037975,
+ "grad_norm": 0.029660161584615707,
+ "learning_rate": 4.287317620650954e-05,
+ "loss": 0.02020389772951603,
+ "step": 1217
+ },
+ {
+ "epoch": 6.151898734177215,
+ "grad_norm": 0.03027571365237236,
+ "learning_rate": 4.281705948372615e-05,
+ "loss": 0.020769162103533745,
+ "step": 1218
+ },
+ {
+ "epoch": 6.156962025316456,
+ "grad_norm": 0.03282143920660019,
+ "learning_rate": 4.276094276094276e-05,
+ "loss": 0.02164040133357048,
+ "step": 1219
+ },
+ {
+ "epoch": 6.162025316455696,
+ "grad_norm": 0.025130681693553925,
+ "learning_rate": 4.270482603815937e-05,
+ "loss": 0.01677907630801201,
+ "step": 1220
+ },
+ {
+ "epoch": 6.167088607594937,
+ "grad_norm": 0.031690534204244614,
+ "learning_rate": 4.264870931537598e-05,
+ "loss": 0.024241283535957336,
+ "step": 1221
+ },
+ {
+ "epoch": 6.172151898734177,
+ "grad_norm": 0.03872871398925781,
+ "learning_rate": 4.259259259259259e-05,
+ "loss": 0.021466728299856186,
+ "step": 1222
+ },
+ {
+ "epoch": 6.177215189873418,
+ "grad_norm": 0.025186678394675255,
+ "learning_rate": 4.253647586980921e-05,
+ "loss": 0.01849488914012909,
+ "step": 1223
+ },
+ {
+ "epoch": 6.182278481012658,
+ "grad_norm": 0.0362236425280571,
+ "learning_rate": 4.248035914702582e-05,
+ "loss": 0.023382779210805893,
+ "step": 1224
+ },
+ {
+ "epoch": 6.187341772151899,
+ "grad_norm": 0.03484080359339714,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.02402529865503311,
+ "step": 1225
+ },
+ {
+ "epoch": 6.192405063291139,
+ "grad_norm": 0.030236870050430298,
+ "learning_rate": 4.236812570145904e-05,
+ "loss": 0.02027088962495327,
+ "step": 1226
+ },
+ {
+ "epoch": 6.19746835443038,
+ "grad_norm": 0.042696740478277206,
+ "learning_rate": 4.231200897867565e-05,
+ "loss": 0.026293184608221054,
+ "step": 1227
+ },
+ {
+ "epoch": 6.2025316455696204,
+ "grad_norm": 0.033474963158369064,
+ "learning_rate": 4.225589225589226e-05,
+ "loss": 0.0192638598382473,
+ "step": 1228
+ },
+ {
+ "epoch": 6.207594936708861,
+ "grad_norm": 0.02278994210064411,
+ "learning_rate": 4.219977553310887e-05,
+ "loss": 0.016719598323106766,
+ "step": 1229
+ },
+ {
+ "epoch": 6.2126582278481015,
+ "grad_norm": 0.02794811874628067,
+ "learning_rate": 4.214365881032548e-05,
+ "loss": 0.02083922177553177,
+ "step": 1230
+ },
+ {
+ "epoch": 6.217721518987342,
+ "grad_norm": 0.036294132471084595,
+ "learning_rate": 4.208754208754209e-05,
+ "loss": 0.019131788983941078,
+ "step": 1231
+ },
+ {
+ "epoch": 6.222784810126583,
+ "grad_norm": 0.04194558039307594,
+ "learning_rate": 4.20314253647587e-05,
+ "loss": 0.02200900763273239,
+ "step": 1232
+ },
+ {
+ "epoch": 6.227848101265823,
+ "grad_norm": 0.031245706602931023,
+ "learning_rate": 4.197530864197531e-05,
+ "loss": 0.020135007798671722,
+ "step": 1233
+ },
+ {
+ "epoch": 6.232911392405064,
+ "grad_norm": 0.28146594762802124,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.028484351933002472,
+ "step": 1234
+ },
+ {
+ "epoch": 6.237974683544304,
+ "grad_norm": 0.03472084552049637,
+ "learning_rate": 4.186307519640853e-05,
+ "loss": 0.022836994379758835,
+ "step": 1235
+ },
+ {
+ "epoch": 6.243037974683545,
+ "grad_norm": 0.03993033990263939,
+ "learning_rate": 4.180695847362514e-05,
+ "loss": 0.02047956921160221,
+ "step": 1236
+ },
+ {
+ "epoch": 6.248101265822784,
+ "grad_norm": 0.04095892980694771,
+ "learning_rate": 4.175084175084175e-05,
+ "loss": 0.02556988038122654,
+ "step": 1237
+ },
+ {
+ "epoch": 6.253164556962025,
+ "grad_norm": 0.025003930553793907,
+ "learning_rate": 4.169472502805836e-05,
+ "loss": 0.02012123167514801,
+ "step": 1238
+ },
+ {
+ "epoch": 6.258227848101265,
+ "grad_norm": 0.13136205077171326,
+ "learning_rate": 4.163860830527497e-05,
+ "loss": 0.02262711711227894,
+ "step": 1239
+ },
+ {
+ "epoch": 6.263291139240506,
+ "grad_norm": 0.030299177393317223,
+ "learning_rate": 4.158249158249159e-05,
+ "loss": 0.02208639681339264,
+ "step": 1240
+ },
+ {
+ "epoch": 6.2683544303797465,
+ "grad_norm": 0.029313303530216217,
+ "learning_rate": 4.15263748597082e-05,
+ "loss": 0.01897791400551796,
+ "step": 1241
+ },
+ {
+ "epoch": 6.273417721518987,
+ "grad_norm": 0.02532120980322361,
+ "learning_rate": 4.147025813692481e-05,
+ "loss": 0.017832642421126366,
+ "step": 1242
+ },
+ {
+ "epoch": 6.2784810126582276,
+ "grad_norm": 0.03251331299543381,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.018247608095407486,
+ "step": 1243
+ },
+ {
+ "epoch": 6.283544303797468,
+ "grad_norm": 0.022575413808226585,
+ "learning_rate": 4.135802469135803e-05,
+ "loss": 0.018954705446958542,
+ "step": 1244
+ },
+ {
+ "epoch": 6.288607594936709,
+ "grad_norm": 0.039219100028276443,
+ "learning_rate": 4.130190796857464e-05,
+ "loss": 0.024930771440267563,
+ "step": 1245
+ },
+ {
+ "epoch": 6.293670886075949,
+ "grad_norm": 0.0373169481754303,
+ "learning_rate": 4.124579124579125e-05,
+ "loss": 0.01826397515833378,
+ "step": 1246
+ },
+ {
+ "epoch": 6.29873417721519,
+ "grad_norm": 0.027518540620803833,
+ "learning_rate": 4.118967452300786e-05,
+ "loss": 0.019876884296536446,
+ "step": 1247
+ },
+ {
+ "epoch": 6.30379746835443,
+ "grad_norm": 0.0396210178732872,
+ "learning_rate": 4.113355780022447e-05,
+ "loss": 0.025219090282917023,
+ "step": 1248
+ },
+ {
+ "epoch": 6.308860759493671,
+ "grad_norm": 0.08618787676095963,
+ "learning_rate": 4.1077441077441085e-05,
+ "loss": 0.023020410910248756,
+ "step": 1249
+ },
+ {
+ "epoch": 6.313924050632911,
+ "grad_norm": 0.029861560091376305,
+ "learning_rate": 4.1021324354657695e-05,
+ "loss": 0.017338024452328682,
+ "step": 1250
+ },
+ {
+ "epoch": 6.318987341772152,
+ "grad_norm": 0.02950313501060009,
+ "learning_rate": 4.0965207631874305e-05,
+ "loss": 0.02082744613289833,
+ "step": 1251
+ },
+ {
+ "epoch": 6.324050632911392,
+ "grad_norm": 0.04144814610481262,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.022624965757131577,
+ "step": 1252
+ },
+ {
+ "epoch": 6.329113924050633,
+ "grad_norm": 0.026044249534606934,
+ "learning_rate": 4.085297418630752e-05,
+ "loss": 0.021008584648370743,
+ "step": 1253
+ },
+ {
+ "epoch": 6.334177215189873,
+ "grad_norm": 0.022971170023083687,
+ "learning_rate": 4.079685746352413e-05,
+ "loss": 0.017941180616617203,
+ "step": 1254
+ },
+ {
+ "epoch": 6.339240506329114,
+ "grad_norm": 0.06906288862228394,
+ "learning_rate": 4.074074074074074e-05,
+ "loss": 0.028001971542835236,
+ "step": 1255
+ },
+ {
+ "epoch": 6.3443037974683545,
+ "grad_norm": 0.023604001849889755,
+ "learning_rate": 4.068462401795735e-05,
+ "loss": 0.01718234084546566,
+ "step": 1256
+ },
+ {
+ "epoch": 6.349367088607595,
+ "grad_norm": 0.01937725767493248,
+ "learning_rate": 4.0628507295173965e-05,
+ "loss": 0.014251970686018467,
+ "step": 1257
+ },
+ {
+ "epoch": 6.3544303797468356,
+ "grad_norm": 0.029861370101571083,
+ "learning_rate": 4.0572390572390575e-05,
+ "loss": 0.020723488181829453,
+ "step": 1258
+ },
+ {
+ "epoch": 6.359493670886076,
+ "grad_norm": 0.021436452865600586,
+ "learning_rate": 4.0516273849607185e-05,
+ "loss": 0.017737478017807007,
+ "step": 1259
+ },
+ {
+ "epoch": 6.364556962025317,
+ "grad_norm": 0.028320396319031715,
+ "learning_rate": 4.0460157126823795e-05,
+ "loss": 0.018616296350955963,
+ "step": 1260
+ },
+ {
+ "epoch": 6.369620253164557,
+ "grad_norm": 0.06868637353181839,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.021761005744338036,
+ "step": 1261
+ },
+ {
+ "epoch": 6.374683544303798,
+ "grad_norm": 0.051593340933322906,
+ "learning_rate": 4.0347923681257015e-05,
+ "loss": 0.024777185171842575,
+ "step": 1262
+ },
+ {
+ "epoch": 6.379746835443038,
+ "grad_norm": 0.03426795080304146,
+ "learning_rate": 4.0291806958473625e-05,
+ "loss": 0.018097344785928726,
+ "step": 1263
+ },
+ {
+ "epoch": 6.384810126582279,
+ "grad_norm": 0.029523326084017754,
+ "learning_rate": 4.0235690235690236e-05,
+ "loss": 0.021459240466356277,
+ "step": 1264
+ },
+ {
+ "epoch": 6.389873417721519,
+ "grad_norm": 0.0349370501935482,
+ "learning_rate": 4.0179573512906846e-05,
+ "loss": 0.02003314346075058,
+ "step": 1265
+ },
+ {
+ "epoch": 6.39493670886076,
+ "grad_norm": 0.03242987021803856,
+ "learning_rate": 4.012345679012346e-05,
+ "loss": 0.021367881447076797,
+ "step": 1266
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.024630239233374596,
+ "learning_rate": 4.006734006734007e-05,
+ "loss": 0.018102720379829407,
+ "step": 1267
+ },
+ {
+ "epoch": 6.405063291139241,
+ "grad_norm": 0.031077086925506592,
+ "learning_rate": 4.001122334455668e-05,
+ "loss": 0.018588688224554062,
+ "step": 1268
+ },
+ {
+ "epoch": 6.410126582278481,
+ "grad_norm": 0.027421677485108376,
+ "learning_rate": 3.995510662177329e-05,
+ "loss": 0.02185939997434616,
+ "step": 1269
+ },
+ {
+ "epoch": 6.415189873417722,
+ "grad_norm": 0.025877851992845535,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.014880839735269547,
+ "step": 1270
+ },
+ {
+ "epoch": 6.4202531645569625,
+ "grad_norm": 0.06078079342842102,
+ "learning_rate": 3.984287317620651e-05,
+ "loss": 0.020707489922642708,
+ "step": 1271
+ },
+ {
+ "epoch": 6.425316455696202,
+ "grad_norm": 0.037427812814712524,
+ "learning_rate": 3.978675645342312e-05,
+ "loss": 0.019588246941566467,
+ "step": 1272
+ },
+ {
+ "epoch": 6.430379746835443,
+ "grad_norm": 0.021001679822802544,
+ "learning_rate": 3.973063973063973e-05,
+ "loss": 0.01820206455886364,
+ "step": 1273
+ },
+ {
+ "epoch": 6.435443037974683,
+ "grad_norm": 0.05302223563194275,
+ "learning_rate": 3.967452300785634e-05,
+ "loss": 0.028976645320653915,
+ "step": 1274
+ },
+ {
+ "epoch": 6.440506329113924,
+ "grad_norm": 0.021593907848000526,
+ "learning_rate": 3.961840628507295e-05,
+ "loss": 0.018273863941431046,
+ "step": 1275
+ },
+ {
+ "epoch": 6.445569620253164,
+ "grad_norm": 0.05006744712591171,
+ "learning_rate": 3.956228956228956e-05,
+ "loss": 0.020786389708518982,
+ "step": 1276
+ },
+ {
+ "epoch": 6.450632911392405,
+ "grad_norm": 0.025030262768268585,
+ "learning_rate": 3.950617283950617e-05,
+ "loss": 0.017760692164301872,
+ "step": 1277
+ },
+ {
+ "epoch": 6.455696202531645,
+ "grad_norm": 0.04701874032616615,
+ "learning_rate": 3.945005611672278e-05,
+ "loss": 0.029284045100212097,
+ "step": 1278
+ },
+ {
+ "epoch": 6.460759493670886,
+ "grad_norm": 0.032726943492889404,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.02018846571445465,
+ "step": 1279
+ },
+ {
+ "epoch": 6.465822784810126,
+ "grad_norm": 0.039836980402469635,
+ "learning_rate": 3.9337822671156003e-05,
+ "loss": 0.01897161826491356,
+ "step": 1280
+ },
+ {
+ "epoch": 6.470886075949367,
+ "grad_norm": 0.033106207847595215,
+ "learning_rate": 3.9281705948372613e-05,
+ "loss": 0.01981613039970398,
+ "step": 1281
+ },
+ {
+ "epoch": 6.4759493670886075,
+ "grad_norm": 0.024439049884676933,
+ "learning_rate": 3.9225589225589224e-05,
+ "loss": 0.018410254269838333,
+ "step": 1282
+ },
+ {
+ "epoch": 6.481012658227848,
+ "grad_norm": 0.025965489447116852,
+ "learning_rate": 3.916947250280584e-05,
+ "loss": 0.02004053071141243,
+ "step": 1283
+ },
+ {
+ "epoch": 6.4860759493670885,
+ "grad_norm": 0.02710670977830887,
+ "learning_rate": 3.911335578002245e-05,
+ "loss": 0.022794827818870544,
+ "step": 1284
+ },
+ {
+ "epoch": 6.491139240506329,
+ "grad_norm": 0.04063912108540535,
+ "learning_rate": 3.905723905723906e-05,
+ "loss": 0.022095832973718643,
+ "step": 1285
+ },
+ {
+ "epoch": 6.49620253164557,
+ "grad_norm": 0.02844894304871559,
+ "learning_rate": 3.900112233445567e-05,
+ "loss": 0.02208099141716957,
+ "step": 1286
+ },
+ {
+ "epoch": 6.50126582278481,
+ "grad_norm": 0.042183391749858856,
+ "learning_rate": 3.894500561167228e-05,
+ "loss": 0.022891748696565628,
+ "step": 1287
+ },
+ {
+ "epoch": 6.506329113924051,
+ "grad_norm": 0.03206615149974823,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.01791396550834179,
+ "step": 1288
+ },
+ {
+ "epoch": 6.511392405063291,
+ "grad_norm": 0.20604346692562103,
+ "learning_rate": 3.88327721661055e-05,
+ "loss": 0.021381299942731857,
+ "step": 1289
+ },
+ {
+ "epoch": 6.516455696202532,
+ "grad_norm": 0.040892940014600754,
+ "learning_rate": 3.877665544332211e-05,
+ "loss": 0.027452345937490463,
+ "step": 1290
+ },
+ {
+ "epoch": 6.521518987341772,
+ "grad_norm": 0.036108002066612244,
+ "learning_rate": 3.872053872053872e-05,
+ "loss": 0.02328622341156006,
+ "step": 1291
+ },
+ {
+ "epoch": 6.526582278481013,
+ "grad_norm": 0.0261856522411108,
+ "learning_rate": 3.866442199775534e-05,
+ "loss": 0.019690997898578644,
+ "step": 1292
+ },
+ {
+ "epoch": 6.531645569620253,
+ "grad_norm": 0.03961426392197609,
+ "learning_rate": 3.860830527497195e-05,
+ "loss": 0.0222979336977005,
+ "step": 1293
+ },
+ {
+ "epoch": 6.536708860759494,
+ "grad_norm": 0.04051761329174042,
+ "learning_rate": 3.855218855218856e-05,
+ "loss": 0.025474993512034416,
+ "step": 1294
+ },
+ {
+ "epoch": 6.541772151898734,
+ "grad_norm": 0.02267736941576004,
+ "learning_rate": 3.849607182940517e-05,
+ "loss": 0.022006051614880562,
+ "step": 1295
+ },
+ {
+ "epoch": 6.546835443037975,
+ "grad_norm": 0.030732441693544388,
+ "learning_rate": 3.843995510662178e-05,
+ "loss": 0.019268793985247612,
+ "step": 1296
+ },
+ {
+ "epoch": 6.5518987341772155,
+ "grad_norm": 0.028448719531297684,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.022158455103635788,
+ "step": 1297
+ },
+ {
+ "epoch": 6.556962025316456,
+ "grad_norm": 0.03139292076230049,
+ "learning_rate": 3.832772166105499e-05,
+ "loss": 0.022079430520534515,
+ "step": 1298
+ },
+ {
+ "epoch": 6.5620253164556965,
+ "grad_norm": 0.031093589961528778,
+ "learning_rate": 3.82716049382716e-05,
+ "loss": 0.018232567235827446,
+ "step": 1299
+ },
+ {
+ "epoch": 6.567088607594937,
+ "grad_norm": 0.05002875253558159,
+ "learning_rate": 3.821548821548822e-05,
+ "loss": 0.025977667421102524,
+ "step": 1300
+ },
+ {
+ "epoch": 6.572151898734178,
+ "grad_norm": 0.022760825231671333,
+ "learning_rate": 3.815937149270483e-05,
+ "loss": 0.01952279731631279,
+ "step": 1301
+ },
+ {
+ "epoch": 6.577215189873417,
+ "grad_norm": 0.038710758090019226,
+ "learning_rate": 3.810325476992144e-05,
+ "loss": 0.018337469547986984,
+ "step": 1302
+ },
+ {
+ "epoch": 6.582278481012658,
+ "grad_norm": 0.03606388345360756,
+ "learning_rate": 3.804713804713805e-05,
+ "loss": 0.022117454558610916,
+ "step": 1303
+ },
+ {
+ "epoch": 6.587341772151898,
+ "grad_norm": 0.0337548591196537,
+ "learning_rate": 3.799102132435466e-05,
+ "loss": 0.021384209394454956,
+ "step": 1304
+ },
+ {
+ "epoch": 6.592405063291139,
+ "grad_norm": 0.03523571416735649,
+ "learning_rate": 3.793490460157127e-05,
+ "loss": 0.017840903252363205,
+ "step": 1305
+ },
+ {
+ "epoch": 6.597468354430379,
+ "grad_norm": 0.06067586690187454,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.024789758026599884,
+ "step": 1306
+ },
+ {
+ "epoch": 6.60253164556962,
+ "grad_norm": 0.03350597992539406,
+ "learning_rate": 3.782267115600449e-05,
+ "loss": 0.02044159173965454,
+ "step": 1307
+ },
+ {
+ "epoch": 6.6075949367088604,
+ "grad_norm": 0.027923524379730225,
+ "learning_rate": 3.77665544332211e-05,
+ "loss": 0.016555916517972946,
+ "step": 1308
+ },
+ {
+ "epoch": 6.612658227848101,
+ "grad_norm": 0.049295879900455475,
+ "learning_rate": 3.7710437710437716e-05,
+ "loss": 0.02809835597872734,
+ "step": 1309
+ },
+ {
+ "epoch": 6.6177215189873415,
+ "grad_norm": 0.0679546371102333,
+ "learning_rate": 3.7654320987654326e-05,
+ "loss": 0.02421809732913971,
+ "step": 1310
+ },
+ {
+ "epoch": 6.622784810126582,
+ "grad_norm": 0.027567917481064796,
+ "learning_rate": 3.7598204264870936e-05,
+ "loss": 0.020084332674741745,
+ "step": 1311
+ },
+ {
+ "epoch": 6.627848101265823,
+ "grad_norm": 0.04364616423845291,
+ "learning_rate": 3.7542087542087546e-05,
+ "loss": 0.024303186684846878,
+ "step": 1312
+ },
+ {
+ "epoch": 6.632911392405063,
+ "grad_norm": 0.060693949460983276,
+ "learning_rate": 3.7485970819304156e-05,
+ "loss": 0.022462837398052216,
+ "step": 1313
+ },
+ {
+ "epoch": 6.637974683544304,
+ "grad_norm": 0.05344981327652931,
+ "learning_rate": 3.7429854096520766e-05,
+ "loss": 0.02119705080986023,
+ "step": 1314
+ },
+ {
+ "epoch": 6.643037974683544,
+ "grad_norm": 0.04188868775963783,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.02262813225388527,
+ "step": 1315
+ },
+ {
+ "epoch": 6.648101265822785,
+ "grad_norm": 0.10617388039827347,
+ "learning_rate": 3.7317620650953986e-05,
+ "loss": 0.028262268751859665,
+ "step": 1316
+ },
+ {
+ "epoch": 6.653164556962025,
+ "grad_norm": 0.028918985277414322,
+ "learning_rate": 3.7261503928170596e-05,
+ "loss": 0.018603652715682983,
+ "step": 1317
+ },
+ {
+ "epoch": 6.658227848101266,
+ "grad_norm": 0.037515874952077866,
+ "learning_rate": 3.720538720538721e-05,
+ "loss": 0.024647820740938187,
+ "step": 1318
+ },
+ {
+ "epoch": 6.663291139240506,
+ "grad_norm": 0.0347459651529789,
+ "learning_rate": 3.7149270482603816e-05,
+ "loss": 0.024235039949417114,
+ "step": 1319
+ },
+ {
+ "epoch": 6.668354430379747,
+ "grad_norm": 0.04326598346233368,
+ "learning_rate": 3.7093153759820426e-05,
+ "loss": 0.02030426263809204,
+ "step": 1320
+ },
+ {
+ "epoch": 6.673417721518987,
+ "grad_norm": 0.026792412623763084,
+ "learning_rate": 3.7037037037037037e-05,
+ "loss": 0.02184079959988594,
+ "step": 1321
+ },
+ {
+ "epoch": 6.678481012658228,
+ "grad_norm": 0.033112917095422745,
+ "learning_rate": 3.698092031425365e-05,
+ "loss": 0.019945142790675163,
+ "step": 1322
+ },
+ {
+ "epoch": 6.6835443037974684,
+ "grad_norm": 0.031808555126190186,
+ "learning_rate": 3.692480359147026e-05,
+ "loss": 0.024434339255094528,
+ "step": 1323
+ },
+ {
+ "epoch": 6.688607594936709,
+ "grad_norm": 0.03284522145986557,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.017459489405155182,
+ "step": 1324
+ },
+ {
+ "epoch": 6.6936708860759495,
+ "grad_norm": 0.029303887858986855,
+ "learning_rate": 3.681257014590348e-05,
+ "loss": 0.017790818586945534,
+ "step": 1325
+ },
+ {
+ "epoch": 6.69873417721519,
+ "grad_norm": 0.028168147429823875,
+ "learning_rate": 3.6756453423120094e-05,
+ "loss": 0.022105036303400993,
+ "step": 1326
+ },
+ {
+ "epoch": 6.703797468354431,
+ "grad_norm": 0.045645441859960556,
+ "learning_rate": 3.6700336700336704e-05,
+ "loss": 0.0288691483438015,
+ "step": 1327
+ },
+ {
+ "epoch": 6.708860759493671,
+ "grad_norm": 0.02225707843899727,
+ "learning_rate": 3.6644219977553314e-05,
+ "loss": 0.016150090843439102,
+ "step": 1328
+ },
+ {
+ "epoch": 6.713924050632912,
+ "grad_norm": 0.02501208707690239,
+ "learning_rate": 3.6588103254769924e-05,
+ "loss": 0.023236583918333054,
+ "step": 1329
+ },
+ {
+ "epoch": 6.718987341772152,
+ "grad_norm": 0.038911011070013046,
+ "learning_rate": 3.6531986531986534e-05,
+ "loss": 0.025721289217472076,
+ "step": 1330
+ },
+ {
+ "epoch": 6.724050632911393,
+ "grad_norm": 0.036257173866033554,
+ "learning_rate": 3.6475869809203144e-05,
+ "loss": 0.025515632703900337,
+ "step": 1331
+ },
+ {
+ "epoch": 6.729113924050633,
+ "grad_norm": 0.03473728895187378,
+ "learning_rate": 3.6419753086419754e-05,
+ "loss": 0.02300131320953369,
+ "step": 1332
+ },
+ {
+ "epoch": 6.734177215189874,
+ "grad_norm": 0.03154155611991882,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.024625634774565697,
+ "step": 1333
+ },
+ {
+ "epoch": 6.739240506329114,
+ "grad_norm": 0.04241670295596123,
+ "learning_rate": 3.6307519640852974e-05,
+ "loss": 0.021008290350437164,
+ "step": 1334
+ },
+ {
+ "epoch": 6.744303797468355,
+ "grad_norm": 0.027151785790920258,
+ "learning_rate": 3.625140291806959e-05,
+ "loss": 0.021018799394369125,
+ "step": 1335
+ },
+ {
+ "epoch": 6.749367088607595,
+ "grad_norm": 0.026534251868724823,
+ "learning_rate": 3.61952861952862e-05,
+ "loss": 0.018448853865265846,
+ "step": 1336
+ },
+ {
+ "epoch": 6.754430379746836,
+ "grad_norm": 0.02729695476591587,
+ "learning_rate": 3.613916947250281e-05,
+ "loss": 0.022980306297540665,
+ "step": 1337
+ },
+ {
+ "epoch": 6.759493670886076,
+ "grad_norm": 0.023642007261514664,
+ "learning_rate": 3.608305274971942e-05,
+ "loss": 0.019568361341953278,
+ "step": 1338
+ },
+ {
+ "epoch": 6.764556962025316,
+ "grad_norm": 0.03455951064825058,
+ "learning_rate": 3.602693602693603e-05,
+ "loss": 0.019078724086284637,
+ "step": 1339
+ },
+ {
+ "epoch": 6.769620253164557,
+ "grad_norm": 0.02380317822098732,
+ "learning_rate": 3.5970819304152635e-05,
+ "loss": 0.01807081699371338,
+ "step": 1340
+ },
+ {
+ "epoch": 6.774683544303797,
+ "grad_norm": 0.0337495282292366,
+ "learning_rate": 3.5914702581369245e-05,
+ "loss": 0.019128164276480675,
+ "step": 1341
+ },
+ {
+ "epoch": 6.779746835443038,
+ "grad_norm": 0.041405126452445984,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.017617477104067802,
+ "step": 1342
+ },
+ {
+ "epoch": 6.784810126582278,
+ "grad_norm": 0.028542209416627884,
+ "learning_rate": 3.580246913580247e-05,
+ "loss": 0.01781628280878067,
+ "step": 1343
+ },
+ {
+ "epoch": 6.789873417721519,
+ "grad_norm": 0.038718484342098236,
+ "learning_rate": 3.574635241301908e-05,
+ "loss": 0.025421444326639175,
+ "step": 1344
+ },
+ {
+ "epoch": 6.794936708860759,
+ "grad_norm": 0.03298761323094368,
+ "learning_rate": 3.569023569023569e-05,
+ "loss": 0.01900479383766651,
+ "step": 1345
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.024823278188705444,
+ "learning_rate": 3.56341189674523e-05,
+ "loss": 0.021245522424578667,
+ "step": 1346
+ },
+ {
+ "epoch": 6.80506329113924,
+ "grad_norm": 0.0321645587682724,
+ "learning_rate": 3.557800224466891e-05,
+ "loss": 0.01712404564023018,
+ "step": 1347
+ },
+ {
+ "epoch": 6.810126582278481,
+ "grad_norm": 0.03605357185006142,
+ "learning_rate": 3.552188552188552e-05,
+ "loss": 0.02691786363720894,
+ "step": 1348
+ },
+ {
+ "epoch": 6.815189873417721,
+ "grad_norm": 0.03685377910733223,
+ "learning_rate": 3.546576879910213e-05,
+ "loss": 0.02375425398349762,
+ "step": 1349
+ },
+ {
+ "epoch": 6.820253164556962,
+ "grad_norm": 0.022712258622050285,
+ "learning_rate": 3.540965207631874e-05,
+ "loss": 0.016492441296577454,
+ "step": 1350
+ },
+ {
+ "epoch": 6.8253164556962025,
+ "grad_norm": 0.027446497231721878,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.019083943217992783,
+ "step": 1351
+ },
+ {
+ "epoch": 6.830379746835443,
+ "grad_norm": 0.060375552624464035,
+ "learning_rate": 3.529741863075197e-05,
+ "loss": 0.021610641852021217,
+ "step": 1352
+ },
+ {
+ "epoch": 6.8354430379746836,
+ "grad_norm": 0.026175983250141144,
+ "learning_rate": 3.524130190796858e-05,
+ "loss": 0.02164904959499836,
+ "step": 1353
+ },
+ {
+ "epoch": 6.840506329113924,
+ "grad_norm": 0.04348548501729965,
+ "learning_rate": 3.518518518518519e-05,
+ "loss": 0.02257148176431656,
+ "step": 1354
+ },
+ {
+ "epoch": 6.845569620253165,
+ "grad_norm": 0.051051557064056396,
+ "learning_rate": 3.51290684624018e-05,
+ "loss": 0.027986399829387665,
+ "step": 1355
+ },
+ {
+ "epoch": 6.850632911392405,
+ "grad_norm": 0.02255374938249588,
+ "learning_rate": 3.507295173961841e-05,
+ "loss": 0.017260409891605377,
+ "step": 1356
+ },
+ {
+ "epoch": 6.855696202531646,
+ "grad_norm": 0.053478825837373734,
+ "learning_rate": 3.501683501683502e-05,
+ "loss": 0.025036044418811798,
+ "step": 1357
+ },
+ {
+ "epoch": 6.860759493670886,
+ "grad_norm": 0.03688240423798561,
+ "learning_rate": 3.496071829405163e-05,
+ "loss": 0.0243881456553936,
+ "step": 1358
+ },
+ {
+ "epoch": 6.865822784810127,
+ "grad_norm": 0.03860153257846832,
+ "learning_rate": 3.490460157126824e-05,
+ "loss": 0.018570398911833763,
+ "step": 1359
+ },
+ {
+ "epoch": 6.870886075949367,
+ "grad_norm": 0.02771756984293461,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.022013407200574875,
+ "step": 1360
+ },
+ {
+ "epoch": 6.875949367088608,
+ "grad_norm": 0.03359522670507431,
+ "learning_rate": 3.4792368125701466e-05,
+ "loss": 0.024430446326732635,
+ "step": 1361
+ },
+ {
+ "epoch": 6.881012658227848,
+ "grad_norm": 0.028827447444200516,
+ "learning_rate": 3.473625140291807e-05,
+ "loss": 0.018073707818984985,
+ "step": 1362
+ },
+ {
+ "epoch": 6.886075949367089,
+ "grad_norm": 0.03537776693701744,
+ "learning_rate": 3.468013468013468e-05,
+ "loss": 0.022164030000567436,
+ "step": 1363
+ },
+ {
+ "epoch": 6.891139240506329,
+ "grad_norm": 0.029529782012104988,
+ "learning_rate": 3.462401795735129e-05,
+ "loss": 0.02529158815741539,
+ "step": 1364
+ },
+ {
+ "epoch": 6.89620253164557,
+ "grad_norm": 0.026303067803382874,
+ "learning_rate": 3.45679012345679e-05,
+ "loss": 0.019374631345272064,
+ "step": 1365
+ },
+ {
+ "epoch": 6.9012658227848105,
+ "grad_norm": 0.039471473544836044,
+ "learning_rate": 3.451178451178451e-05,
+ "loss": 0.022283609956502914,
+ "step": 1366
+ },
+ {
+ "epoch": 6.90632911392405,
+ "grad_norm": 0.03414482623338699,
+ "learning_rate": 3.445566778900112e-05,
+ "loss": 0.024151155725121498,
+ "step": 1367
+ },
+ {
+ "epoch": 6.911392405063291,
+ "grad_norm": 0.01648244820535183,
+ "learning_rate": 3.439955106621773e-05,
+ "loss": 0.01653912290930748,
+ "step": 1368
+ },
+ {
+ "epoch": 6.916455696202531,
+ "grad_norm": 0.036713164299726486,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.01961999014019966,
+ "step": 1369
+ },
+ {
+ "epoch": 6.921518987341772,
+ "grad_norm": 0.02502237819135189,
+ "learning_rate": 3.428731762065096e-05,
+ "loss": 0.019946709275245667,
+ "step": 1370
+ },
+ {
+ "epoch": 6.926582278481012,
+ "grad_norm": 0.03062540479004383,
+ "learning_rate": 3.423120089786757e-05,
+ "loss": 0.023258816450834274,
+ "step": 1371
+ },
+ {
+ "epoch": 6.931645569620253,
+ "grad_norm": 0.021536799147725105,
+ "learning_rate": 3.417508417508418e-05,
+ "loss": 0.01964723877608776,
+ "step": 1372
+ },
+ {
+ "epoch": 6.936708860759493,
+ "grad_norm": 0.035745471715927124,
+ "learning_rate": 3.411896745230079e-05,
+ "loss": 0.026319682598114014,
+ "step": 1373
+ },
+ {
+ "epoch": 6.941772151898734,
+ "grad_norm": 0.03711705282330513,
+ "learning_rate": 3.40628507295174e-05,
+ "loss": 0.022980816662311554,
+ "step": 1374
+ },
+ {
+ "epoch": 6.946835443037974,
+ "grad_norm": 0.02977835014462471,
+ "learning_rate": 3.400673400673401e-05,
+ "loss": 0.020178712904453278,
+ "step": 1375
+ },
+ {
+ "epoch": 6.951898734177215,
+ "grad_norm": 0.122103750705719,
+ "learning_rate": 3.395061728395062e-05,
+ "loss": 0.028520341962575912,
+ "step": 1376
+ },
+ {
+ "epoch": 6.9569620253164555,
+ "grad_norm": 0.046767886728048325,
+ "learning_rate": 3.389450056116723e-05,
+ "loss": 0.0207063015550375,
+ "step": 1377
+ },
+ {
+ "epoch": 6.962025316455696,
+ "grad_norm": 0.027442077174782753,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.018590064719319344,
+ "step": 1378
+ },
+ {
+ "epoch": 6.9670886075949365,
+ "grad_norm": 0.03202109411358833,
+ "learning_rate": 3.3782267115600454e-05,
+ "loss": 0.0225562434643507,
+ "step": 1379
+ },
+ {
+ "epoch": 6.972151898734177,
+ "grad_norm": 0.024545297026634216,
+ "learning_rate": 3.3726150392817064e-05,
+ "loss": 0.020356591790914536,
+ "step": 1380
+ },
+ {
+ "epoch": 6.977215189873418,
+ "grad_norm": 0.028534026816487312,
+ "learning_rate": 3.3670033670033675e-05,
+ "loss": 0.017728019505739212,
+ "step": 1381
+ },
+ {
+ "epoch": 6.982278481012658,
+ "grad_norm": 0.04066401720046997,
+ "learning_rate": 3.3613916947250285e-05,
+ "loss": 0.02500733733177185,
+ "step": 1382
+ },
+ {
+ "epoch": 6.987341772151899,
+ "grad_norm": 0.03498203679919243,
+ "learning_rate": 3.3557800224466895e-05,
+ "loss": 0.020952323451638222,
+ "step": 1383
+ },
+ {
+ "epoch": 6.992405063291139,
+ "grad_norm": 0.024813339114189148,
+ "learning_rate": 3.35016835016835e-05,
+ "loss": 0.019022852182388306,
+ "step": 1384
+ },
+ {
+ "epoch": 6.99746835443038,
+ "grad_norm": 0.02122138813138008,
+ "learning_rate": 3.3445566778900115e-05,
+ "loss": 0.019452452659606934,
+ "step": 1385
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.025631824508309364,
+ "learning_rate": 3.3389450056116725e-05,
+ "loss": 0.01880500651896,
+ "step": 1386
+ },
+ {
+ "epoch": 7.0050632911392405,
+ "grad_norm": 0.03023305907845497,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.019060317426919937,
+ "step": 1387
+ },
+ {
+ "epoch": 7.010126582278481,
+ "grad_norm": 0.03772016614675522,
+ "learning_rate": 3.3277216610549945e-05,
+ "loss": 0.024812128394842148,
+ "step": 1388
+ },
+ {
+ "epoch": 7.015189873417722,
+ "grad_norm": 0.022726386785507202,
+ "learning_rate": 3.3221099887766555e-05,
+ "loss": 0.016584882512688637,
+ "step": 1389
+ },
+ {
+ "epoch": 7.020253164556962,
+ "grad_norm": 0.034556008875370026,
+ "learning_rate": 3.3164983164983165e-05,
+ "loss": 0.019786395132541656,
+ "step": 1390
+ },
+ {
+ "epoch": 7.025316455696203,
+ "grad_norm": 0.028575370088219643,
+ "learning_rate": 3.3108866442199775e-05,
+ "loss": 0.01822180114686489,
+ "step": 1391
+ },
+ {
+ "epoch": 7.030379746835443,
+ "grad_norm": 0.023528434336185455,
+ "learning_rate": 3.3052749719416385e-05,
+ "loss": 0.020981397479772568,
+ "step": 1392
+ },
+ {
+ "epoch": 7.035443037974684,
+ "grad_norm": 0.022872168570756912,
+ "learning_rate": 3.2996632996632995e-05,
+ "loss": 0.01915448158979416,
+ "step": 1393
+ },
+ {
+ "epoch": 7.040506329113924,
+ "grad_norm": 0.027755601331591606,
+ "learning_rate": 3.2940516273849605e-05,
+ "loss": 0.022184018045663834,
+ "step": 1394
+ },
+ {
+ "epoch": 7.045569620253165,
+ "grad_norm": 0.02798120491206646,
+ "learning_rate": 3.288439955106622e-05,
+ "loss": 0.018451202660799026,
+ "step": 1395
+ },
+ {
+ "epoch": 7.050632911392405,
+ "grad_norm": 0.03338237479329109,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.020784873515367508,
+ "step": 1396
+ },
+ {
+ "epoch": 7.055696202531646,
+ "grad_norm": 0.02282361313700676,
+ "learning_rate": 3.277216610549944e-05,
+ "loss": 0.017811089754104614,
+ "step": 1397
+ },
+ {
+ "epoch": 7.060759493670886,
+ "grad_norm": 0.03505925461649895,
+ "learning_rate": 3.271604938271605e-05,
+ "loss": 0.02735268510878086,
+ "step": 1398
+ },
+ {
+ "epoch": 7.065822784810127,
+ "grad_norm": 0.023442594334483147,
+ "learning_rate": 3.265993265993266e-05,
+ "loss": 0.017855383455753326,
+ "step": 1399
+ },
+ {
+ "epoch": 7.0708860759493675,
+ "grad_norm": 0.028511418029665947,
+ "learning_rate": 3.260381593714927e-05,
+ "loss": 0.01905960589647293,
+ "step": 1400
+ },
+ {
+ "epoch": 7.075949367088608,
+ "grad_norm": 0.027948686853051186,
+ "learning_rate": 3.254769921436588e-05,
+ "loss": 0.019588086754083633,
+ "step": 1401
+ },
+ {
+ "epoch": 7.0810126582278485,
+ "grad_norm": 0.031204944476485252,
+ "learning_rate": 3.249158249158249e-05,
+ "loss": 0.025335699319839478,
+ "step": 1402
+ },
+ {
+ "epoch": 7.086075949367088,
+ "grad_norm": 0.026365051046013832,
+ "learning_rate": 3.24354657687991e-05,
+ "loss": 0.020061418414115906,
+ "step": 1403
+ },
+ {
+ "epoch": 7.091139240506329,
+ "grad_norm": 0.02992449328303337,
+ "learning_rate": 3.237934904601572e-05,
+ "loss": 0.0207480788230896,
+ "step": 1404
+ },
+ {
+ "epoch": 7.096202531645569,
+ "grad_norm": 0.023861777037382126,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.018660075962543488,
+ "step": 1405
+ },
+ {
+ "epoch": 7.10126582278481,
+ "grad_norm": 0.029991189017891884,
+ "learning_rate": 3.226711560044893e-05,
+ "loss": 0.01724623516201973,
+ "step": 1406
+ },
+ {
+ "epoch": 7.10632911392405,
+ "grad_norm": 0.0326378308236599,
+ "learning_rate": 3.221099887766554e-05,
+ "loss": 0.02030283957719803,
+ "step": 1407
+ },
+ {
+ "epoch": 7.111392405063291,
+ "grad_norm": 0.21390174329280853,
+ "learning_rate": 3.215488215488215e-05,
+ "loss": 0.022705763578414917,
+ "step": 1408
+ },
+ {
+ "epoch": 7.116455696202531,
+ "grad_norm": 0.03886239975690842,
+ "learning_rate": 3.209876543209876e-05,
+ "loss": 0.018677497282624245,
+ "step": 1409
+ },
+ {
+ "epoch": 7.121518987341772,
+ "grad_norm": 0.08851044625043869,
+ "learning_rate": 3.204264870931537e-05,
+ "loss": 0.023592950776219368,
+ "step": 1410
+ },
+ {
+ "epoch": 7.1265822784810124,
+ "grad_norm": 0.02696068212389946,
+ "learning_rate": 3.198653198653199e-05,
+ "loss": 0.02084396779537201,
+ "step": 1411
+ },
+ {
+ "epoch": 7.131645569620253,
+ "grad_norm": 0.02673780545592308,
+ "learning_rate": 3.19304152637486e-05,
+ "loss": 0.01957092061638832,
+ "step": 1412
+ },
+ {
+ "epoch": 7.1367088607594935,
+ "grad_norm": 0.027915315702557564,
+ "learning_rate": 3.187429854096521e-05,
+ "loss": 0.017723560333251953,
+ "step": 1413
+ },
+ {
+ "epoch": 7.141772151898734,
+ "grad_norm": 0.03920222446322441,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.025390218943357468,
+ "step": 1414
+ },
+ {
+ "epoch": 7.146835443037975,
+ "grad_norm": 0.0384795181453228,
+ "learning_rate": 3.176206509539843e-05,
+ "loss": 0.01968265138566494,
+ "step": 1415
+ },
+ {
+ "epoch": 7.151898734177215,
+ "grad_norm": 0.035265080630779266,
+ "learning_rate": 3.170594837261504e-05,
+ "loss": 0.024998726323246956,
+ "step": 1416
+ },
+ {
+ "epoch": 7.156962025316456,
+ "grad_norm": 0.029263779520988464,
+ "learning_rate": 3.164983164983165e-05,
+ "loss": 0.020544305443763733,
+ "step": 1417
+ },
+ {
+ "epoch": 7.162025316455696,
+ "grad_norm": 0.04175667464733124,
+ "learning_rate": 3.159371492704826e-05,
+ "loss": 0.019445113837718964,
+ "step": 1418
+ },
+ {
+ "epoch": 7.167088607594937,
+ "grad_norm": 0.041344888508319855,
+ "learning_rate": 3.153759820426487e-05,
+ "loss": 0.02322668954730034,
+ "step": 1419
+ },
+ {
+ "epoch": 7.172151898734177,
+ "grad_norm": 0.03339385986328125,
+ "learning_rate": 3.148148148148148e-05,
+ "loss": 0.023453861474990845,
+ "step": 1420
+ },
+ {
+ "epoch": 7.177215189873418,
+ "grad_norm": 0.07248332351446152,
+ "learning_rate": 3.14253647586981e-05,
+ "loss": 0.02372308447957039,
+ "step": 1421
+ },
+ {
+ "epoch": 7.182278481012658,
+ "grad_norm": 0.03583402931690216,
+ "learning_rate": 3.136924803591471e-05,
+ "loss": 0.021252157166600227,
+ "step": 1422
+ },
+ {
+ "epoch": 7.187341772151899,
+ "grad_norm": 0.035940300673246384,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.02373434416949749,
+ "step": 1423
+ },
+ {
+ "epoch": 7.192405063291139,
+ "grad_norm": 0.037396274507045746,
+ "learning_rate": 3.125701459034793e-05,
+ "loss": 0.021743204444646835,
+ "step": 1424
+ },
+ {
+ "epoch": 7.19746835443038,
+ "grad_norm": 0.03273582085967064,
+ "learning_rate": 3.120089786756454e-05,
+ "loss": 0.021748099476099014,
+ "step": 1425
+ },
+ {
+ "epoch": 7.2025316455696204,
+ "grad_norm": 0.05356048792600632,
+ "learning_rate": 3.114478114478115e-05,
+ "loss": 0.018289824947714806,
+ "step": 1426
+ },
+ {
+ "epoch": 7.207594936708861,
+ "grad_norm": 0.08134915679693222,
+ "learning_rate": 3.108866442199775e-05,
+ "loss": 0.019879773259162903,
+ "step": 1427
+ },
+ {
+ "epoch": 7.2126582278481015,
+ "grad_norm": 0.028759760782122612,
+ "learning_rate": 3.103254769921437e-05,
+ "loss": 0.02021026611328125,
+ "step": 1428
+ },
+ {
+ "epoch": 7.217721518987342,
+ "grad_norm": 0.03647785633802414,
+ "learning_rate": 3.097643097643098e-05,
+ "loss": 0.019807487726211548,
+ "step": 1429
+ },
+ {
+ "epoch": 7.222784810126583,
+ "grad_norm": 0.04302947223186493,
+ "learning_rate": 3.092031425364759e-05,
+ "loss": 0.02610229328274727,
+ "step": 1430
+ },
+ {
+ "epoch": 7.227848101265823,
+ "grad_norm": 0.040028274059295654,
+ "learning_rate": 3.08641975308642e-05,
+ "loss": 0.020702369511127472,
+ "step": 1431
+ },
+ {
+ "epoch": 7.232911392405064,
+ "grad_norm": 0.03221731632947922,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.019945278763771057,
+ "step": 1432
+ },
+ {
+ "epoch": 7.237974683544304,
+ "grad_norm": 0.043122660368680954,
+ "learning_rate": 3.075196408529742e-05,
+ "loss": 0.01944747380912304,
+ "step": 1433
+ },
+ {
+ "epoch": 7.243037974683545,
+ "grad_norm": 0.041211001574993134,
+ "learning_rate": 3.069584736251403e-05,
+ "loss": 0.02140875533223152,
+ "step": 1434
+ },
+ {
+ "epoch": 7.248101265822784,
+ "grad_norm": 0.038251616060733795,
+ "learning_rate": 3.063973063973064e-05,
+ "loss": 0.017319878563284874,
+ "step": 1435
+ },
+ {
+ "epoch": 7.253164556962025,
+ "grad_norm": 0.023718461394309998,
+ "learning_rate": 3.058361391694725e-05,
+ "loss": 0.017003588378429413,
+ "step": 1436
+ },
+ {
+ "epoch": 7.258227848101265,
+ "grad_norm": 0.04274767264723778,
+ "learning_rate": 3.0527497194163865e-05,
+ "loss": 0.022676389664411545,
+ "step": 1437
+ },
+ {
+ "epoch": 7.263291139240506,
+ "grad_norm": 0.05663180723786354,
+ "learning_rate": 3.0471380471380472e-05,
+ "loss": 0.018122078850865364,
+ "step": 1438
+ },
+ {
+ "epoch": 7.2683544303797465,
+ "grad_norm": 0.046230170875787735,
+ "learning_rate": 3.0415263748597082e-05,
+ "loss": 0.02533666044473648,
+ "step": 1439
+ },
+ {
+ "epoch": 7.273417721518987,
+ "grad_norm": 0.029917370527982712,
+ "learning_rate": 3.0359147025813696e-05,
+ "loss": 0.017602022737264633,
+ "step": 1440
+ },
+ {
+ "epoch": 7.2784810126582276,
+ "grad_norm": 0.02992556430399418,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.018274672329425812,
+ "step": 1441
+ },
+ {
+ "epoch": 7.283544303797468,
+ "grad_norm": 0.02617500349879265,
+ "learning_rate": 3.0246913580246916e-05,
+ "loss": 0.01885201409459114,
+ "step": 1442
+ },
+ {
+ "epoch": 7.288607594936709,
+ "grad_norm": 0.065202996134758,
+ "learning_rate": 3.0190796857463526e-05,
+ "loss": 0.026795238256454468,
+ "step": 1443
+ },
+ {
+ "epoch": 7.293670886075949,
+ "grad_norm": 0.03273150697350502,
+ "learning_rate": 3.013468013468014e-05,
+ "loss": 0.021357936784625053,
+ "step": 1444
+ },
+ {
+ "epoch": 7.29873417721519,
+ "grad_norm": 0.024254770949482918,
+ "learning_rate": 3.007856341189675e-05,
+ "loss": 0.018274925649166107,
+ "step": 1445
+ },
+ {
+ "epoch": 7.30379746835443,
+ "grad_norm": 0.03504091128706932,
+ "learning_rate": 3.002244668911336e-05,
+ "loss": 0.02005249634385109,
+ "step": 1446
+ },
+ {
+ "epoch": 7.308860759493671,
+ "grad_norm": 0.03011571802198887,
+ "learning_rate": 2.996632996632997e-05,
+ "loss": 0.02488003298640251,
+ "step": 1447
+ },
+ {
+ "epoch": 7.313924050632911,
+ "grad_norm": 0.027476035058498383,
+ "learning_rate": 2.991021324354658e-05,
+ "loss": 0.01974816992878914,
+ "step": 1448
+ },
+ {
+ "epoch": 7.318987341772152,
+ "grad_norm": 0.026227811351418495,
+ "learning_rate": 2.9854096520763186e-05,
+ "loss": 0.019309503957629204,
+ "step": 1449
+ },
+ {
+ "epoch": 7.324050632911392,
+ "grad_norm": 0.03413211554288864,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.02053218148648739,
+ "step": 1450
+ },
+ {
+ "epoch": 7.329113924050633,
+ "grad_norm": 0.05214853584766388,
+ "learning_rate": 2.9741863075196406e-05,
+ "loss": 0.02286684140563011,
+ "step": 1451
+ },
+ {
+ "epoch": 7.334177215189873,
+ "grad_norm": 0.041933804750442505,
+ "learning_rate": 2.968574635241302e-05,
+ "loss": 0.025886723771691322,
+ "step": 1452
+ },
+ {
+ "epoch": 7.339240506329114,
+ "grad_norm": 0.029031161218881607,
+ "learning_rate": 2.962962962962963e-05,
+ "loss": 0.017816081643104553,
+ "step": 1453
+ },
+ {
+ "epoch": 7.3443037974683545,
+ "grad_norm": 0.02532730996608734,
+ "learning_rate": 2.957351290684624e-05,
+ "loss": 0.017425578087568283,
+ "step": 1454
+ },
+ {
+ "epoch": 7.349367088607595,
+ "grad_norm": 0.02859879471361637,
+ "learning_rate": 2.951739618406285e-05,
+ "loss": 0.02076636254787445,
+ "step": 1455
+ },
+ {
+ "epoch": 7.3544303797468356,
+ "grad_norm": 0.03137378767132759,
+ "learning_rate": 2.946127946127946e-05,
+ "loss": 0.020406391471624374,
+ "step": 1456
+ },
+ {
+ "epoch": 7.359493670886076,
+ "grad_norm": 0.032471053302288055,
+ "learning_rate": 2.9405162738496074e-05,
+ "loss": 0.01692109927535057,
+ "step": 1457
+ },
+ {
+ "epoch": 7.364556962025317,
+ "grad_norm": 0.028477061539888382,
+ "learning_rate": 2.9349046015712684e-05,
+ "loss": 0.020386110991239548,
+ "step": 1458
+ },
+ {
+ "epoch": 7.369620253164557,
+ "grad_norm": 0.022607816383242607,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.01817784458398819,
+ "step": 1459
+ },
+ {
+ "epoch": 7.374683544303798,
+ "grad_norm": 0.023832928389310837,
+ "learning_rate": 2.9236812570145904e-05,
+ "loss": 0.01865188032388687,
+ "step": 1460
+ },
+ {
+ "epoch": 7.379746835443038,
+ "grad_norm": 0.027590278536081314,
+ "learning_rate": 2.9180695847362517e-05,
+ "loss": 0.022126823663711548,
+ "step": 1461
+ },
+ {
+ "epoch": 7.384810126582279,
+ "grad_norm": 0.4172179698944092,
+ "learning_rate": 2.9124579124579127e-05,
+ "loss": 0.022308025509119034,
+ "step": 1462
+ },
+ {
+ "epoch": 7.389873417721519,
+ "grad_norm": 0.026935985311865807,
+ "learning_rate": 2.9068462401795737e-05,
+ "loss": 0.019504904747009277,
+ "step": 1463
+ },
+ {
+ "epoch": 7.39493670886076,
+ "grad_norm": 0.03200481832027435,
+ "learning_rate": 2.9012345679012347e-05,
+ "loss": 0.02669564262032509,
+ "step": 1464
+ },
+ {
+ "epoch": 7.4,
+ "grad_norm": 0.029977383092045784,
+ "learning_rate": 2.8956228956228958e-05,
+ "loss": 0.020015545189380646,
+ "step": 1465
+ },
+ {
+ "epoch": 7.405063291139241,
+ "grad_norm": 0.056856609880924225,
+ "learning_rate": 2.890011223344557e-05,
+ "loss": 0.02192942053079605,
+ "step": 1466
+ },
+ {
+ "epoch": 7.410126582278481,
+ "grad_norm": 0.025086626410484314,
+ "learning_rate": 2.884399551066218e-05,
+ "loss": 0.01919681392610073,
+ "step": 1467
+ },
+ {
+ "epoch": 7.415189873417722,
+ "grad_norm": 0.022608574479818344,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.01909647136926651,
+ "step": 1468
+ },
+ {
+ "epoch": 7.4202531645569625,
+ "grad_norm": 0.034612007439136505,
+ "learning_rate": 2.87317620650954e-05,
+ "loss": 0.01842370256781578,
+ "step": 1469
+ },
+ {
+ "epoch": 7.425316455696202,
+ "grad_norm": 0.06468075513839722,
+ "learning_rate": 2.8675645342312015e-05,
+ "loss": 0.02434670552611351,
+ "step": 1470
+ },
+ {
+ "epoch": 7.430379746835443,
+ "grad_norm": 0.03149627894163132,
+ "learning_rate": 2.8619528619528618e-05,
+ "loss": 0.019917085766792297,
+ "step": 1471
+ },
+ {
+ "epoch": 7.435443037974683,
+ "grad_norm": 0.057844966650009155,
+ "learning_rate": 2.8563411896745228e-05,
+ "loss": 0.024164216592907906,
+ "step": 1472
+ },
+ {
+ "epoch": 7.440506329113924,
+ "grad_norm": 0.026152828708291054,
+ "learning_rate": 2.850729517396184e-05,
+ "loss": 0.01977004110813141,
+ "step": 1473
+ },
+ {
+ "epoch": 7.445569620253164,
+ "grad_norm": 0.02952045202255249,
+ "learning_rate": 2.845117845117845e-05,
+ "loss": 0.017811203375458717,
+ "step": 1474
+ },
+ {
+ "epoch": 7.450632911392405,
+ "grad_norm": 0.04974228888750076,
+ "learning_rate": 2.839506172839506e-05,
+ "loss": 0.02152227610349655,
+ "step": 1475
+ },
+ {
+ "epoch": 7.455696202531645,
+ "grad_norm": 0.031569063663482666,
+ "learning_rate": 2.833894500561167e-05,
+ "loss": 0.01801261678338051,
+ "step": 1476
+ },
+ {
+ "epoch": 7.460759493670886,
+ "grad_norm": 0.027251577004790306,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.019541654735803604,
+ "step": 1477
+ },
+ {
+ "epoch": 7.465822784810126,
+ "grad_norm": 0.05990522354841232,
+ "learning_rate": 2.8226711560044895e-05,
+ "loss": 0.028783954679965973,
+ "step": 1478
+ },
+ {
+ "epoch": 7.470886075949367,
+ "grad_norm": 0.05585836246609688,
+ "learning_rate": 2.8170594837261505e-05,
+ "loss": 0.021160079166293144,
+ "step": 1479
+ },
+ {
+ "epoch": 7.4759493670886075,
+ "grad_norm": 0.07603998482227325,
+ "learning_rate": 2.8114478114478115e-05,
+ "loss": 0.020453037694096565,
+ "step": 1480
+ },
+ {
+ "epoch": 7.481012658227848,
+ "grad_norm": 0.027796803042292595,
+ "learning_rate": 2.8058361391694725e-05,
+ "loss": 0.018019884824752808,
+ "step": 1481
+ },
+ {
+ "epoch": 7.4860759493670885,
+ "grad_norm": 0.03738328441977501,
+ "learning_rate": 2.8002244668911335e-05,
+ "loss": 0.018781842663884163,
+ "step": 1482
+ },
+ {
+ "epoch": 7.491139240506329,
+ "grad_norm": 0.026894861832261086,
+ "learning_rate": 2.794612794612795e-05,
+ "loss": 0.018704136833548546,
+ "step": 1483
+ },
+ {
+ "epoch": 7.49620253164557,
+ "grad_norm": 0.04921836778521538,
+ "learning_rate": 2.789001122334456e-05,
+ "loss": 0.025394737720489502,
+ "step": 1484
+ },
+ {
+ "epoch": 7.50126582278481,
+ "grad_norm": 0.02966165542602539,
+ "learning_rate": 2.783389450056117e-05,
+ "loss": 0.018199149519205093,
+ "step": 1485
+ },
+ {
+ "epoch": 7.506329113924051,
+ "grad_norm": 0.0387556366622448,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.022723186761140823,
+ "step": 1486
+ },
+ {
+ "epoch": 7.511392405063291,
+ "grad_norm": 0.03414534777402878,
+ "learning_rate": 2.7721661054994393e-05,
+ "loss": 0.02049117535352707,
+ "step": 1487
+ },
+ {
+ "epoch": 7.516455696202532,
+ "grad_norm": 0.03540657088160515,
+ "learning_rate": 2.7665544332211003e-05,
+ "loss": 0.016004232689738274,
+ "step": 1488
+ },
+ {
+ "epoch": 7.521518987341772,
+ "grad_norm": 0.02518565021455288,
+ "learning_rate": 2.7609427609427613e-05,
+ "loss": 0.01941412314772606,
+ "step": 1489
+ },
+ {
+ "epoch": 7.526582278481013,
+ "grad_norm": 0.05959590524435043,
+ "learning_rate": 2.7553310886644223e-05,
+ "loss": 0.02951142191886902,
+ "step": 1490
+ },
+ {
+ "epoch": 7.531645569620253,
+ "grad_norm": 0.03249293565750122,
+ "learning_rate": 2.7497194163860833e-05,
+ "loss": 0.017881492152810097,
+ "step": 1491
+ },
+ {
+ "epoch": 7.536708860759494,
+ "grad_norm": 0.03257756307721138,
+ "learning_rate": 2.7441077441077446e-05,
+ "loss": 0.02113383263349533,
+ "step": 1492
+ },
+ {
+ "epoch": 7.541772151898734,
+ "grad_norm": 0.033309679478406906,
+ "learning_rate": 2.738496071829405e-05,
+ "loss": 0.026215262711048126,
+ "step": 1493
+ },
+ {
+ "epoch": 7.546835443037975,
+ "grad_norm": 0.022595476359128952,
+ "learning_rate": 2.732884399551066e-05,
+ "loss": 0.02027580887079239,
+ "step": 1494
+ },
+ {
+ "epoch": 7.5518987341772155,
+ "grad_norm": 0.031081587076187134,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.019502829760313034,
+ "step": 1495
+ },
+ {
+ "epoch": 7.556962025316456,
+ "grad_norm": 0.03038015030324459,
+ "learning_rate": 2.7216610549943883e-05,
+ "loss": 0.01952512189745903,
+ "step": 1496
+ },
+ {
+ "epoch": 7.5620253164556965,
+ "grad_norm": 0.029864326119422913,
+ "learning_rate": 2.7160493827160493e-05,
+ "loss": 0.02026083692908287,
+ "step": 1497
+ },
+ {
+ "epoch": 7.567088607594937,
+ "grad_norm": 0.040809404104948044,
+ "learning_rate": 2.7104377104377103e-05,
+ "loss": 0.026188697665929794,
+ "step": 1498
+ },
+ {
+ "epoch": 7.572151898734178,
+ "grad_norm": 0.023756515234708786,
+ "learning_rate": 2.7048260381593717e-05,
+ "loss": 0.019195934757590294,
+ "step": 1499
+ },
+ {
+ "epoch": 7.577215189873417,
+ "grad_norm": 0.04987863078713417,
+ "learning_rate": 2.6992143658810327e-05,
+ "loss": 0.02136474847793579,
+ "step": 1500
+ },
+ {
+ "epoch": 7.582278481012658,
+ "grad_norm": 0.027713749557733536,
+ "learning_rate": 2.6936026936026937e-05,
+ "loss": 0.01946287602186203,
+ "step": 1501
+ },
+ {
+ "epoch": 7.587341772151898,
+ "grad_norm": 0.039245858788490295,
+ "learning_rate": 2.6879910213243547e-05,
+ "loss": 0.02284877747297287,
+ "step": 1502
+ },
+ {
+ "epoch": 7.592405063291139,
+ "grad_norm": 0.028289446607232094,
+ "learning_rate": 2.6823793490460157e-05,
+ "loss": 0.01939627155661583,
+ "step": 1503
+ },
+ {
+ "epoch": 7.597468354430379,
+ "grad_norm": 0.032388728111982346,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.021464064717292786,
+ "step": 1504
+ },
+ {
+ "epoch": 7.60253164556962,
+ "grad_norm": 0.029117215424776077,
+ "learning_rate": 2.671156004489338e-05,
+ "loss": 0.021073060110211372,
+ "step": 1505
+ },
+ {
+ "epoch": 7.6075949367088604,
+ "grad_norm": 0.041485581547021866,
+ "learning_rate": 2.665544332210999e-05,
+ "loss": 0.022546250373125076,
+ "step": 1506
+ },
+ {
+ "epoch": 7.612658227848101,
+ "grad_norm": 0.03320342302322388,
+ "learning_rate": 2.65993265993266e-05,
+ "loss": 0.026163101196289062,
+ "step": 1507
+ },
+ {
+ "epoch": 7.6177215189873415,
+ "grad_norm": 0.021322058513760567,
+ "learning_rate": 2.654320987654321e-05,
+ "loss": 0.015460850670933723,
+ "step": 1508
+ },
+ {
+ "epoch": 7.622784810126582,
+ "grad_norm": 0.029875705018639565,
+ "learning_rate": 2.6487093153759824e-05,
+ "loss": 0.017766594886779785,
+ "step": 1509
+ },
+ {
+ "epoch": 7.627848101265823,
+ "grad_norm": 0.02629193477332592,
+ "learning_rate": 2.6430976430976434e-05,
+ "loss": 0.019405700266361237,
+ "step": 1510
+ },
+ {
+ "epoch": 7.632911392405063,
+ "grad_norm": 0.027344992384314537,
+ "learning_rate": 2.6374859708193044e-05,
+ "loss": 0.021626925095915794,
+ "step": 1511
+ },
+ {
+ "epoch": 7.637974683544304,
+ "grad_norm": 0.03218991681933403,
+ "learning_rate": 2.6318742985409654e-05,
+ "loss": 0.025306588038802147,
+ "step": 1512
+ },
+ {
+ "epoch": 7.643037974683544,
+ "grad_norm": 0.03371857479214668,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.02218639850616455,
+ "step": 1513
+ },
+ {
+ "epoch": 7.648101265822785,
+ "grad_norm": 0.033074695616960526,
+ "learning_rate": 2.620650953984287e-05,
+ "loss": 0.022175181657075882,
+ "step": 1514
+ },
+ {
+ "epoch": 7.653164556962025,
+ "grad_norm": 0.040838733315467834,
+ "learning_rate": 2.615039281705948e-05,
+ "loss": 0.024300530552864075,
+ "step": 1515
+ },
+ {
+ "epoch": 7.658227848101266,
+ "grad_norm": 0.04166492819786072,
+ "learning_rate": 2.6094276094276095e-05,
+ "loss": 0.023746581748127937,
+ "step": 1516
+ },
+ {
+ "epoch": 7.663291139240506,
+ "grad_norm": 0.024037878960371017,
+ "learning_rate": 2.6038159371492705e-05,
+ "loss": 0.014877275563776493,
+ "step": 1517
+ },
+ {
+ "epoch": 7.668354430379747,
+ "grad_norm": 0.027796877548098564,
+ "learning_rate": 2.5982042648709315e-05,
+ "loss": 0.020726773887872696,
+ "step": 1518
+ },
+ {
+ "epoch": 7.673417721518987,
+ "grad_norm": 0.027635321021080017,
+ "learning_rate": 2.5925925925925925e-05,
+ "loss": 0.01928134821355343,
+ "step": 1519
+ },
+ {
+ "epoch": 7.678481012658228,
+ "grad_norm": 0.03595967963337898,
+ "learning_rate": 2.5869809203142535e-05,
+ "loss": 0.021230777725577354,
+ "step": 1520
+ },
+ {
+ "epoch": 7.6835443037974684,
+ "grad_norm": 0.027645453810691833,
+ "learning_rate": 2.581369248035915e-05,
+ "loss": 0.020900100469589233,
+ "step": 1521
+ },
+ {
+ "epoch": 7.688607594936709,
+ "grad_norm": 0.026998694986104965,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.01859203726053238,
+ "step": 1522
+ },
+ {
+ "epoch": 7.6936708860759495,
+ "grad_norm": 0.03182216361165047,
+ "learning_rate": 2.570145903479237e-05,
+ "loss": 0.01927625760436058,
+ "step": 1523
+ },
+ {
+ "epoch": 7.69873417721519,
+ "grad_norm": 0.04432869702577591,
+ "learning_rate": 2.564534231200898e-05,
+ "loss": 0.020073015242815018,
+ "step": 1524
+ },
+ {
+ "epoch": 7.703797468354431,
+ "grad_norm": 0.03800998628139496,
+ "learning_rate": 2.5589225589225592e-05,
+ "loss": 0.0257626473903656,
+ "step": 1525
+ },
+ {
+ "epoch": 7.708860759493671,
+ "grad_norm": 0.03346885368227959,
+ "learning_rate": 2.5533108866442202e-05,
+ "loss": 0.020997589454054832,
+ "step": 1526
+ },
+ {
+ "epoch": 7.713924050632912,
+ "grad_norm": 0.031936272978782654,
+ "learning_rate": 2.5476992143658812e-05,
+ "loss": 0.018775295466184616,
+ "step": 1527
+ },
+ {
+ "epoch": 7.718987341772152,
+ "grad_norm": 0.038017526268959045,
+ "learning_rate": 2.5420875420875422e-05,
+ "loss": 0.023845292627811432,
+ "step": 1528
+ },
+ {
+ "epoch": 7.724050632911393,
+ "grad_norm": 0.0348825678229332,
+ "learning_rate": 2.5364758698092032e-05,
+ "loss": 0.018793366849422455,
+ "step": 1529
+ },
+ {
+ "epoch": 7.729113924050633,
+ "grad_norm": 0.040639717131853104,
+ "learning_rate": 2.5308641975308646e-05,
+ "loss": 0.02135619707405567,
+ "step": 1530
+ },
+ {
+ "epoch": 7.734177215189874,
+ "grad_norm": 0.03508064150810242,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.01841862127184868,
+ "step": 1531
+ },
+ {
+ "epoch": 7.739240506329114,
+ "grad_norm": 0.028800271451473236,
+ "learning_rate": 2.5196408529741866e-05,
+ "loss": 0.017473943531513214,
+ "step": 1532
+ },
+ {
+ "epoch": 7.744303797468355,
+ "grad_norm": 0.03582684323191643,
+ "learning_rate": 2.5140291806958476e-05,
+ "loss": 0.026108454912900925,
+ "step": 1533
+ },
+ {
+ "epoch": 7.749367088607595,
+ "grad_norm": 0.02528059482574463,
+ "learning_rate": 2.5084175084175086e-05,
+ "loss": 0.022859979420900345,
+ "step": 1534
+ },
+ {
+ "epoch": 7.754430379746836,
+ "grad_norm": 0.04829512536525726,
+ "learning_rate": 2.50280583613917e-05,
+ "loss": 0.027691150084137917,
+ "step": 1535
+ },
+ {
+ "epoch": 7.759493670886076,
+ "grad_norm": 0.050450246781110764,
+ "learning_rate": 2.4971941638608306e-05,
+ "loss": 0.022913554683327675,
+ "step": 1536
+ },
+ {
+ "epoch": 7.764556962025316,
+ "grad_norm": 0.045245204120874405,
+ "learning_rate": 2.4915824915824916e-05,
+ "loss": 0.02299308404326439,
+ "step": 1537
+ },
+ {
+ "epoch": 7.769620253164557,
+ "grad_norm": 0.041785869747400284,
+ "learning_rate": 2.485970819304153e-05,
+ "loss": 0.019534088671207428,
+ "step": 1538
+ },
+ {
+ "epoch": 7.774683544303797,
+ "grad_norm": 0.02439288981258869,
+ "learning_rate": 2.480359147025814e-05,
+ "loss": 0.017930708825588226,
+ "step": 1539
+ },
+ {
+ "epoch": 7.779746835443038,
+ "grad_norm": 0.08324351161718369,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.028837718069553375,
+ "step": 1540
+ },
+ {
+ "epoch": 7.784810126582278,
+ "grad_norm": 0.04910506680607796,
+ "learning_rate": 2.4691358024691357e-05,
+ "loss": 0.023599382489919662,
+ "step": 1541
+ },
+ {
+ "epoch": 7.789873417721519,
+ "grad_norm": 0.02449595369398594,
+ "learning_rate": 2.463524130190797e-05,
+ "loss": 0.017761975526809692,
+ "step": 1542
+ },
+ {
+ "epoch": 7.794936708860759,
+ "grad_norm": 0.07905204594135284,
+ "learning_rate": 2.457912457912458e-05,
+ "loss": 0.017839400097727776,
+ "step": 1543
+ },
+ {
+ "epoch": 7.8,
+ "grad_norm": 0.030506471171975136,
+ "learning_rate": 2.452300785634119e-05,
+ "loss": 0.021404195576906204,
+ "step": 1544
+ },
+ {
+ "epoch": 7.80506329113924,
+ "grad_norm": 0.03580015152692795,
+ "learning_rate": 2.44668911335578e-05,
+ "loss": 0.023948010057210922,
+ "step": 1545
+ },
+ {
+ "epoch": 7.810126582278481,
+ "grad_norm": 0.027275504544377327,
+ "learning_rate": 2.441077441077441e-05,
+ "loss": 0.01799733377993107,
+ "step": 1546
+ },
+ {
+ "epoch": 7.815189873417721,
+ "grad_norm": 0.032968342304229736,
+ "learning_rate": 2.4354657687991024e-05,
+ "loss": 0.020244449377059937,
+ "step": 1547
+ },
+ {
+ "epoch": 7.820253164556962,
+ "grad_norm": 0.04385100305080414,
+ "learning_rate": 2.4298540965207634e-05,
+ "loss": 0.022481925785541534,
+ "step": 1548
+ },
+ {
+ "epoch": 7.8253164556962025,
+ "grad_norm": 0.038451679050922394,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.01878458261489868,
+ "step": 1549
+ },
+ {
+ "epoch": 7.830379746835443,
+ "grad_norm": 0.033544667065143585,
+ "learning_rate": 2.4186307519640854e-05,
+ "loss": 0.016049742698669434,
+ "step": 1550
+ },
+ {
+ "epoch": 7.8354430379746836,
+ "grad_norm": 0.03697581961750984,
+ "learning_rate": 2.4130190796857467e-05,
+ "loss": 0.020224547013640404,
+ "step": 1551
+ },
+ {
+ "epoch": 7.840506329113924,
+ "grad_norm": 0.029879426583647728,
+ "learning_rate": 2.4074074074074074e-05,
+ "loss": 0.020256631076335907,
+ "step": 1552
+ },
+ {
+ "epoch": 7.845569620253165,
+ "grad_norm": 0.04084770381450653,
+ "learning_rate": 2.4017957351290684e-05,
+ "loss": 0.020736820995807648,
+ "step": 1553
+ },
+ {
+ "epoch": 7.850632911392405,
+ "grad_norm": 0.03414049744606018,
+ "learning_rate": 2.3961840628507294e-05,
+ "loss": 0.019767913967370987,
+ "step": 1554
+ },
+ {
+ "epoch": 7.855696202531646,
+ "grad_norm": 0.039317626506090164,
+ "learning_rate": 2.3905723905723908e-05,
+ "loss": 0.018381286412477493,
+ "step": 1555
+ },
+ {
+ "epoch": 7.860759493670886,
+ "grad_norm": 0.031546756625175476,
+ "learning_rate": 2.3849607182940518e-05,
+ "loss": 0.02302321046590805,
+ "step": 1556
+ },
+ {
+ "epoch": 7.865822784810127,
+ "grad_norm": 0.029209598898887634,
+ "learning_rate": 2.3793490460157128e-05,
+ "loss": 0.018067756667733192,
+ "step": 1557
+ },
+ {
+ "epoch": 7.870886075949367,
+ "grad_norm": 0.051513414829969406,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.022878596559166908,
+ "step": 1558
+ },
+ {
+ "epoch": 7.875949367088608,
+ "grad_norm": 0.03623906150460243,
+ "learning_rate": 2.3681257014590348e-05,
+ "loss": 0.023763731122016907,
+ "step": 1559
+ },
+ {
+ "epoch": 7.881012658227848,
+ "grad_norm": 0.07554662227630615,
+ "learning_rate": 2.362514029180696e-05,
+ "loss": 0.030443711206316948,
+ "step": 1560
+ },
+ {
+ "epoch": 7.886075949367089,
+ "grad_norm": 0.0360538624227047,
+ "learning_rate": 2.356902356902357e-05,
+ "loss": 0.021874116733670235,
+ "step": 1561
+ },
+ {
+ "epoch": 7.891139240506329,
+ "grad_norm": 0.047155726701021194,
+ "learning_rate": 2.351290684624018e-05,
+ "loss": 0.019587252289056778,
+ "step": 1562
+ },
+ {
+ "epoch": 7.89620253164557,
+ "grad_norm": 0.04118090867996216,
+ "learning_rate": 2.345679012345679e-05,
+ "loss": 0.019452955573797226,
+ "step": 1563
+ },
+ {
+ "epoch": 7.9012658227848105,
+ "grad_norm": 0.04445638135075569,
+ "learning_rate": 2.34006734006734e-05,
+ "loss": 0.021509487181901932,
+ "step": 1564
+ },
+ {
+ "epoch": 7.90632911392405,
+ "grad_norm": 0.035687156021595,
+ "learning_rate": 2.3344556677890012e-05,
+ "loss": 0.0197590384632349,
+ "step": 1565
+ },
+ {
+ "epoch": 7.911392405063291,
+ "grad_norm": 0.0370895117521286,
+ "learning_rate": 2.3288439955106622e-05,
+ "loss": 0.02165234461426735,
+ "step": 1566
+ },
+ {
+ "epoch": 7.916455696202531,
+ "grad_norm": 0.047829173505306244,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.02411428466439247,
+ "step": 1567
+ },
+ {
+ "epoch": 7.921518987341772,
+ "grad_norm": 0.04207474738359451,
+ "learning_rate": 2.3176206509539845e-05,
+ "loss": 0.01990335062146187,
+ "step": 1568
+ },
+ {
+ "epoch": 7.926582278481012,
+ "grad_norm": 0.03687848150730133,
+ "learning_rate": 2.3120089786756455e-05,
+ "loss": 0.019368968904018402,
+ "step": 1569
+ },
+ {
+ "epoch": 7.931645569620253,
+ "grad_norm": 0.05300358310341835,
+ "learning_rate": 2.3063973063973065e-05,
+ "loss": 0.023623181506991386,
+ "step": 1570
+ },
+ {
+ "epoch": 7.936708860759493,
+ "grad_norm": 0.03355899825692177,
+ "learning_rate": 2.3007856341189676e-05,
+ "loss": 0.020780185237526894,
+ "step": 1571
+ },
+ {
+ "epoch": 7.941772151898734,
+ "grad_norm": 0.03521987795829773,
+ "learning_rate": 2.2951739618406286e-05,
+ "loss": 0.02071826532483101,
+ "step": 1572
+ },
+ {
+ "epoch": 7.946835443037974,
+ "grad_norm": 0.055831391364336014,
+ "learning_rate": 2.28956228956229e-05,
+ "loss": 0.024928733706474304,
+ "step": 1573
+ },
+ {
+ "epoch": 7.951898734177215,
+ "grad_norm": 0.035024408251047134,
+ "learning_rate": 2.2839506172839506e-05,
+ "loss": 0.025659071281552315,
+ "step": 1574
+ },
+ {
+ "epoch": 7.9569620253164555,
+ "grad_norm": 0.02845335751771927,
+ "learning_rate": 2.2783389450056116e-05,
+ "loss": 0.019141599535942078,
+ "step": 1575
+ },
+ {
+ "epoch": 7.962025316455696,
+ "grad_norm": 0.04973668232560158,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.019758496433496475,
+ "step": 1576
+ },
+ {
+ "epoch": 7.9670886075949365,
+ "grad_norm": 0.03656197339296341,
+ "learning_rate": 2.267115600448934e-05,
+ "loss": 0.02074349671602249,
+ "step": 1577
+ },
+ {
+ "epoch": 7.972151898734177,
+ "grad_norm": 0.02872154489159584,
+ "learning_rate": 2.261503928170595e-05,
+ "loss": 0.021470116451382637,
+ "step": 1578
+ },
+ {
+ "epoch": 7.977215189873418,
+ "grad_norm": 0.0539005771279335,
+ "learning_rate": 2.255892255892256e-05,
+ "loss": 0.02254091575741768,
+ "step": 1579
+ },
+ {
+ "epoch": 7.982278481012658,
+ "grad_norm": 0.02891739085316658,
+ "learning_rate": 2.250280583613917e-05,
+ "loss": 0.021109875291585922,
+ "step": 1580
+ },
+ {
+ "epoch": 7.987341772151899,
+ "grad_norm": 0.04463773965835571,
+ "learning_rate": 2.2446689113355783e-05,
+ "loss": 0.01814463920891285,
+ "step": 1581
+ },
+ {
+ "epoch": 7.992405063291139,
+ "grad_norm": 0.02977980673313141,
+ "learning_rate": 2.2390572390572393e-05,
+ "loss": 0.019279852509498596,
+ "step": 1582
+ },
+ {
+ "epoch": 7.99746835443038,
+ "grad_norm": 0.05468489229679108,
+ "learning_rate": 2.2334455667789003e-05,
+ "loss": 0.02706337347626686,
+ "step": 1583
+ },
+ {
+ "epoch": 8.0,
+ "grad_norm": 0.039158184081315994,
+ "learning_rate": 2.2278338945005613e-05,
+ "loss": 0.019180098548531532,
+ "step": 1584
+ },
+ {
+ "epoch": 8.00506329113924,
+ "grad_norm": 0.03874150663614273,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.02349966950714588,
+ "step": 1585
+ },
+ {
+ "epoch": 8.010126582278481,
+ "grad_norm": 0.028303006663918495,
+ "learning_rate": 2.2166105499438833e-05,
+ "loss": 0.020042207092046738,
+ "step": 1586
+ },
+ {
+ "epoch": 8.015189873417722,
+ "grad_norm": 0.027012774720788002,
+ "learning_rate": 2.2109988776655443e-05,
+ "loss": 0.01871410757303238,
+ "step": 1587
+ },
+ {
+ "epoch": 8.020253164556962,
+ "grad_norm": 0.0347730778157711,
+ "learning_rate": 2.2053872053872053e-05,
+ "loss": 0.023310858756303787,
+ "step": 1588
+ },
+ {
+ "epoch": 8.025316455696203,
+ "grad_norm": 0.033759064972400665,
+ "learning_rate": 2.1997755331088667e-05,
+ "loss": 0.02006402425467968,
+ "step": 1589
+ },
+ {
+ "epoch": 8.030379746835443,
+ "grad_norm": 0.043490003794431686,
+ "learning_rate": 2.1941638608305277e-05,
+ "loss": 0.02252586930990219,
+ "step": 1590
+ },
+ {
+ "epoch": 8.035443037974684,
+ "grad_norm": 0.02826276421546936,
+ "learning_rate": 2.1885521885521887e-05,
+ "loss": 0.017057735472917557,
+ "step": 1591
+ },
+ {
+ "epoch": 8.040506329113924,
+ "grad_norm": 0.03614484891295433,
+ "learning_rate": 2.1829405162738497e-05,
+ "loss": 0.019878169521689415,
+ "step": 1592
+ },
+ {
+ "epoch": 8.045569620253165,
+ "grad_norm": 0.0442340224981308,
+ "learning_rate": 2.1773288439955107e-05,
+ "loss": 0.021510383114218712,
+ "step": 1593
+ },
+ {
+ "epoch": 8.050632911392405,
+ "grad_norm": 0.03986986726522446,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.02094593085348606,
+ "step": 1594
+ },
+ {
+ "epoch": 8.055696202531646,
+ "grad_norm": 0.027924973517656326,
+ "learning_rate": 2.166105499438833e-05,
+ "loss": 0.016089333221316338,
+ "step": 1595
+ },
+ {
+ "epoch": 8.060759493670886,
+ "grad_norm": 0.03711482137441635,
+ "learning_rate": 2.1604938271604937e-05,
+ "loss": 0.01916680298745632,
+ "step": 1596
+ },
+ {
+ "epoch": 8.065822784810127,
+ "grad_norm": 0.03245445713400841,
+ "learning_rate": 2.1548821548821547e-05,
+ "loss": 0.018280092626810074,
+ "step": 1597
+ },
+ {
+ "epoch": 8.070886075949367,
+ "grad_norm": 0.03527464717626572,
+ "learning_rate": 2.149270482603816e-05,
+ "loss": 0.01857042871415615,
+ "step": 1598
+ },
+ {
+ "epoch": 8.075949367088608,
+ "grad_norm": 0.04572213441133499,
+ "learning_rate": 2.143658810325477e-05,
+ "loss": 0.019725468009710312,
+ "step": 1599
+ },
+ {
+ "epoch": 8.081012658227849,
+ "grad_norm": 0.052677255123853683,
+ "learning_rate": 2.138047138047138e-05,
+ "loss": 0.020236564800143242,
+ "step": 1600
+ },
+ {
+ "epoch": 8.086075949367089,
+ "grad_norm": 0.038237541913986206,
+ "learning_rate": 2.132435465768799e-05,
+ "loss": 0.02289256826043129,
+ "step": 1601
+ },
+ {
+ "epoch": 8.09113924050633,
+ "grad_norm": 0.04814478009939194,
+ "learning_rate": 2.1268237934904605e-05,
+ "loss": 0.023208077996969223,
+ "step": 1602
+ },
+ {
+ "epoch": 8.09620253164557,
+ "grad_norm": 0.03882291167974472,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.016750838607549667,
+ "step": 1603
+ },
+ {
+ "epoch": 8.10126582278481,
+ "grad_norm": 0.03828950598835945,
+ "learning_rate": 2.1156004489337825e-05,
+ "loss": 0.02248811535537243,
+ "step": 1604
+ },
+ {
+ "epoch": 8.106329113924051,
+ "grad_norm": 0.051767073571681976,
+ "learning_rate": 2.1099887766554435e-05,
+ "loss": 0.020300567150115967,
+ "step": 1605
+ },
+ {
+ "epoch": 8.111392405063292,
+ "grad_norm": 0.03202275186777115,
+ "learning_rate": 2.1043771043771045e-05,
+ "loss": 0.020990904420614243,
+ "step": 1606
+ },
+ {
+ "epoch": 8.116455696202532,
+ "grad_norm": 0.03568022698163986,
+ "learning_rate": 2.0987654320987655e-05,
+ "loss": 0.020043212920427322,
+ "step": 1607
+ },
+ {
+ "epoch": 8.121518987341773,
+ "grad_norm": 0.042120713740587234,
+ "learning_rate": 2.0931537598204265e-05,
+ "loss": 0.018924225121736526,
+ "step": 1608
+ },
+ {
+ "epoch": 8.126582278481013,
+ "grad_norm": 0.07374672591686249,
+ "learning_rate": 2.0875420875420875e-05,
+ "loss": 0.023183997720479965,
+ "step": 1609
+ },
+ {
+ "epoch": 8.131645569620254,
+ "grad_norm": 0.048076704144477844,
+ "learning_rate": 2.0819304152637485e-05,
+ "loss": 0.022698618471622467,
+ "step": 1610
+ },
+ {
+ "epoch": 8.136708860759494,
+ "grad_norm": 0.0357067808508873,
+ "learning_rate": 2.07631874298541e-05,
+ "loss": 0.019262734800577164,
+ "step": 1611
+ },
+ {
+ "epoch": 8.141772151898735,
+ "grad_norm": 0.03643433377146721,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.019496144726872444,
+ "step": 1612
+ },
+ {
+ "epoch": 8.146835443037975,
+ "grad_norm": 0.037579167634248734,
+ "learning_rate": 2.065095398428732e-05,
+ "loss": 0.021149439737200737,
+ "step": 1613
+ },
+ {
+ "epoch": 8.151898734177216,
+ "grad_norm": 0.045883674174547195,
+ "learning_rate": 2.059483726150393e-05,
+ "loss": 0.018761437386274338,
+ "step": 1614
+ },
+ {
+ "epoch": 8.156962025316457,
+ "grad_norm": 0.0358751118183136,
+ "learning_rate": 2.0538720538720542e-05,
+ "loss": 0.017815619707107544,
+ "step": 1615
+ },
+ {
+ "epoch": 8.162025316455697,
+ "grad_norm": 0.02891910821199417,
+ "learning_rate": 2.0482603815937152e-05,
+ "loss": 0.019915573298931122,
+ "step": 1616
+ },
+ {
+ "epoch": 8.167088607594938,
+ "grad_norm": 0.04840585216879845,
+ "learning_rate": 2.042648709315376e-05,
+ "loss": 0.02655443549156189,
+ "step": 1617
+ },
+ {
+ "epoch": 8.172151898734176,
+ "grad_norm": 0.03741428256034851,
+ "learning_rate": 2.037037037037037e-05,
+ "loss": 0.02237093076109886,
+ "step": 1618
+ },
+ {
+ "epoch": 8.177215189873417,
+ "grad_norm": 0.03736718371510506,
+ "learning_rate": 2.0314253647586983e-05,
+ "loss": 0.021470289677381516,
+ "step": 1619
+ },
+ {
+ "epoch": 8.182278481012657,
+ "grad_norm": 0.034190185368061066,
+ "learning_rate": 2.0258136924803593e-05,
+ "loss": 0.01896979846060276,
+ "step": 1620
+ },
+ {
+ "epoch": 8.187341772151898,
+ "grad_norm": 0.05405646190047264,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.025164462625980377,
+ "step": 1621
+ },
+ {
+ "epoch": 8.192405063291138,
+ "grad_norm": 0.03861319646239281,
+ "learning_rate": 2.0145903479236813e-05,
+ "loss": 0.019382188096642494,
+ "step": 1622
+ },
+ {
+ "epoch": 8.197468354430379,
+ "grad_norm": 0.03321823850274086,
+ "learning_rate": 2.0089786756453423e-05,
+ "loss": 0.019713260233402252,
+ "step": 1623
+ },
+ {
+ "epoch": 8.20253164556962,
+ "grad_norm": 0.06996209919452667,
+ "learning_rate": 2.0033670033670036e-05,
+ "loss": 0.02416607365012169,
+ "step": 1624
+ },
+ {
+ "epoch": 8.20759493670886,
+ "grad_norm": 0.029993634670972824,
+ "learning_rate": 1.9977553310886646e-05,
+ "loss": 0.02143584005534649,
+ "step": 1625
+ },
+ {
+ "epoch": 8.2126582278481,
+ "grad_norm": 0.04937511682510376,
+ "learning_rate": 1.9921436588103256e-05,
+ "loss": 0.028348810970783234,
+ "step": 1626
+ },
+ {
+ "epoch": 8.217721518987341,
+ "grad_norm": 0.04342762380838394,
+ "learning_rate": 1.9865319865319866e-05,
+ "loss": 0.015720611438155174,
+ "step": 1627
+ },
+ {
+ "epoch": 8.222784810126582,
+ "grad_norm": 0.045899055898189545,
+ "learning_rate": 1.9809203142536477e-05,
+ "loss": 0.026816781610250473,
+ "step": 1628
+ },
+ {
+ "epoch": 8.227848101265822,
+ "grad_norm": 0.040222615003585815,
+ "learning_rate": 1.9753086419753087e-05,
+ "loss": 0.022753147408366203,
+ "step": 1629
+ },
+ {
+ "epoch": 8.232911392405063,
+ "grad_norm": 0.09004436433315277,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.020190425217151642,
+ "step": 1630
+ },
+ {
+ "epoch": 8.237974683544303,
+ "grad_norm": 0.02380538359284401,
+ "learning_rate": 1.9640852974186307e-05,
+ "loss": 0.018503259867429733,
+ "step": 1631
+ },
+ {
+ "epoch": 8.243037974683544,
+ "grad_norm": 0.027618510648608208,
+ "learning_rate": 1.958473625140292e-05,
+ "loss": 0.017995689064264297,
+ "step": 1632
+ },
+ {
+ "epoch": 8.248101265822784,
+ "grad_norm": 0.030420871451497078,
+ "learning_rate": 1.952861952861953e-05,
+ "loss": 0.014693077653646469,
+ "step": 1633
+ },
+ {
+ "epoch": 8.253164556962025,
+ "grad_norm": 0.04113646596670151,
+ "learning_rate": 1.947250280583614e-05,
+ "loss": 0.01770118996500969,
+ "step": 1634
+ },
+ {
+ "epoch": 8.258227848101265,
+ "grad_norm": 0.045156482607126236,
+ "learning_rate": 1.941638608305275e-05,
+ "loss": 0.020409928634762764,
+ "step": 1635
+ },
+ {
+ "epoch": 8.263291139240506,
+ "grad_norm": 0.04830678552389145,
+ "learning_rate": 1.936026936026936e-05,
+ "loss": 0.018951844424009323,
+ "step": 1636
+ },
+ {
+ "epoch": 8.268354430379746,
+ "grad_norm": 0.06338296085596085,
+ "learning_rate": 1.9304152637485974e-05,
+ "loss": 0.023953819647431374,
+ "step": 1637
+ },
+ {
+ "epoch": 8.273417721518987,
+ "grad_norm": 0.038997847586870193,
+ "learning_rate": 1.9248035914702584e-05,
+ "loss": 0.020438311621546745,
+ "step": 1638
+ },
+ {
+ "epoch": 8.278481012658228,
+ "grad_norm": 0.030472544953227043,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.02027466520667076,
+ "step": 1639
+ },
+ {
+ "epoch": 8.283544303797468,
+ "grad_norm": 0.03637097775936127,
+ "learning_rate": 1.91358024691358e-05,
+ "loss": 0.018772058188915253,
+ "step": 1640
+ },
+ {
+ "epoch": 8.288607594936709,
+ "grad_norm": 0.036580171436071396,
+ "learning_rate": 1.9079685746352414e-05,
+ "loss": 0.018405672162771225,
+ "step": 1641
+ },
+ {
+ "epoch": 8.29367088607595,
+ "grad_norm": 0.044952355325222015,
+ "learning_rate": 1.9023569023569024e-05,
+ "loss": 0.0315709188580513,
+ "step": 1642
+ },
+ {
+ "epoch": 8.29873417721519,
+ "grad_norm": 0.04381463676691055,
+ "learning_rate": 1.8967452300785634e-05,
+ "loss": 0.025517355650663376,
+ "step": 1643
+ },
+ {
+ "epoch": 8.30379746835443,
+ "grad_norm": 0.03697361797094345,
+ "learning_rate": 1.8911335578002244e-05,
+ "loss": 0.01883242279291153,
+ "step": 1644
+ },
+ {
+ "epoch": 8.30886075949367,
+ "grad_norm": 0.025049922987818718,
+ "learning_rate": 1.8855218855218858e-05,
+ "loss": 0.01739310473203659,
+ "step": 1645
+ },
+ {
+ "epoch": 8.313924050632911,
+ "grad_norm": 0.04703689366579056,
+ "learning_rate": 1.8799102132435468e-05,
+ "loss": 0.021556306630373,
+ "step": 1646
+ },
+ {
+ "epoch": 8.318987341772152,
+ "grad_norm": 0.026696166023612022,
+ "learning_rate": 1.8742985409652078e-05,
+ "loss": 0.018746083602309227,
+ "step": 1647
+ },
+ {
+ "epoch": 8.324050632911392,
+ "grad_norm": 0.04652746394276619,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.026190966367721558,
+ "step": 1648
+ },
+ {
+ "epoch": 8.329113924050633,
+ "grad_norm": 0.03909657150506973,
+ "learning_rate": 1.8630751964085298e-05,
+ "loss": 0.01834474503993988,
+ "step": 1649
+ },
+ {
+ "epoch": 8.334177215189873,
+ "grad_norm": 0.03401157632470131,
+ "learning_rate": 1.8574635241301908e-05,
+ "loss": 0.02036638930439949,
+ "step": 1650
+ },
+ {
+ "epoch": 8.339240506329114,
+ "grad_norm": 0.03521033748984337,
+ "learning_rate": 1.8518518518518518e-05,
+ "loss": 0.017022229731082916,
+ "step": 1651
+ },
+ {
+ "epoch": 8.344303797468354,
+ "grad_norm": 0.035023730248212814,
+ "learning_rate": 1.846240179573513e-05,
+ "loss": 0.020699895918369293,
+ "step": 1652
+ },
+ {
+ "epoch": 8.349367088607595,
+ "grad_norm": 0.03863868862390518,
+ "learning_rate": 1.840628507295174e-05,
+ "loss": 0.023510808125138283,
+ "step": 1653
+ },
+ {
+ "epoch": 8.354430379746836,
+ "grad_norm": 0.02204951085150242,
+ "learning_rate": 1.8350168350168352e-05,
+ "loss": 0.018996592611074448,
+ "step": 1654
+ },
+ {
+ "epoch": 8.359493670886076,
+ "grad_norm": 0.03648384287953377,
+ "learning_rate": 1.8294051627384962e-05,
+ "loss": 0.020242292433977127,
+ "step": 1655
+ },
+ {
+ "epoch": 8.364556962025317,
+ "grad_norm": 0.02552957460284233,
+ "learning_rate": 1.8237934904601572e-05,
+ "loss": 0.01911015436053276,
+ "step": 1656
+ },
+ {
+ "epoch": 8.369620253164557,
+ "grad_norm": 0.03243561089038849,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.016632333397865295,
+ "step": 1657
+ },
+ {
+ "epoch": 8.374683544303798,
+ "grad_norm": 0.03896692395210266,
+ "learning_rate": 1.8125701459034796e-05,
+ "loss": 0.021029481664299965,
+ "step": 1658
+ },
+ {
+ "epoch": 8.379746835443038,
+ "grad_norm": 0.05999606102705002,
+ "learning_rate": 1.8069584736251406e-05,
+ "loss": 0.025573844090104103,
+ "step": 1659
+ },
+ {
+ "epoch": 8.384810126582279,
+ "grad_norm": 0.025940202176570892,
+ "learning_rate": 1.8013468013468016e-05,
+ "loss": 0.016936955973505974,
+ "step": 1660
+ },
+ {
+ "epoch": 8.38987341772152,
+ "grad_norm": 0.026151031255722046,
+ "learning_rate": 1.7957351290684622e-05,
+ "loss": 0.01887635514140129,
+ "step": 1661
+ },
+ {
+ "epoch": 8.39493670886076,
+ "grad_norm": 0.0342579111456871,
+ "learning_rate": 1.7901234567901236e-05,
+ "loss": 0.01805766299366951,
+ "step": 1662
+ },
+ {
+ "epoch": 8.4,
+ "grad_norm": 0.02385263331234455,
+ "learning_rate": 1.7845117845117846e-05,
+ "loss": 0.016147712245583534,
+ "step": 1663
+ },
+ {
+ "epoch": 8.405063291139241,
+ "grad_norm": 0.031331419944763184,
+ "learning_rate": 1.7789001122334456e-05,
+ "loss": 0.021235540509223938,
+ "step": 1664
+ },
+ {
+ "epoch": 8.410126582278481,
+ "grad_norm": 0.04477498680353165,
+ "learning_rate": 1.7732884399551066e-05,
+ "loss": 0.026890354230999947,
+ "step": 1665
+ },
+ {
+ "epoch": 8.415189873417722,
+ "grad_norm": 0.022508280351758003,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.01546957716345787,
+ "step": 1666
+ },
+ {
+ "epoch": 8.420253164556962,
+ "grad_norm": 0.02612249366939068,
+ "learning_rate": 1.762065095398429e-05,
+ "loss": 0.018115274608135223,
+ "step": 1667
+ },
+ {
+ "epoch": 8.425316455696203,
+ "grad_norm": 0.03443365916609764,
+ "learning_rate": 1.75645342312009e-05,
+ "loss": 0.02186448872089386,
+ "step": 1668
+ },
+ {
+ "epoch": 8.430379746835444,
+ "grad_norm": 0.0335167795419693,
+ "learning_rate": 1.750841750841751e-05,
+ "loss": 0.022555597126483917,
+ "step": 1669
+ },
+ {
+ "epoch": 8.435443037974684,
+ "grad_norm": 0.043306734412908554,
+ "learning_rate": 1.745230078563412e-05,
+ "loss": 0.023090258240699768,
+ "step": 1670
+ },
+ {
+ "epoch": 8.440506329113925,
+ "grad_norm": 0.045756179839372635,
+ "learning_rate": 1.7396184062850733e-05,
+ "loss": 0.02251247689127922,
+ "step": 1671
+ },
+ {
+ "epoch": 8.445569620253165,
+ "grad_norm": 0.04961887747049332,
+ "learning_rate": 1.734006734006734e-05,
+ "loss": 0.023708034306764603,
+ "step": 1672
+ },
+ {
+ "epoch": 8.450632911392406,
+ "grad_norm": 0.03879154846072197,
+ "learning_rate": 1.728395061728395e-05,
+ "loss": 0.019672028720378876,
+ "step": 1673
+ },
+ {
+ "epoch": 8.455696202531646,
+ "grad_norm": 0.030347641557455063,
+ "learning_rate": 1.722783389450056e-05,
+ "loss": 0.01895594596862793,
+ "step": 1674
+ },
+ {
+ "epoch": 8.460759493670887,
+ "grad_norm": 0.05273548886179924,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.026300976052880287,
+ "step": 1675
+ },
+ {
+ "epoch": 8.465822784810127,
+ "grad_norm": 0.021372321993112564,
+ "learning_rate": 1.7115600448933784e-05,
+ "loss": 0.01731477677822113,
+ "step": 1676
+ },
+ {
+ "epoch": 8.470886075949368,
+ "grad_norm": 0.03678557649254799,
+ "learning_rate": 1.7059483726150394e-05,
+ "loss": 0.020638134330511093,
+ "step": 1677
+ },
+ {
+ "epoch": 8.475949367088608,
+ "grad_norm": 0.020072737708687782,
+ "learning_rate": 1.7003367003367004e-05,
+ "loss": 0.016518577933311462,
+ "step": 1678
+ },
+ {
+ "epoch": 8.481012658227849,
+ "grad_norm": 0.035935647785663605,
+ "learning_rate": 1.6947250280583614e-05,
+ "loss": 0.02194409817457199,
+ "step": 1679
+ },
+ {
+ "epoch": 8.48607594936709,
+ "grad_norm": 0.03272787109017372,
+ "learning_rate": 1.6891133557800227e-05,
+ "loss": 0.021359751001000404,
+ "step": 1680
+ },
+ {
+ "epoch": 8.49113924050633,
+ "grad_norm": 0.024064186960458755,
+ "learning_rate": 1.6835016835016837e-05,
+ "loss": 0.020910244435071945,
+ "step": 1681
+ },
+ {
+ "epoch": 8.496202531645569,
+ "grad_norm": 0.07355224341154099,
+ "learning_rate": 1.6778900112233447e-05,
+ "loss": 0.023593805730342865,
+ "step": 1682
+ },
+ {
+ "epoch": 8.50126582278481,
+ "grad_norm": 0.04556228592991829,
+ "learning_rate": 1.6722783389450057e-05,
+ "loss": 0.023713823407888412,
+ "step": 1683
+ },
+ {
+ "epoch": 8.50632911392405,
+ "grad_norm": 0.022360576316714287,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.015103806741535664,
+ "step": 1684
+ },
+ {
+ "epoch": 8.51139240506329,
+ "grad_norm": 0.024630824103951454,
+ "learning_rate": 1.6610549943883278e-05,
+ "loss": 0.01824590191245079,
+ "step": 1685
+ },
+ {
+ "epoch": 8.51645569620253,
+ "grad_norm": 0.02524208277463913,
+ "learning_rate": 1.6554433221099888e-05,
+ "loss": 0.01721012592315674,
+ "step": 1686
+ },
+ {
+ "epoch": 8.521518987341771,
+ "grad_norm": 0.043577272444963455,
+ "learning_rate": 1.6498316498316498e-05,
+ "loss": 0.02484818734228611,
+ "step": 1687
+ },
+ {
+ "epoch": 8.526582278481012,
+ "grad_norm": 0.040581341832876205,
+ "learning_rate": 1.644219977553311e-05,
+ "loss": 0.020861376076936722,
+ "step": 1688
+ },
+ {
+ "epoch": 8.531645569620252,
+ "grad_norm": 0.043159108608961105,
+ "learning_rate": 1.638608305274972e-05,
+ "loss": 0.024222414940595627,
+ "step": 1689
+ },
+ {
+ "epoch": 8.536708860759493,
+ "grad_norm": 0.032750554382801056,
+ "learning_rate": 1.632996632996633e-05,
+ "loss": 0.021366942673921585,
+ "step": 1690
+ },
+ {
+ "epoch": 8.541772151898734,
+ "grad_norm": 0.06848470121622086,
+ "learning_rate": 1.627384960718294e-05,
+ "loss": 0.02088351361453533,
+ "step": 1691
+ },
+ {
+ "epoch": 8.546835443037974,
+ "grad_norm": 0.018929218873381615,
+ "learning_rate": 1.621773288439955e-05,
+ "loss": 0.01409424189478159,
+ "step": 1692
+ },
+ {
+ "epoch": 8.551898734177215,
+ "grad_norm": 0.0196766946464777,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.015851899981498718,
+ "step": 1693
+ },
+ {
+ "epoch": 8.556962025316455,
+ "grad_norm": 0.04986285790801048,
+ "learning_rate": 1.610549943883277e-05,
+ "loss": 0.02252126857638359,
+ "step": 1694
+ },
+ {
+ "epoch": 8.562025316455696,
+ "grad_norm": 0.036650970578193665,
+ "learning_rate": 1.604938271604938e-05,
+ "loss": 0.025080909952521324,
+ "step": 1695
+ },
+ {
+ "epoch": 8.567088607594936,
+ "grad_norm": 0.06662989407777786,
+ "learning_rate": 1.5993265993265995e-05,
+ "loss": 0.017443537712097168,
+ "step": 1696
+ },
+ {
+ "epoch": 8.572151898734177,
+ "grad_norm": 0.033134326338768005,
+ "learning_rate": 1.5937149270482605e-05,
+ "loss": 0.01927754282951355,
+ "step": 1697
+ },
+ {
+ "epoch": 8.577215189873417,
+ "grad_norm": 0.03530196473002434,
+ "learning_rate": 1.5881032547699215e-05,
+ "loss": 0.017344174906611443,
+ "step": 1698
+ },
+ {
+ "epoch": 8.582278481012658,
+ "grad_norm": 0.04167468845844269,
+ "learning_rate": 1.5824915824915825e-05,
+ "loss": 0.017574958503246307,
+ "step": 1699
+ },
+ {
+ "epoch": 8.587341772151898,
+ "grad_norm": 0.03879455849528313,
+ "learning_rate": 1.5768799102132435e-05,
+ "loss": 0.022970087826251984,
+ "step": 1700
+ },
+ {
+ "epoch": 8.592405063291139,
+ "grad_norm": 0.039318036288022995,
+ "learning_rate": 1.571268237934905e-05,
+ "loss": 0.023542512208223343,
+ "step": 1701
+ },
+ {
+ "epoch": 8.59746835443038,
+ "grad_norm": 0.04210037738084793,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.020435117185115814,
+ "step": 1702
+ },
+ {
+ "epoch": 8.60253164556962,
+ "grad_norm": 0.05356878042221069,
+ "learning_rate": 1.560044893378227e-05,
+ "loss": 0.029099322855472565,
+ "step": 1703
+ },
+ {
+ "epoch": 8.60759493670886,
+ "grad_norm": 0.04548292234539986,
+ "learning_rate": 1.5544332210998876e-05,
+ "loss": 0.02403360977768898,
+ "step": 1704
+ },
+ {
+ "epoch": 8.612658227848101,
+ "grad_norm": 0.058599721640348434,
+ "learning_rate": 1.548821548821549e-05,
+ "loss": 0.019631415605545044,
+ "step": 1705
+ },
+ {
+ "epoch": 8.617721518987342,
+ "grad_norm": 0.048964597284793854,
+ "learning_rate": 1.54320987654321e-05,
+ "loss": 0.02591722458600998,
+ "step": 1706
+ },
+ {
+ "epoch": 8.622784810126582,
+ "grad_norm": 0.03341981768608093,
+ "learning_rate": 1.537598204264871e-05,
+ "loss": 0.01625223457813263,
+ "step": 1707
+ },
+ {
+ "epoch": 8.627848101265823,
+ "grad_norm": 0.04235633835196495,
+ "learning_rate": 1.531986531986532e-05,
+ "loss": 0.02332795225083828,
+ "step": 1708
+ },
+ {
+ "epoch": 8.632911392405063,
+ "grad_norm": 0.04729039594531059,
+ "learning_rate": 1.5263748597081933e-05,
+ "loss": 0.026190035045146942,
+ "step": 1709
+ },
+ {
+ "epoch": 8.637974683544304,
+ "grad_norm": 0.049981195479631424,
+ "learning_rate": 1.5207631874298541e-05,
+ "loss": 0.01922479085624218,
+ "step": 1710
+ },
+ {
+ "epoch": 8.643037974683544,
+ "grad_norm": 0.035248979926109314,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 0.01900644041597843,
+ "step": 1711
+ },
+ {
+ "epoch": 8.648101265822785,
+ "grad_norm": 0.026077786460518837,
+ "learning_rate": 1.5095398428731763e-05,
+ "loss": 0.01419617235660553,
+ "step": 1712
+ },
+ {
+ "epoch": 8.653164556962025,
+ "grad_norm": 0.03994458541274071,
+ "learning_rate": 1.5039281705948375e-05,
+ "loss": 0.020943276584148407,
+ "step": 1713
+ },
+ {
+ "epoch": 8.658227848101266,
+ "grad_norm": 0.040251314640045166,
+ "learning_rate": 1.4983164983164985e-05,
+ "loss": 0.018465735018253326,
+ "step": 1714
+ },
+ {
+ "epoch": 8.663291139240506,
+ "grad_norm": 0.057643208652734756,
+ "learning_rate": 1.4927048260381593e-05,
+ "loss": 0.02323145791888237,
+ "step": 1715
+ },
+ {
+ "epoch": 8.668354430379747,
+ "grad_norm": 0.035218413919210434,
+ "learning_rate": 1.4870931537598203e-05,
+ "loss": 0.021585840731859207,
+ "step": 1716
+ },
+ {
+ "epoch": 8.673417721518987,
+ "grad_norm": 0.046144526451826096,
+ "learning_rate": 1.4814814814814815e-05,
+ "loss": 0.02442515268921852,
+ "step": 1717
+ },
+ {
+ "epoch": 8.678481012658228,
+ "grad_norm": 0.04745814576745033,
+ "learning_rate": 1.4758698092031425e-05,
+ "loss": 0.02154768817126751,
+ "step": 1718
+ },
+ {
+ "epoch": 8.683544303797468,
+ "grad_norm": 0.04004049673676491,
+ "learning_rate": 1.4702581369248037e-05,
+ "loss": 0.02032260037958622,
+ "step": 1719
+ },
+ {
+ "epoch": 8.688607594936709,
+ "grad_norm": 0.049177829176187515,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 0.02218678593635559,
+ "step": 1720
+ },
+ {
+ "epoch": 8.69367088607595,
+ "grad_norm": 0.0472177118062973,
+ "learning_rate": 1.4590347923681259e-05,
+ "loss": 0.02500525861978531,
+ "step": 1721
+ },
+ {
+ "epoch": 8.69873417721519,
+ "grad_norm": 0.025222698226571083,
+ "learning_rate": 1.4534231200897869e-05,
+ "loss": 0.016689050942659378,
+ "step": 1722
+ },
+ {
+ "epoch": 8.70379746835443,
+ "grad_norm": 0.031236030161380768,
+ "learning_rate": 1.4478114478114479e-05,
+ "loss": 0.018756099045276642,
+ "step": 1723
+ },
+ {
+ "epoch": 8.708860759493671,
+ "grad_norm": 0.05628811568021774,
+ "learning_rate": 1.442199775533109e-05,
+ "loss": 0.02265356108546257,
+ "step": 1724
+ },
+ {
+ "epoch": 8.713924050632912,
+ "grad_norm": 0.04260335490107536,
+ "learning_rate": 1.43658810325477e-05,
+ "loss": 0.01870463788509369,
+ "step": 1725
+ },
+ {
+ "epoch": 8.718987341772152,
+ "grad_norm": 0.040789660066366196,
+ "learning_rate": 1.4309764309764309e-05,
+ "loss": 0.01859685778617859,
+ "step": 1726
+ },
+ {
+ "epoch": 8.724050632911393,
+ "grad_norm": 0.048222146928310394,
+ "learning_rate": 1.425364758698092e-05,
+ "loss": 0.021515006199479103,
+ "step": 1727
+ },
+ {
+ "epoch": 8.729113924050633,
+ "grad_norm": 0.04557273909449577,
+ "learning_rate": 1.419753086419753e-05,
+ "loss": 0.01895933598279953,
+ "step": 1728
+ },
+ {
+ "epoch": 8.734177215189874,
+ "grad_norm": 0.03032032586634159,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.017313968390226364,
+ "step": 1729
+ },
+ {
+ "epoch": 8.739240506329114,
+ "grad_norm": 0.03724924474954605,
+ "learning_rate": 1.4085297418630753e-05,
+ "loss": 0.019865073263645172,
+ "step": 1730
+ },
+ {
+ "epoch": 8.744303797468355,
+ "grad_norm": 0.03196002170443535,
+ "learning_rate": 1.4029180695847363e-05,
+ "loss": 0.01838015392422676,
+ "step": 1731
+ },
+ {
+ "epoch": 8.749367088607595,
+ "grad_norm": 0.04037972912192345,
+ "learning_rate": 1.3973063973063974e-05,
+ "loss": 0.018499307334423065,
+ "step": 1732
+ },
+ {
+ "epoch": 8.754430379746836,
+ "grad_norm": 0.0446816124022007,
+ "learning_rate": 1.3916947250280585e-05,
+ "loss": 0.023477882146835327,
+ "step": 1733
+ },
+ {
+ "epoch": 8.759493670886076,
+ "grad_norm": 0.05564434453845024,
+ "learning_rate": 1.3860830527497196e-05,
+ "loss": 0.02302028052508831,
+ "step": 1734
+ },
+ {
+ "epoch": 8.764556962025317,
+ "grad_norm": 0.05366382375359535,
+ "learning_rate": 1.3804713804713806e-05,
+ "loss": 0.019608285278081894,
+ "step": 1735
+ },
+ {
+ "epoch": 8.769620253164558,
+ "grad_norm": 0.026229161769151688,
+ "learning_rate": 1.3748597081930416e-05,
+ "loss": 0.017702946439385414,
+ "step": 1736
+ },
+ {
+ "epoch": 8.774683544303798,
+ "grad_norm": 0.043612100183963776,
+ "learning_rate": 1.3692480359147025e-05,
+ "loss": 0.024102207273244858,
+ "step": 1737
+ },
+ {
+ "epoch": 8.779746835443039,
+ "grad_norm": 0.06441514939069748,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.018779249861836433,
+ "step": 1738
+ },
+ {
+ "epoch": 8.784810126582279,
+ "grad_norm": 0.033235881477594376,
+ "learning_rate": 1.3580246913580247e-05,
+ "loss": 0.021414864808321,
+ "step": 1739
+ },
+ {
+ "epoch": 8.78987341772152,
+ "grad_norm": 0.06340032815933228,
+ "learning_rate": 1.3524130190796858e-05,
+ "loss": 0.028709903359413147,
+ "step": 1740
+ },
+ {
+ "epoch": 8.79493670886076,
+ "grad_norm": 0.04297724738717079,
+ "learning_rate": 1.3468013468013468e-05,
+ "loss": 0.017328426241874695,
+ "step": 1741
+ },
+ {
+ "epoch": 8.8,
+ "grad_norm": 0.05757950246334076,
+ "learning_rate": 1.3411896745230079e-05,
+ "loss": 0.020599257200956345,
+ "step": 1742
+ },
+ {
+ "epoch": 8.805063291139241,
+ "grad_norm": 0.04797070473432541,
+ "learning_rate": 1.335578002244669e-05,
+ "loss": 0.021628066897392273,
+ "step": 1743
+ },
+ {
+ "epoch": 8.810126582278482,
+ "grad_norm": 0.02652834728360176,
+ "learning_rate": 1.32996632996633e-05,
+ "loss": 0.01941632851958275,
+ "step": 1744
+ },
+ {
+ "epoch": 8.815189873417722,
+ "grad_norm": 0.03820030018687248,
+ "learning_rate": 1.3243546576879912e-05,
+ "loss": 0.026358280330896378,
+ "step": 1745
+ },
+ {
+ "epoch": 8.820253164556963,
+ "grad_norm": 0.043385930359363556,
+ "learning_rate": 1.3187429854096522e-05,
+ "loss": 0.019407518208026886,
+ "step": 1746
+ },
+ {
+ "epoch": 8.825316455696203,
+ "grad_norm": 0.15225189924240112,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.026875533163547516,
+ "step": 1747
+ },
+ {
+ "epoch": 8.830379746835444,
+ "grad_norm": 0.0693509504199028,
+ "learning_rate": 1.307519640852974e-05,
+ "loss": 0.031278014183044434,
+ "step": 1748
+ },
+ {
+ "epoch": 8.835443037974684,
+ "grad_norm": 0.039454419165849686,
+ "learning_rate": 1.3019079685746352e-05,
+ "loss": 0.022833138704299927,
+ "step": 1749
+ },
+ {
+ "epoch": 8.840506329113925,
+ "grad_norm": 0.05326049402356148,
+ "learning_rate": 1.2962962962962962e-05,
+ "loss": 0.020145760849118233,
+ "step": 1750
+ },
+ {
+ "epoch": 8.845569620253164,
+ "grad_norm": 0.054488569498062134,
+ "learning_rate": 1.2906846240179574e-05,
+ "loss": 0.020528502762317657,
+ "step": 1751
+ },
+ {
+ "epoch": 8.850632911392404,
+ "grad_norm": 0.03178486227989197,
+ "learning_rate": 1.2850729517396184e-05,
+ "loss": 0.019795618951320648,
+ "step": 1752
+ },
+ {
+ "epoch": 8.855696202531645,
+ "grad_norm": 0.03832017630338669,
+ "learning_rate": 1.2794612794612796e-05,
+ "loss": 0.021070487797260284,
+ "step": 1753
+ },
+ {
+ "epoch": 8.860759493670885,
+ "grad_norm": 0.034100815653800964,
+ "learning_rate": 1.2738496071829406e-05,
+ "loss": 0.02188778668642044,
+ "step": 1754
+ },
+ {
+ "epoch": 8.865822784810126,
+ "grad_norm": 0.04417391121387482,
+ "learning_rate": 1.2682379349046016e-05,
+ "loss": 0.02592797949910164,
+ "step": 1755
+ },
+ {
+ "epoch": 8.870886075949366,
+ "grad_norm": 0.04168103262782097,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 0.0172443687915802,
+ "step": 1756
+ },
+ {
+ "epoch": 8.875949367088607,
+ "grad_norm": 0.05162866413593292,
+ "learning_rate": 1.2570145903479238e-05,
+ "loss": 0.026856279000639915,
+ "step": 1757
+ },
+ {
+ "epoch": 8.881012658227847,
+ "grad_norm": 0.04332068935036659,
+ "learning_rate": 1.251402918069585e-05,
+ "loss": 0.019132032990455627,
+ "step": 1758
+ },
+ {
+ "epoch": 8.886075949367088,
+ "grad_norm": 0.05732255056500435,
+ "learning_rate": 1.2457912457912458e-05,
+ "loss": 0.02246692404150963,
+ "step": 1759
+ },
+ {
+ "epoch": 8.891139240506329,
+ "grad_norm": 0.03296470269560814,
+ "learning_rate": 1.240179573512907e-05,
+ "loss": 0.016651242971420288,
+ "step": 1760
+ },
+ {
+ "epoch": 8.896202531645569,
+ "grad_norm": 0.03243505209684372,
+ "learning_rate": 1.2345679012345678e-05,
+ "loss": 0.022674527019262314,
+ "step": 1761
+ },
+ {
+ "epoch": 8.90126582278481,
+ "grad_norm": 0.031305041164159775,
+ "learning_rate": 1.228956228956229e-05,
+ "loss": 0.020587362349033356,
+ "step": 1762
+ },
+ {
+ "epoch": 8.90632911392405,
+ "grad_norm": 0.032173529267311096,
+ "learning_rate": 1.22334455667789e-05,
+ "loss": 0.016672726720571518,
+ "step": 1763
+ },
+ {
+ "epoch": 8.91139240506329,
+ "grad_norm": 0.024416670203208923,
+ "learning_rate": 1.2177328843995512e-05,
+ "loss": 0.015204197727143764,
+ "step": 1764
+ },
+ {
+ "epoch": 8.916455696202531,
+ "grad_norm": 0.0479590967297554,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.024873821064829826,
+ "step": 1765
+ },
+ {
+ "epoch": 8.921518987341772,
+ "grad_norm": 0.027549419552087784,
+ "learning_rate": 1.2065095398428734e-05,
+ "loss": 0.019144555553793907,
+ "step": 1766
+ },
+ {
+ "epoch": 8.926582278481012,
+ "grad_norm": 0.024039549753069878,
+ "learning_rate": 1.2008978675645342e-05,
+ "loss": 0.017182042822241783,
+ "step": 1767
+ },
+ {
+ "epoch": 8.931645569620253,
+ "grad_norm": 0.03899740055203438,
+ "learning_rate": 1.1952861952861954e-05,
+ "loss": 0.020350690931081772,
+ "step": 1768
+ },
+ {
+ "epoch": 8.936708860759493,
+ "grad_norm": 0.03636085242033005,
+ "learning_rate": 1.1896745230078564e-05,
+ "loss": 0.020022999495267868,
+ "step": 1769
+ },
+ {
+ "epoch": 8.941772151898734,
+ "grad_norm": 0.03000877983868122,
+ "learning_rate": 1.1840628507295174e-05,
+ "loss": 0.01844680681824684,
+ "step": 1770
+ },
+ {
+ "epoch": 8.946835443037974,
+ "grad_norm": 0.03979242593050003,
+ "learning_rate": 1.1784511784511786e-05,
+ "loss": 0.02085147425532341,
+ "step": 1771
+ },
+ {
+ "epoch": 8.951898734177215,
+ "grad_norm": 0.028240645304322243,
+ "learning_rate": 1.1728395061728396e-05,
+ "loss": 0.016546549275517464,
+ "step": 1772
+ },
+ {
+ "epoch": 8.956962025316455,
+ "grad_norm": 0.033536069095134735,
+ "learning_rate": 1.1672278338945006e-05,
+ "loss": 0.01593935489654541,
+ "step": 1773
+ },
+ {
+ "epoch": 8.962025316455696,
+ "grad_norm": 0.04754582792520523,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.026883091777563095,
+ "step": 1774
+ },
+ {
+ "epoch": 8.967088607594937,
+ "grad_norm": 0.04063970968127251,
+ "learning_rate": 1.1560044893378228e-05,
+ "loss": 0.019803281873464584,
+ "step": 1775
+ },
+ {
+ "epoch": 8.972151898734177,
+ "grad_norm": 0.031503964215517044,
+ "learning_rate": 1.1503928170594838e-05,
+ "loss": 0.01680890843272209,
+ "step": 1776
+ },
+ {
+ "epoch": 8.977215189873418,
+ "grad_norm": 0.03479184955358505,
+ "learning_rate": 1.144781144781145e-05,
+ "loss": 0.02515973523259163,
+ "step": 1777
+ },
+ {
+ "epoch": 8.982278481012658,
+ "grad_norm": 0.05013234168291092,
+ "learning_rate": 1.1391694725028058e-05,
+ "loss": 0.02148749679327011,
+ "step": 1778
+ },
+ {
+ "epoch": 8.987341772151899,
+ "grad_norm": 0.03847988322377205,
+ "learning_rate": 1.133557800224467e-05,
+ "loss": 0.024204935878515244,
+ "step": 1779
+ },
+ {
+ "epoch": 8.99240506329114,
+ "grad_norm": 0.039273642003536224,
+ "learning_rate": 1.127946127946128e-05,
+ "loss": 0.020495504140853882,
+ "step": 1780
+ },
+ {
+ "epoch": 8.99746835443038,
+ "grad_norm": 0.041439611464738846,
+ "learning_rate": 1.1223344556677892e-05,
+ "loss": 0.019127510488033295,
+ "step": 1781
+ },
+ {
+ "epoch": 9.0,
+ "grad_norm": 0.05990270525217056,
+ "learning_rate": 1.1167227833894502e-05,
+ "loss": 0.023109547793865204,
+ "step": 1782
+ },
+ {
+ "epoch": 9.00506329113924,
+ "grad_norm": 0.047061819583177567,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.025214694440364838,
+ "step": 1783
+ },
+ {
+ "epoch": 9.010126582278481,
+ "grad_norm": 0.030379803851246834,
+ "learning_rate": 1.1054994388327722e-05,
+ "loss": 0.018331672996282578,
+ "step": 1784
+ },
+ {
+ "epoch": 9.015189873417722,
+ "grad_norm": 0.05749034509062767,
+ "learning_rate": 1.0998877665544333e-05,
+ "loss": 0.028934331610798836,
+ "step": 1785
+ },
+ {
+ "epoch": 9.020253164556962,
+ "grad_norm": 0.03509669750928879,
+ "learning_rate": 1.0942760942760944e-05,
+ "loss": 0.01619633473455906,
+ "step": 1786
+ },
+ {
+ "epoch": 9.025316455696203,
+ "grad_norm": 0.03159119561314583,
+ "learning_rate": 1.0886644219977554e-05,
+ "loss": 0.01846158131957054,
+ "step": 1787
+ },
+ {
+ "epoch": 9.030379746835443,
+ "grad_norm": 0.034257568418979645,
+ "learning_rate": 1.0830527497194165e-05,
+ "loss": 0.021350473165512085,
+ "step": 1788
+ },
+ {
+ "epoch": 9.035443037974684,
+ "grad_norm": 0.053091831505298615,
+ "learning_rate": 1.0774410774410774e-05,
+ "loss": 0.026899423450231552,
+ "step": 1789
+ },
+ {
+ "epoch": 9.040506329113924,
+ "grad_norm": 0.034528207033872604,
+ "learning_rate": 1.0718294051627386e-05,
+ "loss": 0.0215089600533247,
+ "step": 1790
+ },
+ {
+ "epoch": 9.045569620253165,
+ "grad_norm": 0.036446332931518555,
+ "learning_rate": 1.0662177328843996e-05,
+ "loss": 0.019670188426971436,
+ "step": 1791
+ },
+ {
+ "epoch": 9.050632911392405,
+ "grad_norm": 0.035793256014585495,
+ "learning_rate": 1.0606060606060607e-05,
+ "loss": 0.020122066140174866,
+ "step": 1792
+ },
+ {
+ "epoch": 9.055696202531646,
+ "grad_norm": 0.029014602303504944,
+ "learning_rate": 1.0549943883277217e-05,
+ "loss": 0.01671663671731949,
+ "step": 1793
+ },
+ {
+ "epoch": 9.060759493670886,
+ "grad_norm": 0.03698967769742012,
+ "learning_rate": 1.0493827160493827e-05,
+ "loss": 0.018668465316295624,
+ "step": 1794
+ },
+ {
+ "epoch": 9.065822784810127,
+ "grad_norm": 0.04404931515455246,
+ "learning_rate": 1.0437710437710438e-05,
+ "loss": 0.0258408822119236,
+ "step": 1795
+ },
+ {
+ "epoch": 9.070886075949367,
+ "grad_norm": 0.02788466401398182,
+ "learning_rate": 1.038159371492705e-05,
+ "loss": 0.01569712534546852,
+ "step": 1796
+ },
+ {
+ "epoch": 9.075949367088608,
+ "grad_norm": 0.04576987028121948,
+ "learning_rate": 1.032547699214366e-05,
+ "loss": 0.026826951652765274,
+ "step": 1797
+ },
+ {
+ "epoch": 9.081012658227849,
+ "grad_norm": 0.03926515951752663,
+ "learning_rate": 1.0269360269360271e-05,
+ "loss": 0.021020367741584778,
+ "step": 1798
+ },
+ {
+ "epoch": 9.086075949367089,
+ "grad_norm": 0.032130490988492966,
+ "learning_rate": 1.021324354657688e-05,
+ "loss": 0.019157692790031433,
+ "step": 1799
+ },
+ {
+ "epoch": 9.09113924050633,
+ "grad_norm": 0.04469049349427223,
+ "learning_rate": 1.0157126823793491e-05,
+ "loss": 0.018554870039224625,
+ "step": 1800
+ },
+ {
+ "epoch": 9.09620253164557,
+ "grad_norm": 0.04053068906068802,
+ "learning_rate": 1.0101010101010101e-05,
+ "loss": 0.0167707409709692,
+ "step": 1801
+ },
+ {
+ "epoch": 9.10126582278481,
+ "grad_norm": 0.04856531322002411,
+ "learning_rate": 1.0044893378226711e-05,
+ "loss": 0.02337830886244774,
+ "step": 1802
+ },
+ {
+ "epoch": 9.106329113924051,
+ "grad_norm": 0.03873730078339577,
+ "learning_rate": 9.988776655443323e-06,
+ "loss": 0.020911158993840218,
+ "step": 1803
+ },
+ {
+ "epoch": 9.111392405063292,
+ "grad_norm": 0.058970216661691666,
+ "learning_rate": 9.932659932659933e-06,
+ "loss": 0.01642131805419922,
+ "step": 1804
+ },
+ {
+ "epoch": 9.116455696202532,
+ "grad_norm": 0.05682053416967392,
+ "learning_rate": 9.876543209876543e-06,
+ "loss": 0.026575906202197075,
+ "step": 1805
+ },
+ {
+ "epoch": 9.121518987341773,
+ "grad_norm": 0.03910275548696518,
+ "learning_rate": 9.820426487093153e-06,
+ "loss": 0.018824167549610138,
+ "step": 1806
+ },
+ {
+ "epoch": 9.126582278481013,
+ "grad_norm": 0.037792056798934937,
+ "learning_rate": 9.764309764309765e-06,
+ "loss": 0.019908487796783447,
+ "step": 1807
+ },
+ {
+ "epoch": 9.131645569620254,
+ "grad_norm": 0.05523673817515373,
+ "learning_rate": 9.708193041526375e-06,
+ "loss": 0.020042993128299713,
+ "step": 1808
+ },
+ {
+ "epoch": 9.136708860759494,
+ "grad_norm": 0.04413062334060669,
+ "learning_rate": 9.652076318742987e-06,
+ "loss": 0.020535126328468323,
+ "step": 1809
+ },
+ {
+ "epoch": 9.141772151898735,
+ "grad_norm": 0.056551627814769745,
+ "learning_rate": 9.595959595959595e-06,
+ "loss": 0.025261811912059784,
+ "step": 1810
+ },
+ {
+ "epoch": 9.146835443037975,
+ "grad_norm": 0.05183473229408264,
+ "learning_rate": 9.539842873176207e-06,
+ "loss": 0.01721227914094925,
+ "step": 1811
+ },
+ {
+ "epoch": 9.151898734177216,
+ "grad_norm": 0.0401085801422596,
+ "learning_rate": 9.483726150392817e-06,
+ "loss": 0.01639746129512787,
+ "step": 1812
+ },
+ {
+ "epoch": 9.156962025316457,
+ "grad_norm": 0.04009125009179115,
+ "learning_rate": 9.427609427609429e-06,
+ "loss": 0.022812869399785995,
+ "step": 1813
+ },
+ {
+ "epoch": 9.162025316455697,
+ "grad_norm": 0.04864509776234627,
+ "learning_rate": 9.371492704826039e-06,
+ "loss": 0.01932794414460659,
+ "step": 1814
+ },
+ {
+ "epoch": 9.167088607594938,
+ "grad_norm": 0.03863656148314476,
+ "learning_rate": 9.315375982042649e-06,
+ "loss": 0.019282303750514984,
+ "step": 1815
+ },
+ {
+ "epoch": 9.172151898734176,
+ "grad_norm": 0.03486642241477966,
+ "learning_rate": 9.259259259259259e-06,
+ "loss": 0.018861494958400726,
+ "step": 1816
+ },
+ {
+ "epoch": 9.177215189873417,
+ "grad_norm": 0.036858294159173965,
+ "learning_rate": 9.20314253647587e-06,
+ "loss": 0.020449288189411163,
+ "step": 1817
+ },
+ {
+ "epoch": 9.182278481012657,
+ "grad_norm": 0.050751060247421265,
+ "learning_rate": 9.147025813692481e-06,
+ "loss": 0.023053709417581558,
+ "step": 1818
+ },
+ {
+ "epoch": 9.187341772151898,
+ "grad_norm": 0.03217271342873573,
+ "learning_rate": 9.090909090909091e-06,
+ "loss": 0.015296204015612602,
+ "step": 1819
+ },
+ {
+ "epoch": 9.192405063291138,
+ "grad_norm": 0.057376254349946976,
+ "learning_rate": 9.034792368125703e-06,
+ "loss": 0.02562561258673668,
+ "step": 1820
+ },
+ {
+ "epoch": 9.197468354430379,
+ "grad_norm": 0.04721210524439812,
+ "learning_rate": 8.978675645342311e-06,
+ "loss": 0.01858190819621086,
+ "step": 1821
+ },
+ {
+ "epoch": 9.20253164556962,
+ "grad_norm": 0.051653601229190826,
+ "learning_rate": 8.922558922558923e-06,
+ "loss": 0.017723191529512405,
+ "step": 1822
+ },
+ {
+ "epoch": 9.20759493670886,
+ "grad_norm": 0.0407535582780838,
+ "learning_rate": 8.866442199775533e-06,
+ "loss": 0.01954728364944458,
+ "step": 1823
+ },
+ {
+ "epoch": 9.2126582278481,
+ "grad_norm": 0.038390859961509705,
+ "learning_rate": 8.810325476992145e-06,
+ "loss": 0.01730344444513321,
+ "step": 1824
+ },
+ {
+ "epoch": 9.217721518987341,
+ "grad_norm": 0.04526997730135918,
+ "learning_rate": 8.754208754208755e-06,
+ "loss": 0.020680539309978485,
+ "step": 1825
+ },
+ {
+ "epoch": 9.222784810126582,
+ "grad_norm": 0.05338016152381897,
+ "learning_rate": 8.698092031425367e-06,
+ "loss": 0.02615617960691452,
+ "step": 1826
+ },
+ {
+ "epoch": 9.227848101265822,
+ "grad_norm": 0.043167877942323685,
+ "learning_rate": 8.641975308641975e-06,
+ "loss": 0.02184569276869297,
+ "step": 1827
+ },
+ {
+ "epoch": 9.232911392405063,
+ "grad_norm": 0.06493937969207764,
+ "learning_rate": 8.585858585858587e-06,
+ "loss": 0.02993769198656082,
+ "step": 1828
+ },
+ {
+ "epoch": 9.237974683544303,
+ "grad_norm": 0.06029151752591133,
+ "learning_rate": 8.529741863075197e-06,
+ "loss": 0.02144983969628811,
+ "step": 1829
+ },
+ {
+ "epoch": 9.243037974683544,
+ "grad_norm": 0.03910079225897789,
+ "learning_rate": 8.473625140291807e-06,
+ "loss": 0.017928767949342728,
+ "step": 1830
+ },
+ {
+ "epoch": 9.248101265822784,
+ "grad_norm": 0.05914199352264404,
+ "learning_rate": 8.417508417508419e-06,
+ "loss": 0.021121149882674217,
+ "step": 1831
+ },
+ {
+ "epoch": 9.253164556962025,
+ "grad_norm": 0.03321961686015129,
+ "learning_rate": 8.361391694725029e-06,
+ "loss": 0.020468972623348236,
+ "step": 1832
+ },
+ {
+ "epoch": 9.258227848101265,
+ "grad_norm": 0.7659075260162354,
+ "learning_rate": 8.305274971941639e-06,
+ "loss": 0.01939770206809044,
+ "step": 1833
+ },
+ {
+ "epoch": 9.263291139240506,
+ "grad_norm": 0.03027530573308468,
+ "learning_rate": 8.249158249158249e-06,
+ "loss": 0.016905058175325394,
+ "step": 1834
+ },
+ {
+ "epoch": 9.268354430379746,
+ "grad_norm": 0.05859652906656265,
+ "learning_rate": 8.19304152637486e-06,
+ "loss": 0.022065438330173492,
+ "step": 1835
+ },
+ {
+ "epoch": 9.273417721518987,
+ "grad_norm": 0.04476224631071091,
+ "learning_rate": 8.13692480359147e-06,
+ "loss": 0.018651409074664116,
+ "step": 1836
+ },
+ {
+ "epoch": 9.278481012658228,
+ "grad_norm": 0.03598480299115181,
+ "learning_rate": 8.080808080808082e-06,
+ "loss": 0.019033677875995636,
+ "step": 1837
+ },
+ {
+ "epoch": 9.283544303797468,
+ "grad_norm": 0.09132448583841324,
+ "learning_rate": 8.02469135802469e-06,
+ "loss": 0.02182481437921524,
+ "step": 1838
+ },
+ {
+ "epoch": 9.288607594936709,
+ "grad_norm": 0.13293714821338654,
+ "learning_rate": 7.968574635241303e-06,
+ "loss": 0.024381443858146667,
+ "step": 1839
+ },
+ {
+ "epoch": 9.29367088607595,
+ "grad_norm": 0.04686405509710312,
+ "learning_rate": 7.912457912457913e-06,
+ "loss": 0.018170200288295746,
+ "step": 1840
+ },
+ {
+ "epoch": 9.29873417721519,
+ "grad_norm": 0.05251675099134445,
+ "learning_rate": 7.856341189674524e-06,
+ "loss": 0.01857583224773407,
+ "step": 1841
+ },
+ {
+ "epoch": 9.30379746835443,
+ "grad_norm": 0.04821787029504776,
+ "learning_rate": 7.800224466891134e-06,
+ "loss": 0.020663246512413025,
+ "step": 1842
+ },
+ {
+ "epoch": 9.30886075949367,
+ "grad_norm": 0.06094640493392944,
+ "learning_rate": 7.744107744107745e-06,
+ "loss": 0.02171882428228855,
+ "step": 1843
+ },
+ {
+ "epoch": 9.313924050632911,
+ "grad_norm": 0.08395229279994965,
+ "learning_rate": 7.687991021324355e-06,
+ "loss": 0.02078585885465145,
+ "step": 1844
+ },
+ {
+ "epoch": 9.318987341772152,
+ "grad_norm": 0.06046644225716591,
+ "learning_rate": 7.631874298540966e-06,
+ "loss": 0.02072206512093544,
+ "step": 1845
+ },
+ {
+ "epoch": 9.324050632911392,
+ "grad_norm": 0.06851425021886826,
+ "learning_rate": 7.5757575757575764e-06,
+ "loss": 0.02590831182897091,
+ "step": 1846
+ },
+ {
+ "epoch": 9.329113924050633,
+ "grad_norm": 0.04084591567516327,
+ "learning_rate": 7.519640852974187e-06,
+ "loss": 0.01973675936460495,
+ "step": 1847
+ },
+ {
+ "epoch": 9.334177215189873,
+ "grad_norm": 0.05829346179962158,
+ "learning_rate": 7.4635241301907966e-06,
+ "loss": 0.01944262906908989,
+ "step": 1848
+ },
+ {
+ "epoch": 9.339240506329114,
+ "grad_norm": 0.0540008507668972,
+ "learning_rate": 7.4074074074074075e-06,
+ "loss": 0.02449873462319374,
+ "step": 1849
+ },
+ {
+ "epoch": 9.344303797468354,
+ "grad_norm": 0.05580221116542816,
+ "learning_rate": 7.351290684624018e-06,
+ "loss": 0.01977585442364216,
+ "step": 1850
+ },
+ {
+ "epoch": 9.349367088607595,
+ "grad_norm": 0.05629776790738106,
+ "learning_rate": 7.295173961840629e-06,
+ "loss": 0.02293727919459343,
+ "step": 1851
+ },
+ {
+ "epoch": 9.354430379746836,
+ "grad_norm": 0.030068427324295044,
+ "learning_rate": 7.239057239057239e-06,
+ "loss": 0.017065981402993202,
+ "step": 1852
+ },
+ {
+ "epoch": 9.359493670886076,
+ "grad_norm": 0.060565538704395294,
+ "learning_rate": 7.18294051627385e-06,
+ "loss": 0.016005266457796097,
+ "step": 1853
+ },
+ {
+ "epoch": 9.364556962025317,
+ "grad_norm": 0.1038983166217804,
+ "learning_rate": 7.12682379349046e-06,
+ "loss": 0.017740413546562195,
+ "step": 1854
+ },
+ {
+ "epoch": 9.369620253164557,
+ "grad_norm": 0.051535703241825104,
+ "learning_rate": 7.0707070707070704e-06,
+ "loss": 0.020748045295476913,
+ "step": 1855
+ },
+ {
+ "epoch": 9.374683544303798,
+ "grad_norm": 0.03921234980225563,
+ "learning_rate": 7.014590347923681e-06,
+ "loss": 0.02201096899807453,
+ "step": 1856
+ },
+ {
+ "epoch": 9.379746835443038,
+ "grad_norm": 0.058679282665252686,
+ "learning_rate": 6.958473625140292e-06,
+ "loss": 0.024434097111225128,
+ "step": 1857
+ },
+ {
+ "epoch": 9.384810126582279,
+ "grad_norm": 0.04492834210395813,
+ "learning_rate": 6.902356902356903e-06,
+ "loss": 0.02465798705816269,
+ "step": 1858
+ },
+ {
+ "epoch": 9.38987341772152,
+ "grad_norm": 0.04768746718764305,
+ "learning_rate": 6.846240179573512e-06,
+ "loss": 0.019887633621692657,
+ "step": 1859
+ },
+ {
+ "epoch": 9.39493670886076,
+ "grad_norm": 0.03653556481003761,
+ "learning_rate": 6.790123456790123e-06,
+ "loss": 0.020044632256031036,
+ "step": 1860
+ },
+ {
+ "epoch": 9.4,
+ "grad_norm": 0.05657031014561653,
+ "learning_rate": 6.734006734006734e-06,
+ "loss": 0.02113870345056057,
+ "step": 1861
+ },
+ {
+ "epoch": 9.405063291139241,
+ "grad_norm": 0.08268840610980988,
+ "learning_rate": 6.677890011223345e-06,
+ "loss": 0.025488805025815964,
+ "step": 1862
+ },
+ {
+ "epoch": 9.410126582278481,
+ "grad_norm": 0.0868019238114357,
+ "learning_rate": 6.621773288439956e-06,
+ "loss": 0.02351730689406395,
+ "step": 1863
+ },
+ {
+ "epoch": 9.415189873417722,
+ "grad_norm": 0.029764017090201378,
+ "learning_rate": 6.565656565656567e-06,
+ "loss": 0.016324780881404877,
+ "step": 1864
+ },
+ {
+ "epoch": 9.420253164556962,
+ "grad_norm": 0.03425216302275658,
+ "learning_rate": 6.509539842873176e-06,
+ "loss": 0.0200341809540987,
+ "step": 1865
+ },
+ {
+ "epoch": 9.425316455696203,
+ "grad_norm": 0.05918268859386444,
+ "learning_rate": 6.453423120089787e-06,
+ "loss": 0.02535460889339447,
+ "step": 1866
+ },
+ {
+ "epoch": 9.430379746835444,
+ "grad_norm": 0.054995130747556686,
+ "learning_rate": 6.397306397306398e-06,
+ "loss": 0.01632389798760414,
+ "step": 1867
+ },
+ {
+ "epoch": 9.435443037974684,
+ "grad_norm": 0.04437824711203575,
+ "learning_rate": 6.341189674523008e-06,
+ "loss": 0.0195779949426651,
+ "step": 1868
+ },
+ {
+ "epoch": 9.440506329113925,
+ "grad_norm": 0.05082770064473152,
+ "learning_rate": 6.285072951739619e-06,
+ "loss": 0.025311456993222237,
+ "step": 1869
+ },
+ {
+ "epoch": 9.445569620253165,
+ "grad_norm": 0.0277100782841444,
+ "learning_rate": 6.228956228956229e-06,
+ "loss": 0.017872802913188934,
+ "step": 1870
+ },
+ {
+ "epoch": 9.450632911392406,
+ "grad_norm": 0.042890291661024094,
+ "learning_rate": 6.172839506172839e-06,
+ "loss": 0.019677232950925827,
+ "step": 1871
+ },
+ {
+ "epoch": 9.455696202531646,
+ "grad_norm": 0.06866726279258728,
+ "learning_rate": 6.11672278338945e-06,
+ "loss": 0.023001503199338913,
+ "step": 1872
+ },
+ {
+ "epoch": 9.460759493670887,
+ "grad_norm": 0.041647154837846756,
+ "learning_rate": 6.060606060606061e-06,
+ "loss": 0.019325535744428635,
+ "step": 1873
+ },
+ {
+ "epoch": 9.465822784810127,
+ "grad_norm": 0.04845361411571503,
+ "learning_rate": 6.004489337822671e-06,
+ "loss": 0.0216340571641922,
+ "step": 1874
+ },
+ {
+ "epoch": 9.470886075949368,
+ "grad_norm": 0.032870013266801834,
+ "learning_rate": 5.948372615039282e-06,
+ "loss": 0.01625978946685791,
+ "step": 1875
+ },
+ {
+ "epoch": 9.475949367088608,
+ "grad_norm": 0.0492057278752327,
+ "learning_rate": 5.892255892255893e-06,
+ "loss": 0.022932130843400955,
+ "step": 1876
+ },
+ {
+ "epoch": 9.481012658227849,
+ "grad_norm": 0.05473386496305466,
+ "learning_rate": 5.836139169472503e-06,
+ "loss": 0.021532990038394928,
+ "step": 1877
+ },
+ {
+ "epoch": 9.48607594936709,
+ "grad_norm": 0.028771599754691124,
+ "learning_rate": 5.780022446689114e-06,
+ "loss": 0.01729103922843933,
+ "step": 1878
+ },
+ {
+ "epoch": 9.49113924050633,
+ "grad_norm": 0.05029717832803726,
+ "learning_rate": 5.723905723905725e-06,
+ "loss": 0.023412462323904037,
+ "step": 1879
+ },
+ {
+ "epoch": 9.496202531645569,
+ "grad_norm": 0.037294141948223114,
+ "learning_rate": 5.667789001122335e-06,
+ "loss": 0.018875129520893097,
+ "step": 1880
+ },
+ {
+ "epoch": 9.50126582278481,
+ "grad_norm": 0.08159356564283371,
+ "learning_rate": 5.611672278338946e-06,
+ "loss": 0.01867450401186943,
+ "step": 1881
+ },
+ {
+ "epoch": 9.50632911392405,
+ "grad_norm": 0.046070560812950134,
+ "learning_rate": 5.555555555555556e-06,
+ "loss": 0.017857477068901062,
+ "step": 1882
+ },
+ {
+ "epoch": 9.51139240506329,
+ "grad_norm": 0.04586658626794815,
+ "learning_rate": 5.499438832772167e-06,
+ "loss": 0.02222653292119503,
+ "step": 1883
+ },
+ {
+ "epoch": 9.51645569620253,
+ "grad_norm": 0.04138347506523132,
+ "learning_rate": 5.443322109988777e-06,
+ "loss": 0.0239041019231081,
+ "step": 1884
+ },
+ {
+ "epoch": 9.521518987341771,
+ "grad_norm": 0.03416672348976135,
+ "learning_rate": 5.387205387205387e-06,
+ "loss": 0.019459370523691177,
+ "step": 1885
+ },
+ {
+ "epoch": 9.526582278481012,
+ "grad_norm": 0.5165029764175415,
+ "learning_rate": 5.331088664421998e-06,
+ "loss": 0.01856951043009758,
+ "step": 1886
+ },
+ {
+ "epoch": 9.531645569620252,
+ "grad_norm": 0.05089139565825462,
+ "learning_rate": 5.274971941638609e-06,
+ "loss": 0.018053002655506134,
+ "step": 1887
+ },
+ {
+ "epoch": 9.536708860759493,
+ "grad_norm": 0.03544516861438751,
+ "learning_rate": 5.218855218855219e-06,
+ "loss": 0.01634579338133335,
+ "step": 1888
+ },
+ {
+ "epoch": 9.541772151898734,
+ "grad_norm": 0.03188427910208702,
+ "learning_rate": 5.16273849607183e-06,
+ "loss": 0.01789737492799759,
+ "step": 1889
+ },
+ {
+ "epoch": 9.546835443037974,
+ "grad_norm": 0.04106273502111435,
+ "learning_rate": 5.10662177328844e-06,
+ "loss": 0.019593622535467148,
+ "step": 1890
+ },
+ {
+ "epoch": 9.551898734177215,
+ "grad_norm": 0.036733996123075485,
+ "learning_rate": 5.050505050505051e-06,
+ "loss": 0.01835111528635025,
+ "step": 1891
+ },
+ {
+ "epoch": 9.556962025316455,
+ "grad_norm": 0.042167697101831436,
+ "learning_rate": 4.994388327721662e-06,
+ "loss": 0.017475677654147148,
+ "step": 1892
+ },
+ {
+ "epoch": 9.562025316455696,
+ "grad_norm": 0.04592873528599739,
+ "learning_rate": 4.938271604938272e-06,
+ "loss": 0.020182453095912933,
+ "step": 1893
+ },
+ {
+ "epoch": 9.567088607594936,
+ "grad_norm": 0.03492767736315727,
+ "learning_rate": 4.8821548821548826e-06,
+ "loss": 0.020557107403874397,
+ "step": 1894
+ },
+ {
+ "epoch": 9.572151898734177,
+ "grad_norm": 0.05710060894489288,
+ "learning_rate": 4.8260381593714935e-06,
+ "loss": 0.021605905145406723,
+ "step": 1895
+ },
+ {
+ "epoch": 9.577215189873417,
+ "grad_norm": 0.034083474427461624,
+ "learning_rate": 4.7699214365881036e-06,
+ "loss": 0.018348470330238342,
+ "step": 1896
+ },
+ {
+ "epoch": 9.582278481012658,
+ "grad_norm": 0.0651543065905571,
+ "learning_rate": 4.7138047138047145e-06,
+ "loss": 0.020901817828416824,
+ "step": 1897
+ },
+ {
+ "epoch": 9.587341772151898,
+ "grad_norm": 0.08248941600322723,
+ "learning_rate": 4.6576879910213245e-06,
+ "loss": 0.025736823678016663,
+ "step": 1898
+ },
+ {
+ "epoch": 9.592405063291139,
+ "grad_norm": 0.041289493441581726,
+ "learning_rate": 4.601571268237935e-06,
+ "loss": 0.019824344664812088,
+ "step": 1899
+ },
+ {
+ "epoch": 9.59746835443038,
+ "grad_norm": 0.04936572164297104,
+ "learning_rate": 4.5454545454545455e-06,
+ "loss": 0.021768750622868538,
+ "step": 1900
+ },
+ {
+ "epoch": 9.60253164556962,
+ "grad_norm": 0.032843731343746185,
+ "learning_rate": 4.489337822671156e-06,
+ "loss": 0.017534000799059868,
+ "step": 1901
+ },
+ {
+ "epoch": 9.60759493670886,
+ "grad_norm": 0.04354838654398918,
+ "learning_rate": 4.4332210998877665e-06,
+ "loss": 0.01718713343143463,
+ "step": 1902
+ },
+ {
+ "epoch": 9.612658227848101,
+ "grad_norm": 0.038604699075222015,
+ "learning_rate": 4.377104377104377e-06,
+ "loss": 0.01597282662987709,
+ "step": 1903
+ },
+ {
+ "epoch": 9.617721518987342,
+ "grad_norm": 0.052852943539619446,
+ "learning_rate": 4.3209876543209875e-06,
+ "loss": 0.024028461426496506,
+ "step": 1904
+ },
+ {
+ "epoch": 9.622784810126582,
+ "grad_norm": 0.0756857618689537,
+ "learning_rate": 4.264870931537598e-06,
+ "loss": 0.02735048159956932,
+ "step": 1905
+ },
+ {
+ "epoch": 9.627848101265823,
+ "grad_norm": 0.06754814833402634,
+ "learning_rate": 4.208754208754209e-06,
+ "loss": 0.020943649113178253,
+ "step": 1906
+ },
+ {
+ "epoch": 9.632911392405063,
+ "grad_norm": 0.04769815504550934,
+ "learning_rate": 4.152637485970819e-06,
+ "loss": 0.022937996312975883,
+ "step": 1907
+ },
+ {
+ "epoch": 9.637974683544304,
+ "grad_norm": 0.039939772337675095,
+ "learning_rate": 4.09652076318743e-06,
+ "loss": 0.020546654239296913,
+ "step": 1908
+ },
+ {
+ "epoch": 9.643037974683544,
+ "grad_norm": 0.034484442323446274,
+ "learning_rate": 4.040404040404041e-06,
+ "loss": 0.018679223954677582,
+ "step": 1909
+ },
+ {
+ "epoch": 9.648101265822785,
+ "grad_norm": 0.03369096294045448,
+ "learning_rate": 3.984287317620651e-06,
+ "loss": 0.016150813549757004,
+ "step": 1910
+ },
+ {
+ "epoch": 9.653164556962025,
+ "grad_norm": 0.04491995647549629,
+ "learning_rate": 3.928170594837262e-06,
+ "loss": 0.0214182510972023,
+ "step": 1911
+ },
+ {
+ "epoch": 9.658227848101266,
+ "grad_norm": 0.034008391201496124,
+ "learning_rate": 3.872053872053872e-06,
+ "loss": 0.015146106481552124,
+ "step": 1912
+ },
+ {
+ "epoch": 9.663291139240506,
+ "grad_norm": 0.048939891159534454,
+ "learning_rate": 3.815937149270483e-06,
+ "loss": 0.024398421868681908,
+ "step": 1913
+ },
+ {
+ "epoch": 9.668354430379747,
+ "grad_norm": 0.08318967372179031,
+ "learning_rate": 3.7598204264870937e-06,
+ "loss": 0.025867443531751633,
+ "step": 1914
+ },
+ {
+ "epoch": 9.673417721518987,
+ "grad_norm": 0.047449447214603424,
+ "learning_rate": 3.7037037037037037e-06,
+ "loss": 0.01829744502902031,
+ "step": 1915
+ },
+ {
+ "epoch": 9.678481012658228,
+ "grad_norm": 0.04739027097821236,
+ "learning_rate": 3.6475869809203147e-06,
+ "loss": 0.02088984102010727,
+ "step": 1916
+ },
+ {
+ "epoch": 9.683544303797468,
+ "grad_norm": 0.044072285294532776,
+ "learning_rate": 3.591470258136925e-06,
+ "loss": 0.021133191883563995,
+ "step": 1917
+ },
+ {
+ "epoch": 9.688607594936709,
+ "grad_norm": 0.04227243363857269,
+ "learning_rate": 3.5353535353535352e-06,
+ "loss": 0.017507197335362434,
+ "step": 1918
+ },
+ {
+ "epoch": 9.69367088607595,
+ "grad_norm": 0.6993705034255981,
+ "learning_rate": 3.479236812570146e-06,
+ "loss": 0.02402547001838684,
+ "step": 1919
+ },
+ {
+ "epoch": 9.69873417721519,
+ "grad_norm": 0.03104744665324688,
+ "learning_rate": 3.423120089786756e-06,
+ "loss": 0.01744554005563259,
+ "step": 1920
+ },
+ {
+ "epoch": 9.70379746835443,
+ "grad_norm": 0.03840234503149986,
+ "learning_rate": 3.367003367003367e-06,
+ "loss": 0.021233508363366127,
+ "step": 1921
+ },
+ {
+ "epoch": 9.708860759493671,
+ "grad_norm": 0.07724355906248093,
+ "learning_rate": 3.310886644219978e-06,
+ "loss": 0.025418926030397415,
+ "step": 1922
+ },
+ {
+ "epoch": 9.713924050632912,
+ "grad_norm": 0.05659948289394379,
+ "learning_rate": 3.254769921436588e-06,
+ "loss": 0.021125826984643936,
+ "step": 1923
+ },
+ {
+ "epoch": 9.718987341772152,
+ "grad_norm": 0.05541156232357025,
+ "learning_rate": 3.198653198653199e-06,
+ "loss": 0.019467147067189217,
+ "step": 1924
+ },
+ {
+ "epoch": 9.724050632911393,
+ "grad_norm": 0.051174346357584,
+ "learning_rate": 3.1425364758698095e-06,
+ "loss": 0.015815753489732742,
+ "step": 1925
+ },
+ {
+ "epoch": 9.729113924050633,
+ "grad_norm": 0.059443213045597076,
+ "learning_rate": 3.0864197530864196e-06,
+ "loss": 0.027249962091445923,
+ "step": 1926
+ },
+ {
+ "epoch": 9.734177215189874,
+ "grad_norm": 0.05025959387421608,
+ "learning_rate": 3.0303030303030305e-06,
+ "loss": 0.02017822489142418,
+ "step": 1927
+ },
+ {
+ "epoch": 9.739240506329114,
+ "grad_norm": 0.03740310296416283,
+ "learning_rate": 2.974186307519641e-06,
+ "loss": 0.017556963488459587,
+ "step": 1928
+ },
+ {
+ "epoch": 9.744303797468355,
+ "grad_norm": 0.0694611445069313,
+ "learning_rate": 2.9180695847362515e-06,
+ "loss": 0.023965295404195786,
+ "step": 1929
+ },
+ {
+ "epoch": 9.749367088607595,
+ "grad_norm": 0.036724843084812164,
+ "learning_rate": 2.8619528619528624e-06,
+ "loss": 0.021316323429346085,
+ "step": 1930
+ },
+ {
+ "epoch": 9.754430379746836,
+ "grad_norm": 0.036311905831098557,
+ "learning_rate": 2.805836139169473e-06,
+ "loss": 0.019903525710105896,
+ "step": 1931
+ },
+ {
+ "epoch": 9.759493670886076,
+ "grad_norm": 0.03565463796257973,
+ "learning_rate": 2.7497194163860834e-06,
+ "loss": 0.015445968136191368,
+ "step": 1932
+ },
+ {
+ "epoch": 9.764556962025317,
+ "grad_norm": 0.06959722936153412,
+ "learning_rate": 2.6936026936026934e-06,
+ "loss": 0.02059973031282425,
+ "step": 1933
+ },
+ {
+ "epoch": 9.769620253164558,
+ "grad_norm": 0.04934488609433174,
+ "learning_rate": 2.6374859708193044e-06,
+ "loss": 0.021995320916175842,
+ "step": 1934
+ },
+ {
+ "epoch": 9.774683544303798,
+ "grad_norm": 0.0453757643699646,
+ "learning_rate": 2.581369248035915e-06,
+ "loss": 0.023885395377874374,
+ "step": 1935
+ },
+ {
+ "epoch": 9.779746835443039,
+ "grad_norm": 0.033577773720026016,
+ "learning_rate": 2.5252525252525253e-06,
+ "loss": 0.020609261468052864,
+ "step": 1936
+ },
+ {
+ "epoch": 9.784810126582279,
+ "grad_norm": 0.03478984907269478,
+ "learning_rate": 2.469135802469136e-06,
+ "loss": 0.017293797805905342,
+ "step": 1937
+ },
+ {
+ "epoch": 9.78987341772152,
+ "grad_norm": 0.05951296538114548,
+ "learning_rate": 2.4130190796857467e-06,
+ "loss": 0.02433600276708603,
+ "step": 1938
+ },
+ {
+ "epoch": 9.79493670886076,
+ "grad_norm": 0.043593067675828934,
+ "learning_rate": 2.3569023569023572e-06,
+ "loss": 0.01717185042798519,
+ "step": 1939
+ },
+ {
+ "epoch": 9.8,
+ "grad_norm": 0.036551423370838165,
+ "learning_rate": 2.3007856341189673e-06,
+ "loss": 0.014705630950629711,
+ "step": 1940
+ },
+ {
+ "epoch": 9.805063291139241,
+ "grad_norm": 0.02873985841870308,
+ "learning_rate": 2.244668911335578e-06,
+ "loss": 0.015784509479999542,
+ "step": 1941
+ },
+ {
+ "epoch": 9.810126582278482,
+ "grad_norm": 0.04626985639333725,
+ "learning_rate": 2.1885521885521887e-06,
+ "loss": 0.01896033249795437,
+ "step": 1942
+ },
+ {
+ "epoch": 9.815189873417722,
+ "grad_norm": 0.042403966188430786,
+ "learning_rate": 2.132435465768799e-06,
+ "loss": 0.021556947380304337,
+ "step": 1943
+ },
+ {
+ "epoch": 9.820253164556963,
+ "grad_norm": 0.04335792735219002,
+ "learning_rate": 2.0763187429854097e-06,
+ "loss": 0.02120579034090042,
+ "step": 1944
+ },
+ {
+ "epoch": 9.825316455696203,
+ "grad_norm": 0.04230713099241257,
+ "learning_rate": 2.0202020202020206e-06,
+ "loss": 0.02101757749915123,
+ "step": 1945
+ },
+ {
+ "epoch": 9.830379746835444,
+ "grad_norm": 0.03693247586488724,
+ "learning_rate": 1.964085297418631e-06,
+ "loss": 0.01896755024790764,
+ "step": 1946
+ },
+ {
+ "epoch": 9.835443037974684,
+ "grad_norm": 0.052694592624902725,
+ "learning_rate": 1.9079685746352416e-06,
+ "loss": 0.0245214756578207,
+ "step": 1947
+ },
+ {
+ "epoch": 9.840506329113925,
+ "grad_norm": 0.06044641137123108,
+ "learning_rate": 1.8518518518518519e-06,
+ "loss": 0.02465645968914032,
+ "step": 1948
+ },
+ {
+ "epoch": 9.845569620253164,
+ "grad_norm": 0.036910027265548706,
+ "learning_rate": 1.7957351290684626e-06,
+ "loss": 0.016615547239780426,
+ "step": 1949
+ },
+ {
+ "epoch": 9.850632911392404,
+ "grad_norm": 0.035510141402482986,
+ "learning_rate": 1.739618406285073e-06,
+ "loss": 0.020313918590545654,
+ "step": 1950
+ },
+ {
+ "epoch": 9.855696202531645,
+ "grad_norm": 0.03556206822395325,
+ "learning_rate": 1.6835016835016836e-06,
+ "loss": 0.022235754877328873,
+ "step": 1951
+ },
+ {
+ "epoch": 9.860759493670885,
+ "grad_norm": 0.027055278420448303,
+ "learning_rate": 1.627384960718294e-06,
+ "loss": 0.017283467575907707,
+ "step": 1952
+ },
+ {
+ "epoch": 9.865822784810126,
+ "grad_norm": 0.03496241569519043,
+ "learning_rate": 1.5712682379349048e-06,
+ "loss": 0.016226312145590782,
+ "step": 1953
+ },
+ {
+ "epoch": 9.870886075949366,
+ "grad_norm": 0.03780671954154968,
+ "learning_rate": 1.5151515151515152e-06,
+ "loss": 0.01685931719839573,
+ "step": 1954
+ },
+ {
+ "epoch": 9.875949367088607,
+ "grad_norm": 0.044845063239336014,
+ "learning_rate": 1.4590347923681257e-06,
+ "loss": 0.022931791841983795,
+ "step": 1955
+ },
+ {
+ "epoch": 9.881012658227847,
+ "grad_norm": 0.14863106608390808,
+ "learning_rate": 1.4029180695847364e-06,
+ "loss": 0.02121223881840706,
+ "step": 1956
+ },
+ {
+ "epoch": 9.886075949367088,
+ "grad_norm": 0.026823746040463448,
+ "learning_rate": 1.3468013468013467e-06,
+ "loss": 0.01615726947784424,
+ "step": 1957
+ },
+ {
+ "epoch": 9.891139240506329,
+ "grad_norm": 0.036688726395368576,
+ "learning_rate": 1.2906846240179574e-06,
+ "loss": 0.017043281346559525,
+ "step": 1958
+ },
+ {
+ "epoch": 9.896202531645569,
+ "grad_norm": 0.043992746621370316,
+ "learning_rate": 1.234567901234568e-06,
+ "loss": 0.019607234746217728,
+ "step": 1959
+ },
+ {
+ "epoch": 9.90126582278481,
+ "grad_norm": 0.04232911393046379,
+ "learning_rate": 1.1784511784511786e-06,
+ "loss": 0.016032947227358818,
+ "step": 1960
+ },
+ {
+ "epoch": 9.90632911392405,
+ "grad_norm": 0.036432672291994095,
+ "learning_rate": 1.122334455667789e-06,
+ "loss": 0.018159886822104454,
+ "step": 1961
+ },
+ {
+ "epoch": 9.91139240506329,
+ "grad_norm": 0.05228167772293091,
+ "learning_rate": 1.0662177328843996e-06,
+ "loss": 0.022306080907583237,
+ "step": 1962
+ },
+ {
+ "epoch": 9.916455696202531,
+ "grad_norm": 0.03903724625706673,
+ "learning_rate": 1.0101010101010103e-06,
+ "loss": 0.020357143133878708,
+ "step": 1963
+ },
+ {
+ "epoch": 9.921518987341772,
+ "grad_norm": 0.0439494326710701,
+ "learning_rate": 9.539842873176208e-07,
+ "loss": 0.021676119416952133,
+ "step": 1964
+ },
+ {
+ "epoch": 9.926582278481012,
+ "grad_norm": 0.06019267439842224,
+ "learning_rate": 8.978675645342313e-07,
+ "loss": 0.023516695946455002,
+ "step": 1965
+ },
+ {
+ "epoch": 9.931645569620253,
+ "grad_norm": 0.037639789283275604,
+ "learning_rate": 8.417508417508418e-07,
+ "loss": 0.019544271752238274,
+ "step": 1966
+ },
+ {
+ "epoch": 9.936708860759493,
+ "grad_norm": 0.040310416370630264,
+ "learning_rate": 7.856341189674524e-07,
+ "loss": 0.015638157725334167,
+ "step": 1967
+ },
+ {
+ "epoch": 9.941772151898734,
+ "grad_norm": 0.0416545532643795,
+ "learning_rate": 7.295173961840629e-07,
+ "loss": 0.01969909481704235,
+ "step": 1968
+ },
+ {
+ "epoch": 9.946835443037974,
+ "grad_norm": 0.044751107692718506,
+ "learning_rate": 6.734006734006734e-07,
+ "loss": 0.019855637103319168,
+ "step": 1969
+ },
+ {
+ "epoch": 9.951898734177215,
+ "grad_norm": 0.05070524290204048,
+ "learning_rate": 6.17283950617284e-07,
+ "loss": 0.022250555455684662,
+ "step": 1970
+ },
+ {
+ "epoch": 9.956962025316455,
+ "grad_norm": 0.038012389093637466,
+ "learning_rate": 5.611672278338944e-07,
+ "loss": 0.021679066121578217,
+ "step": 1971
+ },
+ {
+ "epoch": 9.962025316455696,
+ "grad_norm": 0.05101729929447174,
+ "learning_rate": 5.050505050505052e-07,
+ "loss": 0.02098817005753517,
+ "step": 1972
+ },
+ {
+ "epoch": 9.967088607594937,
+ "grad_norm": 0.04685389623045921,
+ "learning_rate": 4.4893378226711564e-07,
+ "loss": 0.019951000809669495,
+ "step": 1973
+ },
+ {
+ "epoch": 9.972151898734177,
+ "grad_norm": 0.0466696135699749,
+ "learning_rate": 3.928170594837262e-07,
+ "loss": 0.019787713885307312,
+ "step": 1974
+ },
+ {
+ "epoch": 9.977215189873418,
+ "grad_norm": 0.031979382038116455,
+ "learning_rate": 3.367003367003367e-07,
+ "loss": 0.016201099380850792,
+ "step": 1975
+ },
+ {
+ "epoch": 9.982278481012658,
+ "grad_norm": 0.04080849885940552,
+ "learning_rate": 2.805836139169472e-07,
+ "loss": 0.017817523330450058,
+ "step": 1976
+ },
+ {
+ "epoch": 9.987341772151899,
+ "grad_norm": 0.03473231568932533,
+ "learning_rate": 2.2446689113355782e-07,
+ "loss": 0.020670736208558083,
+ "step": 1977
+ },
+ {
+ "epoch": 9.99240506329114,
+ "grad_norm": 0.04875967279076576,
+ "learning_rate": 1.6835016835016834e-07,
+ "loss": 0.024235252290964127,
+ "step": 1978
+ },
+ {
+ "epoch": 9.99746835443038,
+ "grad_norm": 0.04600756987929344,
+ "learning_rate": 1.1223344556677891e-07,
+ "loss": 0.01782885193824768,
+ "step": 1979
+ },
+ {
+ "epoch": 10.0,
+ "grad_norm": 0.05248195677995682,
+ "learning_rate": 5.6116722783389455e-08,
+ "loss": 0.023276718333363533,
+ "step": 1980
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 1980,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": true
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 1.260825557984256e+17,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-1980/training_args.bin b/checkpoint-1980/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ce6b9228ad6cf155da5af64a370f864d5fe04e56
--- /dev/null
+++ b/checkpoint-1980/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3a4d7936dc7001e3baf6e9cead308b6188ace221538f9d436668bdf0b1d43a1
+size 5777
diff --git a/checkpoint-20/README.md b/checkpoint-20/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..17bc522e13c6998ab7f14e4524a99f96b2e38000
--- /dev/null
+++ b/checkpoint-20/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-20/adapter_config.json b/checkpoint-20/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b01b681148ff188ab3d162c0d6bb07268b3adfca
--- /dev/null
+++ b/checkpoint-20/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-1.7B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "o_proj",
+ "v_proj",
+ "up_proj",
+ "down_proj",
+ "q_proj",
+ "gate_proj",
+ "k_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-20/adapter_model.safetensors b/checkpoint-20/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..66f03b176f21b292ccfdd2aaffed058db4267adf
--- /dev/null
+++ b/checkpoint-20/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd2858c4972c4cefa2c8e0bfcd88affea231d7a4afeb27068ea28c61338d6f99
+size 69782384
diff --git a/checkpoint-20/chat_template.jinja b/checkpoint-20/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-20/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-20/optimizer.pt b/checkpoint-20/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..fff3866a26ebda837e1c4796158e52653cb3ad9e
--- /dev/null
+++ b/checkpoint-20/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d81b30f8279c30218320d8e65c8d5d30b328252c38211ab72c9dc48fe7365443
+size 35873029
diff --git a/checkpoint-20/rng_state.pth b/checkpoint-20/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..fead4304753e2900e172284781541c879e4507c4
--- /dev/null
+++ b/checkpoint-20/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d6d8fafcd1ee268414be5acf0366296af5b03d60871978712eac1979cb42d65
+size 14645
diff --git a/checkpoint-20/scheduler.pt b/checkpoint-20/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..3de9715d40c01b37331d4175d662e27f66413e37
--- /dev/null
+++ b/checkpoint-20/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6f39fd07483e62f7ff4083beb5fbf2046b19d06cb9b2fa876e32871776e88516
+size 1465
diff --git a/checkpoint-20/tokenizer.json b/checkpoint-20/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-20/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-20/tokenizer_config.json b/checkpoint-20/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-20/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-20/trainer_state.json b/checkpoint-20/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..e9b843ac52e9598c84f3093593b1ec0467a0ed6a
--- /dev/null
+++ b/checkpoint-20/trainer_state.json
@@ -0,0 +1,174 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 4.0,
+ "eval_steps": 500,
+ "global_step": 20,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.8728970289230347,
+ "learning_rate": 0.0,
+ "loss": 1.7144343852996826,
+ "step": 1
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.6763373613357544,
+ "learning_rate": 2e-05,
+ "loss": 1.4952771663665771,
+ "step": 2
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 1.7191307544708252,
+ "learning_rate": 4e-05,
+ "loss": 1.574378252029419,
+ "step": 3
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 1.7878174781799316,
+ "learning_rate": 6e-05,
+ "loss": 1.6600843667984009,
+ "step": 4
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 1.929695725440979,
+ "learning_rate": 8e-05,
+ "loss": 1.7657139301300049,
+ "step": 5
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 1.8718829154968262,
+ "learning_rate": 0.0001,
+ "loss": 1.6730849742889404,
+ "step": 6
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 1.7125587463378906,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 1.5219359397888184,
+ "step": 7
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 1.4176026582717896,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 1.2670559883117676,
+ "step": 8
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 1.132968544960022,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.9341962933540344,
+ "step": 9
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 1.0091828107833862,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.9576144218444824,
+ "step": 10
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.9517018795013428,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 1.0370712280273438,
+ "step": 11
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.7950196266174316,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.8810007572174072,
+ "step": 12
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.5975409150123596,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.6599255204200745,
+ "step": 13
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.670741617679596,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.7524279356002808,
+ "step": 14
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.6229442358016968,
+ "learning_rate": 8e-05,
+ "loss": 0.7022373676300049,
+ "step": 15
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.6008868217468262,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.7129132151603699,
+ "step": 16
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.4868341386318207,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.5670006275177002,
+ "step": 17
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.3936000168323517,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.4459620416164398,
+ "step": 18
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.6198397278785706,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.6668416261672974,
+ "step": 19
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.4862337112426758,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.5134721398353577,
+ "step": 20
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 50,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 370317027262464.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-20/training_args.bin b/checkpoint-20/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-20/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-200/README.md b/checkpoint-200/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-200/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-200/adapter_config.json b/checkpoint-200/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-200/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-200/adapter_model.safetensors b/checkpoint-200/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c23f37434c710918e03adaf56c44ea324e937c32
--- /dev/null
+++ b/checkpoint-200/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4837b76e9ca172e82f4a4c34c58fac010822ad2b63468fc38baa7ba9213c2c9f
+size 132187888
diff --git a/checkpoint-200/chat_template.jinja b/checkpoint-200/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-200/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-200/optimizer.pt b/checkpoint-200/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..7e18ad14001f1e9539d4f155a299eb83aec67e6a
--- /dev/null
+++ b/checkpoint-200/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:563ec7eae7726d361755c4b2352035adeb42cb5d6af602e281500e02de57533d
+size 67688197
diff --git a/checkpoint-200/rng_state.pth b/checkpoint-200/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..f2b227c0cab23c835054e23d3b4f04c526244af2
--- /dev/null
+++ b/checkpoint-200/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3f947f8aa5caa4e125266d06e9a43b5cd4aa4afba7b6e461769b4b5e73969952
+size 14645
diff --git a/checkpoint-200/scheduler.pt b/checkpoint-200/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..a2bbc971a1dc5edc249c1e900e0c0636d0e89b90
--- /dev/null
+++ b/checkpoint-200/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0165c794b96f4138b584029c9c4f47fbd9e820f8bf59534338f3c84cb241fd3c
+size 1465
diff --git a/checkpoint-200/tokenizer.json b/checkpoint-200/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-200/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-200/tokenizer_config.json b/checkpoint-200/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-200/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-200/trainer_state.json b/checkpoint-200/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..7abd99784d6bb3999d1219cb5e0f1a4b80647f8f
--- /dev/null
+++ b/checkpoint-200/trainer_state.json
@@ -0,0 +1,1434 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 8.0,
+ "eval_steps": 500,
+ "global_step": 200,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ },
+ {
+ "epoch": 1.04,
+ "grad_norm": 0.36699211597442627,
+ "learning_rate": 0.0001,
+ "loss": 0.4363247752189636,
+ "step": 26
+ },
+ {
+ "epoch": 1.08,
+ "grad_norm": 0.3731786608695984,
+ "learning_rate": 9.955555555555556e-05,
+ "loss": 0.4297473430633545,
+ "step": 27
+ },
+ {
+ "epoch": 1.12,
+ "grad_norm": 0.3378784954547882,
+ "learning_rate": 9.911111111111112e-05,
+ "loss": 0.35973912477493286,
+ "step": 28
+ },
+ {
+ "epoch": 1.16,
+ "grad_norm": 0.36273664236068726,
+ "learning_rate": 9.866666666666668e-05,
+ "loss": 0.34903788566589355,
+ "step": 29
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 0.362885981798172,
+ "learning_rate": 9.822222222222223e-05,
+ "loss": 0.3119792342185974,
+ "step": 30
+ },
+ {
+ "epoch": 1.24,
+ "grad_norm": 0.3790324032306671,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 0.29530155658721924,
+ "step": 31
+ },
+ {
+ "epoch": 1.28,
+ "grad_norm": 0.37333837151527405,
+ "learning_rate": 9.733333333333335e-05,
+ "loss": 0.2653456926345825,
+ "step": 32
+ },
+ {
+ "epoch": 1.32,
+ "grad_norm": 0.32163503766059875,
+ "learning_rate": 9.68888888888889e-05,
+ "loss": 0.19654956459999084,
+ "step": 33
+ },
+ {
+ "epoch": 1.3599999999999999,
+ "grad_norm": 0.5297159552574158,
+ "learning_rate": 9.644444444444445e-05,
+ "loss": 0.23580318689346313,
+ "step": 34
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.4474238455295563,
+ "learning_rate": 9.6e-05,
+ "loss": 0.18798796832561493,
+ "step": 35
+ },
+ {
+ "epoch": 1.44,
+ "grad_norm": 0.31346794962882996,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 0.12066371738910675,
+ "step": 36
+ },
+ {
+ "epoch": 1.48,
+ "grad_norm": 0.3099532723426819,
+ "learning_rate": 9.511111111111112e-05,
+ "loss": 0.08859007060527802,
+ "step": 37
+ },
+ {
+ "epoch": 1.52,
+ "grad_norm": 0.3490828275680542,
+ "learning_rate": 9.466666666666667e-05,
+ "loss": 0.07878822088241577,
+ "step": 38
+ },
+ {
+ "epoch": 1.56,
+ "grad_norm": 0.32395538687705994,
+ "learning_rate": 9.422222222222223e-05,
+ "loss": 0.06694570928812027,
+ "step": 39
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 0.20870603621006012,
+ "learning_rate": 9.377777777777779e-05,
+ "loss": 0.04379018768668175,
+ "step": 40
+ },
+ {
+ "epoch": 1.6400000000000001,
+ "grad_norm": 0.3310009837150574,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.048647329211235046,
+ "step": 41
+ },
+ {
+ "epoch": 1.6800000000000002,
+ "grad_norm": 0.26949432492256165,
+ "learning_rate": 9.28888888888889e-05,
+ "loss": 0.039286017417907715,
+ "step": 42
+ },
+ {
+ "epoch": 1.72,
+ "grad_norm": 0.11029712855815887,
+ "learning_rate": 9.244444444444445e-05,
+ "loss": 0.029231950640678406,
+ "step": 43
+ },
+ {
+ "epoch": 1.76,
+ "grad_norm": 0.1476302146911621,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.027003085240721703,
+ "step": 44
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.18617521226406097,
+ "learning_rate": 9.155555555555557e-05,
+ "loss": 0.025106143206357956,
+ "step": 45
+ },
+ {
+ "epoch": 1.8399999999999999,
+ "grad_norm": 0.13198262453079224,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.025741657242178917,
+ "step": 46
+ },
+ {
+ "epoch": 1.88,
+ "grad_norm": 0.26712384819984436,
+ "learning_rate": 9.066666666666667e-05,
+ "loss": 0.035036977380514145,
+ "step": 47
+ },
+ {
+ "epoch": 1.92,
+ "grad_norm": 0.3569182753562927,
+ "learning_rate": 9.022222222222224e-05,
+ "loss": 0.04259534925222397,
+ "step": 48
+ },
+ {
+ "epoch": 1.96,
+ "grad_norm": 0.1843830794095993,
+ "learning_rate": 8.977777777777779e-05,
+ "loss": 0.03471647948026657,
+ "step": 49
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.1248057410120964,
+ "learning_rate": 8.933333333333334e-05,
+ "loss": 0.030936148017644882,
+ "step": 50
+ },
+ {
+ "epoch": 2.04,
+ "grad_norm": 0.12060711532831192,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.032452136278152466,
+ "step": 51
+ },
+ {
+ "epoch": 2.08,
+ "grad_norm": 0.2026030570268631,
+ "learning_rate": 8.844444444444445e-05,
+ "loss": 0.03268110007047653,
+ "step": 52
+ },
+ {
+ "epoch": 2.12,
+ "grad_norm": 0.21289987862110138,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.03406357392668724,
+ "step": 53
+ },
+ {
+ "epoch": 2.16,
+ "grad_norm": 0.14732478559017181,
+ "learning_rate": 8.755555555555556e-05,
+ "loss": 0.02936721034348011,
+ "step": 54
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.10120426118373871,
+ "learning_rate": 8.711111111111112e-05,
+ "loss": 0.02511693350970745,
+ "step": 55
+ },
+ {
+ "epoch": 2.24,
+ "grad_norm": 0.08917918056249619,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.025877539068460464,
+ "step": 56
+ },
+ {
+ "epoch": 2.2800000000000002,
+ "grad_norm": 0.08735086023807526,
+ "learning_rate": 8.622222222222222e-05,
+ "loss": 0.02145460993051529,
+ "step": 57
+ },
+ {
+ "epoch": 2.32,
+ "grad_norm": 0.07835431396961212,
+ "learning_rate": 8.577777777777777e-05,
+ "loss": 0.021244943141937256,
+ "step": 58
+ },
+ {
+ "epoch": 2.36,
+ "grad_norm": 0.06953317672014236,
+ "learning_rate": 8.533333333333334e-05,
+ "loss": 0.02279437705874443,
+ "step": 59
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.0854259729385376,
+ "learning_rate": 8.488888888888889e-05,
+ "loss": 0.023704543709754944,
+ "step": 60
+ },
+ {
+ "epoch": 2.44,
+ "grad_norm": 0.17068363726139069,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.035272784531116486,
+ "step": 61
+ },
+ {
+ "epoch": 2.48,
+ "grad_norm": 0.11971863359212875,
+ "learning_rate": 8.4e-05,
+ "loss": 0.02707826718688011,
+ "step": 62
+ },
+ {
+ "epoch": 2.52,
+ "grad_norm": 0.05303095281124115,
+ "learning_rate": 8.355555555555556e-05,
+ "loss": 0.01696968823671341,
+ "step": 63
+ },
+ {
+ "epoch": 2.56,
+ "grad_norm": 0.06503961980342865,
+ "learning_rate": 8.311111111111111e-05,
+ "loss": 0.018413860350847244,
+ "step": 64
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.05390244349837303,
+ "learning_rate": 8.266666666666667e-05,
+ "loss": 0.01641814410686493,
+ "step": 65
+ },
+ {
+ "epoch": 2.64,
+ "grad_norm": 0.07149611413478851,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.020658448338508606,
+ "step": 66
+ },
+ {
+ "epoch": 2.68,
+ "grad_norm": 0.09244706481695175,
+ "learning_rate": 8.177777777777778e-05,
+ "loss": 0.022394295781850815,
+ "step": 67
+ },
+ {
+ "epoch": 2.7199999999999998,
+ "grad_norm": 0.11381954699754715,
+ "learning_rate": 8.133333333333334e-05,
+ "loss": 0.028476765379309654,
+ "step": 68
+ },
+ {
+ "epoch": 2.76,
+ "grad_norm": 0.07354001700878143,
+ "learning_rate": 8.088888888888889e-05,
+ "loss": 0.019497834146022797,
+ "step": 69
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.06727641820907593,
+ "learning_rate": 8.044444444444444e-05,
+ "loss": 0.014356930740177631,
+ "step": 70
+ },
+ {
+ "epoch": 2.84,
+ "grad_norm": 0.07417713105678558,
+ "learning_rate": 8e-05,
+ "loss": 0.01823577657341957,
+ "step": 71
+ },
+ {
+ "epoch": 2.88,
+ "grad_norm": 0.09163317829370499,
+ "learning_rate": 7.955555555555556e-05,
+ "loss": 0.02139071188867092,
+ "step": 72
+ },
+ {
+ "epoch": 2.92,
+ "grad_norm": 0.08178975433111191,
+ "learning_rate": 7.911111111111111e-05,
+ "loss": 0.018335483968257904,
+ "step": 73
+ },
+ {
+ "epoch": 2.96,
+ "grad_norm": 0.08015220612287521,
+ "learning_rate": 7.866666666666666e-05,
+ "loss": 0.016001513227820396,
+ "step": 74
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.08509402722120285,
+ "learning_rate": 7.822222222222223e-05,
+ "loss": 0.017747700214385986,
+ "step": 75
+ },
+ {
+ "epoch": 3.04,
+ "grad_norm": 0.07863253355026245,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.015054607763886452,
+ "step": 76
+ },
+ {
+ "epoch": 3.08,
+ "grad_norm": 0.09398715198040009,
+ "learning_rate": 7.733333333333333e-05,
+ "loss": 0.01887289062142372,
+ "step": 77
+ },
+ {
+ "epoch": 3.12,
+ "grad_norm": 0.12165197730064392,
+ "learning_rate": 7.688888888888889e-05,
+ "loss": 0.020169202238321304,
+ "step": 78
+ },
+ {
+ "epoch": 3.16,
+ "grad_norm": 0.07627179473638535,
+ "learning_rate": 7.644444444444445e-05,
+ "loss": 0.012153002433478832,
+ "step": 79
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.0885142832994461,
+ "learning_rate": 7.6e-05,
+ "loss": 0.015390444546937943,
+ "step": 80
+ },
+ {
+ "epoch": 3.24,
+ "grad_norm": 0.11557707190513611,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.019245222210884094,
+ "step": 81
+ },
+ {
+ "epoch": 3.2800000000000002,
+ "grad_norm": 0.0976581946015358,
+ "learning_rate": 7.511111111111111e-05,
+ "loss": 0.014158917590975761,
+ "step": 82
+ },
+ {
+ "epoch": 3.32,
+ "grad_norm": 0.09829393774271011,
+ "learning_rate": 7.466666666666667e-05,
+ "loss": 0.013099931180477142,
+ "step": 83
+ },
+ {
+ "epoch": 3.36,
+ "grad_norm": 0.10063999146223068,
+ "learning_rate": 7.422222222222223e-05,
+ "loss": 0.013834481127560139,
+ "step": 84
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.09943496435880661,
+ "learning_rate": 7.377777777777778e-05,
+ "loss": 0.012920765206217766,
+ "step": 85
+ },
+ {
+ "epoch": 3.44,
+ "grad_norm": 0.1093878448009491,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.013458158820867538,
+ "step": 86
+ },
+ {
+ "epoch": 3.48,
+ "grad_norm": 0.1128634586930275,
+ "learning_rate": 7.28888888888889e-05,
+ "loss": 0.013067865744233131,
+ "step": 87
+ },
+ {
+ "epoch": 3.52,
+ "grad_norm": 0.11049138009548187,
+ "learning_rate": 7.244444444444445e-05,
+ "loss": 0.01237843930721283,
+ "step": 88
+ },
+ {
+ "epoch": 3.56,
+ "grad_norm": 0.1535821557044983,
+ "learning_rate": 7.2e-05,
+ "loss": 0.015146344900131226,
+ "step": 89
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.10436677187681198,
+ "learning_rate": 7.155555555555555e-05,
+ "loss": 0.00996164046227932,
+ "step": 90
+ },
+ {
+ "epoch": 3.64,
+ "grad_norm": 0.14084051549434662,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.013795388862490654,
+ "step": 91
+ },
+ {
+ "epoch": 3.68,
+ "grad_norm": 0.12718933820724487,
+ "learning_rate": 7.066666666666667e-05,
+ "loss": 0.011878985911607742,
+ "step": 92
+ },
+ {
+ "epoch": 3.7199999999999998,
+ "grad_norm": 0.1412353217601776,
+ "learning_rate": 7.022222222222222e-05,
+ "loss": 0.010964864864945412,
+ "step": 93
+ },
+ {
+ "epoch": 3.76,
+ "grad_norm": 0.11453556269407272,
+ "learning_rate": 6.977777777777779e-05,
+ "loss": 0.008170144632458687,
+ "step": 94
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.16155096888542175,
+ "learning_rate": 6.933333333333334e-05,
+ "loss": 0.011488870717585087,
+ "step": 95
+ },
+ {
+ "epoch": 3.84,
+ "grad_norm": 0.11969174444675446,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.007895090617239475,
+ "step": 96
+ },
+ {
+ "epoch": 3.88,
+ "grad_norm": 0.22626101970672607,
+ "learning_rate": 6.844444444444445e-05,
+ "loss": 0.01467936858534813,
+ "step": 97
+ },
+ {
+ "epoch": 3.92,
+ "grad_norm": 0.21040032804012299,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.010772328823804855,
+ "step": 98
+ },
+ {
+ "epoch": 3.96,
+ "grad_norm": 0.19558775424957275,
+ "learning_rate": 6.755555555555557e-05,
+ "loss": 0.009220557287335396,
+ "step": 99
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.18061381578445435,
+ "learning_rate": 6.711111111111112e-05,
+ "loss": 0.006471008062362671,
+ "step": 100
+ },
+ {
+ "epoch": 4.04,
+ "grad_norm": 0.12179632484912872,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.0057976702228188515,
+ "step": 101
+ },
+ {
+ "epoch": 4.08,
+ "grad_norm": 0.12671399116516113,
+ "learning_rate": 6.622222222222224e-05,
+ "loss": 0.006621541455388069,
+ "step": 102
+ },
+ {
+ "epoch": 4.12,
+ "grad_norm": 0.11084511876106262,
+ "learning_rate": 6.577777777777779e-05,
+ "loss": 0.006054866127669811,
+ "step": 103
+ },
+ {
+ "epoch": 4.16,
+ "grad_norm": 0.12502190470695496,
+ "learning_rate": 6.533333333333334e-05,
+ "loss": 0.00817898940294981,
+ "step": 104
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.09107036888599396,
+ "learning_rate": 6.488888888888889e-05,
+ "loss": 0.006295117549598217,
+ "step": 105
+ },
+ {
+ "epoch": 4.24,
+ "grad_norm": 0.07194884121417999,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.006192575674504042,
+ "step": 106
+ },
+ {
+ "epoch": 4.28,
+ "grad_norm": 0.03464571759104729,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.003843494923785329,
+ "step": 107
+ },
+ {
+ "epoch": 4.32,
+ "grad_norm": 0.10040883719921112,
+ "learning_rate": 6.355555555555556e-05,
+ "loss": 0.006318099796772003,
+ "step": 108
+ },
+ {
+ "epoch": 4.36,
+ "grad_norm": 0.07303845882415771,
+ "learning_rate": 6.311111111111112e-05,
+ "loss": 0.0047858962789177895,
+ "step": 109
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.03440818190574646,
+ "learning_rate": 6.266666666666667e-05,
+ "loss": 0.004050814546644688,
+ "step": 110
+ },
+ {
+ "epoch": 4.44,
+ "grad_norm": 0.046613194048404694,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.0035898215137422085,
+ "step": 111
+ },
+ {
+ "epoch": 4.48,
+ "grad_norm": 0.02108742855489254,
+ "learning_rate": 6.177777777777779e-05,
+ "loss": 0.003291932400316,
+ "step": 112
+ },
+ {
+ "epoch": 4.52,
+ "grad_norm": 0.04408564418554306,
+ "learning_rate": 6.133333333333334e-05,
+ "loss": 0.0033779453951865435,
+ "step": 113
+ },
+ {
+ "epoch": 4.5600000000000005,
+ "grad_norm": 0.022311383858323097,
+ "learning_rate": 6.08888888888889e-05,
+ "loss": 0.0038345090579241514,
+ "step": 114
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.026365282014012337,
+ "learning_rate": 6.044444444444445e-05,
+ "loss": 0.004205222241580486,
+ "step": 115
+ },
+ {
+ "epoch": 4.64,
+ "grad_norm": 0.04582115262746811,
+ "learning_rate": 6e-05,
+ "loss": 0.005077291280031204,
+ "step": 116
+ },
+ {
+ "epoch": 4.68,
+ "grad_norm": 0.05057913810014725,
+ "learning_rate": 5.9555555555555554e-05,
+ "loss": 0.004747368395328522,
+ "step": 117
+ },
+ {
+ "epoch": 4.72,
+ "grad_norm": 0.04699229821562767,
+ "learning_rate": 5.911111111111112e-05,
+ "loss": 0.00538603262975812,
+ "step": 118
+ },
+ {
+ "epoch": 4.76,
+ "grad_norm": 0.026704438030719757,
+ "learning_rate": 5.866666666666667e-05,
+ "loss": 0.0041087716817855835,
+ "step": 119
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.04175629839301109,
+ "learning_rate": 5.8222222222222224e-05,
+ "loss": 0.004437651485204697,
+ "step": 120
+ },
+ {
+ "epoch": 4.84,
+ "grad_norm": 0.032657600939273834,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.003728377167135477,
+ "step": 121
+ },
+ {
+ "epoch": 4.88,
+ "grad_norm": 0.03405195474624634,
+ "learning_rate": 5.7333333333333336e-05,
+ "loss": 0.005017922259867191,
+ "step": 122
+ },
+ {
+ "epoch": 4.92,
+ "grad_norm": 0.02600262127816677,
+ "learning_rate": 5.6888888888888895e-05,
+ "loss": 0.003841507714241743,
+ "step": 123
+ },
+ {
+ "epoch": 4.96,
+ "grad_norm": 0.03402233496308327,
+ "learning_rate": 5.644444444444445e-05,
+ "loss": 0.002483899937942624,
+ "step": 124
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.03151554986834526,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 0.0036559500731527805,
+ "step": 125
+ },
+ {
+ "epoch": 5.04,
+ "grad_norm": 0.03822990879416466,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.0028562736697494984,
+ "step": 126
+ },
+ {
+ "epoch": 5.08,
+ "grad_norm": 0.028356632217764854,
+ "learning_rate": 5.511111111111111e-05,
+ "loss": 0.003123738570138812,
+ "step": 127
+ },
+ {
+ "epoch": 5.12,
+ "grad_norm": 0.032560307532548904,
+ "learning_rate": 5.466666666666666e-05,
+ "loss": 0.004612874239683151,
+ "step": 128
+ },
+ {
+ "epoch": 5.16,
+ "grad_norm": 0.023662906140089035,
+ "learning_rate": 5.422222222222223e-05,
+ "loss": 0.0028404039330780506,
+ "step": 129
+ },
+ {
+ "epoch": 5.2,
+ "grad_norm": 0.03967975080013275,
+ "learning_rate": 5.377777777777778e-05,
+ "loss": 0.004116460680961609,
+ "step": 130
+ },
+ {
+ "epoch": 5.24,
+ "grad_norm": 0.02488141693174839,
+ "learning_rate": 5.333333333333333e-05,
+ "loss": 0.0041904142126441,
+ "step": 131
+ },
+ {
+ "epoch": 5.28,
+ "grad_norm": 0.011391286738216877,
+ "learning_rate": 5.2888888888888885e-05,
+ "loss": 0.002993058878928423,
+ "step": 132
+ },
+ {
+ "epoch": 5.32,
+ "grad_norm": 0.02595183439552784,
+ "learning_rate": 5.244444444444445e-05,
+ "loss": 0.00301048019900918,
+ "step": 133
+ },
+ {
+ "epoch": 5.36,
+ "grad_norm": 0.014937770552933216,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 0.003106491407379508,
+ "step": 134
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.0208111684769392,
+ "learning_rate": 5.1555555555555556e-05,
+ "loss": 0.003945561125874519,
+ "step": 135
+ },
+ {
+ "epoch": 5.44,
+ "grad_norm": 0.01186386402696371,
+ "learning_rate": 5.111111111111111e-05,
+ "loss": 0.003586095292121172,
+ "step": 136
+ },
+ {
+ "epoch": 5.48,
+ "grad_norm": 0.012205840088427067,
+ "learning_rate": 5.0666666666666674e-05,
+ "loss": 0.0032413718290627003,
+ "step": 137
+ },
+ {
+ "epoch": 5.52,
+ "grad_norm": 0.02764296717941761,
+ "learning_rate": 5.0222222222222226e-05,
+ "loss": 0.0030944915488362312,
+ "step": 138
+ },
+ {
+ "epoch": 5.5600000000000005,
+ "grad_norm": 0.023670295253396034,
+ "learning_rate": 4.977777777777778e-05,
+ "loss": 0.0030482488218694925,
+ "step": 139
+ },
+ {
+ "epoch": 5.6,
+ "grad_norm": 0.024959059432148933,
+ "learning_rate": 4.933333333333334e-05,
+ "loss": 0.002743522170931101,
+ "step": 140
+ },
+ {
+ "epoch": 5.64,
+ "grad_norm": 0.019349221140146255,
+ "learning_rate": 4.888888888888889e-05,
+ "loss": 0.002883533015847206,
+ "step": 141
+ },
+ {
+ "epoch": 5.68,
+ "grad_norm": 0.021185332909226418,
+ "learning_rate": 4.844444444444445e-05,
+ "loss": 0.0025618618819862604,
+ "step": 142
+ },
+ {
+ "epoch": 5.72,
+ "grad_norm": 0.017232399433851242,
+ "learning_rate": 4.8e-05,
+ "loss": 0.0027296345215290785,
+ "step": 143
+ },
+ {
+ "epoch": 5.76,
+ "grad_norm": 0.025460300967097282,
+ "learning_rate": 4.755555555555556e-05,
+ "loss": 0.002679885132238269,
+ "step": 144
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.021230001002550125,
+ "learning_rate": 4.711111111111111e-05,
+ "loss": 0.0037597499322146177,
+ "step": 145
+ },
+ {
+ "epoch": 5.84,
+ "grad_norm": 0.018495697528123856,
+ "learning_rate": 4.666666666666667e-05,
+ "loss": 0.0026929471641778946,
+ "step": 146
+ },
+ {
+ "epoch": 5.88,
+ "grad_norm": 0.027612268924713135,
+ "learning_rate": 4.6222222222222224e-05,
+ "loss": 0.0031238074880093336,
+ "step": 147
+ },
+ {
+ "epoch": 5.92,
+ "grad_norm": 0.039522312581539154,
+ "learning_rate": 4.577777777777778e-05,
+ "loss": 0.0035351444967091084,
+ "step": 148
+ },
+ {
+ "epoch": 5.96,
+ "grad_norm": 0.014303261414170265,
+ "learning_rate": 4.5333333333333335e-05,
+ "loss": 0.0025896867737174034,
+ "step": 149
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.03775525838136673,
+ "learning_rate": 4.4888888888888894e-05,
+ "loss": 0.0035551211331039667,
+ "step": 150
+ },
+ {
+ "epoch": 6.04,
+ "grad_norm": 0.04990272596478462,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.004297541920095682,
+ "step": 151
+ },
+ {
+ "epoch": 6.08,
+ "grad_norm": 0.017710352316498756,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 0.0033112887758761644,
+ "step": 152
+ },
+ {
+ "epoch": 6.12,
+ "grad_norm": 0.022754572331905365,
+ "learning_rate": 4.355555555555556e-05,
+ "loss": 0.002353265881538391,
+ "step": 153
+ },
+ {
+ "epoch": 6.16,
+ "grad_norm": 0.02410873770713806,
+ "learning_rate": 4.311111111111111e-05,
+ "loss": 0.0037385188043117523,
+ "step": 154
+ },
+ {
+ "epoch": 6.2,
+ "grad_norm": 0.02232186868786812,
+ "learning_rate": 4.266666666666667e-05,
+ "loss": 0.00313817011192441,
+ "step": 155
+ },
+ {
+ "epoch": 6.24,
+ "grad_norm": 0.02414192631840706,
+ "learning_rate": 4.222222222222222e-05,
+ "loss": 0.003970893565565348,
+ "step": 156
+ },
+ {
+ "epoch": 6.28,
+ "grad_norm": 0.03084409236907959,
+ "learning_rate": 4.177777777777778e-05,
+ "loss": 0.0034115584567189217,
+ "step": 157
+ },
+ {
+ "epoch": 6.32,
+ "grad_norm": 0.035011716187000275,
+ "learning_rate": 4.133333333333333e-05,
+ "loss": 0.004035938531160355,
+ "step": 158
+ },
+ {
+ "epoch": 6.36,
+ "grad_norm": 0.0190069992095232,
+ "learning_rate": 4.088888888888889e-05,
+ "loss": 0.003001230303198099,
+ "step": 159
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.03748108446598053,
+ "learning_rate": 4.0444444444444444e-05,
+ "loss": 0.0041668531484901905,
+ "step": 160
+ },
+ {
+ "epoch": 6.44,
+ "grad_norm": 0.03820832818746567,
+ "learning_rate": 4e-05,
+ "loss": 0.0028840310405939817,
+ "step": 161
+ },
+ {
+ "epoch": 6.48,
+ "grad_norm": 0.039001427590847015,
+ "learning_rate": 3.9555555555555556e-05,
+ "loss": 0.0028830585069954395,
+ "step": 162
+ },
+ {
+ "epoch": 6.52,
+ "grad_norm": 0.02733510732650757,
+ "learning_rate": 3.9111111111111115e-05,
+ "loss": 0.002750289160758257,
+ "step": 163
+ },
+ {
+ "epoch": 6.5600000000000005,
+ "grad_norm": 0.01641351543366909,
+ "learning_rate": 3.866666666666667e-05,
+ "loss": 0.002791184466332197,
+ "step": 164
+ },
+ {
+ "epoch": 6.6,
+ "grad_norm": 0.021426184102892876,
+ "learning_rate": 3.8222222222222226e-05,
+ "loss": 0.0032122773118317127,
+ "step": 165
+ },
+ {
+ "epoch": 6.64,
+ "grad_norm": 0.026212267577648163,
+ "learning_rate": 3.777777777777778e-05,
+ "loss": 0.002747473306953907,
+ "step": 166
+ },
+ {
+ "epoch": 6.68,
+ "grad_norm": 0.019693776965141296,
+ "learning_rate": 3.733333333333334e-05,
+ "loss": 0.002691935747861862,
+ "step": 167
+ },
+ {
+ "epoch": 6.72,
+ "grad_norm": 0.02187752164900303,
+ "learning_rate": 3.688888888888889e-05,
+ "loss": 0.0032634371891617775,
+ "step": 168
+ },
+ {
+ "epoch": 6.76,
+ "grad_norm": 0.02258922904729843,
+ "learning_rate": 3.644444444444445e-05,
+ "loss": 0.0025645019486546516,
+ "step": 169
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.02120850421488285,
+ "learning_rate": 3.6e-05,
+ "loss": 0.002402626909315586,
+ "step": 170
+ },
+ {
+ "epoch": 6.84,
+ "grad_norm": 0.027142135426402092,
+ "learning_rate": 3.555555555555556e-05,
+ "loss": 0.0029081657994538546,
+ "step": 171
+ },
+ {
+ "epoch": 6.88,
+ "grad_norm": 0.016608284786343575,
+ "learning_rate": 3.511111111111111e-05,
+ "loss": 0.002675814088433981,
+ "step": 172
+ },
+ {
+ "epoch": 6.92,
+ "grad_norm": 0.025261735543608665,
+ "learning_rate": 3.466666666666667e-05,
+ "loss": 0.0027554240077733994,
+ "step": 173
+ },
+ {
+ "epoch": 6.96,
+ "grad_norm": 0.027320940047502518,
+ "learning_rate": 3.4222222222222224e-05,
+ "loss": 0.003410451812669635,
+ "step": 174
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.026871275156736374,
+ "learning_rate": 3.377777777777778e-05,
+ "loss": 0.003376966342329979,
+ "step": 175
+ },
+ {
+ "epoch": 7.04,
+ "grad_norm": 0.016450949013233185,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.002620718441903591,
+ "step": 176
+ },
+ {
+ "epoch": 7.08,
+ "grad_norm": 0.010365518741309643,
+ "learning_rate": 3.2888888888888894e-05,
+ "loss": 0.0021599559113383293,
+ "step": 177
+ },
+ {
+ "epoch": 7.12,
+ "grad_norm": 0.022241489961743355,
+ "learning_rate": 3.2444444444444446e-05,
+ "loss": 0.0017859019571915269,
+ "step": 178
+ },
+ {
+ "epoch": 7.16,
+ "grad_norm": 0.020874621346592903,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 0.002129746600985527,
+ "step": 179
+ },
+ {
+ "epoch": 7.2,
+ "grad_norm": 0.04520160332322121,
+ "learning_rate": 3.155555555555556e-05,
+ "loss": 0.004575295373797417,
+ "step": 180
+ },
+ {
+ "epoch": 7.24,
+ "grad_norm": 0.0321652777493,
+ "learning_rate": 3.111111111111111e-05,
+ "loss": 0.003585377475246787,
+ "step": 181
+ },
+ {
+ "epoch": 7.28,
+ "grad_norm": 0.06066919490695,
+ "learning_rate": 3.066666666666667e-05,
+ "loss": 0.004659339785575867,
+ "step": 182
+ },
+ {
+ "epoch": 7.32,
+ "grad_norm": 0.05730052664875984,
+ "learning_rate": 3.0222222222222225e-05,
+ "loss": 0.005264223553240299,
+ "step": 183
+ },
+ {
+ "epoch": 7.36,
+ "grad_norm": 0.03588332608342171,
+ "learning_rate": 2.9777777777777777e-05,
+ "loss": 0.0038815282750874758,
+ "step": 184
+ },
+ {
+ "epoch": 7.4,
+ "grad_norm": 0.01236315630376339,
+ "learning_rate": 2.9333333333333336e-05,
+ "loss": 0.0027745934203267097,
+ "step": 185
+ },
+ {
+ "epoch": 7.44,
+ "grad_norm": 0.029325781390070915,
+ "learning_rate": 2.8888888888888888e-05,
+ "loss": 0.002651514019817114,
+ "step": 186
+ },
+ {
+ "epoch": 7.48,
+ "grad_norm": 0.020734379068017006,
+ "learning_rate": 2.8444444444444447e-05,
+ "loss": 0.002661932958289981,
+ "step": 187
+ },
+ {
+ "epoch": 7.52,
+ "grad_norm": 0.01843331567943096,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 0.0035277302376925945,
+ "step": 188
+ },
+ {
+ "epoch": 7.5600000000000005,
+ "grad_norm": 0.026685994118452072,
+ "learning_rate": 2.7555555555555555e-05,
+ "loss": 0.0020395792089402676,
+ "step": 189
+ },
+ {
+ "epoch": 7.6,
+ "grad_norm": 0.033618271350860596,
+ "learning_rate": 2.7111111111111114e-05,
+ "loss": 0.0031584161333739758,
+ "step": 190
+ },
+ {
+ "epoch": 7.64,
+ "grad_norm": 0.030674412846565247,
+ "learning_rate": 2.6666666666666667e-05,
+ "loss": 0.0027489513158798218,
+ "step": 191
+ },
+ {
+ "epoch": 7.68,
+ "grad_norm": 0.015450477600097656,
+ "learning_rate": 2.6222222222222226e-05,
+ "loss": 0.002614565659314394,
+ "step": 192
+ },
+ {
+ "epoch": 7.72,
+ "grad_norm": 0.017924876883625984,
+ "learning_rate": 2.5777777777777778e-05,
+ "loss": 0.0035272736568003893,
+ "step": 193
+ },
+ {
+ "epoch": 7.76,
+ "grad_norm": 0.02555103413760662,
+ "learning_rate": 2.5333333333333337e-05,
+ "loss": 0.002506188815459609,
+ "step": 194
+ },
+ {
+ "epoch": 7.8,
+ "grad_norm": 0.016485845670104027,
+ "learning_rate": 2.488888888888889e-05,
+ "loss": 0.0030358778312802315,
+ "step": 195
+ },
+ {
+ "epoch": 7.84,
+ "grad_norm": 0.01830879971385002,
+ "learning_rate": 2.4444444444444445e-05,
+ "loss": 0.003063053358346224,
+ "step": 196
+ },
+ {
+ "epoch": 7.88,
+ "grad_norm": 0.01950378157198429,
+ "learning_rate": 2.4e-05,
+ "loss": 0.003265776438638568,
+ "step": 197
+ },
+ {
+ "epoch": 7.92,
+ "grad_norm": 0.02045619860291481,
+ "learning_rate": 2.3555555555555556e-05,
+ "loss": 0.0033433851785957813,
+ "step": 198
+ },
+ {
+ "epoch": 7.96,
+ "grad_norm": 0.0100328978151083,
+ "learning_rate": 2.3111111111111112e-05,
+ "loss": 0.0027878526598215103,
+ "step": 199
+ },
+ {
+ "epoch": 8.0,
+ "grad_norm": 0.010031516663730145,
+ "learning_rate": 2.2666666666666668e-05,
+ "loss": 0.0027771005406975746,
+ "step": 200
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 9810610641960960.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-200/training_args.bin b/checkpoint-200/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-200/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-225/README.md b/checkpoint-225/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-225/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-225/adapter_config.json b/checkpoint-225/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-225/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-225/adapter_model.safetensors b/checkpoint-225/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..51cbbf1ca2d824b3db4c00e152a441d59bcb8666
--- /dev/null
+++ b/checkpoint-225/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:400cc8c8dda406d2d9fb482a8e2fddea4185ef20930052fe6239afacdb2c8614
+size 132187888
diff --git a/checkpoint-225/chat_template.jinja b/checkpoint-225/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-225/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-225/optimizer.pt b/checkpoint-225/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..49a716ce849921832e2f1f7a2adea0f280f754ed
--- /dev/null
+++ b/checkpoint-225/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:05718733040f9944531154adb68957d39dda980f6315e5e64a5fac0a769db8b4
+size 67688197
diff --git a/checkpoint-225/rng_state.pth b/checkpoint-225/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..77729d4bc088ad9fab197923e9ca84ef702af1bc
--- /dev/null
+++ b/checkpoint-225/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6846fcb7fd5a783ad80e0c1c5902482ea69e479e8dfeb46ebc73e2f33affb875
+size 14645
diff --git a/checkpoint-225/scheduler.pt b/checkpoint-225/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..197d24787b0f3d5bd1d0b85d1021eefe8728b3cb
--- /dev/null
+++ b/checkpoint-225/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8c82872be641e4971effc1c710e19a03caa7f2e1e7828dfeba094eb4c1b25a18
+size 1465
diff --git a/checkpoint-225/tokenizer.json b/checkpoint-225/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-225/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-225/tokenizer_config.json b/checkpoint-225/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-225/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-225/trainer_state.json b/checkpoint-225/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..89d5453a2cf0d42cb57f4059955fd0a3ca1e9e70
--- /dev/null
+++ b/checkpoint-225/trainer_state.json
@@ -0,0 +1,1609 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 9.0,
+ "eval_steps": 500,
+ "global_step": 225,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ },
+ {
+ "epoch": 1.04,
+ "grad_norm": 0.36699211597442627,
+ "learning_rate": 0.0001,
+ "loss": 0.4363247752189636,
+ "step": 26
+ },
+ {
+ "epoch": 1.08,
+ "grad_norm": 0.3731786608695984,
+ "learning_rate": 9.955555555555556e-05,
+ "loss": 0.4297473430633545,
+ "step": 27
+ },
+ {
+ "epoch": 1.12,
+ "grad_norm": 0.3378784954547882,
+ "learning_rate": 9.911111111111112e-05,
+ "loss": 0.35973912477493286,
+ "step": 28
+ },
+ {
+ "epoch": 1.16,
+ "grad_norm": 0.36273664236068726,
+ "learning_rate": 9.866666666666668e-05,
+ "loss": 0.34903788566589355,
+ "step": 29
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 0.362885981798172,
+ "learning_rate": 9.822222222222223e-05,
+ "loss": 0.3119792342185974,
+ "step": 30
+ },
+ {
+ "epoch": 1.24,
+ "grad_norm": 0.3790324032306671,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 0.29530155658721924,
+ "step": 31
+ },
+ {
+ "epoch": 1.28,
+ "grad_norm": 0.37333837151527405,
+ "learning_rate": 9.733333333333335e-05,
+ "loss": 0.2653456926345825,
+ "step": 32
+ },
+ {
+ "epoch": 1.32,
+ "grad_norm": 0.32163503766059875,
+ "learning_rate": 9.68888888888889e-05,
+ "loss": 0.19654956459999084,
+ "step": 33
+ },
+ {
+ "epoch": 1.3599999999999999,
+ "grad_norm": 0.5297159552574158,
+ "learning_rate": 9.644444444444445e-05,
+ "loss": 0.23580318689346313,
+ "step": 34
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.4474238455295563,
+ "learning_rate": 9.6e-05,
+ "loss": 0.18798796832561493,
+ "step": 35
+ },
+ {
+ "epoch": 1.44,
+ "grad_norm": 0.31346794962882996,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 0.12066371738910675,
+ "step": 36
+ },
+ {
+ "epoch": 1.48,
+ "grad_norm": 0.3099532723426819,
+ "learning_rate": 9.511111111111112e-05,
+ "loss": 0.08859007060527802,
+ "step": 37
+ },
+ {
+ "epoch": 1.52,
+ "grad_norm": 0.3490828275680542,
+ "learning_rate": 9.466666666666667e-05,
+ "loss": 0.07878822088241577,
+ "step": 38
+ },
+ {
+ "epoch": 1.56,
+ "grad_norm": 0.32395538687705994,
+ "learning_rate": 9.422222222222223e-05,
+ "loss": 0.06694570928812027,
+ "step": 39
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 0.20870603621006012,
+ "learning_rate": 9.377777777777779e-05,
+ "loss": 0.04379018768668175,
+ "step": 40
+ },
+ {
+ "epoch": 1.6400000000000001,
+ "grad_norm": 0.3310009837150574,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.048647329211235046,
+ "step": 41
+ },
+ {
+ "epoch": 1.6800000000000002,
+ "grad_norm": 0.26949432492256165,
+ "learning_rate": 9.28888888888889e-05,
+ "loss": 0.039286017417907715,
+ "step": 42
+ },
+ {
+ "epoch": 1.72,
+ "grad_norm": 0.11029712855815887,
+ "learning_rate": 9.244444444444445e-05,
+ "loss": 0.029231950640678406,
+ "step": 43
+ },
+ {
+ "epoch": 1.76,
+ "grad_norm": 0.1476302146911621,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.027003085240721703,
+ "step": 44
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.18617521226406097,
+ "learning_rate": 9.155555555555557e-05,
+ "loss": 0.025106143206357956,
+ "step": 45
+ },
+ {
+ "epoch": 1.8399999999999999,
+ "grad_norm": 0.13198262453079224,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.025741657242178917,
+ "step": 46
+ },
+ {
+ "epoch": 1.88,
+ "grad_norm": 0.26712384819984436,
+ "learning_rate": 9.066666666666667e-05,
+ "loss": 0.035036977380514145,
+ "step": 47
+ },
+ {
+ "epoch": 1.92,
+ "grad_norm": 0.3569182753562927,
+ "learning_rate": 9.022222222222224e-05,
+ "loss": 0.04259534925222397,
+ "step": 48
+ },
+ {
+ "epoch": 1.96,
+ "grad_norm": 0.1843830794095993,
+ "learning_rate": 8.977777777777779e-05,
+ "loss": 0.03471647948026657,
+ "step": 49
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.1248057410120964,
+ "learning_rate": 8.933333333333334e-05,
+ "loss": 0.030936148017644882,
+ "step": 50
+ },
+ {
+ "epoch": 2.04,
+ "grad_norm": 0.12060711532831192,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.032452136278152466,
+ "step": 51
+ },
+ {
+ "epoch": 2.08,
+ "grad_norm": 0.2026030570268631,
+ "learning_rate": 8.844444444444445e-05,
+ "loss": 0.03268110007047653,
+ "step": 52
+ },
+ {
+ "epoch": 2.12,
+ "grad_norm": 0.21289987862110138,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.03406357392668724,
+ "step": 53
+ },
+ {
+ "epoch": 2.16,
+ "grad_norm": 0.14732478559017181,
+ "learning_rate": 8.755555555555556e-05,
+ "loss": 0.02936721034348011,
+ "step": 54
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.10120426118373871,
+ "learning_rate": 8.711111111111112e-05,
+ "loss": 0.02511693350970745,
+ "step": 55
+ },
+ {
+ "epoch": 2.24,
+ "grad_norm": 0.08917918056249619,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.025877539068460464,
+ "step": 56
+ },
+ {
+ "epoch": 2.2800000000000002,
+ "grad_norm": 0.08735086023807526,
+ "learning_rate": 8.622222222222222e-05,
+ "loss": 0.02145460993051529,
+ "step": 57
+ },
+ {
+ "epoch": 2.32,
+ "grad_norm": 0.07835431396961212,
+ "learning_rate": 8.577777777777777e-05,
+ "loss": 0.021244943141937256,
+ "step": 58
+ },
+ {
+ "epoch": 2.36,
+ "grad_norm": 0.06953317672014236,
+ "learning_rate": 8.533333333333334e-05,
+ "loss": 0.02279437705874443,
+ "step": 59
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.0854259729385376,
+ "learning_rate": 8.488888888888889e-05,
+ "loss": 0.023704543709754944,
+ "step": 60
+ },
+ {
+ "epoch": 2.44,
+ "grad_norm": 0.17068363726139069,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.035272784531116486,
+ "step": 61
+ },
+ {
+ "epoch": 2.48,
+ "grad_norm": 0.11971863359212875,
+ "learning_rate": 8.4e-05,
+ "loss": 0.02707826718688011,
+ "step": 62
+ },
+ {
+ "epoch": 2.52,
+ "grad_norm": 0.05303095281124115,
+ "learning_rate": 8.355555555555556e-05,
+ "loss": 0.01696968823671341,
+ "step": 63
+ },
+ {
+ "epoch": 2.56,
+ "grad_norm": 0.06503961980342865,
+ "learning_rate": 8.311111111111111e-05,
+ "loss": 0.018413860350847244,
+ "step": 64
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.05390244349837303,
+ "learning_rate": 8.266666666666667e-05,
+ "loss": 0.01641814410686493,
+ "step": 65
+ },
+ {
+ "epoch": 2.64,
+ "grad_norm": 0.07149611413478851,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.020658448338508606,
+ "step": 66
+ },
+ {
+ "epoch": 2.68,
+ "grad_norm": 0.09244706481695175,
+ "learning_rate": 8.177777777777778e-05,
+ "loss": 0.022394295781850815,
+ "step": 67
+ },
+ {
+ "epoch": 2.7199999999999998,
+ "grad_norm": 0.11381954699754715,
+ "learning_rate": 8.133333333333334e-05,
+ "loss": 0.028476765379309654,
+ "step": 68
+ },
+ {
+ "epoch": 2.76,
+ "grad_norm": 0.07354001700878143,
+ "learning_rate": 8.088888888888889e-05,
+ "loss": 0.019497834146022797,
+ "step": 69
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.06727641820907593,
+ "learning_rate": 8.044444444444444e-05,
+ "loss": 0.014356930740177631,
+ "step": 70
+ },
+ {
+ "epoch": 2.84,
+ "grad_norm": 0.07417713105678558,
+ "learning_rate": 8e-05,
+ "loss": 0.01823577657341957,
+ "step": 71
+ },
+ {
+ "epoch": 2.88,
+ "grad_norm": 0.09163317829370499,
+ "learning_rate": 7.955555555555556e-05,
+ "loss": 0.02139071188867092,
+ "step": 72
+ },
+ {
+ "epoch": 2.92,
+ "grad_norm": 0.08178975433111191,
+ "learning_rate": 7.911111111111111e-05,
+ "loss": 0.018335483968257904,
+ "step": 73
+ },
+ {
+ "epoch": 2.96,
+ "grad_norm": 0.08015220612287521,
+ "learning_rate": 7.866666666666666e-05,
+ "loss": 0.016001513227820396,
+ "step": 74
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.08509402722120285,
+ "learning_rate": 7.822222222222223e-05,
+ "loss": 0.017747700214385986,
+ "step": 75
+ },
+ {
+ "epoch": 3.04,
+ "grad_norm": 0.07863253355026245,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.015054607763886452,
+ "step": 76
+ },
+ {
+ "epoch": 3.08,
+ "grad_norm": 0.09398715198040009,
+ "learning_rate": 7.733333333333333e-05,
+ "loss": 0.01887289062142372,
+ "step": 77
+ },
+ {
+ "epoch": 3.12,
+ "grad_norm": 0.12165197730064392,
+ "learning_rate": 7.688888888888889e-05,
+ "loss": 0.020169202238321304,
+ "step": 78
+ },
+ {
+ "epoch": 3.16,
+ "grad_norm": 0.07627179473638535,
+ "learning_rate": 7.644444444444445e-05,
+ "loss": 0.012153002433478832,
+ "step": 79
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.0885142832994461,
+ "learning_rate": 7.6e-05,
+ "loss": 0.015390444546937943,
+ "step": 80
+ },
+ {
+ "epoch": 3.24,
+ "grad_norm": 0.11557707190513611,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.019245222210884094,
+ "step": 81
+ },
+ {
+ "epoch": 3.2800000000000002,
+ "grad_norm": 0.0976581946015358,
+ "learning_rate": 7.511111111111111e-05,
+ "loss": 0.014158917590975761,
+ "step": 82
+ },
+ {
+ "epoch": 3.32,
+ "grad_norm": 0.09829393774271011,
+ "learning_rate": 7.466666666666667e-05,
+ "loss": 0.013099931180477142,
+ "step": 83
+ },
+ {
+ "epoch": 3.36,
+ "grad_norm": 0.10063999146223068,
+ "learning_rate": 7.422222222222223e-05,
+ "loss": 0.013834481127560139,
+ "step": 84
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.09943496435880661,
+ "learning_rate": 7.377777777777778e-05,
+ "loss": 0.012920765206217766,
+ "step": 85
+ },
+ {
+ "epoch": 3.44,
+ "grad_norm": 0.1093878448009491,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.013458158820867538,
+ "step": 86
+ },
+ {
+ "epoch": 3.48,
+ "grad_norm": 0.1128634586930275,
+ "learning_rate": 7.28888888888889e-05,
+ "loss": 0.013067865744233131,
+ "step": 87
+ },
+ {
+ "epoch": 3.52,
+ "grad_norm": 0.11049138009548187,
+ "learning_rate": 7.244444444444445e-05,
+ "loss": 0.01237843930721283,
+ "step": 88
+ },
+ {
+ "epoch": 3.56,
+ "grad_norm": 0.1535821557044983,
+ "learning_rate": 7.2e-05,
+ "loss": 0.015146344900131226,
+ "step": 89
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.10436677187681198,
+ "learning_rate": 7.155555555555555e-05,
+ "loss": 0.00996164046227932,
+ "step": 90
+ },
+ {
+ "epoch": 3.64,
+ "grad_norm": 0.14084051549434662,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.013795388862490654,
+ "step": 91
+ },
+ {
+ "epoch": 3.68,
+ "grad_norm": 0.12718933820724487,
+ "learning_rate": 7.066666666666667e-05,
+ "loss": 0.011878985911607742,
+ "step": 92
+ },
+ {
+ "epoch": 3.7199999999999998,
+ "grad_norm": 0.1412353217601776,
+ "learning_rate": 7.022222222222222e-05,
+ "loss": 0.010964864864945412,
+ "step": 93
+ },
+ {
+ "epoch": 3.76,
+ "grad_norm": 0.11453556269407272,
+ "learning_rate": 6.977777777777779e-05,
+ "loss": 0.008170144632458687,
+ "step": 94
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.16155096888542175,
+ "learning_rate": 6.933333333333334e-05,
+ "loss": 0.011488870717585087,
+ "step": 95
+ },
+ {
+ "epoch": 3.84,
+ "grad_norm": 0.11969174444675446,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.007895090617239475,
+ "step": 96
+ },
+ {
+ "epoch": 3.88,
+ "grad_norm": 0.22626101970672607,
+ "learning_rate": 6.844444444444445e-05,
+ "loss": 0.01467936858534813,
+ "step": 97
+ },
+ {
+ "epoch": 3.92,
+ "grad_norm": 0.21040032804012299,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.010772328823804855,
+ "step": 98
+ },
+ {
+ "epoch": 3.96,
+ "grad_norm": 0.19558775424957275,
+ "learning_rate": 6.755555555555557e-05,
+ "loss": 0.009220557287335396,
+ "step": 99
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.18061381578445435,
+ "learning_rate": 6.711111111111112e-05,
+ "loss": 0.006471008062362671,
+ "step": 100
+ },
+ {
+ "epoch": 4.04,
+ "grad_norm": 0.12179632484912872,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.0057976702228188515,
+ "step": 101
+ },
+ {
+ "epoch": 4.08,
+ "grad_norm": 0.12671399116516113,
+ "learning_rate": 6.622222222222224e-05,
+ "loss": 0.006621541455388069,
+ "step": 102
+ },
+ {
+ "epoch": 4.12,
+ "grad_norm": 0.11084511876106262,
+ "learning_rate": 6.577777777777779e-05,
+ "loss": 0.006054866127669811,
+ "step": 103
+ },
+ {
+ "epoch": 4.16,
+ "grad_norm": 0.12502190470695496,
+ "learning_rate": 6.533333333333334e-05,
+ "loss": 0.00817898940294981,
+ "step": 104
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.09107036888599396,
+ "learning_rate": 6.488888888888889e-05,
+ "loss": 0.006295117549598217,
+ "step": 105
+ },
+ {
+ "epoch": 4.24,
+ "grad_norm": 0.07194884121417999,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.006192575674504042,
+ "step": 106
+ },
+ {
+ "epoch": 4.28,
+ "grad_norm": 0.03464571759104729,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.003843494923785329,
+ "step": 107
+ },
+ {
+ "epoch": 4.32,
+ "grad_norm": 0.10040883719921112,
+ "learning_rate": 6.355555555555556e-05,
+ "loss": 0.006318099796772003,
+ "step": 108
+ },
+ {
+ "epoch": 4.36,
+ "grad_norm": 0.07303845882415771,
+ "learning_rate": 6.311111111111112e-05,
+ "loss": 0.0047858962789177895,
+ "step": 109
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.03440818190574646,
+ "learning_rate": 6.266666666666667e-05,
+ "loss": 0.004050814546644688,
+ "step": 110
+ },
+ {
+ "epoch": 4.44,
+ "grad_norm": 0.046613194048404694,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.0035898215137422085,
+ "step": 111
+ },
+ {
+ "epoch": 4.48,
+ "grad_norm": 0.02108742855489254,
+ "learning_rate": 6.177777777777779e-05,
+ "loss": 0.003291932400316,
+ "step": 112
+ },
+ {
+ "epoch": 4.52,
+ "grad_norm": 0.04408564418554306,
+ "learning_rate": 6.133333333333334e-05,
+ "loss": 0.0033779453951865435,
+ "step": 113
+ },
+ {
+ "epoch": 4.5600000000000005,
+ "grad_norm": 0.022311383858323097,
+ "learning_rate": 6.08888888888889e-05,
+ "loss": 0.0038345090579241514,
+ "step": 114
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.026365282014012337,
+ "learning_rate": 6.044444444444445e-05,
+ "loss": 0.004205222241580486,
+ "step": 115
+ },
+ {
+ "epoch": 4.64,
+ "grad_norm": 0.04582115262746811,
+ "learning_rate": 6e-05,
+ "loss": 0.005077291280031204,
+ "step": 116
+ },
+ {
+ "epoch": 4.68,
+ "grad_norm": 0.05057913810014725,
+ "learning_rate": 5.9555555555555554e-05,
+ "loss": 0.004747368395328522,
+ "step": 117
+ },
+ {
+ "epoch": 4.72,
+ "grad_norm": 0.04699229821562767,
+ "learning_rate": 5.911111111111112e-05,
+ "loss": 0.00538603262975812,
+ "step": 118
+ },
+ {
+ "epoch": 4.76,
+ "grad_norm": 0.026704438030719757,
+ "learning_rate": 5.866666666666667e-05,
+ "loss": 0.0041087716817855835,
+ "step": 119
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.04175629839301109,
+ "learning_rate": 5.8222222222222224e-05,
+ "loss": 0.004437651485204697,
+ "step": 120
+ },
+ {
+ "epoch": 4.84,
+ "grad_norm": 0.032657600939273834,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.003728377167135477,
+ "step": 121
+ },
+ {
+ "epoch": 4.88,
+ "grad_norm": 0.03405195474624634,
+ "learning_rate": 5.7333333333333336e-05,
+ "loss": 0.005017922259867191,
+ "step": 122
+ },
+ {
+ "epoch": 4.92,
+ "grad_norm": 0.02600262127816677,
+ "learning_rate": 5.6888888888888895e-05,
+ "loss": 0.003841507714241743,
+ "step": 123
+ },
+ {
+ "epoch": 4.96,
+ "grad_norm": 0.03402233496308327,
+ "learning_rate": 5.644444444444445e-05,
+ "loss": 0.002483899937942624,
+ "step": 124
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.03151554986834526,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 0.0036559500731527805,
+ "step": 125
+ },
+ {
+ "epoch": 5.04,
+ "grad_norm": 0.03822990879416466,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.0028562736697494984,
+ "step": 126
+ },
+ {
+ "epoch": 5.08,
+ "grad_norm": 0.028356632217764854,
+ "learning_rate": 5.511111111111111e-05,
+ "loss": 0.003123738570138812,
+ "step": 127
+ },
+ {
+ "epoch": 5.12,
+ "grad_norm": 0.032560307532548904,
+ "learning_rate": 5.466666666666666e-05,
+ "loss": 0.004612874239683151,
+ "step": 128
+ },
+ {
+ "epoch": 5.16,
+ "grad_norm": 0.023662906140089035,
+ "learning_rate": 5.422222222222223e-05,
+ "loss": 0.0028404039330780506,
+ "step": 129
+ },
+ {
+ "epoch": 5.2,
+ "grad_norm": 0.03967975080013275,
+ "learning_rate": 5.377777777777778e-05,
+ "loss": 0.004116460680961609,
+ "step": 130
+ },
+ {
+ "epoch": 5.24,
+ "grad_norm": 0.02488141693174839,
+ "learning_rate": 5.333333333333333e-05,
+ "loss": 0.0041904142126441,
+ "step": 131
+ },
+ {
+ "epoch": 5.28,
+ "grad_norm": 0.011391286738216877,
+ "learning_rate": 5.2888888888888885e-05,
+ "loss": 0.002993058878928423,
+ "step": 132
+ },
+ {
+ "epoch": 5.32,
+ "grad_norm": 0.02595183439552784,
+ "learning_rate": 5.244444444444445e-05,
+ "loss": 0.00301048019900918,
+ "step": 133
+ },
+ {
+ "epoch": 5.36,
+ "grad_norm": 0.014937770552933216,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 0.003106491407379508,
+ "step": 134
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.0208111684769392,
+ "learning_rate": 5.1555555555555556e-05,
+ "loss": 0.003945561125874519,
+ "step": 135
+ },
+ {
+ "epoch": 5.44,
+ "grad_norm": 0.01186386402696371,
+ "learning_rate": 5.111111111111111e-05,
+ "loss": 0.003586095292121172,
+ "step": 136
+ },
+ {
+ "epoch": 5.48,
+ "grad_norm": 0.012205840088427067,
+ "learning_rate": 5.0666666666666674e-05,
+ "loss": 0.0032413718290627003,
+ "step": 137
+ },
+ {
+ "epoch": 5.52,
+ "grad_norm": 0.02764296717941761,
+ "learning_rate": 5.0222222222222226e-05,
+ "loss": 0.0030944915488362312,
+ "step": 138
+ },
+ {
+ "epoch": 5.5600000000000005,
+ "grad_norm": 0.023670295253396034,
+ "learning_rate": 4.977777777777778e-05,
+ "loss": 0.0030482488218694925,
+ "step": 139
+ },
+ {
+ "epoch": 5.6,
+ "grad_norm": 0.024959059432148933,
+ "learning_rate": 4.933333333333334e-05,
+ "loss": 0.002743522170931101,
+ "step": 140
+ },
+ {
+ "epoch": 5.64,
+ "grad_norm": 0.019349221140146255,
+ "learning_rate": 4.888888888888889e-05,
+ "loss": 0.002883533015847206,
+ "step": 141
+ },
+ {
+ "epoch": 5.68,
+ "grad_norm": 0.021185332909226418,
+ "learning_rate": 4.844444444444445e-05,
+ "loss": 0.0025618618819862604,
+ "step": 142
+ },
+ {
+ "epoch": 5.72,
+ "grad_norm": 0.017232399433851242,
+ "learning_rate": 4.8e-05,
+ "loss": 0.0027296345215290785,
+ "step": 143
+ },
+ {
+ "epoch": 5.76,
+ "grad_norm": 0.025460300967097282,
+ "learning_rate": 4.755555555555556e-05,
+ "loss": 0.002679885132238269,
+ "step": 144
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.021230001002550125,
+ "learning_rate": 4.711111111111111e-05,
+ "loss": 0.0037597499322146177,
+ "step": 145
+ },
+ {
+ "epoch": 5.84,
+ "grad_norm": 0.018495697528123856,
+ "learning_rate": 4.666666666666667e-05,
+ "loss": 0.0026929471641778946,
+ "step": 146
+ },
+ {
+ "epoch": 5.88,
+ "grad_norm": 0.027612268924713135,
+ "learning_rate": 4.6222222222222224e-05,
+ "loss": 0.0031238074880093336,
+ "step": 147
+ },
+ {
+ "epoch": 5.92,
+ "grad_norm": 0.039522312581539154,
+ "learning_rate": 4.577777777777778e-05,
+ "loss": 0.0035351444967091084,
+ "step": 148
+ },
+ {
+ "epoch": 5.96,
+ "grad_norm": 0.014303261414170265,
+ "learning_rate": 4.5333333333333335e-05,
+ "loss": 0.0025896867737174034,
+ "step": 149
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.03775525838136673,
+ "learning_rate": 4.4888888888888894e-05,
+ "loss": 0.0035551211331039667,
+ "step": 150
+ },
+ {
+ "epoch": 6.04,
+ "grad_norm": 0.04990272596478462,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.004297541920095682,
+ "step": 151
+ },
+ {
+ "epoch": 6.08,
+ "grad_norm": 0.017710352316498756,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 0.0033112887758761644,
+ "step": 152
+ },
+ {
+ "epoch": 6.12,
+ "grad_norm": 0.022754572331905365,
+ "learning_rate": 4.355555555555556e-05,
+ "loss": 0.002353265881538391,
+ "step": 153
+ },
+ {
+ "epoch": 6.16,
+ "grad_norm": 0.02410873770713806,
+ "learning_rate": 4.311111111111111e-05,
+ "loss": 0.0037385188043117523,
+ "step": 154
+ },
+ {
+ "epoch": 6.2,
+ "grad_norm": 0.02232186868786812,
+ "learning_rate": 4.266666666666667e-05,
+ "loss": 0.00313817011192441,
+ "step": 155
+ },
+ {
+ "epoch": 6.24,
+ "grad_norm": 0.02414192631840706,
+ "learning_rate": 4.222222222222222e-05,
+ "loss": 0.003970893565565348,
+ "step": 156
+ },
+ {
+ "epoch": 6.28,
+ "grad_norm": 0.03084409236907959,
+ "learning_rate": 4.177777777777778e-05,
+ "loss": 0.0034115584567189217,
+ "step": 157
+ },
+ {
+ "epoch": 6.32,
+ "grad_norm": 0.035011716187000275,
+ "learning_rate": 4.133333333333333e-05,
+ "loss": 0.004035938531160355,
+ "step": 158
+ },
+ {
+ "epoch": 6.36,
+ "grad_norm": 0.0190069992095232,
+ "learning_rate": 4.088888888888889e-05,
+ "loss": 0.003001230303198099,
+ "step": 159
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.03748108446598053,
+ "learning_rate": 4.0444444444444444e-05,
+ "loss": 0.0041668531484901905,
+ "step": 160
+ },
+ {
+ "epoch": 6.44,
+ "grad_norm": 0.03820832818746567,
+ "learning_rate": 4e-05,
+ "loss": 0.0028840310405939817,
+ "step": 161
+ },
+ {
+ "epoch": 6.48,
+ "grad_norm": 0.039001427590847015,
+ "learning_rate": 3.9555555555555556e-05,
+ "loss": 0.0028830585069954395,
+ "step": 162
+ },
+ {
+ "epoch": 6.52,
+ "grad_norm": 0.02733510732650757,
+ "learning_rate": 3.9111111111111115e-05,
+ "loss": 0.002750289160758257,
+ "step": 163
+ },
+ {
+ "epoch": 6.5600000000000005,
+ "grad_norm": 0.01641351543366909,
+ "learning_rate": 3.866666666666667e-05,
+ "loss": 0.002791184466332197,
+ "step": 164
+ },
+ {
+ "epoch": 6.6,
+ "grad_norm": 0.021426184102892876,
+ "learning_rate": 3.8222222222222226e-05,
+ "loss": 0.0032122773118317127,
+ "step": 165
+ },
+ {
+ "epoch": 6.64,
+ "grad_norm": 0.026212267577648163,
+ "learning_rate": 3.777777777777778e-05,
+ "loss": 0.002747473306953907,
+ "step": 166
+ },
+ {
+ "epoch": 6.68,
+ "grad_norm": 0.019693776965141296,
+ "learning_rate": 3.733333333333334e-05,
+ "loss": 0.002691935747861862,
+ "step": 167
+ },
+ {
+ "epoch": 6.72,
+ "grad_norm": 0.02187752164900303,
+ "learning_rate": 3.688888888888889e-05,
+ "loss": 0.0032634371891617775,
+ "step": 168
+ },
+ {
+ "epoch": 6.76,
+ "grad_norm": 0.02258922904729843,
+ "learning_rate": 3.644444444444445e-05,
+ "loss": 0.0025645019486546516,
+ "step": 169
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.02120850421488285,
+ "learning_rate": 3.6e-05,
+ "loss": 0.002402626909315586,
+ "step": 170
+ },
+ {
+ "epoch": 6.84,
+ "grad_norm": 0.027142135426402092,
+ "learning_rate": 3.555555555555556e-05,
+ "loss": 0.0029081657994538546,
+ "step": 171
+ },
+ {
+ "epoch": 6.88,
+ "grad_norm": 0.016608284786343575,
+ "learning_rate": 3.511111111111111e-05,
+ "loss": 0.002675814088433981,
+ "step": 172
+ },
+ {
+ "epoch": 6.92,
+ "grad_norm": 0.025261735543608665,
+ "learning_rate": 3.466666666666667e-05,
+ "loss": 0.0027554240077733994,
+ "step": 173
+ },
+ {
+ "epoch": 6.96,
+ "grad_norm": 0.027320940047502518,
+ "learning_rate": 3.4222222222222224e-05,
+ "loss": 0.003410451812669635,
+ "step": 174
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.026871275156736374,
+ "learning_rate": 3.377777777777778e-05,
+ "loss": 0.003376966342329979,
+ "step": 175
+ },
+ {
+ "epoch": 7.04,
+ "grad_norm": 0.016450949013233185,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.002620718441903591,
+ "step": 176
+ },
+ {
+ "epoch": 7.08,
+ "grad_norm": 0.010365518741309643,
+ "learning_rate": 3.2888888888888894e-05,
+ "loss": 0.0021599559113383293,
+ "step": 177
+ },
+ {
+ "epoch": 7.12,
+ "grad_norm": 0.022241489961743355,
+ "learning_rate": 3.2444444444444446e-05,
+ "loss": 0.0017859019571915269,
+ "step": 178
+ },
+ {
+ "epoch": 7.16,
+ "grad_norm": 0.020874621346592903,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 0.002129746600985527,
+ "step": 179
+ },
+ {
+ "epoch": 7.2,
+ "grad_norm": 0.04520160332322121,
+ "learning_rate": 3.155555555555556e-05,
+ "loss": 0.004575295373797417,
+ "step": 180
+ },
+ {
+ "epoch": 7.24,
+ "grad_norm": 0.0321652777493,
+ "learning_rate": 3.111111111111111e-05,
+ "loss": 0.003585377475246787,
+ "step": 181
+ },
+ {
+ "epoch": 7.28,
+ "grad_norm": 0.06066919490695,
+ "learning_rate": 3.066666666666667e-05,
+ "loss": 0.004659339785575867,
+ "step": 182
+ },
+ {
+ "epoch": 7.32,
+ "grad_norm": 0.05730052664875984,
+ "learning_rate": 3.0222222222222225e-05,
+ "loss": 0.005264223553240299,
+ "step": 183
+ },
+ {
+ "epoch": 7.36,
+ "grad_norm": 0.03588332608342171,
+ "learning_rate": 2.9777777777777777e-05,
+ "loss": 0.0038815282750874758,
+ "step": 184
+ },
+ {
+ "epoch": 7.4,
+ "grad_norm": 0.01236315630376339,
+ "learning_rate": 2.9333333333333336e-05,
+ "loss": 0.0027745934203267097,
+ "step": 185
+ },
+ {
+ "epoch": 7.44,
+ "grad_norm": 0.029325781390070915,
+ "learning_rate": 2.8888888888888888e-05,
+ "loss": 0.002651514019817114,
+ "step": 186
+ },
+ {
+ "epoch": 7.48,
+ "grad_norm": 0.020734379068017006,
+ "learning_rate": 2.8444444444444447e-05,
+ "loss": 0.002661932958289981,
+ "step": 187
+ },
+ {
+ "epoch": 7.52,
+ "grad_norm": 0.01843331567943096,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 0.0035277302376925945,
+ "step": 188
+ },
+ {
+ "epoch": 7.5600000000000005,
+ "grad_norm": 0.026685994118452072,
+ "learning_rate": 2.7555555555555555e-05,
+ "loss": 0.0020395792089402676,
+ "step": 189
+ },
+ {
+ "epoch": 7.6,
+ "grad_norm": 0.033618271350860596,
+ "learning_rate": 2.7111111111111114e-05,
+ "loss": 0.0031584161333739758,
+ "step": 190
+ },
+ {
+ "epoch": 7.64,
+ "grad_norm": 0.030674412846565247,
+ "learning_rate": 2.6666666666666667e-05,
+ "loss": 0.0027489513158798218,
+ "step": 191
+ },
+ {
+ "epoch": 7.68,
+ "grad_norm": 0.015450477600097656,
+ "learning_rate": 2.6222222222222226e-05,
+ "loss": 0.002614565659314394,
+ "step": 192
+ },
+ {
+ "epoch": 7.72,
+ "grad_norm": 0.017924876883625984,
+ "learning_rate": 2.5777777777777778e-05,
+ "loss": 0.0035272736568003893,
+ "step": 193
+ },
+ {
+ "epoch": 7.76,
+ "grad_norm": 0.02555103413760662,
+ "learning_rate": 2.5333333333333337e-05,
+ "loss": 0.002506188815459609,
+ "step": 194
+ },
+ {
+ "epoch": 7.8,
+ "grad_norm": 0.016485845670104027,
+ "learning_rate": 2.488888888888889e-05,
+ "loss": 0.0030358778312802315,
+ "step": 195
+ },
+ {
+ "epoch": 7.84,
+ "grad_norm": 0.01830879971385002,
+ "learning_rate": 2.4444444444444445e-05,
+ "loss": 0.003063053358346224,
+ "step": 196
+ },
+ {
+ "epoch": 7.88,
+ "grad_norm": 0.01950378157198429,
+ "learning_rate": 2.4e-05,
+ "loss": 0.003265776438638568,
+ "step": 197
+ },
+ {
+ "epoch": 7.92,
+ "grad_norm": 0.02045619860291481,
+ "learning_rate": 2.3555555555555556e-05,
+ "loss": 0.0033433851785957813,
+ "step": 198
+ },
+ {
+ "epoch": 7.96,
+ "grad_norm": 0.0100328978151083,
+ "learning_rate": 2.3111111111111112e-05,
+ "loss": 0.0027878526598215103,
+ "step": 199
+ },
+ {
+ "epoch": 8.0,
+ "grad_norm": 0.010031516663730145,
+ "learning_rate": 2.2666666666666668e-05,
+ "loss": 0.0027771005406975746,
+ "step": 200
+ },
+ {
+ "epoch": 8.04,
+ "grad_norm": 0.022695884108543396,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.00276823528110981,
+ "step": 201
+ },
+ {
+ "epoch": 8.08,
+ "grad_norm": 0.050612468272447586,
+ "learning_rate": 2.177777777777778e-05,
+ "loss": 0.003243266837671399,
+ "step": 202
+ },
+ {
+ "epoch": 8.12,
+ "grad_norm": 0.018536781892180443,
+ "learning_rate": 2.1333333333333335e-05,
+ "loss": 0.0030410350300371647,
+ "step": 203
+ },
+ {
+ "epoch": 8.16,
+ "grad_norm": 0.016438741236925125,
+ "learning_rate": 2.088888888888889e-05,
+ "loss": 0.0035175576340407133,
+ "step": 204
+ },
+ {
+ "epoch": 8.2,
+ "grad_norm": 0.015039130114018917,
+ "learning_rate": 2.0444444444444446e-05,
+ "loss": 0.0029155865777283907,
+ "step": 205
+ },
+ {
+ "epoch": 8.24,
+ "grad_norm": 0.02183271013200283,
+ "learning_rate": 2e-05,
+ "loss": 0.0025679857935756445,
+ "step": 206
+ },
+ {
+ "epoch": 8.28,
+ "grad_norm": 0.02275138348340988,
+ "learning_rate": 1.9555555555555557e-05,
+ "loss": 0.0025438228622078896,
+ "step": 207
+ },
+ {
+ "epoch": 8.32,
+ "grad_norm": 0.025838805362582207,
+ "learning_rate": 1.9111111111111113e-05,
+ "loss": 0.0031353782396763563,
+ "step": 208
+ },
+ {
+ "epoch": 8.36,
+ "grad_norm": 0.01668969914317131,
+ "learning_rate": 1.866666666666667e-05,
+ "loss": 0.0025828094221651554,
+ "step": 209
+ },
+ {
+ "epoch": 8.4,
+ "grad_norm": 0.020336873829364777,
+ "learning_rate": 1.8222222222222224e-05,
+ "loss": 0.0024747150018811226,
+ "step": 210
+ },
+ {
+ "epoch": 8.44,
+ "grad_norm": 0.02213417738676071,
+ "learning_rate": 1.777777777777778e-05,
+ "loss": 0.0029987948946654797,
+ "step": 211
+ },
+ {
+ "epoch": 8.48,
+ "grad_norm": 0.021517926827073097,
+ "learning_rate": 1.7333333333333336e-05,
+ "loss": 0.002465041819959879,
+ "step": 212
+ },
+ {
+ "epoch": 8.52,
+ "grad_norm": 0.01751171052455902,
+ "learning_rate": 1.688888888888889e-05,
+ "loss": 0.0026049830485135317,
+ "step": 213
+ },
+ {
+ "epoch": 8.56,
+ "grad_norm": 0.021795880049467087,
+ "learning_rate": 1.6444444444444447e-05,
+ "loss": 0.0028803041204810143,
+ "step": 214
+ },
+ {
+ "epoch": 8.6,
+ "grad_norm": 0.020086100324988365,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 0.0028778044506907463,
+ "step": 215
+ },
+ {
+ "epoch": 8.64,
+ "grad_norm": 0.015516013838350773,
+ "learning_rate": 1.5555555555555555e-05,
+ "loss": 0.0024672122672200203,
+ "step": 216
+ },
+ {
+ "epoch": 8.68,
+ "grad_norm": 0.0401972159743309,
+ "learning_rate": 1.5111111111111112e-05,
+ "loss": 0.004364989697933197,
+ "step": 217
+ },
+ {
+ "epoch": 8.72,
+ "grad_norm": 0.017837317660450935,
+ "learning_rate": 1.4666666666666668e-05,
+ "loss": 0.0024297013878822327,
+ "step": 218
+ },
+ {
+ "epoch": 8.76,
+ "grad_norm": 0.04800090938806534,
+ "learning_rate": 1.4222222222222224e-05,
+ "loss": 0.004841526038944721,
+ "step": 219
+ },
+ {
+ "epoch": 8.8,
+ "grad_norm": 0.022919492796063423,
+ "learning_rate": 1.3777777777777778e-05,
+ "loss": 0.0032237900886684656,
+ "step": 220
+ },
+ {
+ "epoch": 8.84,
+ "grad_norm": 0.02397754043340683,
+ "learning_rate": 1.3333333333333333e-05,
+ "loss": 0.0032201295252889395,
+ "step": 221
+ },
+ {
+ "epoch": 8.88,
+ "grad_norm": 0.019710563123226166,
+ "learning_rate": 1.2888888888888889e-05,
+ "loss": 0.002729036845266819,
+ "step": 222
+ },
+ {
+ "epoch": 8.92,
+ "grad_norm": 0.02915951795876026,
+ "learning_rate": 1.2444444444444445e-05,
+ "loss": 0.0023130630142986774,
+ "step": 223
+ },
+ {
+ "epoch": 8.96,
+ "grad_norm": 0.022674476727843285,
+ "learning_rate": 1.2e-05,
+ "loss": 0.003879572730511427,
+ "step": 224
+ },
+ {
+ "epoch": 9.0,
+ "grad_norm": 0.03299430012702942,
+ "learning_rate": 1.1555555555555556e-05,
+ "loss": 0.003597201080992818,
+ "step": 225
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 1.103693697220608e+16,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-225/training_args.bin b/checkpoint-225/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-225/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-25/README.md b/checkpoint-25/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-25/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-25/adapter_config.json b/checkpoint-25/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-25/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-25/adapter_model.safetensors b/checkpoint-25/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..87d2967c839a0ba36f54cf33ae9986d2ece84e1b
--- /dev/null
+++ b/checkpoint-25/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe23d03aa9da79b810c6d38ec16729eecbea5ff07988ec39bee31ea95bd1e492
+size 132187888
diff --git a/checkpoint-25/chat_template.jinja b/checkpoint-25/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-25/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-25/optimizer.pt b/checkpoint-25/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..9ba0e163e461d5713521d4f887aaf993d447a7ef
--- /dev/null
+++ b/checkpoint-25/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:78ea6d6af7f67c8c665d0a3dde4c2b7916d81844e6899effe8c4d81996d573ef
+size 67688197
diff --git a/checkpoint-25/rng_state.pth b/checkpoint-25/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..3ef66339b9befa098183fd5d69faed6838e526b0
--- /dev/null
+++ b/checkpoint-25/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1d565802a8e26c4e8a31328752b7a7fdc186d9401aa008e65697d0ad8c22e33
+size 14645
diff --git a/checkpoint-25/scheduler.pt b/checkpoint-25/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..346ce9b98c687fba0b4afe222d12e345055a346f
--- /dev/null
+++ b/checkpoint-25/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6083e374202d34e86a9e39cb228c9ceb918399a5a2b4ca9898dcfa8789d5db54
+size 1465
diff --git a/checkpoint-25/tokenizer.json b/checkpoint-25/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-25/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-25/tokenizer_config.json b/checkpoint-25/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-25/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-25/trainer_state.json b/checkpoint-25/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..73f0a966152996694a123dd033a4d409c00d8738
--- /dev/null
+++ b/checkpoint-25/trainer_state.json
@@ -0,0 +1,209 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 1.0,
+ "eval_steps": 500,
+ "global_step": 25,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 1226326330245120.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-25/training_args.bin b/checkpoint-25/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-25/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-250/README.md b/checkpoint-250/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-250/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-250/adapter_config.json b/checkpoint-250/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-250/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-250/adapter_model.safetensors b/checkpoint-250/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c94b34db171258e368b99d0a8dbe016f0d6134f7
--- /dev/null
+++ b/checkpoint-250/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed674b65e5fa446f26523a1acb914b68cf23ecdf470b5c43df182b2ee14b021c
+size 132187888
diff --git a/checkpoint-250/chat_template.jinja b/checkpoint-250/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-250/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-250/optimizer.pt b/checkpoint-250/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..ad6889a75f06c479c34af28b1ab0e6c2d0e6ef7f
--- /dev/null
+++ b/checkpoint-250/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3d0505b67c5fc35ea5a3cf3f6d7dcc493e6365f613af0109a99c72bd0f601d4
+size 67688197
diff --git a/checkpoint-250/rng_state.pth b/checkpoint-250/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..7d291e9d10e1020604acf08c246d96afb5aefcc2
--- /dev/null
+++ b/checkpoint-250/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19b15d59b7d2f507771b26ca44b1603b8cdd22ee0992f3217d7e17b763986855
+size 14645
diff --git a/checkpoint-250/scheduler.pt b/checkpoint-250/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..b9befa276b8219635f84306673178757eb5e577c
--- /dev/null
+++ b/checkpoint-250/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e95eee2a573ddd28974abe92c987e2321a0fe3f3a302ea9798d819b323feeff
+size 1465
diff --git a/checkpoint-250/tokenizer.json b/checkpoint-250/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-250/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-250/tokenizer_config.json b/checkpoint-250/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-250/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-250/trainer_state.json b/checkpoint-250/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..1364d86a990d83af7f81699b08aa9eda30cb2953
--- /dev/null
+++ b/checkpoint-250/trainer_state.json
@@ -0,0 +1,1784 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 10.0,
+ "eval_steps": 500,
+ "global_step": 250,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ },
+ {
+ "epoch": 1.04,
+ "grad_norm": 0.36699211597442627,
+ "learning_rate": 0.0001,
+ "loss": 0.4363247752189636,
+ "step": 26
+ },
+ {
+ "epoch": 1.08,
+ "grad_norm": 0.3731786608695984,
+ "learning_rate": 9.955555555555556e-05,
+ "loss": 0.4297473430633545,
+ "step": 27
+ },
+ {
+ "epoch": 1.12,
+ "grad_norm": 0.3378784954547882,
+ "learning_rate": 9.911111111111112e-05,
+ "loss": 0.35973912477493286,
+ "step": 28
+ },
+ {
+ "epoch": 1.16,
+ "grad_norm": 0.36273664236068726,
+ "learning_rate": 9.866666666666668e-05,
+ "loss": 0.34903788566589355,
+ "step": 29
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 0.362885981798172,
+ "learning_rate": 9.822222222222223e-05,
+ "loss": 0.3119792342185974,
+ "step": 30
+ },
+ {
+ "epoch": 1.24,
+ "grad_norm": 0.3790324032306671,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 0.29530155658721924,
+ "step": 31
+ },
+ {
+ "epoch": 1.28,
+ "grad_norm": 0.37333837151527405,
+ "learning_rate": 9.733333333333335e-05,
+ "loss": 0.2653456926345825,
+ "step": 32
+ },
+ {
+ "epoch": 1.32,
+ "grad_norm": 0.32163503766059875,
+ "learning_rate": 9.68888888888889e-05,
+ "loss": 0.19654956459999084,
+ "step": 33
+ },
+ {
+ "epoch": 1.3599999999999999,
+ "grad_norm": 0.5297159552574158,
+ "learning_rate": 9.644444444444445e-05,
+ "loss": 0.23580318689346313,
+ "step": 34
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.4474238455295563,
+ "learning_rate": 9.6e-05,
+ "loss": 0.18798796832561493,
+ "step": 35
+ },
+ {
+ "epoch": 1.44,
+ "grad_norm": 0.31346794962882996,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 0.12066371738910675,
+ "step": 36
+ },
+ {
+ "epoch": 1.48,
+ "grad_norm": 0.3099532723426819,
+ "learning_rate": 9.511111111111112e-05,
+ "loss": 0.08859007060527802,
+ "step": 37
+ },
+ {
+ "epoch": 1.52,
+ "grad_norm": 0.3490828275680542,
+ "learning_rate": 9.466666666666667e-05,
+ "loss": 0.07878822088241577,
+ "step": 38
+ },
+ {
+ "epoch": 1.56,
+ "grad_norm": 0.32395538687705994,
+ "learning_rate": 9.422222222222223e-05,
+ "loss": 0.06694570928812027,
+ "step": 39
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 0.20870603621006012,
+ "learning_rate": 9.377777777777779e-05,
+ "loss": 0.04379018768668175,
+ "step": 40
+ },
+ {
+ "epoch": 1.6400000000000001,
+ "grad_norm": 0.3310009837150574,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.048647329211235046,
+ "step": 41
+ },
+ {
+ "epoch": 1.6800000000000002,
+ "grad_norm": 0.26949432492256165,
+ "learning_rate": 9.28888888888889e-05,
+ "loss": 0.039286017417907715,
+ "step": 42
+ },
+ {
+ "epoch": 1.72,
+ "grad_norm": 0.11029712855815887,
+ "learning_rate": 9.244444444444445e-05,
+ "loss": 0.029231950640678406,
+ "step": 43
+ },
+ {
+ "epoch": 1.76,
+ "grad_norm": 0.1476302146911621,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.027003085240721703,
+ "step": 44
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.18617521226406097,
+ "learning_rate": 9.155555555555557e-05,
+ "loss": 0.025106143206357956,
+ "step": 45
+ },
+ {
+ "epoch": 1.8399999999999999,
+ "grad_norm": 0.13198262453079224,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.025741657242178917,
+ "step": 46
+ },
+ {
+ "epoch": 1.88,
+ "grad_norm": 0.26712384819984436,
+ "learning_rate": 9.066666666666667e-05,
+ "loss": 0.035036977380514145,
+ "step": 47
+ },
+ {
+ "epoch": 1.92,
+ "grad_norm": 0.3569182753562927,
+ "learning_rate": 9.022222222222224e-05,
+ "loss": 0.04259534925222397,
+ "step": 48
+ },
+ {
+ "epoch": 1.96,
+ "grad_norm": 0.1843830794095993,
+ "learning_rate": 8.977777777777779e-05,
+ "loss": 0.03471647948026657,
+ "step": 49
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.1248057410120964,
+ "learning_rate": 8.933333333333334e-05,
+ "loss": 0.030936148017644882,
+ "step": 50
+ },
+ {
+ "epoch": 2.04,
+ "grad_norm": 0.12060711532831192,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.032452136278152466,
+ "step": 51
+ },
+ {
+ "epoch": 2.08,
+ "grad_norm": 0.2026030570268631,
+ "learning_rate": 8.844444444444445e-05,
+ "loss": 0.03268110007047653,
+ "step": 52
+ },
+ {
+ "epoch": 2.12,
+ "grad_norm": 0.21289987862110138,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.03406357392668724,
+ "step": 53
+ },
+ {
+ "epoch": 2.16,
+ "grad_norm": 0.14732478559017181,
+ "learning_rate": 8.755555555555556e-05,
+ "loss": 0.02936721034348011,
+ "step": 54
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.10120426118373871,
+ "learning_rate": 8.711111111111112e-05,
+ "loss": 0.02511693350970745,
+ "step": 55
+ },
+ {
+ "epoch": 2.24,
+ "grad_norm": 0.08917918056249619,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.025877539068460464,
+ "step": 56
+ },
+ {
+ "epoch": 2.2800000000000002,
+ "grad_norm": 0.08735086023807526,
+ "learning_rate": 8.622222222222222e-05,
+ "loss": 0.02145460993051529,
+ "step": 57
+ },
+ {
+ "epoch": 2.32,
+ "grad_norm": 0.07835431396961212,
+ "learning_rate": 8.577777777777777e-05,
+ "loss": 0.021244943141937256,
+ "step": 58
+ },
+ {
+ "epoch": 2.36,
+ "grad_norm": 0.06953317672014236,
+ "learning_rate": 8.533333333333334e-05,
+ "loss": 0.02279437705874443,
+ "step": 59
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.0854259729385376,
+ "learning_rate": 8.488888888888889e-05,
+ "loss": 0.023704543709754944,
+ "step": 60
+ },
+ {
+ "epoch": 2.44,
+ "grad_norm": 0.17068363726139069,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.035272784531116486,
+ "step": 61
+ },
+ {
+ "epoch": 2.48,
+ "grad_norm": 0.11971863359212875,
+ "learning_rate": 8.4e-05,
+ "loss": 0.02707826718688011,
+ "step": 62
+ },
+ {
+ "epoch": 2.52,
+ "grad_norm": 0.05303095281124115,
+ "learning_rate": 8.355555555555556e-05,
+ "loss": 0.01696968823671341,
+ "step": 63
+ },
+ {
+ "epoch": 2.56,
+ "grad_norm": 0.06503961980342865,
+ "learning_rate": 8.311111111111111e-05,
+ "loss": 0.018413860350847244,
+ "step": 64
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.05390244349837303,
+ "learning_rate": 8.266666666666667e-05,
+ "loss": 0.01641814410686493,
+ "step": 65
+ },
+ {
+ "epoch": 2.64,
+ "grad_norm": 0.07149611413478851,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.020658448338508606,
+ "step": 66
+ },
+ {
+ "epoch": 2.68,
+ "grad_norm": 0.09244706481695175,
+ "learning_rate": 8.177777777777778e-05,
+ "loss": 0.022394295781850815,
+ "step": 67
+ },
+ {
+ "epoch": 2.7199999999999998,
+ "grad_norm": 0.11381954699754715,
+ "learning_rate": 8.133333333333334e-05,
+ "loss": 0.028476765379309654,
+ "step": 68
+ },
+ {
+ "epoch": 2.76,
+ "grad_norm": 0.07354001700878143,
+ "learning_rate": 8.088888888888889e-05,
+ "loss": 0.019497834146022797,
+ "step": 69
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.06727641820907593,
+ "learning_rate": 8.044444444444444e-05,
+ "loss": 0.014356930740177631,
+ "step": 70
+ },
+ {
+ "epoch": 2.84,
+ "grad_norm": 0.07417713105678558,
+ "learning_rate": 8e-05,
+ "loss": 0.01823577657341957,
+ "step": 71
+ },
+ {
+ "epoch": 2.88,
+ "grad_norm": 0.09163317829370499,
+ "learning_rate": 7.955555555555556e-05,
+ "loss": 0.02139071188867092,
+ "step": 72
+ },
+ {
+ "epoch": 2.92,
+ "grad_norm": 0.08178975433111191,
+ "learning_rate": 7.911111111111111e-05,
+ "loss": 0.018335483968257904,
+ "step": 73
+ },
+ {
+ "epoch": 2.96,
+ "grad_norm": 0.08015220612287521,
+ "learning_rate": 7.866666666666666e-05,
+ "loss": 0.016001513227820396,
+ "step": 74
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.08509402722120285,
+ "learning_rate": 7.822222222222223e-05,
+ "loss": 0.017747700214385986,
+ "step": 75
+ },
+ {
+ "epoch": 3.04,
+ "grad_norm": 0.07863253355026245,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.015054607763886452,
+ "step": 76
+ },
+ {
+ "epoch": 3.08,
+ "grad_norm": 0.09398715198040009,
+ "learning_rate": 7.733333333333333e-05,
+ "loss": 0.01887289062142372,
+ "step": 77
+ },
+ {
+ "epoch": 3.12,
+ "grad_norm": 0.12165197730064392,
+ "learning_rate": 7.688888888888889e-05,
+ "loss": 0.020169202238321304,
+ "step": 78
+ },
+ {
+ "epoch": 3.16,
+ "grad_norm": 0.07627179473638535,
+ "learning_rate": 7.644444444444445e-05,
+ "loss": 0.012153002433478832,
+ "step": 79
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.0885142832994461,
+ "learning_rate": 7.6e-05,
+ "loss": 0.015390444546937943,
+ "step": 80
+ },
+ {
+ "epoch": 3.24,
+ "grad_norm": 0.11557707190513611,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.019245222210884094,
+ "step": 81
+ },
+ {
+ "epoch": 3.2800000000000002,
+ "grad_norm": 0.0976581946015358,
+ "learning_rate": 7.511111111111111e-05,
+ "loss": 0.014158917590975761,
+ "step": 82
+ },
+ {
+ "epoch": 3.32,
+ "grad_norm": 0.09829393774271011,
+ "learning_rate": 7.466666666666667e-05,
+ "loss": 0.013099931180477142,
+ "step": 83
+ },
+ {
+ "epoch": 3.36,
+ "grad_norm": 0.10063999146223068,
+ "learning_rate": 7.422222222222223e-05,
+ "loss": 0.013834481127560139,
+ "step": 84
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.09943496435880661,
+ "learning_rate": 7.377777777777778e-05,
+ "loss": 0.012920765206217766,
+ "step": 85
+ },
+ {
+ "epoch": 3.44,
+ "grad_norm": 0.1093878448009491,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.013458158820867538,
+ "step": 86
+ },
+ {
+ "epoch": 3.48,
+ "grad_norm": 0.1128634586930275,
+ "learning_rate": 7.28888888888889e-05,
+ "loss": 0.013067865744233131,
+ "step": 87
+ },
+ {
+ "epoch": 3.52,
+ "grad_norm": 0.11049138009548187,
+ "learning_rate": 7.244444444444445e-05,
+ "loss": 0.01237843930721283,
+ "step": 88
+ },
+ {
+ "epoch": 3.56,
+ "grad_norm": 0.1535821557044983,
+ "learning_rate": 7.2e-05,
+ "loss": 0.015146344900131226,
+ "step": 89
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.10436677187681198,
+ "learning_rate": 7.155555555555555e-05,
+ "loss": 0.00996164046227932,
+ "step": 90
+ },
+ {
+ "epoch": 3.64,
+ "grad_norm": 0.14084051549434662,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.013795388862490654,
+ "step": 91
+ },
+ {
+ "epoch": 3.68,
+ "grad_norm": 0.12718933820724487,
+ "learning_rate": 7.066666666666667e-05,
+ "loss": 0.011878985911607742,
+ "step": 92
+ },
+ {
+ "epoch": 3.7199999999999998,
+ "grad_norm": 0.1412353217601776,
+ "learning_rate": 7.022222222222222e-05,
+ "loss": 0.010964864864945412,
+ "step": 93
+ },
+ {
+ "epoch": 3.76,
+ "grad_norm": 0.11453556269407272,
+ "learning_rate": 6.977777777777779e-05,
+ "loss": 0.008170144632458687,
+ "step": 94
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.16155096888542175,
+ "learning_rate": 6.933333333333334e-05,
+ "loss": 0.011488870717585087,
+ "step": 95
+ },
+ {
+ "epoch": 3.84,
+ "grad_norm": 0.11969174444675446,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.007895090617239475,
+ "step": 96
+ },
+ {
+ "epoch": 3.88,
+ "grad_norm": 0.22626101970672607,
+ "learning_rate": 6.844444444444445e-05,
+ "loss": 0.01467936858534813,
+ "step": 97
+ },
+ {
+ "epoch": 3.92,
+ "grad_norm": 0.21040032804012299,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.010772328823804855,
+ "step": 98
+ },
+ {
+ "epoch": 3.96,
+ "grad_norm": 0.19558775424957275,
+ "learning_rate": 6.755555555555557e-05,
+ "loss": 0.009220557287335396,
+ "step": 99
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.18061381578445435,
+ "learning_rate": 6.711111111111112e-05,
+ "loss": 0.006471008062362671,
+ "step": 100
+ },
+ {
+ "epoch": 4.04,
+ "grad_norm": 0.12179632484912872,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.0057976702228188515,
+ "step": 101
+ },
+ {
+ "epoch": 4.08,
+ "grad_norm": 0.12671399116516113,
+ "learning_rate": 6.622222222222224e-05,
+ "loss": 0.006621541455388069,
+ "step": 102
+ },
+ {
+ "epoch": 4.12,
+ "grad_norm": 0.11084511876106262,
+ "learning_rate": 6.577777777777779e-05,
+ "loss": 0.006054866127669811,
+ "step": 103
+ },
+ {
+ "epoch": 4.16,
+ "grad_norm": 0.12502190470695496,
+ "learning_rate": 6.533333333333334e-05,
+ "loss": 0.00817898940294981,
+ "step": 104
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.09107036888599396,
+ "learning_rate": 6.488888888888889e-05,
+ "loss": 0.006295117549598217,
+ "step": 105
+ },
+ {
+ "epoch": 4.24,
+ "grad_norm": 0.07194884121417999,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.006192575674504042,
+ "step": 106
+ },
+ {
+ "epoch": 4.28,
+ "grad_norm": 0.03464571759104729,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.003843494923785329,
+ "step": 107
+ },
+ {
+ "epoch": 4.32,
+ "grad_norm": 0.10040883719921112,
+ "learning_rate": 6.355555555555556e-05,
+ "loss": 0.006318099796772003,
+ "step": 108
+ },
+ {
+ "epoch": 4.36,
+ "grad_norm": 0.07303845882415771,
+ "learning_rate": 6.311111111111112e-05,
+ "loss": 0.0047858962789177895,
+ "step": 109
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.03440818190574646,
+ "learning_rate": 6.266666666666667e-05,
+ "loss": 0.004050814546644688,
+ "step": 110
+ },
+ {
+ "epoch": 4.44,
+ "grad_norm": 0.046613194048404694,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.0035898215137422085,
+ "step": 111
+ },
+ {
+ "epoch": 4.48,
+ "grad_norm": 0.02108742855489254,
+ "learning_rate": 6.177777777777779e-05,
+ "loss": 0.003291932400316,
+ "step": 112
+ },
+ {
+ "epoch": 4.52,
+ "grad_norm": 0.04408564418554306,
+ "learning_rate": 6.133333333333334e-05,
+ "loss": 0.0033779453951865435,
+ "step": 113
+ },
+ {
+ "epoch": 4.5600000000000005,
+ "grad_norm": 0.022311383858323097,
+ "learning_rate": 6.08888888888889e-05,
+ "loss": 0.0038345090579241514,
+ "step": 114
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.026365282014012337,
+ "learning_rate": 6.044444444444445e-05,
+ "loss": 0.004205222241580486,
+ "step": 115
+ },
+ {
+ "epoch": 4.64,
+ "grad_norm": 0.04582115262746811,
+ "learning_rate": 6e-05,
+ "loss": 0.005077291280031204,
+ "step": 116
+ },
+ {
+ "epoch": 4.68,
+ "grad_norm": 0.05057913810014725,
+ "learning_rate": 5.9555555555555554e-05,
+ "loss": 0.004747368395328522,
+ "step": 117
+ },
+ {
+ "epoch": 4.72,
+ "grad_norm": 0.04699229821562767,
+ "learning_rate": 5.911111111111112e-05,
+ "loss": 0.00538603262975812,
+ "step": 118
+ },
+ {
+ "epoch": 4.76,
+ "grad_norm": 0.026704438030719757,
+ "learning_rate": 5.866666666666667e-05,
+ "loss": 0.0041087716817855835,
+ "step": 119
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.04175629839301109,
+ "learning_rate": 5.8222222222222224e-05,
+ "loss": 0.004437651485204697,
+ "step": 120
+ },
+ {
+ "epoch": 4.84,
+ "grad_norm": 0.032657600939273834,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.003728377167135477,
+ "step": 121
+ },
+ {
+ "epoch": 4.88,
+ "grad_norm": 0.03405195474624634,
+ "learning_rate": 5.7333333333333336e-05,
+ "loss": 0.005017922259867191,
+ "step": 122
+ },
+ {
+ "epoch": 4.92,
+ "grad_norm": 0.02600262127816677,
+ "learning_rate": 5.6888888888888895e-05,
+ "loss": 0.003841507714241743,
+ "step": 123
+ },
+ {
+ "epoch": 4.96,
+ "grad_norm": 0.03402233496308327,
+ "learning_rate": 5.644444444444445e-05,
+ "loss": 0.002483899937942624,
+ "step": 124
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.03151554986834526,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 0.0036559500731527805,
+ "step": 125
+ },
+ {
+ "epoch": 5.04,
+ "grad_norm": 0.03822990879416466,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.0028562736697494984,
+ "step": 126
+ },
+ {
+ "epoch": 5.08,
+ "grad_norm": 0.028356632217764854,
+ "learning_rate": 5.511111111111111e-05,
+ "loss": 0.003123738570138812,
+ "step": 127
+ },
+ {
+ "epoch": 5.12,
+ "grad_norm": 0.032560307532548904,
+ "learning_rate": 5.466666666666666e-05,
+ "loss": 0.004612874239683151,
+ "step": 128
+ },
+ {
+ "epoch": 5.16,
+ "grad_norm": 0.023662906140089035,
+ "learning_rate": 5.422222222222223e-05,
+ "loss": 0.0028404039330780506,
+ "step": 129
+ },
+ {
+ "epoch": 5.2,
+ "grad_norm": 0.03967975080013275,
+ "learning_rate": 5.377777777777778e-05,
+ "loss": 0.004116460680961609,
+ "step": 130
+ },
+ {
+ "epoch": 5.24,
+ "grad_norm": 0.02488141693174839,
+ "learning_rate": 5.333333333333333e-05,
+ "loss": 0.0041904142126441,
+ "step": 131
+ },
+ {
+ "epoch": 5.28,
+ "grad_norm": 0.011391286738216877,
+ "learning_rate": 5.2888888888888885e-05,
+ "loss": 0.002993058878928423,
+ "step": 132
+ },
+ {
+ "epoch": 5.32,
+ "grad_norm": 0.02595183439552784,
+ "learning_rate": 5.244444444444445e-05,
+ "loss": 0.00301048019900918,
+ "step": 133
+ },
+ {
+ "epoch": 5.36,
+ "grad_norm": 0.014937770552933216,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 0.003106491407379508,
+ "step": 134
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.0208111684769392,
+ "learning_rate": 5.1555555555555556e-05,
+ "loss": 0.003945561125874519,
+ "step": 135
+ },
+ {
+ "epoch": 5.44,
+ "grad_norm": 0.01186386402696371,
+ "learning_rate": 5.111111111111111e-05,
+ "loss": 0.003586095292121172,
+ "step": 136
+ },
+ {
+ "epoch": 5.48,
+ "grad_norm": 0.012205840088427067,
+ "learning_rate": 5.0666666666666674e-05,
+ "loss": 0.0032413718290627003,
+ "step": 137
+ },
+ {
+ "epoch": 5.52,
+ "grad_norm": 0.02764296717941761,
+ "learning_rate": 5.0222222222222226e-05,
+ "loss": 0.0030944915488362312,
+ "step": 138
+ },
+ {
+ "epoch": 5.5600000000000005,
+ "grad_norm": 0.023670295253396034,
+ "learning_rate": 4.977777777777778e-05,
+ "loss": 0.0030482488218694925,
+ "step": 139
+ },
+ {
+ "epoch": 5.6,
+ "grad_norm": 0.024959059432148933,
+ "learning_rate": 4.933333333333334e-05,
+ "loss": 0.002743522170931101,
+ "step": 140
+ },
+ {
+ "epoch": 5.64,
+ "grad_norm": 0.019349221140146255,
+ "learning_rate": 4.888888888888889e-05,
+ "loss": 0.002883533015847206,
+ "step": 141
+ },
+ {
+ "epoch": 5.68,
+ "grad_norm": 0.021185332909226418,
+ "learning_rate": 4.844444444444445e-05,
+ "loss": 0.0025618618819862604,
+ "step": 142
+ },
+ {
+ "epoch": 5.72,
+ "grad_norm": 0.017232399433851242,
+ "learning_rate": 4.8e-05,
+ "loss": 0.0027296345215290785,
+ "step": 143
+ },
+ {
+ "epoch": 5.76,
+ "grad_norm": 0.025460300967097282,
+ "learning_rate": 4.755555555555556e-05,
+ "loss": 0.002679885132238269,
+ "step": 144
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.021230001002550125,
+ "learning_rate": 4.711111111111111e-05,
+ "loss": 0.0037597499322146177,
+ "step": 145
+ },
+ {
+ "epoch": 5.84,
+ "grad_norm": 0.018495697528123856,
+ "learning_rate": 4.666666666666667e-05,
+ "loss": 0.0026929471641778946,
+ "step": 146
+ },
+ {
+ "epoch": 5.88,
+ "grad_norm": 0.027612268924713135,
+ "learning_rate": 4.6222222222222224e-05,
+ "loss": 0.0031238074880093336,
+ "step": 147
+ },
+ {
+ "epoch": 5.92,
+ "grad_norm": 0.039522312581539154,
+ "learning_rate": 4.577777777777778e-05,
+ "loss": 0.0035351444967091084,
+ "step": 148
+ },
+ {
+ "epoch": 5.96,
+ "grad_norm": 0.014303261414170265,
+ "learning_rate": 4.5333333333333335e-05,
+ "loss": 0.0025896867737174034,
+ "step": 149
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.03775525838136673,
+ "learning_rate": 4.4888888888888894e-05,
+ "loss": 0.0035551211331039667,
+ "step": 150
+ },
+ {
+ "epoch": 6.04,
+ "grad_norm": 0.04990272596478462,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.004297541920095682,
+ "step": 151
+ },
+ {
+ "epoch": 6.08,
+ "grad_norm": 0.017710352316498756,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 0.0033112887758761644,
+ "step": 152
+ },
+ {
+ "epoch": 6.12,
+ "grad_norm": 0.022754572331905365,
+ "learning_rate": 4.355555555555556e-05,
+ "loss": 0.002353265881538391,
+ "step": 153
+ },
+ {
+ "epoch": 6.16,
+ "grad_norm": 0.02410873770713806,
+ "learning_rate": 4.311111111111111e-05,
+ "loss": 0.0037385188043117523,
+ "step": 154
+ },
+ {
+ "epoch": 6.2,
+ "grad_norm": 0.02232186868786812,
+ "learning_rate": 4.266666666666667e-05,
+ "loss": 0.00313817011192441,
+ "step": 155
+ },
+ {
+ "epoch": 6.24,
+ "grad_norm": 0.02414192631840706,
+ "learning_rate": 4.222222222222222e-05,
+ "loss": 0.003970893565565348,
+ "step": 156
+ },
+ {
+ "epoch": 6.28,
+ "grad_norm": 0.03084409236907959,
+ "learning_rate": 4.177777777777778e-05,
+ "loss": 0.0034115584567189217,
+ "step": 157
+ },
+ {
+ "epoch": 6.32,
+ "grad_norm": 0.035011716187000275,
+ "learning_rate": 4.133333333333333e-05,
+ "loss": 0.004035938531160355,
+ "step": 158
+ },
+ {
+ "epoch": 6.36,
+ "grad_norm": 0.0190069992095232,
+ "learning_rate": 4.088888888888889e-05,
+ "loss": 0.003001230303198099,
+ "step": 159
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.03748108446598053,
+ "learning_rate": 4.0444444444444444e-05,
+ "loss": 0.0041668531484901905,
+ "step": 160
+ },
+ {
+ "epoch": 6.44,
+ "grad_norm": 0.03820832818746567,
+ "learning_rate": 4e-05,
+ "loss": 0.0028840310405939817,
+ "step": 161
+ },
+ {
+ "epoch": 6.48,
+ "grad_norm": 0.039001427590847015,
+ "learning_rate": 3.9555555555555556e-05,
+ "loss": 0.0028830585069954395,
+ "step": 162
+ },
+ {
+ "epoch": 6.52,
+ "grad_norm": 0.02733510732650757,
+ "learning_rate": 3.9111111111111115e-05,
+ "loss": 0.002750289160758257,
+ "step": 163
+ },
+ {
+ "epoch": 6.5600000000000005,
+ "grad_norm": 0.01641351543366909,
+ "learning_rate": 3.866666666666667e-05,
+ "loss": 0.002791184466332197,
+ "step": 164
+ },
+ {
+ "epoch": 6.6,
+ "grad_norm": 0.021426184102892876,
+ "learning_rate": 3.8222222222222226e-05,
+ "loss": 0.0032122773118317127,
+ "step": 165
+ },
+ {
+ "epoch": 6.64,
+ "grad_norm": 0.026212267577648163,
+ "learning_rate": 3.777777777777778e-05,
+ "loss": 0.002747473306953907,
+ "step": 166
+ },
+ {
+ "epoch": 6.68,
+ "grad_norm": 0.019693776965141296,
+ "learning_rate": 3.733333333333334e-05,
+ "loss": 0.002691935747861862,
+ "step": 167
+ },
+ {
+ "epoch": 6.72,
+ "grad_norm": 0.02187752164900303,
+ "learning_rate": 3.688888888888889e-05,
+ "loss": 0.0032634371891617775,
+ "step": 168
+ },
+ {
+ "epoch": 6.76,
+ "grad_norm": 0.02258922904729843,
+ "learning_rate": 3.644444444444445e-05,
+ "loss": 0.0025645019486546516,
+ "step": 169
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.02120850421488285,
+ "learning_rate": 3.6e-05,
+ "loss": 0.002402626909315586,
+ "step": 170
+ },
+ {
+ "epoch": 6.84,
+ "grad_norm": 0.027142135426402092,
+ "learning_rate": 3.555555555555556e-05,
+ "loss": 0.0029081657994538546,
+ "step": 171
+ },
+ {
+ "epoch": 6.88,
+ "grad_norm": 0.016608284786343575,
+ "learning_rate": 3.511111111111111e-05,
+ "loss": 0.002675814088433981,
+ "step": 172
+ },
+ {
+ "epoch": 6.92,
+ "grad_norm": 0.025261735543608665,
+ "learning_rate": 3.466666666666667e-05,
+ "loss": 0.0027554240077733994,
+ "step": 173
+ },
+ {
+ "epoch": 6.96,
+ "grad_norm": 0.027320940047502518,
+ "learning_rate": 3.4222222222222224e-05,
+ "loss": 0.003410451812669635,
+ "step": 174
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.026871275156736374,
+ "learning_rate": 3.377777777777778e-05,
+ "loss": 0.003376966342329979,
+ "step": 175
+ },
+ {
+ "epoch": 7.04,
+ "grad_norm": 0.016450949013233185,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.002620718441903591,
+ "step": 176
+ },
+ {
+ "epoch": 7.08,
+ "grad_norm": 0.010365518741309643,
+ "learning_rate": 3.2888888888888894e-05,
+ "loss": 0.0021599559113383293,
+ "step": 177
+ },
+ {
+ "epoch": 7.12,
+ "grad_norm": 0.022241489961743355,
+ "learning_rate": 3.2444444444444446e-05,
+ "loss": 0.0017859019571915269,
+ "step": 178
+ },
+ {
+ "epoch": 7.16,
+ "grad_norm": 0.020874621346592903,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 0.002129746600985527,
+ "step": 179
+ },
+ {
+ "epoch": 7.2,
+ "grad_norm": 0.04520160332322121,
+ "learning_rate": 3.155555555555556e-05,
+ "loss": 0.004575295373797417,
+ "step": 180
+ },
+ {
+ "epoch": 7.24,
+ "grad_norm": 0.0321652777493,
+ "learning_rate": 3.111111111111111e-05,
+ "loss": 0.003585377475246787,
+ "step": 181
+ },
+ {
+ "epoch": 7.28,
+ "grad_norm": 0.06066919490695,
+ "learning_rate": 3.066666666666667e-05,
+ "loss": 0.004659339785575867,
+ "step": 182
+ },
+ {
+ "epoch": 7.32,
+ "grad_norm": 0.05730052664875984,
+ "learning_rate": 3.0222222222222225e-05,
+ "loss": 0.005264223553240299,
+ "step": 183
+ },
+ {
+ "epoch": 7.36,
+ "grad_norm": 0.03588332608342171,
+ "learning_rate": 2.9777777777777777e-05,
+ "loss": 0.0038815282750874758,
+ "step": 184
+ },
+ {
+ "epoch": 7.4,
+ "grad_norm": 0.01236315630376339,
+ "learning_rate": 2.9333333333333336e-05,
+ "loss": 0.0027745934203267097,
+ "step": 185
+ },
+ {
+ "epoch": 7.44,
+ "grad_norm": 0.029325781390070915,
+ "learning_rate": 2.8888888888888888e-05,
+ "loss": 0.002651514019817114,
+ "step": 186
+ },
+ {
+ "epoch": 7.48,
+ "grad_norm": 0.020734379068017006,
+ "learning_rate": 2.8444444444444447e-05,
+ "loss": 0.002661932958289981,
+ "step": 187
+ },
+ {
+ "epoch": 7.52,
+ "grad_norm": 0.01843331567943096,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 0.0035277302376925945,
+ "step": 188
+ },
+ {
+ "epoch": 7.5600000000000005,
+ "grad_norm": 0.026685994118452072,
+ "learning_rate": 2.7555555555555555e-05,
+ "loss": 0.0020395792089402676,
+ "step": 189
+ },
+ {
+ "epoch": 7.6,
+ "grad_norm": 0.033618271350860596,
+ "learning_rate": 2.7111111111111114e-05,
+ "loss": 0.0031584161333739758,
+ "step": 190
+ },
+ {
+ "epoch": 7.64,
+ "grad_norm": 0.030674412846565247,
+ "learning_rate": 2.6666666666666667e-05,
+ "loss": 0.0027489513158798218,
+ "step": 191
+ },
+ {
+ "epoch": 7.68,
+ "grad_norm": 0.015450477600097656,
+ "learning_rate": 2.6222222222222226e-05,
+ "loss": 0.002614565659314394,
+ "step": 192
+ },
+ {
+ "epoch": 7.72,
+ "grad_norm": 0.017924876883625984,
+ "learning_rate": 2.5777777777777778e-05,
+ "loss": 0.0035272736568003893,
+ "step": 193
+ },
+ {
+ "epoch": 7.76,
+ "grad_norm": 0.02555103413760662,
+ "learning_rate": 2.5333333333333337e-05,
+ "loss": 0.002506188815459609,
+ "step": 194
+ },
+ {
+ "epoch": 7.8,
+ "grad_norm": 0.016485845670104027,
+ "learning_rate": 2.488888888888889e-05,
+ "loss": 0.0030358778312802315,
+ "step": 195
+ },
+ {
+ "epoch": 7.84,
+ "grad_norm": 0.01830879971385002,
+ "learning_rate": 2.4444444444444445e-05,
+ "loss": 0.003063053358346224,
+ "step": 196
+ },
+ {
+ "epoch": 7.88,
+ "grad_norm": 0.01950378157198429,
+ "learning_rate": 2.4e-05,
+ "loss": 0.003265776438638568,
+ "step": 197
+ },
+ {
+ "epoch": 7.92,
+ "grad_norm": 0.02045619860291481,
+ "learning_rate": 2.3555555555555556e-05,
+ "loss": 0.0033433851785957813,
+ "step": 198
+ },
+ {
+ "epoch": 7.96,
+ "grad_norm": 0.0100328978151083,
+ "learning_rate": 2.3111111111111112e-05,
+ "loss": 0.0027878526598215103,
+ "step": 199
+ },
+ {
+ "epoch": 8.0,
+ "grad_norm": 0.010031516663730145,
+ "learning_rate": 2.2666666666666668e-05,
+ "loss": 0.0027771005406975746,
+ "step": 200
+ },
+ {
+ "epoch": 8.04,
+ "grad_norm": 0.022695884108543396,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.00276823528110981,
+ "step": 201
+ },
+ {
+ "epoch": 8.08,
+ "grad_norm": 0.050612468272447586,
+ "learning_rate": 2.177777777777778e-05,
+ "loss": 0.003243266837671399,
+ "step": 202
+ },
+ {
+ "epoch": 8.12,
+ "grad_norm": 0.018536781892180443,
+ "learning_rate": 2.1333333333333335e-05,
+ "loss": 0.0030410350300371647,
+ "step": 203
+ },
+ {
+ "epoch": 8.16,
+ "grad_norm": 0.016438741236925125,
+ "learning_rate": 2.088888888888889e-05,
+ "loss": 0.0035175576340407133,
+ "step": 204
+ },
+ {
+ "epoch": 8.2,
+ "grad_norm": 0.015039130114018917,
+ "learning_rate": 2.0444444444444446e-05,
+ "loss": 0.0029155865777283907,
+ "step": 205
+ },
+ {
+ "epoch": 8.24,
+ "grad_norm": 0.02183271013200283,
+ "learning_rate": 2e-05,
+ "loss": 0.0025679857935756445,
+ "step": 206
+ },
+ {
+ "epoch": 8.28,
+ "grad_norm": 0.02275138348340988,
+ "learning_rate": 1.9555555555555557e-05,
+ "loss": 0.0025438228622078896,
+ "step": 207
+ },
+ {
+ "epoch": 8.32,
+ "grad_norm": 0.025838805362582207,
+ "learning_rate": 1.9111111111111113e-05,
+ "loss": 0.0031353782396763563,
+ "step": 208
+ },
+ {
+ "epoch": 8.36,
+ "grad_norm": 0.01668969914317131,
+ "learning_rate": 1.866666666666667e-05,
+ "loss": 0.0025828094221651554,
+ "step": 209
+ },
+ {
+ "epoch": 8.4,
+ "grad_norm": 0.020336873829364777,
+ "learning_rate": 1.8222222222222224e-05,
+ "loss": 0.0024747150018811226,
+ "step": 210
+ },
+ {
+ "epoch": 8.44,
+ "grad_norm": 0.02213417738676071,
+ "learning_rate": 1.777777777777778e-05,
+ "loss": 0.0029987948946654797,
+ "step": 211
+ },
+ {
+ "epoch": 8.48,
+ "grad_norm": 0.021517926827073097,
+ "learning_rate": 1.7333333333333336e-05,
+ "loss": 0.002465041819959879,
+ "step": 212
+ },
+ {
+ "epoch": 8.52,
+ "grad_norm": 0.01751171052455902,
+ "learning_rate": 1.688888888888889e-05,
+ "loss": 0.0026049830485135317,
+ "step": 213
+ },
+ {
+ "epoch": 8.56,
+ "grad_norm": 0.021795880049467087,
+ "learning_rate": 1.6444444444444447e-05,
+ "loss": 0.0028803041204810143,
+ "step": 214
+ },
+ {
+ "epoch": 8.6,
+ "grad_norm": 0.020086100324988365,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 0.0028778044506907463,
+ "step": 215
+ },
+ {
+ "epoch": 8.64,
+ "grad_norm": 0.015516013838350773,
+ "learning_rate": 1.5555555555555555e-05,
+ "loss": 0.0024672122672200203,
+ "step": 216
+ },
+ {
+ "epoch": 8.68,
+ "grad_norm": 0.0401972159743309,
+ "learning_rate": 1.5111111111111112e-05,
+ "loss": 0.004364989697933197,
+ "step": 217
+ },
+ {
+ "epoch": 8.72,
+ "grad_norm": 0.017837317660450935,
+ "learning_rate": 1.4666666666666668e-05,
+ "loss": 0.0024297013878822327,
+ "step": 218
+ },
+ {
+ "epoch": 8.76,
+ "grad_norm": 0.04800090938806534,
+ "learning_rate": 1.4222222222222224e-05,
+ "loss": 0.004841526038944721,
+ "step": 219
+ },
+ {
+ "epoch": 8.8,
+ "grad_norm": 0.022919492796063423,
+ "learning_rate": 1.3777777777777778e-05,
+ "loss": 0.0032237900886684656,
+ "step": 220
+ },
+ {
+ "epoch": 8.84,
+ "grad_norm": 0.02397754043340683,
+ "learning_rate": 1.3333333333333333e-05,
+ "loss": 0.0032201295252889395,
+ "step": 221
+ },
+ {
+ "epoch": 8.88,
+ "grad_norm": 0.019710563123226166,
+ "learning_rate": 1.2888888888888889e-05,
+ "loss": 0.002729036845266819,
+ "step": 222
+ },
+ {
+ "epoch": 8.92,
+ "grad_norm": 0.02915951795876026,
+ "learning_rate": 1.2444444444444445e-05,
+ "loss": 0.0023130630142986774,
+ "step": 223
+ },
+ {
+ "epoch": 8.96,
+ "grad_norm": 0.022674476727843285,
+ "learning_rate": 1.2e-05,
+ "loss": 0.003879572730511427,
+ "step": 224
+ },
+ {
+ "epoch": 9.0,
+ "grad_norm": 0.03299430012702942,
+ "learning_rate": 1.1555555555555556e-05,
+ "loss": 0.003597201080992818,
+ "step": 225
+ },
+ {
+ "epoch": 9.04,
+ "grad_norm": 0.04178381338715553,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.0038977889344096184,
+ "step": 226
+ },
+ {
+ "epoch": 9.08,
+ "grad_norm": 0.022731013596057892,
+ "learning_rate": 1.0666666666666667e-05,
+ "loss": 0.0031395514961332083,
+ "step": 227
+ },
+ {
+ "epoch": 9.12,
+ "grad_norm": 0.021279972046613693,
+ "learning_rate": 1.0222222222222223e-05,
+ "loss": 0.003573997877538204,
+ "step": 228
+ },
+ {
+ "epoch": 9.16,
+ "grad_norm": 0.016689857468008995,
+ "learning_rate": 9.777777777777779e-06,
+ "loss": 0.002683068159967661,
+ "step": 229
+ },
+ {
+ "epoch": 9.2,
+ "grad_norm": 0.027687981724739075,
+ "learning_rate": 9.333333333333334e-06,
+ "loss": 0.0020645493641495705,
+ "step": 230
+ },
+ {
+ "epoch": 9.24,
+ "grad_norm": 0.028630748391151428,
+ "learning_rate": 8.88888888888889e-06,
+ "loss": 0.0021039138082414865,
+ "step": 231
+ },
+ {
+ "epoch": 9.28,
+ "grad_norm": 0.04450947418808937,
+ "learning_rate": 8.444444444444446e-06,
+ "loss": 0.0039411382749676704,
+ "step": 232
+ },
+ {
+ "epoch": 9.32,
+ "grad_norm": 0.012366552837193012,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 0.0031887826044112444,
+ "step": 233
+ },
+ {
+ "epoch": 9.36,
+ "grad_norm": 0.022889671847224236,
+ "learning_rate": 7.555555555555556e-06,
+ "loss": 0.002494309563189745,
+ "step": 234
+ },
+ {
+ "epoch": 9.4,
+ "grad_norm": 0.029633989557623863,
+ "learning_rate": 7.111111111111112e-06,
+ "loss": 0.0028545025270432234,
+ "step": 235
+ },
+ {
+ "epoch": 9.44,
+ "grad_norm": 0.017070678994059563,
+ "learning_rate": 6.666666666666667e-06,
+ "loss": 0.002990382956340909,
+ "step": 236
+ },
+ {
+ "epoch": 9.48,
+ "grad_norm": 0.027725275605916977,
+ "learning_rate": 6.222222222222222e-06,
+ "loss": 0.00297362357378006,
+ "step": 237
+ },
+ {
+ "epoch": 9.52,
+ "grad_norm": 0.01877531222999096,
+ "learning_rate": 5.777777777777778e-06,
+ "loss": 0.003159684594720602,
+ "step": 238
+ },
+ {
+ "epoch": 9.56,
+ "grad_norm": 0.03223104029893875,
+ "learning_rate": 5.333333333333334e-06,
+ "loss": 0.0030100371222943068,
+ "step": 239
+ },
+ {
+ "epoch": 9.6,
+ "grad_norm": 0.029351545497775078,
+ "learning_rate": 4.888888888888889e-06,
+ "loss": 0.002276807092130184,
+ "step": 240
+ },
+ {
+ "epoch": 9.64,
+ "grad_norm": 0.022455843165516853,
+ "learning_rate": 4.444444444444445e-06,
+ "loss": 0.0024922131560742855,
+ "step": 241
+ },
+ {
+ "epoch": 9.68,
+ "grad_norm": 0.02251872420310974,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 0.0030298763886094093,
+ "step": 242
+ },
+ {
+ "epoch": 9.72,
+ "grad_norm": 0.010378524661064148,
+ "learning_rate": 3.555555555555556e-06,
+ "loss": 0.002725934609770775,
+ "step": 243
+ },
+ {
+ "epoch": 9.76,
+ "grad_norm": 0.02842440828680992,
+ "learning_rate": 3.111111111111111e-06,
+ "loss": 0.003030488733202219,
+ "step": 244
+ },
+ {
+ "epoch": 9.8,
+ "grad_norm": 0.02121051773428917,
+ "learning_rate": 2.666666666666667e-06,
+ "loss": 0.0028277672827243805,
+ "step": 245
+ },
+ {
+ "epoch": 9.84,
+ "grad_norm": 0.033648084849119186,
+ "learning_rate": 2.2222222222222225e-06,
+ "loss": 0.0034331465139985085,
+ "step": 246
+ },
+ {
+ "epoch": 9.88,
+ "grad_norm": 0.03581396862864494,
+ "learning_rate": 1.777777777777778e-06,
+ "loss": 0.004341538529843092,
+ "step": 247
+ },
+ {
+ "epoch": 9.92,
+ "grad_norm": 0.019394010305404663,
+ "learning_rate": 1.3333333333333334e-06,
+ "loss": 0.0023641129955649376,
+ "step": 248
+ },
+ {
+ "epoch": 9.96,
+ "grad_norm": 0.010669081471860409,
+ "learning_rate": 8.88888888888889e-07,
+ "loss": 0.0028035060968250036,
+ "step": 249
+ },
+ {
+ "epoch": 10.0,
+ "grad_norm": 0.015206006355583668,
+ "learning_rate": 4.444444444444445e-07,
+ "loss": 0.002737415488809347,
+ "step": 250
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": true
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 1.22632633024512e+16,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-250/training_args.bin b/checkpoint-250/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-250/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-30/README.md b/checkpoint-30/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..17bc522e13c6998ab7f14e4524a99f96b2e38000
--- /dev/null
+++ b/checkpoint-30/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-30/adapter_config.json b/checkpoint-30/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b01b681148ff188ab3d162c0d6bb07268b3adfca
--- /dev/null
+++ b/checkpoint-30/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-1.7B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "o_proj",
+ "v_proj",
+ "up_proj",
+ "down_proj",
+ "q_proj",
+ "gate_proj",
+ "k_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-30/adapter_model.safetensors b/checkpoint-30/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3628785f335362237cd5f268abe08c5a7c2f4293
--- /dev/null
+++ b/checkpoint-30/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99591bea638d8a5b6758dc42b2514aa4a44e6c59b656ee42b8958aca5e280212
+size 69782384
diff --git a/checkpoint-30/chat_template.jinja b/checkpoint-30/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-30/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-30/optimizer.pt b/checkpoint-30/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..391d8e823929ae22d3be7f448db232cc496406c5
--- /dev/null
+++ b/checkpoint-30/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1f8e57750dc047d8125c9d525629b1baee04fdae25116cbbda46aada7fc56739
+size 35873029
diff --git a/checkpoint-30/rng_state.pth b/checkpoint-30/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..119a2feec6d0222b6a987748eb278f3a8baec0d9
--- /dev/null
+++ b/checkpoint-30/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d895ccae2b55d4ea213653ca4a80d00de131463e105716eab1b7022906f260bf
+size 14645
diff --git a/checkpoint-30/scheduler.pt b/checkpoint-30/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..b6ed5117d03a2d88d5637ce467442afa6911ac29
--- /dev/null
+++ b/checkpoint-30/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cfb78671fde6d942561abfb8ba2e15a2cfaa408acfbd69a0f918a5a9b8a1a119
+size 1465
diff --git a/checkpoint-30/tokenizer.json b/checkpoint-30/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-30/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-30/tokenizer_config.json b/checkpoint-30/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-30/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-30/trainer_state.json b/checkpoint-30/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..7bfb7a45f4c8e4d1fee8ddd5768730ceb2af207c
--- /dev/null
+++ b/checkpoint-30/trainer_state.json
@@ -0,0 +1,244 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 6.0,
+ "eval_steps": 500,
+ "global_step": 30,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.8728970289230347,
+ "learning_rate": 0.0,
+ "loss": 1.7144343852996826,
+ "step": 1
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.6763373613357544,
+ "learning_rate": 2e-05,
+ "loss": 1.4952771663665771,
+ "step": 2
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 1.7191307544708252,
+ "learning_rate": 4e-05,
+ "loss": 1.574378252029419,
+ "step": 3
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 1.7878174781799316,
+ "learning_rate": 6e-05,
+ "loss": 1.6600843667984009,
+ "step": 4
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 1.929695725440979,
+ "learning_rate": 8e-05,
+ "loss": 1.7657139301300049,
+ "step": 5
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 1.8718829154968262,
+ "learning_rate": 0.0001,
+ "loss": 1.6730849742889404,
+ "step": 6
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 1.7125587463378906,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 1.5219359397888184,
+ "step": 7
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 1.4176026582717896,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 1.2670559883117676,
+ "step": 8
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 1.132968544960022,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.9341962933540344,
+ "step": 9
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 1.0091828107833862,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.9576144218444824,
+ "step": 10
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.9517018795013428,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 1.0370712280273438,
+ "step": 11
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.7950196266174316,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.8810007572174072,
+ "step": 12
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.5975409150123596,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.6599255204200745,
+ "step": 13
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.670741617679596,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.7524279356002808,
+ "step": 14
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.6229442358016968,
+ "learning_rate": 8e-05,
+ "loss": 0.7022373676300049,
+ "step": 15
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.6008868217468262,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.7129132151603699,
+ "step": 16
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.4868341386318207,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.5670006275177002,
+ "step": 17
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.3936000168323517,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.4459620416164398,
+ "step": 18
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.6198397278785706,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.6668416261672974,
+ "step": 19
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.4862337112426758,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.5134721398353577,
+ "step": 20
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.4499748647212982,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.4492708444595337,
+ "step": 21
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.5525116920471191,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.4935491681098938,
+ "step": 22
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.39707908034324646,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.3448738753795624,
+ "step": 23
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.49178075790405273,
+ "learning_rate": 6e-05,
+ "loss": 0.3920281231403351,
+ "step": 24
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.5493410229682922,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.3991503119468689,
+ "step": 25
+ },
+ {
+ "epoch": 5.2,
+ "grad_norm": 0.5442111492156982,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.3687404692173004,
+ "step": 26
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.5512173175811768,
+ "learning_rate": 5.333333333333333e-05,
+ "loss": 0.3348987102508545,
+ "step": 27
+ },
+ {
+ "epoch": 5.6,
+ "grad_norm": 0.397312194108963,
+ "learning_rate": 5.111111111111111e-05,
+ "loss": 0.2330646514892578,
+ "step": 28
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.49750691652297974,
+ "learning_rate": 4.888888888888889e-05,
+ "loss": 0.25489163398742676,
+ "step": 29
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.46191564202308655,
+ "learning_rate": 4.666666666666667e-05,
+ "loss": 0.21787357330322266,
+ "step": 30
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 50,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 555475540893696.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-30/training_args.bin b/checkpoint-30/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-30/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-35/README.md b/checkpoint-35/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..17bc522e13c6998ab7f14e4524a99f96b2e38000
--- /dev/null
+++ b/checkpoint-35/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-35/adapter_config.json b/checkpoint-35/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b01b681148ff188ab3d162c0d6bb07268b3adfca
--- /dev/null
+++ b/checkpoint-35/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-1.7B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "o_proj",
+ "v_proj",
+ "up_proj",
+ "down_proj",
+ "q_proj",
+ "gate_proj",
+ "k_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-35/adapter_model.safetensors b/checkpoint-35/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..5c4912cfcd914163f5b6dcd0d45fb643cdd51fb4
--- /dev/null
+++ b/checkpoint-35/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:83fb4970b788b84730b749f36ae900061f9319b4f8c0bd1d0bc275ca7b308a1f
+size 69782384
diff --git a/checkpoint-35/chat_template.jinja b/checkpoint-35/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-35/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-35/optimizer.pt b/checkpoint-35/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..bd2b1b4ebd5206b042a2b65ea83770a88edaa54d
--- /dev/null
+++ b/checkpoint-35/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fbd396ba510ff7cb15212f3edcb859afc1986bc17bd239c96f2d42925eded120
+size 35873029
diff --git a/checkpoint-35/rng_state.pth b/checkpoint-35/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..f8402b2586fcee7b5a43887ca285370521ba5f1e
--- /dev/null
+++ b/checkpoint-35/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2922886dc37f9211a4affea61093cbe4db90c0a37e91e7edac63ec0cf7b13d45
+size 14645
diff --git a/checkpoint-35/scheduler.pt b/checkpoint-35/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..d15338b75a2d5e3ce1c7297fc62df5a61971abda
--- /dev/null
+++ b/checkpoint-35/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:38909b243700f0ab34aca4f256745556c518fed0511bd67088540033966b4731
+size 1465
diff --git a/checkpoint-35/tokenizer.json b/checkpoint-35/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-35/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-35/tokenizer_config.json b/checkpoint-35/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-35/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-35/trainer_state.json b/checkpoint-35/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..c590f3f6cef6b9858b291b85c276d6090d6901e6
--- /dev/null
+++ b/checkpoint-35/trainer_state.json
@@ -0,0 +1,279 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 7.0,
+ "eval_steps": 500,
+ "global_step": 35,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.8728970289230347,
+ "learning_rate": 0.0,
+ "loss": 1.7144343852996826,
+ "step": 1
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.6763373613357544,
+ "learning_rate": 2e-05,
+ "loss": 1.4952771663665771,
+ "step": 2
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 1.7191307544708252,
+ "learning_rate": 4e-05,
+ "loss": 1.574378252029419,
+ "step": 3
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 1.7878174781799316,
+ "learning_rate": 6e-05,
+ "loss": 1.6600843667984009,
+ "step": 4
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 1.929695725440979,
+ "learning_rate": 8e-05,
+ "loss": 1.7657139301300049,
+ "step": 5
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 1.8718829154968262,
+ "learning_rate": 0.0001,
+ "loss": 1.6730849742889404,
+ "step": 6
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 1.7125587463378906,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 1.5219359397888184,
+ "step": 7
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 1.4176026582717896,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 1.2670559883117676,
+ "step": 8
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 1.132968544960022,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.9341962933540344,
+ "step": 9
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 1.0091828107833862,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.9576144218444824,
+ "step": 10
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.9517018795013428,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 1.0370712280273438,
+ "step": 11
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.7950196266174316,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.8810007572174072,
+ "step": 12
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.5975409150123596,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.6599255204200745,
+ "step": 13
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.670741617679596,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.7524279356002808,
+ "step": 14
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.6229442358016968,
+ "learning_rate": 8e-05,
+ "loss": 0.7022373676300049,
+ "step": 15
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.6008868217468262,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.7129132151603699,
+ "step": 16
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.4868341386318207,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.5670006275177002,
+ "step": 17
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.3936000168323517,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.4459620416164398,
+ "step": 18
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.6198397278785706,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.6668416261672974,
+ "step": 19
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.4862337112426758,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.5134721398353577,
+ "step": 20
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.4499748647212982,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.4492708444595337,
+ "step": 21
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.5525116920471191,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.4935491681098938,
+ "step": 22
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.39707908034324646,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.3448738753795624,
+ "step": 23
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.49178075790405273,
+ "learning_rate": 6e-05,
+ "loss": 0.3920281231403351,
+ "step": 24
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.5493410229682922,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.3991503119468689,
+ "step": 25
+ },
+ {
+ "epoch": 5.2,
+ "grad_norm": 0.5442111492156982,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.3687404692173004,
+ "step": 26
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.5512173175811768,
+ "learning_rate": 5.333333333333333e-05,
+ "loss": 0.3348987102508545,
+ "step": 27
+ },
+ {
+ "epoch": 5.6,
+ "grad_norm": 0.397312194108963,
+ "learning_rate": 5.111111111111111e-05,
+ "loss": 0.2330646514892578,
+ "step": 28
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.49750691652297974,
+ "learning_rate": 4.888888888888889e-05,
+ "loss": 0.25489163398742676,
+ "step": 29
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.46191564202308655,
+ "learning_rate": 4.666666666666667e-05,
+ "loss": 0.21787357330322266,
+ "step": 30
+ },
+ {
+ "epoch": 6.2,
+ "grad_norm": 0.7073832750320435,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.21505802869796753,
+ "step": 31
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.5831727385520935,
+ "learning_rate": 4.222222222222222e-05,
+ "loss": 0.17434410750865936,
+ "step": 32
+ },
+ {
+ "epoch": 6.6,
+ "grad_norm": 0.7414628267288208,
+ "learning_rate": 4e-05,
+ "loss": 0.2174021601676941,
+ "step": 33
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.47256121039390564,
+ "learning_rate": 3.777777777777778e-05,
+ "loss": 0.13752047717571259,
+ "step": 34
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.5125815272331238,
+ "learning_rate": 3.555555555555556e-05,
+ "loss": 0.1274665892124176,
+ "step": 35
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 50,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 648054797709312.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-35/training_args.bin b/checkpoint-35/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-35/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-396/README.md b/checkpoint-396/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-396/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-396/adapter_config.json b/checkpoint-396/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..bbcc7740fbc3841db465c9aa396dca7834e891f0
--- /dev/null
+++ b/checkpoint-396/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "v_proj",
+ "q_proj",
+ "up_proj",
+ "o_proj",
+ "k_proj",
+ "down_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-396/adapter_model.safetensors b/checkpoint-396/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..dcb60eee965e9ed70e0d9e959e025f75c82f9337
--- /dev/null
+++ b/checkpoint-396/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8636ea19f80e695bcfe6bc0b5a7db4ecdacd046c264199b3e8273f1635c4e078
+size 132187888
diff --git a/checkpoint-396/chat_template.jinja b/checkpoint-396/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-396/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-396/optimizer.pt b/checkpoint-396/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..7c6d295edebd0687e34d9aa02645f660a38ed505
--- /dev/null
+++ b/checkpoint-396/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d213aedf56e6734e2cd3ba80182e2245045c9a8c5eb9adc4085c0d50c9083ac1
+size 67688645
diff --git a/checkpoint-396/rng_state.pth b/checkpoint-396/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..a18368651274f7c0847c1b9873fe8c9f4ac945ba
--- /dev/null
+++ b/checkpoint-396/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c800b778fa7e115e4c34de8529902de8b61c9a1b4bab3eb8295d06dafff030e
+size 14645
diff --git a/checkpoint-396/scheduler.pt b/checkpoint-396/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..9c5df4335e6d1290317386177f5782b2b1d34e9b
--- /dev/null
+++ b/checkpoint-396/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a9e67916fd5f503c55c9f912b2f0e02a7346b0c165f620bf4d5255975c891e22
+size 1465
diff --git a/checkpoint-396/tokenizer.json b/checkpoint-396/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-396/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-396/tokenizer_config.json b/checkpoint-396/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-396/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-396/trainer_state.json b/checkpoint-396/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..4203382a35a267b26689f7fac3f83b9938138cd9
--- /dev/null
+++ b/checkpoint-396/trainer_state.json
@@ -0,0 +1,2806 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 2.0,
+ "eval_steps": 500,
+ "global_step": 396,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.541267991065979,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279298663139343,
+ "learning_rate": 2.5e-06,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.688083827495575,
+ "learning_rate": 5e-06,
+ "loss": 1.0431158542633057,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6006338000297546,
+ "learning_rate": 7.5e-06,
+ "loss": 0.8824265003204346,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5470584034919739,
+ "learning_rate": 1e-05,
+ "loss": 0.8030610084533691,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.7974609136581421,
+ "learning_rate": 1.25e-05,
+ "loss": 1.1555473804473877,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8244224190711975,
+ "learning_rate": 1.5e-05,
+ "loss": 1.2229748964309692,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6260581016540527,
+ "learning_rate": 1.75e-05,
+ "loss": 0.8904983401298523,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 2.829580307006836,
+ "learning_rate": 2e-05,
+ "loss": 0.9491637945175171,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.754757285118103,
+ "learning_rate": 2.25e-05,
+ "loss": 0.9019982814788818,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.47440305352211,
+ "learning_rate": 2.5e-05,
+ "loss": 0.6992291212081909,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6505467295646667,
+ "learning_rate": 2.7500000000000004e-05,
+ "loss": 0.889061450958252,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5768685340881348,
+ "learning_rate": 3e-05,
+ "loss": 0.8036602735519409,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5377633571624756,
+ "learning_rate": 3.2500000000000004e-05,
+ "loss": 0.7435633540153503,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9250757098197937,
+ "learning_rate": 3.5e-05,
+ "loss": 1.2175753116607666,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.5793201923370361,
+ "learning_rate": 3.7500000000000003e-05,
+ "loss": 0.7998782992362976,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.6986285448074341,
+ "learning_rate": 4e-05,
+ "loss": 0.8544966578483582,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.5201169848442078,
+ "learning_rate": 4.25e-05,
+ "loss": 0.6589094400405884,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.9791179895401001,
+ "learning_rate": 4.5e-05,
+ "loss": 0.8100125789642334,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.7219038605690002,
+ "learning_rate": 4.75e-05,
+ "loss": 0.6084234714508057,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.46535831689834595,
+ "learning_rate": 5e-05,
+ "loss": 0.6568202972412109,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.31376320123672485,
+ "learning_rate": 5.25e-05,
+ "loss": 0.5392794609069824,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.3170797526836395,
+ "learning_rate": 5.500000000000001e-05,
+ "loss": 0.5918940305709839,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.3495939373970032,
+ "learning_rate": 5.7499999999999995e-05,
+ "loss": 0.5079120397567749,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.28786471486091614,
+ "learning_rate": 6e-05,
+ "loss": 0.5341538786888123,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.3225996792316437,
+ "learning_rate": 6.25e-05,
+ "loss": 0.5839301347732544,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.2762380838394165,
+ "learning_rate": 6.500000000000001e-05,
+ "loss": 0.4959941804409027,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.3259536027908325,
+ "learning_rate": 6.750000000000001e-05,
+ "loss": 0.5259701013565063,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.28954407572746277,
+ "learning_rate": 7e-05,
+ "loss": 0.46511930227279663,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.5785516500473022,
+ "learning_rate": 7.25e-05,
+ "loss": 0.5628081560134888,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 0.5003781318664551,
+ "learning_rate": 7.500000000000001e-05,
+ "loss": 0.623978853225708,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.28861019015312195,
+ "learning_rate": 7.75e-05,
+ "loss": 0.3785879611968994,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.30062854290008545,
+ "learning_rate": 8e-05,
+ "loss": 0.3706434369087219,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.34111225605010986,
+ "learning_rate": 8.25e-05,
+ "loss": 0.31503725051879883,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.249260812997818,
+ "learning_rate": 8.5e-05,
+ "loss": 0.26614612340927124,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.2637145221233368,
+ "learning_rate": 8.75e-05,
+ "loss": 0.2552284002304077,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.2339790314435959,
+ "learning_rate": 9e-05,
+ "loss": 0.20976947247982025,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.28390422463417053,
+ "learning_rate": 9.250000000000001e-05,
+ "loss": 0.2053491771221161,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.41791704297065735,
+ "learning_rate": 9.5e-05,
+ "loss": 0.23765188455581665,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.24454724788665771,
+ "learning_rate": 9.75e-05,
+ "loss": 0.1315624713897705,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.28104257583618164,
+ "learning_rate": 0.0001,
+ "loss": 0.14484520256519318,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.2634645700454712,
+ "learning_rate": 9.971910112359551e-05,
+ "loss": 0.11667350679636002,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.2789415419101715,
+ "learning_rate": 9.943820224719102e-05,
+ "loss": 0.10495678335428238,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.3001563847064972,
+ "learning_rate": 9.915730337078653e-05,
+ "loss": 0.10101388394832611,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.29431262612342834,
+ "learning_rate": 9.887640449438202e-05,
+ "loss": 0.08859837800264359,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.2860342562198639,
+ "learning_rate": 9.859550561797754e-05,
+ "loss": 0.08720342069864273,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.32334786653518677,
+ "learning_rate": 9.831460674157303e-05,
+ "loss": 0.07764355093240738,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.24440690875053406,
+ "learning_rate": 9.803370786516854e-05,
+ "loss": 0.074679896235466,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.13819071650505066,
+ "learning_rate": 9.775280898876405e-05,
+ "loss": 0.05031510069966316,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.18470315635204315,
+ "learning_rate": 9.747191011235956e-05,
+ "loss": 0.06897856295108795,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.10861611366271973,
+ "learning_rate": 9.719101123595506e-05,
+ "loss": 0.04557918757200241,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.1305636465549469,
+ "learning_rate": 9.691011235955057e-05,
+ "loss": 0.05787051469087601,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.09878762811422348,
+ "learning_rate": 9.662921348314608e-05,
+ "loss": 0.05321773141622543,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.13962073624134064,
+ "learning_rate": 9.634831460674157e-05,
+ "loss": 0.054905012249946594,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.15637382864952087,
+ "learning_rate": 9.606741573033708e-05,
+ "loss": 0.06456616520881653,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.0993647500872612,
+ "learning_rate": 9.578651685393259e-05,
+ "loss": 0.04925356060266495,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.07598552852869034,
+ "learning_rate": 9.550561797752809e-05,
+ "loss": 0.039146192371845245,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.1472157984972,
+ "learning_rate": 9.52247191011236e-05,
+ "loss": 0.0649760514497757,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.13113828003406525,
+ "learning_rate": 9.49438202247191e-05,
+ "loss": 0.045674700289964676,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.09389159083366394,
+ "learning_rate": 9.466292134831461e-05,
+ "loss": 0.05372454971075058,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.09965600073337555,
+ "learning_rate": 9.438202247191012e-05,
+ "loss": 0.05305560678243637,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.10993317514657974,
+ "learning_rate": 9.410112359550563e-05,
+ "loss": 0.04224421828985214,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.126717209815979,
+ "learning_rate": 9.382022471910112e-05,
+ "loss": 0.05160766839981079,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.10818025469779968,
+ "learning_rate": 9.353932584269663e-05,
+ "loss": 0.04289766401052475,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.10697201639413834,
+ "learning_rate": 9.325842696629214e-05,
+ "loss": 0.04228357970714569,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.10683801025152206,
+ "learning_rate": 9.297752808988764e-05,
+ "loss": 0.04406578093767166,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.10368553549051285,
+ "learning_rate": 9.269662921348315e-05,
+ "loss": 0.04241921380162239,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.10648658126592636,
+ "learning_rate": 9.241573033707866e-05,
+ "loss": 0.04354353994131088,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.12098433077335358,
+ "learning_rate": 9.213483146067416e-05,
+ "loss": 0.039023373275995255,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.0760948583483696,
+ "learning_rate": 9.185393258426966e-05,
+ "loss": 0.03958747908473015,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.22075068950653076,
+ "learning_rate": 9.157303370786518e-05,
+ "loss": 0.060342662036418915,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.07701070606708527,
+ "learning_rate": 9.129213483146067e-05,
+ "loss": 0.03430912271142006,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.10766447335481644,
+ "learning_rate": 9.101123595505618e-05,
+ "loss": 0.041407521814107895,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.08679414540529251,
+ "learning_rate": 9.07303370786517e-05,
+ "loss": 0.030196014791727066,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.14938987791538239,
+ "learning_rate": 9.04494382022472e-05,
+ "loss": 0.0381748303771019,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.20089861750602722,
+ "learning_rate": 9.01685393258427e-05,
+ "loss": 0.051782768219709396,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.15111377835273743,
+ "learning_rate": 8.988764044943821e-05,
+ "loss": 0.03876986354589462,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.1984938383102417,
+ "learning_rate": 8.960674157303372e-05,
+ "loss": 0.0419108122587204,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.09640980511903763,
+ "learning_rate": 8.932584269662921e-05,
+ "loss": 0.033645566552877426,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.11576851457357407,
+ "learning_rate": 8.904494382022473e-05,
+ "loss": 0.035241927951574326,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.0865691527724266,
+ "learning_rate": 8.876404494382022e-05,
+ "loss": 0.030715249478816986,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.1459137350320816,
+ "learning_rate": 8.848314606741573e-05,
+ "loss": 0.043999187648296356,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.10458692163228989,
+ "learning_rate": 8.820224719101124e-05,
+ "loss": 0.03406348079442978,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.16598516702651978,
+ "learning_rate": 8.792134831460675e-05,
+ "loss": 0.049952901899814606,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.22113963961601257,
+ "learning_rate": 8.764044943820225e-05,
+ "loss": 0.051477186381816864,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.08709916472434998,
+ "learning_rate": 8.735955056179776e-05,
+ "loss": 0.02952735871076584,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.14432036876678467,
+ "learning_rate": 8.707865168539327e-05,
+ "loss": 0.041975200176239014,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.2439240962266922,
+ "learning_rate": 8.679775280898876e-05,
+ "loss": 0.0528157614171505,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.23707805573940277,
+ "learning_rate": 8.651685393258427e-05,
+ "loss": 0.03402837738394737,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.15280698239803314,
+ "learning_rate": 8.623595505617979e-05,
+ "loss": 0.04075885936617851,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.11996722221374512,
+ "learning_rate": 8.595505617977528e-05,
+ "loss": 0.03550145402550697,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.15968245267868042,
+ "learning_rate": 8.567415730337079e-05,
+ "loss": 0.04090861976146698,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.13690805435180664,
+ "learning_rate": 8.53932584269663e-05,
+ "loss": 0.028759023174643517,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.16222038865089417,
+ "learning_rate": 8.51123595505618e-05,
+ "loss": 0.04430348426103592,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.1339799463748932,
+ "learning_rate": 8.483146067415731e-05,
+ "loss": 0.02752600610256195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.21008451282978058,
+ "learning_rate": 8.455056179775282e-05,
+ "loss": 0.03405736759305,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.11415962874889374,
+ "learning_rate": 8.426966292134831e-05,
+ "loss": 0.025026924908161163,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10974401235580444,
+ "learning_rate": 8.398876404494382e-05,
+ "loss": 0.02806137129664421,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.11788799613714218,
+ "learning_rate": 8.370786516853934e-05,
+ "loss": 0.03558914363384247,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10623444616794586,
+ "learning_rate": 8.342696629213483e-05,
+ "loss": 0.02613678388297558,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.08676620572805405,
+ "learning_rate": 8.314606741573034e-05,
+ "loss": 0.025938810780644417,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.07125182449817657,
+ "learning_rate": 8.286516853932585e-05,
+ "loss": 0.021837491542100906,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.1266203671693802,
+ "learning_rate": 8.258426966292135e-05,
+ "loss": 0.03522220626473427,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.07432866096496582,
+ "learning_rate": 8.230337078651685e-05,
+ "loss": 0.026023253798484802,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.13274909555912018,
+ "learning_rate": 8.202247191011237e-05,
+ "loss": 0.03942175954580307,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.06564667820930481,
+ "learning_rate": 8.174157303370788e-05,
+ "loss": 0.026481324806809425,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.09904533624649048,
+ "learning_rate": 8.146067415730337e-05,
+ "loss": 0.034051891416311264,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.10673562437295914,
+ "learning_rate": 8.117977528089889e-05,
+ "loss": 0.037275560200214386,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.08902818709611893,
+ "learning_rate": 8.089887640449438e-05,
+ "loss": 0.033094096928834915,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.08141028136014938,
+ "learning_rate": 8.061797752808989e-05,
+ "loss": 0.026169562712311745,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.1291419267654419,
+ "learning_rate": 8.03370786516854e-05,
+ "loss": 0.027799217030405998,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.09093758463859558,
+ "learning_rate": 8.00561797752809e-05,
+ "loss": 0.028581175953149796,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.10075483471155167,
+ "learning_rate": 7.97752808988764e-05,
+ "loss": 0.025682669132947922,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.09115122258663177,
+ "learning_rate": 7.949438202247192e-05,
+ "loss": 0.02445274218916893,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.10104499012231827,
+ "learning_rate": 7.921348314606743e-05,
+ "loss": 0.03198423981666565,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.09525924921035767,
+ "learning_rate": 7.893258426966292e-05,
+ "loss": 0.03354397788643837,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.08727852255105972,
+ "learning_rate": 7.865168539325843e-05,
+ "loss": 0.024794001132249832,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.13344745337963104,
+ "learning_rate": 7.837078651685393e-05,
+ "loss": 0.027911897748708725,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10268016159534454,
+ "learning_rate": 7.808988764044944e-05,
+ "loss": 0.022515583783388138,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.10109257698059082,
+ "learning_rate": 7.780898876404495e-05,
+ "loss": 0.03221476078033447,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.16964375972747803,
+ "learning_rate": 7.752808988764046e-05,
+ "loss": 0.031795620918273926,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.13246159255504608,
+ "learning_rate": 7.724719101123596e-05,
+ "loss": 0.027082759886980057,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.06262294948101044,
+ "learning_rate": 7.696629213483147e-05,
+ "loss": 0.023925842717289925,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.06809060275554657,
+ "learning_rate": 7.668539325842698e-05,
+ "loss": 0.02438730001449585,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.07383013516664505,
+ "learning_rate": 7.640449438202247e-05,
+ "loss": 0.023031681776046753,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.10721587389707565,
+ "learning_rate": 7.612359550561798e-05,
+ "loss": 0.03192562237381935,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.06741692870855331,
+ "learning_rate": 7.584269662921349e-05,
+ "loss": 0.0246804840862751,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.08125781267881393,
+ "learning_rate": 7.556179775280899e-05,
+ "loss": 0.03119286336004734,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.06413824111223221,
+ "learning_rate": 7.52808988764045e-05,
+ "loss": 0.02655949629843235,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.07669264823198318,
+ "learning_rate": 7.500000000000001e-05,
+ "loss": 0.026687482371926308,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.09918767958879471,
+ "learning_rate": 7.471910112359551e-05,
+ "loss": 0.027516309171915054,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.10148739814758301,
+ "learning_rate": 7.443820224719101e-05,
+ "loss": 0.03195330873131752,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.08711183071136475,
+ "learning_rate": 7.415730337078653e-05,
+ "loss": 0.03217240795493126,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.07990329712629318,
+ "learning_rate": 7.387640449438202e-05,
+ "loss": 0.021410999819636345,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.07874006032943726,
+ "learning_rate": 7.359550561797753e-05,
+ "loss": 0.024128872901201248,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.07868438959121704,
+ "learning_rate": 7.331460674157304e-05,
+ "loss": 0.02699769288301468,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.06750240176916122,
+ "learning_rate": 7.303370786516854e-05,
+ "loss": 0.028122171759605408,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.08443409949541092,
+ "learning_rate": 7.275280898876404e-05,
+ "loss": 0.027627017349004745,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.08431039750576019,
+ "learning_rate": 7.247191011235956e-05,
+ "loss": 0.030967045575380325,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.07539030909538269,
+ "learning_rate": 7.219101123595507e-05,
+ "loss": 0.02236180752515793,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.10955091565847397,
+ "learning_rate": 7.191011235955056e-05,
+ "loss": 0.029895160347223282,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.07425650209188461,
+ "learning_rate": 7.162921348314608e-05,
+ "loss": 0.031453005969524384,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.10125374794006348,
+ "learning_rate": 7.134831460674157e-05,
+ "loss": 0.03458607941865921,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.0830405130982399,
+ "learning_rate": 7.106741573033708e-05,
+ "loss": 0.031049100682139397,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.11105621606111526,
+ "learning_rate": 7.078651685393259e-05,
+ "loss": 0.031229455024003983,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.06040993705391884,
+ "learning_rate": 7.05056179775281e-05,
+ "loss": 0.026813680306077003,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.07566605508327484,
+ "learning_rate": 7.02247191011236e-05,
+ "loss": 0.026412969455122948,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.0760338231921196,
+ "learning_rate": 6.994382022471911e-05,
+ "loss": 0.024791400879621506,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.1741524636745453,
+ "learning_rate": 6.966292134831462e-05,
+ "loss": 0.02279246598482132,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.05075052008032799,
+ "learning_rate": 6.938202247191011e-05,
+ "loss": 0.0200984925031662,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.07410533726215363,
+ "learning_rate": 6.910112359550562e-05,
+ "loss": 0.027529269456863403,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.18064801394939423,
+ "learning_rate": 6.882022471910112e-05,
+ "loss": 0.034961409866809845,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.06059030070900917,
+ "learning_rate": 6.853932584269663e-05,
+ "loss": 0.021033618599176407,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.11783059686422348,
+ "learning_rate": 6.825842696629214e-05,
+ "loss": 0.032214920967817307,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.047202665358781815,
+ "learning_rate": 6.797752808988765e-05,
+ "loss": 0.019470252096652985,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.09729017317295074,
+ "learning_rate": 6.769662921348315e-05,
+ "loss": 0.03214791417121887,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.0970664843916893,
+ "learning_rate": 6.741573033707866e-05,
+ "loss": 0.024394063279032707,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.1301339566707611,
+ "learning_rate": 6.713483146067417e-05,
+ "loss": 0.03639087826013565,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.05040059983730316,
+ "learning_rate": 6.685393258426966e-05,
+ "loss": 0.024697832763195038,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.09459900856018066,
+ "learning_rate": 6.657303370786517e-05,
+ "loss": 0.030857007950544357,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.07537735998630524,
+ "learning_rate": 6.629213483146067e-05,
+ "loss": 0.024350063875317574,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.08085881918668747,
+ "learning_rate": 6.601123595505618e-05,
+ "loss": 0.02919663116335869,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.5784851312637329,
+ "learning_rate": 6.573033707865169e-05,
+ "loss": 0.018593359738588333,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.06892956793308258,
+ "learning_rate": 6.54494382022472e-05,
+ "loss": 0.021966084837913513,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.0662418007850647,
+ "learning_rate": 6.51685393258427e-05,
+ "loss": 0.018197204917669296,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.10896365344524384,
+ "learning_rate": 6.48876404494382e-05,
+ "loss": 0.029372215270996094,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.044214218854904175,
+ "learning_rate": 6.460674157303372e-05,
+ "loss": 0.019298464059829712,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.11028677225112915,
+ "learning_rate": 6.432584269662921e-05,
+ "loss": 0.03576533868908882,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05379929021000862,
+ "learning_rate": 6.404494382022472e-05,
+ "loss": 0.026231547817587852,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.05860014259815216,
+ "learning_rate": 6.376404494382023e-05,
+ "loss": 0.024871408939361572,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.07418687641620636,
+ "learning_rate": 6.348314606741573e-05,
+ "loss": 0.02700434997677803,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.04909646138548851,
+ "learning_rate": 6.320224719101124e-05,
+ "loss": 0.020989028736948967,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.09649103879928589,
+ "learning_rate": 6.292134831460675e-05,
+ "loss": 0.02112525701522827,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.0951089933514595,
+ "learning_rate": 6.264044943820225e-05,
+ "loss": 0.02757953479886055,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.07255524396896362,
+ "learning_rate": 6.235955056179775e-05,
+ "loss": 0.02668045088648796,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.04738844186067581,
+ "learning_rate": 6.207865168539327e-05,
+ "loss": 0.02241366356611252,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06388459354639053,
+ "learning_rate": 6.179775280898876e-05,
+ "loss": 0.02467273734509945,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.0711316466331482,
+ "learning_rate": 6.151685393258427e-05,
+ "loss": 0.02765229530632496,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.06936055421829224,
+ "learning_rate": 6.123595505617978e-05,
+ "loss": 0.017880132421851158,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.14639973640441895,
+ "learning_rate": 6.0955056179775284e-05,
+ "loss": 0.024493057280778885,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.05399472638964653,
+ "learning_rate": 6.067415730337079e-05,
+ "loss": 0.02452176809310913,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.053885601460933685,
+ "learning_rate": 6.039325842696629e-05,
+ "loss": 0.019536789506673813,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.06340774148702621,
+ "learning_rate": 6.0112359550561805e-05,
+ "loss": 0.02424689754843712,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.0645972192287445,
+ "learning_rate": 5.9831460674157306e-05,
+ "loss": 0.022020656615495682,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.08281564712524414,
+ "learning_rate": 5.955056179775281e-05,
+ "loss": 0.028721289709210396,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.06623511761426926,
+ "learning_rate": 5.926966292134831e-05,
+ "loss": 0.024668913334608078,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.11269380897283554,
+ "learning_rate": 5.898876404494382e-05,
+ "loss": 0.026596900075674057,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.05962755158543587,
+ "learning_rate": 5.8707865168539334e-05,
+ "loss": 0.027797695249319077,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.05837902054190636,
+ "learning_rate": 5.8426966292134835e-05,
+ "loss": 0.019832894206047058,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.07743050158023834,
+ "learning_rate": 5.814606741573034e-05,
+ "loss": 0.03128945827484131,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.04493675380945206,
+ "learning_rate": 5.786516853932584e-05,
+ "loss": 0.0192718468606472,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.10079994797706604,
+ "learning_rate": 5.758426966292135e-05,
+ "loss": 0.031823039054870605,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.10614821314811707,
+ "learning_rate": 5.730337078651685e-05,
+ "loss": 0.02893644943833351,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.05476316809654236,
+ "learning_rate": 5.7022471910112364e-05,
+ "loss": 0.018997255712747574,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.05835077539086342,
+ "learning_rate": 5.674157303370787e-05,
+ "loss": 0.02261022850871086,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.04851139336824417,
+ "learning_rate": 5.646067415730337e-05,
+ "loss": 0.02165023237466812,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.07759678363800049,
+ "learning_rate": 5.6179775280898885e-05,
+ "loss": 0.03391243517398834,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09574893862009048,
+ "learning_rate": 5.5898876404494386e-05,
+ "loss": 0.022193273529410362,
+ "step": 198
+ },
+ {
+ "epoch": 1.0050632911392405,
+ "grad_norm": 0.05820813775062561,
+ "learning_rate": 5.561797752808989e-05,
+ "loss": 0.024846427142620087,
+ "step": 199
+ },
+ {
+ "epoch": 1.010126582278481,
+ "grad_norm": 0.044290415942668915,
+ "learning_rate": 5.533707865168539e-05,
+ "loss": 0.021012283861637115,
+ "step": 200
+ },
+ {
+ "epoch": 1.0151898734177216,
+ "grad_norm": 0.07655078917741776,
+ "learning_rate": 5.50561797752809e-05,
+ "loss": 0.02465382032096386,
+ "step": 201
+ },
+ {
+ "epoch": 1.0202531645569621,
+ "grad_norm": 0.07221513241529465,
+ "learning_rate": 5.47752808988764e-05,
+ "loss": 0.027297088876366615,
+ "step": 202
+ },
+ {
+ "epoch": 1.0253164556962024,
+ "grad_norm": 0.06225092336535454,
+ "learning_rate": 5.4494382022471915e-05,
+ "loss": 0.02540985494852066,
+ "step": 203
+ },
+ {
+ "epoch": 1.030379746835443,
+ "grad_norm": 0.07452085614204407,
+ "learning_rate": 5.421348314606742e-05,
+ "loss": 0.025487616658210754,
+ "step": 204
+ },
+ {
+ "epoch": 1.0354430379746835,
+ "grad_norm": 0.07434047013521194,
+ "learning_rate": 5.393258426966292e-05,
+ "loss": 0.020724592730402946,
+ "step": 205
+ },
+ {
+ "epoch": 1.040506329113924,
+ "grad_norm": 0.06409032642841339,
+ "learning_rate": 5.365168539325843e-05,
+ "loss": 0.022476810961961746,
+ "step": 206
+ },
+ {
+ "epoch": 1.0455696202531646,
+ "grad_norm": 0.06417150795459747,
+ "learning_rate": 5.337078651685393e-05,
+ "loss": 0.02009744569659233,
+ "step": 207
+ },
+ {
+ "epoch": 1.0506329113924051,
+ "grad_norm": 0.07029171288013458,
+ "learning_rate": 5.3089887640449444e-05,
+ "loss": 0.026029717177152634,
+ "step": 208
+ },
+ {
+ "epoch": 1.0556962025316456,
+ "grad_norm": 0.11547952890396118,
+ "learning_rate": 5.2808988764044944e-05,
+ "loss": 0.02975822612643242,
+ "step": 209
+ },
+ {
+ "epoch": 1.0607594936708862,
+ "grad_norm": 0.05252953618764877,
+ "learning_rate": 5.252808988764045e-05,
+ "loss": 0.03183172643184662,
+ "step": 210
+ },
+ {
+ "epoch": 1.0658227848101265,
+ "grad_norm": 0.04167373105883598,
+ "learning_rate": 5.2247191011235965e-05,
+ "loss": 0.022458486258983612,
+ "step": 211
+ },
+ {
+ "epoch": 1.070886075949367,
+ "grad_norm": 0.05812355875968933,
+ "learning_rate": 5.1966292134831466e-05,
+ "loss": 0.024729032069444656,
+ "step": 212
+ },
+ {
+ "epoch": 1.0759493670886076,
+ "grad_norm": 0.055412065237760544,
+ "learning_rate": 5.168539325842697e-05,
+ "loss": 0.021617304533720016,
+ "step": 213
+ },
+ {
+ "epoch": 1.081012658227848,
+ "grad_norm": 0.07567988336086273,
+ "learning_rate": 5.140449438202247e-05,
+ "loss": 0.022535085678100586,
+ "step": 214
+ },
+ {
+ "epoch": 1.0860759493670886,
+ "grad_norm": 0.060866981744766235,
+ "learning_rate": 5.112359550561798e-05,
+ "loss": 0.01840364933013916,
+ "step": 215
+ },
+ {
+ "epoch": 1.0911392405063292,
+ "grad_norm": 0.08873461931943893,
+ "learning_rate": 5.084269662921348e-05,
+ "loss": 0.025766316801309586,
+ "step": 216
+ },
+ {
+ "epoch": 1.0962025316455697,
+ "grad_norm": 0.11597098410129547,
+ "learning_rate": 5.0561797752808995e-05,
+ "loss": 0.03225981816649437,
+ "step": 217
+ },
+ {
+ "epoch": 1.1012658227848102,
+ "grad_norm": 0.08358696103096008,
+ "learning_rate": 5.0280898876404495e-05,
+ "loss": 0.02803717739880085,
+ "step": 218
+ },
+ {
+ "epoch": 1.1063291139240505,
+ "grad_norm": 0.061018411070108414,
+ "learning_rate": 5e-05,
+ "loss": 0.021648362278938293,
+ "step": 219
+ },
+ {
+ "epoch": 1.111392405063291,
+ "grad_norm": 0.05671078339219093,
+ "learning_rate": 4.971910112359551e-05,
+ "loss": 0.019684363156557083,
+ "step": 220
+ },
+ {
+ "epoch": 1.1164556962025316,
+ "grad_norm": 0.07847974449396133,
+ "learning_rate": 4.943820224719101e-05,
+ "loss": 0.02301505208015442,
+ "step": 221
+ },
+ {
+ "epoch": 1.1215189873417721,
+ "grad_norm": 0.07058494538068771,
+ "learning_rate": 4.915730337078652e-05,
+ "loss": 0.02161804586648941,
+ "step": 222
+ },
+ {
+ "epoch": 1.1265822784810127,
+ "grad_norm": 0.07703185826539993,
+ "learning_rate": 4.8876404494382024e-05,
+ "loss": 0.02612254023551941,
+ "step": 223
+ },
+ {
+ "epoch": 1.1316455696202532,
+ "grad_norm": 0.09970712661743164,
+ "learning_rate": 4.859550561797753e-05,
+ "loss": 0.02374376356601715,
+ "step": 224
+ },
+ {
+ "epoch": 1.1367088607594937,
+ "grad_norm": 0.08646451681852341,
+ "learning_rate": 4.831460674157304e-05,
+ "loss": 0.028314288705587387,
+ "step": 225
+ },
+ {
+ "epoch": 1.1417721518987343,
+ "grad_norm": 0.08484762907028198,
+ "learning_rate": 4.803370786516854e-05,
+ "loss": 0.025477027520537376,
+ "step": 226
+ },
+ {
+ "epoch": 1.1468354430379746,
+ "grad_norm": 0.1118534579873085,
+ "learning_rate": 4.7752808988764046e-05,
+ "loss": 0.02801482006907463,
+ "step": 227
+ },
+ {
+ "epoch": 1.1518987341772151,
+ "grad_norm": 0.055184341967105865,
+ "learning_rate": 4.747191011235955e-05,
+ "loss": 0.023061107844114304,
+ "step": 228
+ },
+ {
+ "epoch": 1.1569620253164556,
+ "grad_norm": 0.07254941761493683,
+ "learning_rate": 4.719101123595506e-05,
+ "loss": 0.022801868617534637,
+ "step": 229
+ },
+ {
+ "epoch": 1.1620253164556962,
+ "grad_norm": 0.35888558626174927,
+ "learning_rate": 4.691011235955056e-05,
+ "loss": 0.03139413520693779,
+ "step": 230
+ },
+ {
+ "epoch": 1.1670886075949367,
+ "grad_norm": 0.06929845362901688,
+ "learning_rate": 4.662921348314607e-05,
+ "loss": 0.028028275817632675,
+ "step": 231
+ },
+ {
+ "epoch": 1.1721518987341772,
+ "grad_norm": 0.05289424955844879,
+ "learning_rate": 4.6348314606741575e-05,
+ "loss": 0.021396875381469727,
+ "step": 232
+ },
+ {
+ "epoch": 1.1772151898734178,
+ "grad_norm": 0.07960231602191925,
+ "learning_rate": 4.606741573033708e-05,
+ "loss": 0.024000970646739006,
+ "step": 233
+ },
+ {
+ "epoch": 1.1822784810126583,
+ "grad_norm": 0.060839854180812836,
+ "learning_rate": 4.578651685393259e-05,
+ "loss": 0.022219490259885788,
+ "step": 234
+ },
+ {
+ "epoch": 1.1873417721518988,
+ "grad_norm": 0.059355705976486206,
+ "learning_rate": 4.550561797752809e-05,
+ "loss": 0.02514474093914032,
+ "step": 235
+ },
+ {
+ "epoch": 1.1924050632911392,
+ "grad_norm": 0.06133032962679863,
+ "learning_rate": 4.52247191011236e-05,
+ "loss": 0.020457085222005844,
+ "step": 236
+ },
+ {
+ "epoch": 1.1974683544303797,
+ "grad_norm": 0.07158458232879639,
+ "learning_rate": 4.4943820224719104e-05,
+ "loss": 0.02213156223297119,
+ "step": 237
+ },
+ {
+ "epoch": 1.2025316455696202,
+ "grad_norm": 0.06428639590740204,
+ "learning_rate": 4.4662921348314605e-05,
+ "loss": 0.023805856704711914,
+ "step": 238
+ },
+ {
+ "epoch": 1.2075949367088608,
+ "grad_norm": 0.05065426975488663,
+ "learning_rate": 4.438202247191011e-05,
+ "loss": 0.019262265413999557,
+ "step": 239
+ },
+ {
+ "epoch": 1.2126582278481013,
+ "grad_norm": 0.06922949105501175,
+ "learning_rate": 4.410112359550562e-05,
+ "loss": 0.025065988302230835,
+ "step": 240
+ },
+ {
+ "epoch": 1.2177215189873418,
+ "grad_norm": 0.06275492161512375,
+ "learning_rate": 4.3820224719101126e-05,
+ "loss": 0.023258976638317108,
+ "step": 241
+ },
+ {
+ "epoch": 1.2227848101265824,
+ "grad_norm": 0.04986480623483658,
+ "learning_rate": 4.353932584269663e-05,
+ "loss": 0.017242293804883957,
+ "step": 242
+ },
+ {
+ "epoch": 1.2278481012658227,
+ "grad_norm": 0.05149683356285095,
+ "learning_rate": 4.3258426966292134e-05,
+ "loss": 0.018486570566892624,
+ "step": 243
+ },
+ {
+ "epoch": 1.2329113924050632,
+ "grad_norm": 0.13291950523853302,
+ "learning_rate": 4.297752808988764e-05,
+ "loss": 0.02974843978881836,
+ "step": 244
+ },
+ {
+ "epoch": 1.2379746835443037,
+ "grad_norm": 0.0667140856385231,
+ "learning_rate": 4.269662921348315e-05,
+ "loss": 0.020648639649152756,
+ "step": 245
+ },
+ {
+ "epoch": 1.2430379746835443,
+ "grad_norm": 0.060855284333229065,
+ "learning_rate": 4.2415730337078655e-05,
+ "loss": 0.02375114895403385,
+ "step": 246
+ },
+ {
+ "epoch": 1.2481012658227848,
+ "grad_norm": 0.13372953236103058,
+ "learning_rate": 4.2134831460674156e-05,
+ "loss": 0.027109140530228615,
+ "step": 247
+ },
+ {
+ "epoch": 1.2531645569620253,
+ "grad_norm": 0.10401561111211777,
+ "learning_rate": 4.185393258426967e-05,
+ "loss": 0.023977573961019516,
+ "step": 248
+ },
+ {
+ "epoch": 1.2582278481012659,
+ "grad_norm": 0.06237957626581192,
+ "learning_rate": 4.157303370786517e-05,
+ "loss": 0.023332303389906883,
+ "step": 249
+ },
+ {
+ "epoch": 1.2632911392405064,
+ "grad_norm": 0.14403384923934937,
+ "learning_rate": 4.129213483146068e-05,
+ "loss": 0.024930953979492188,
+ "step": 250
+ },
+ {
+ "epoch": 1.268354430379747,
+ "grad_norm": 0.0668739601969719,
+ "learning_rate": 4.1011235955056184e-05,
+ "loss": 0.018033886328339577,
+ "step": 251
+ },
+ {
+ "epoch": 1.2734177215189875,
+ "grad_norm": 0.05586632713675499,
+ "learning_rate": 4.0730337078651685e-05,
+ "loss": 0.018173934891819954,
+ "step": 252
+ },
+ {
+ "epoch": 1.2784810126582278,
+ "grad_norm": 0.09639493376016617,
+ "learning_rate": 4.044943820224719e-05,
+ "loss": 0.027938440442085266,
+ "step": 253
+ },
+ {
+ "epoch": 1.2835443037974683,
+ "grad_norm": 0.08009479939937592,
+ "learning_rate": 4.01685393258427e-05,
+ "loss": 0.023465417325496674,
+ "step": 254
+ },
+ {
+ "epoch": 1.2886075949367088,
+ "grad_norm": 0.1807539463043213,
+ "learning_rate": 3.98876404494382e-05,
+ "loss": 0.01969723030924797,
+ "step": 255
+ },
+ {
+ "epoch": 1.2936708860759494,
+ "grad_norm": 0.06829740852117538,
+ "learning_rate": 3.960674157303371e-05,
+ "loss": 0.021792367100715637,
+ "step": 256
+ },
+ {
+ "epoch": 1.29873417721519,
+ "grad_norm": 0.05660174414515495,
+ "learning_rate": 3.9325842696629214e-05,
+ "loss": 0.020192064344882965,
+ "step": 257
+ },
+ {
+ "epoch": 1.3037974683544304,
+ "grad_norm": 0.08073938637971878,
+ "learning_rate": 3.904494382022472e-05,
+ "loss": 0.02597815915942192,
+ "step": 258
+ },
+ {
+ "epoch": 1.3088607594936708,
+ "grad_norm": 0.10881511121988297,
+ "learning_rate": 3.876404494382023e-05,
+ "loss": 0.024597015231847763,
+ "step": 259
+ },
+ {
+ "epoch": 1.3139240506329113,
+ "grad_norm": 0.0820215567946434,
+ "learning_rate": 3.8483146067415735e-05,
+ "loss": 0.02360178716480732,
+ "step": 260
+ },
+ {
+ "epoch": 1.3189873417721518,
+ "grad_norm": 0.09972008317708969,
+ "learning_rate": 3.8202247191011236e-05,
+ "loss": 0.03047182224690914,
+ "step": 261
+ },
+ {
+ "epoch": 1.3240506329113924,
+ "grad_norm": 0.08419296145439148,
+ "learning_rate": 3.792134831460674e-05,
+ "loss": 0.02330152690410614,
+ "step": 262
+ },
+ {
+ "epoch": 1.3291139240506329,
+ "grad_norm": 0.06094527617096901,
+ "learning_rate": 3.764044943820225e-05,
+ "loss": 0.018342848867177963,
+ "step": 263
+ },
+ {
+ "epoch": 1.3341772151898734,
+ "grad_norm": 0.05268213897943497,
+ "learning_rate": 3.735955056179776e-05,
+ "loss": 0.01991156116127968,
+ "step": 264
+ },
+ {
+ "epoch": 1.339240506329114,
+ "grad_norm": 0.053878139704465866,
+ "learning_rate": 3.7078651685393264e-05,
+ "loss": 0.020518790930509567,
+ "step": 265
+ },
+ {
+ "epoch": 1.3443037974683545,
+ "grad_norm": 0.07669460028409958,
+ "learning_rate": 3.6797752808988765e-05,
+ "loss": 0.02266826666891575,
+ "step": 266
+ },
+ {
+ "epoch": 1.349367088607595,
+ "grad_norm": 0.04602792486548424,
+ "learning_rate": 3.651685393258427e-05,
+ "loss": 0.018465984612703323,
+ "step": 267
+ },
+ {
+ "epoch": 1.3544303797468356,
+ "grad_norm": 0.10155579447746277,
+ "learning_rate": 3.623595505617978e-05,
+ "loss": 0.02757338434457779,
+ "step": 268
+ },
+ {
+ "epoch": 1.3594936708860759,
+ "grad_norm": 0.1848282814025879,
+ "learning_rate": 3.595505617977528e-05,
+ "loss": 0.033505480736494064,
+ "step": 269
+ },
+ {
+ "epoch": 1.3645569620253164,
+ "grad_norm": 0.138128399848938,
+ "learning_rate": 3.5674157303370787e-05,
+ "loss": 0.030650686472654343,
+ "step": 270
+ },
+ {
+ "epoch": 1.369620253164557,
+ "grad_norm": 0.0765174925327301,
+ "learning_rate": 3.5393258426966294e-05,
+ "loss": 0.023368418216705322,
+ "step": 271
+ },
+ {
+ "epoch": 1.3746835443037975,
+ "grad_norm": 0.07541468739509583,
+ "learning_rate": 3.51123595505618e-05,
+ "loss": 0.026541033759713173,
+ "step": 272
+ },
+ {
+ "epoch": 1.379746835443038,
+ "grad_norm": 0.08711216598749161,
+ "learning_rate": 3.483146067415731e-05,
+ "loss": 0.021427802741527557,
+ "step": 273
+ },
+ {
+ "epoch": 1.3848101265822785,
+ "grad_norm": 0.19978079199790955,
+ "learning_rate": 3.455056179775281e-05,
+ "loss": 0.03227628394961357,
+ "step": 274
+ },
+ {
+ "epoch": 1.389873417721519,
+ "grad_norm": 0.07961994409561157,
+ "learning_rate": 3.4269662921348316e-05,
+ "loss": 0.02279270440340042,
+ "step": 275
+ },
+ {
+ "epoch": 1.3949367088607594,
+ "grad_norm": 0.066339872777462,
+ "learning_rate": 3.398876404494382e-05,
+ "loss": 0.03040555864572525,
+ "step": 276
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.08271951228380203,
+ "learning_rate": 3.370786516853933e-05,
+ "loss": 0.022015489637851715,
+ "step": 277
+ },
+ {
+ "epoch": 1.4050632911392404,
+ "grad_norm": 0.09758229553699493,
+ "learning_rate": 3.342696629213483e-05,
+ "loss": 0.029573116451501846,
+ "step": 278
+ },
+ {
+ "epoch": 1.410126582278481,
+ "grad_norm": 0.06353538483381271,
+ "learning_rate": 3.314606741573034e-05,
+ "loss": 0.027620749548077583,
+ "step": 279
+ },
+ {
+ "epoch": 1.4151898734177215,
+ "grad_norm": 0.06581027060747147,
+ "learning_rate": 3.2865168539325845e-05,
+ "loss": 0.025791652500629425,
+ "step": 280
+ },
+ {
+ "epoch": 1.420253164556962,
+ "grad_norm": 0.06837799400091171,
+ "learning_rate": 3.258426966292135e-05,
+ "loss": 0.020104996860027313,
+ "step": 281
+ },
+ {
+ "epoch": 1.4253164556962026,
+ "grad_norm": 0.07667046040296555,
+ "learning_rate": 3.230337078651686e-05,
+ "loss": 0.022089393809437752,
+ "step": 282
+ },
+ {
+ "epoch": 1.4303797468354431,
+ "grad_norm": 0.07643959671258926,
+ "learning_rate": 3.202247191011236e-05,
+ "loss": 0.02299477905035019,
+ "step": 283
+ },
+ {
+ "epoch": 1.4354430379746836,
+ "grad_norm": 0.052867673337459564,
+ "learning_rate": 3.1741573033707866e-05,
+ "loss": 0.021073192358016968,
+ "step": 284
+ },
+ {
+ "epoch": 1.4405063291139242,
+ "grad_norm": 0.05773544684052467,
+ "learning_rate": 3.1460674157303374e-05,
+ "loss": 0.02025243267416954,
+ "step": 285
+ },
+ {
+ "epoch": 1.4455696202531645,
+ "grad_norm": 0.05998314172029495,
+ "learning_rate": 3.1179775280898874e-05,
+ "loss": 0.020083781331777573,
+ "step": 286
+ },
+ {
+ "epoch": 1.450632911392405,
+ "grad_norm": 0.08447867631912231,
+ "learning_rate": 3.089887640449438e-05,
+ "loss": 0.023263949900865555,
+ "step": 287
+ },
+ {
+ "epoch": 1.4556962025316456,
+ "grad_norm": 0.05050220713019371,
+ "learning_rate": 3.061797752808989e-05,
+ "loss": 0.019081300124526024,
+ "step": 288
+ },
+ {
+ "epoch": 1.460759493670886,
+ "grad_norm": 0.10529862344264984,
+ "learning_rate": 3.0337078651685396e-05,
+ "loss": 0.027443014085292816,
+ "step": 289
+ },
+ {
+ "epoch": 1.4658227848101266,
+ "grad_norm": 0.04885238781571388,
+ "learning_rate": 3.0056179775280903e-05,
+ "loss": 0.01990283466875553,
+ "step": 290
+ },
+ {
+ "epoch": 1.4708860759493672,
+ "grad_norm": 0.03970136120915413,
+ "learning_rate": 2.9775280898876406e-05,
+ "loss": 0.019957588985562325,
+ "step": 291
+ },
+ {
+ "epoch": 1.4759493670886075,
+ "grad_norm": 0.09540349990129471,
+ "learning_rate": 2.949438202247191e-05,
+ "loss": 0.023375404998660088,
+ "step": 292
+ },
+ {
+ "epoch": 1.481012658227848,
+ "grad_norm": 0.05323359742760658,
+ "learning_rate": 2.9213483146067417e-05,
+ "loss": 0.021288152784109116,
+ "step": 293
+ },
+ {
+ "epoch": 1.4860759493670885,
+ "grad_norm": 0.05590543895959854,
+ "learning_rate": 2.893258426966292e-05,
+ "loss": 0.022415094077587128,
+ "step": 294
+ },
+ {
+ "epoch": 1.491139240506329,
+ "grad_norm": 0.04170452058315277,
+ "learning_rate": 2.8651685393258425e-05,
+ "loss": 0.019365279003977776,
+ "step": 295
+ },
+ {
+ "epoch": 1.4962025316455696,
+ "grad_norm": 0.06713845580816269,
+ "learning_rate": 2.8370786516853936e-05,
+ "loss": 0.021964367479085922,
+ "step": 296
+ },
+ {
+ "epoch": 1.5012658227848101,
+ "grad_norm": 0.04437360167503357,
+ "learning_rate": 2.8089887640449443e-05,
+ "loss": 0.018354784697294235,
+ "step": 297
+ },
+ {
+ "epoch": 1.5063291139240507,
+ "grad_norm": 0.17045958340168,
+ "learning_rate": 2.7808988764044946e-05,
+ "loss": 0.029483232647180557,
+ "step": 298
+ },
+ {
+ "epoch": 1.5113924050632912,
+ "grad_norm": 0.047910094261169434,
+ "learning_rate": 2.752808988764045e-05,
+ "loss": 0.023236863315105438,
+ "step": 299
+ },
+ {
+ "epoch": 1.5164556962025317,
+ "grad_norm": 0.07887782901525497,
+ "learning_rate": 2.7247191011235957e-05,
+ "loss": 0.02568528801202774,
+ "step": 300
+ },
+ {
+ "epoch": 1.5215189873417723,
+ "grad_norm": 0.06036330386996269,
+ "learning_rate": 2.696629213483146e-05,
+ "loss": 0.029372425749897957,
+ "step": 301
+ },
+ {
+ "epoch": 1.5265822784810128,
+ "grad_norm": 0.052853576838970184,
+ "learning_rate": 2.6685393258426965e-05,
+ "loss": 0.01894172839820385,
+ "step": 302
+ },
+ {
+ "epoch": 1.5316455696202531,
+ "grad_norm": 0.07055529952049255,
+ "learning_rate": 2.6404494382022472e-05,
+ "loss": 0.02091698907315731,
+ "step": 303
+ },
+ {
+ "epoch": 1.5367088607594936,
+ "grad_norm": 0.07571891695261002,
+ "learning_rate": 2.6123595505617983e-05,
+ "loss": 0.027619291096925735,
+ "step": 304
+ },
+ {
+ "epoch": 1.5417721518987342,
+ "grad_norm": 0.09896007925271988,
+ "learning_rate": 2.5842696629213486e-05,
+ "loss": 0.020075365900993347,
+ "step": 305
+ },
+ {
+ "epoch": 1.5468354430379747,
+ "grad_norm": 0.05098677799105644,
+ "learning_rate": 2.556179775280899e-05,
+ "loss": 0.019484052434563637,
+ "step": 306
+ },
+ {
+ "epoch": 1.5518987341772152,
+ "grad_norm": 0.07617086172103882,
+ "learning_rate": 2.5280898876404497e-05,
+ "loss": 0.029518160969018936,
+ "step": 307
+ },
+ {
+ "epoch": 1.5569620253164556,
+ "grad_norm": 0.04699724540114403,
+ "learning_rate": 2.5e-05,
+ "loss": 0.027522489428520203,
+ "step": 308
+ },
+ {
+ "epoch": 1.562025316455696,
+ "grad_norm": 0.049831073731184006,
+ "learning_rate": 2.4719101123595505e-05,
+ "loss": 0.027372654527425766,
+ "step": 309
+ },
+ {
+ "epoch": 1.5670886075949366,
+ "grad_norm": 0.041269559413194656,
+ "learning_rate": 2.4438202247191012e-05,
+ "loss": 0.018155453726649284,
+ "step": 310
+ },
+ {
+ "epoch": 1.5721518987341772,
+ "grad_norm": 0.06620188802480698,
+ "learning_rate": 2.415730337078652e-05,
+ "loss": 0.02107449620962143,
+ "step": 311
+ },
+ {
+ "epoch": 1.5772151898734177,
+ "grad_norm": 0.07382135838270187,
+ "learning_rate": 2.3876404494382023e-05,
+ "loss": 0.02848956361413002,
+ "step": 312
+ },
+ {
+ "epoch": 1.5822784810126582,
+ "grad_norm": 0.04077225923538208,
+ "learning_rate": 2.359550561797753e-05,
+ "loss": 0.020401570945978165,
+ "step": 313
+ },
+ {
+ "epoch": 1.5873417721518988,
+ "grad_norm": 0.03962592035531998,
+ "learning_rate": 2.3314606741573034e-05,
+ "loss": 0.02078087255358696,
+ "step": 314
+ },
+ {
+ "epoch": 1.5924050632911393,
+ "grad_norm": 0.07125665992498398,
+ "learning_rate": 2.303370786516854e-05,
+ "loss": 0.02232661098241806,
+ "step": 315
+ },
+ {
+ "epoch": 1.5974683544303798,
+ "grad_norm": 0.09851735085248947,
+ "learning_rate": 2.2752808988764045e-05,
+ "loss": 0.025687769055366516,
+ "step": 316
+ },
+ {
+ "epoch": 1.6025316455696204,
+ "grad_norm": 0.064850352704525,
+ "learning_rate": 2.2471910112359552e-05,
+ "loss": 0.022183744236826897,
+ "step": 317
+ },
+ {
+ "epoch": 1.6075949367088609,
+ "grad_norm": 0.06365304440259933,
+ "learning_rate": 2.2191011235955056e-05,
+ "loss": 0.02664877101778984,
+ "step": 318
+ },
+ {
+ "epoch": 1.6126582278481014,
+ "grad_norm": 0.06429828703403473,
+ "learning_rate": 2.1910112359550563e-05,
+ "loss": 0.022297101095318794,
+ "step": 319
+ },
+ {
+ "epoch": 1.6177215189873417,
+ "grad_norm": 0.07642437517642975,
+ "learning_rate": 2.1629213483146067e-05,
+ "loss": 0.027119502425193787,
+ "step": 320
+ },
+ {
+ "epoch": 1.6227848101265823,
+ "grad_norm": 0.12292516976594925,
+ "learning_rate": 2.1348314606741574e-05,
+ "loss": 0.028022341430187225,
+ "step": 321
+ },
+ {
+ "epoch": 1.6278481012658228,
+ "grad_norm": 0.075126051902771,
+ "learning_rate": 2.1067415730337078e-05,
+ "loss": 0.02235642448067665,
+ "step": 322
+ },
+ {
+ "epoch": 1.6329113924050633,
+ "grad_norm": 0.03932284563779831,
+ "learning_rate": 2.0786516853932585e-05,
+ "loss": 0.020223911851644516,
+ "step": 323
+ },
+ {
+ "epoch": 1.6379746835443036,
+ "grad_norm": 0.12709097564220428,
+ "learning_rate": 2.0505617977528092e-05,
+ "loss": 0.02956746704876423,
+ "step": 324
+ },
+ {
+ "epoch": 1.6430379746835442,
+ "grad_norm": 0.05546820908784866,
+ "learning_rate": 2.0224719101123596e-05,
+ "loss": 0.01986052840948105,
+ "step": 325
+ },
+ {
+ "epoch": 1.6481012658227847,
+ "grad_norm": 0.066724993288517,
+ "learning_rate": 1.99438202247191e-05,
+ "loss": 0.0187405776232481,
+ "step": 326
+ },
+ {
+ "epoch": 1.6531645569620252,
+ "grad_norm": 0.04929181560873985,
+ "learning_rate": 1.9662921348314607e-05,
+ "loss": 0.023134229704737663,
+ "step": 327
+ },
+ {
+ "epoch": 1.6582278481012658,
+ "grad_norm": 0.12453353404998779,
+ "learning_rate": 1.9382022471910114e-05,
+ "loss": 0.023365017026662827,
+ "step": 328
+ },
+ {
+ "epoch": 1.6632911392405063,
+ "grad_norm": 0.05120285227894783,
+ "learning_rate": 1.9101123595505618e-05,
+ "loss": 0.02097117155790329,
+ "step": 329
+ },
+ {
+ "epoch": 1.6683544303797468,
+ "grad_norm": 0.044391464442014694,
+ "learning_rate": 1.8820224719101125e-05,
+ "loss": 0.02394508197903633,
+ "step": 330
+ },
+ {
+ "epoch": 1.6734177215189874,
+ "grad_norm": 0.04807993397116661,
+ "learning_rate": 1.8539325842696632e-05,
+ "loss": 0.021204879507422447,
+ "step": 331
+ },
+ {
+ "epoch": 1.678481012658228,
+ "grad_norm": 0.09313198179006577,
+ "learning_rate": 1.8258426966292136e-05,
+ "loss": 0.028272360563278198,
+ "step": 332
+ },
+ {
+ "epoch": 1.6835443037974684,
+ "grad_norm": 0.0521085225045681,
+ "learning_rate": 1.797752808988764e-05,
+ "loss": 0.02105197310447693,
+ "step": 333
+ },
+ {
+ "epoch": 1.688607594936709,
+ "grad_norm": 0.16171489655971527,
+ "learning_rate": 1.7696629213483147e-05,
+ "loss": 0.023972850292921066,
+ "step": 334
+ },
+ {
+ "epoch": 1.6936708860759495,
+ "grad_norm": 0.059263281524181366,
+ "learning_rate": 1.7415730337078654e-05,
+ "loss": 0.018791278824210167,
+ "step": 335
+ },
+ {
+ "epoch": 1.6987341772151898,
+ "grad_norm": 0.054993461817502975,
+ "learning_rate": 1.7134831460674158e-05,
+ "loss": 0.01809805817902088,
+ "step": 336
+ },
+ {
+ "epoch": 1.7037974683544304,
+ "grad_norm": 0.06396708637475967,
+ "learning_rate": 1.6853932584269665e-05,
+ "loss": 0.019808873534202576,
+ "step": 337
+ },
+ {
+ "epoch": 1.7088607594936709,
+ "grad_norm": 0.061717305332422256,
+ "learning_rate": 1.657303370786517e-05,
+ "loss": 0.018926184624433517,
+ "step": 338
+ },
+ {
+ "epoch": 1.7139240506329114,
+ "grad_norm": 0.1274409294128418,
+ "learning_rate": 1.6292134831460676e-05,
+ "loss": 0.025588059797883034,
+ "step": 339
+ },
+ {
+ "epoch": 1.7189873417721517,
+ "grad_norm": 0.05238728225231171,
+ "learning_rate": 1.601123595505618e-05,
+ "loss": 0.01933823898434639,
+ "step": 340
+ },
+ {
+ "epoch": 1.7240506329113923,
+ "grad_norm": 0.04448588937520981,
+ "learning_rate": 1.5730337078651687e-05,
+ "loss": 0.01847737282514572,
+ "step": 341
+ },
+ {
+ "epoch": 1.7291139240506328,
+ "grad_norm": 0.0693555697798729,
+ "learning_rate": 1.544943820224719e-05,
+ "loss": 0.02382083237171173,
+ "step": 342
+ },
+ {
+ "epoch": 1.7341772151898733,
+ "grad_norm": 0.09015898406505585,
+ "learning_rate": 1.5168539325842698e-05,
+ "loss": 0.03285374492406845,
+ "step": 343
+ },
+ {
+ "epoch": 1.7392405063291139,
+ "grad_norm": 0.05830130726099014,
+ "learning_rate": 1.4887640449438203e-05,
+ "loss": 0.023597031831741333,
+ "step": 344
+ },
+ {
+ "epoch": 1.7443037974683544,
+ "grad_norm": 0.06964442878961563,
+ "learning_rate": 1.4606741573033709e-05,
+ "loss": 0.025242581963539124,
+ "step": 345
+ },
+ {
+ "epoch": 1.749367088607595,
+ "grad_norm": 0.07636284083127975,
+ "learning_rate": 1.4325842696629212e-05,
+ "loss": 0.025867605581879616,
+ "step": 346
+ },
+ {
+ "epoch": 1.7544303797468355,
+ "grad_norm": 0.0530858188867569,
+ "learning_rate": 1.4044943820224721e-05,
+ "loss": 0.01782223954796791,
+ "step": 347
+ },
+ {
+ "epoch": 1.759493670886076,
+ "grad_norm": 0.057501088827848434,
+ "learning_rate": 1.3764044943820225e-05,
+ "loss": 0.02082682028412819,
+ "step": 348
+ },
+ {
+ "epoch": 1.7645569620253165,
+ "grad_norm": 0.05132418870925903,
+ "learning_rate": 1.348314606741573e-05,
+ "loss": 0.02114701271057129,
+ "step": 349
+ },
+ {
+ "epoch": 1.769620253164557,
+ "grad_norm": 0.06183668598532677,
+ "learning_rate": 1.3202247191011236e-05,
+ "loss": 0.02497776970267296,
+ "step": 350
+ },
+ {
+ "epoch": 1.7746835443037976,
+ "grad_norm": 0.0875011757016182,
+ "learning_rate": 1.2921348314606743e-05,
+ "loss": 0.02531014010310173,
+ "step": 351
+ },
+ {
+ "epoch": 1.7797468354430381,
+ "grad_norm": 0.047346726059913635,
+ "learning_rate": 1.2640449438202249e-05,
+ "loss": 0.020917542278766632,
+ "step": 352
+ },
+ {
+ "epoch": 1.7848101265822784,
+ "grad_norm": 0.06439970433712006,
+ "learning_rate": 1.2359550561797752e-05,
+ "loss": 0.026974394917488098,
+ "step": 353
+ },
+ {
+ "epoch": 1.789873417721519,
+ "grad_norm": 0.05933712422847748,
+ "learning_rate": 1.207865168539326e-05,
+ "loss": 0.023306898772716522,
+ "step": 354
+ },
+ {
+ "epoch": 1.7949367088607595,
+ "grad_norm": 0.10834282636642456,
+ "learning_rate": 1.1797752808988765e-05,
+ "loss": 0.02355179563164711,
+ "step": 355
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.049313463270664215,
+ "learning_rate": 1.151685393258427e-05,
+ "loss": 0.02544863522052765,
+ "step": 356
+ },
+ {
+ "epoch": 1.8050632911392404,
+ "grad_norm": 0.05316372960805893,
+ "learning_rate": 1.1235955056179776e-05,
+ "loss": 0.02087213471531868,
+ "step": 357
+ },
+ {
+ "epoch": 1.810126582278481,
+ "grad_norm": 0.09314416348934174,
+ "learning_rate": 1.0955056179775282e-05,
+ "loss": 0.027589809149503708,
+ "step": 358
+ },
+ {
+ "epoch": 1.8151898734177214,
+ "grad_norm": 0.05720842257142067,
+ "learning_rate": 1.0674157303370787e-05,
+ "loss": 0.017814233899116516,
+ "step": 359
+ },
+ {
+ "epoch": 1.820253164556962,
+ "grad_norm": 0.0778052806854248,
+ "learning_rate": 1.0393258426966292e-05,
+ "loss": 0.02682694047689438,
+ "step": 360
+ },
+ {
+ "epoch": 1.8253164556962025,
+ "grad_norm": 0.09793683886528015,
+ "learning_rate": 1.0112359550561798e-05,
+ "loss": 0.019917789846658707,
+ "step": 361
+ },
+ {
+ "epoch": 1.830379746835443,
+ "grad_norm": 0.08147338777780533,
+ "learning_rate": 9.831460674157303e-06,
+ "loss": 0.02468765154480934,
+ "step": 362
+ },
+ {
+ "epoch": 1.8354430379746836,
+ "grad_norm": 0.04275086522102356,
+ "learning_rate": 9.550561797752809e-06,
+ "loss": 0.020521359518170357,
+ "step": 363
+ },
+ {
+ "epoch": 1.840506329113924,
+ "grad_norm": 0.04727878049015999,
+ "learning_rate": 9.269662921348316e-06,
+ "loss": 0.019041402265429497,
+ "step": 364
+ },
+ {
+ "epoch": 1.8455696202531646,
+ "grad_norm": 0.10783374309539795,
+ "learning_rate": 8.98876404494382e-06,
+ "loss": 0.030300743877887726,
+ "step": 365
+ },
+ {
+ "epoch": 1.8506329113924052,
+ "grad_norm": 0.04381687939167023,
+ "learning_rate": 8.707865168539327e-06,
+ "loss": 0.018183689564466476,
+ "step": 366
+ },
+ {
+ "epoch": 1.8556962025316457,
+ "grad_norm": 0.051079750061035156,
+ "learning_rate": 8.426966292134832e-06,
+ "loss": 0.01922440156340599,
+ "step": 367
+ },
+ {
+ "epoch": 1.8607594936708862,
+ "grad_norm": 0.04523700103163719,
+ "learning_rate": 8.146067415730338e-06,
+ "loss": 0.01726699247956276,
+ "step": 368
+ },
+ {
+ "epoch": 1.8658227848101265,
+ "grad_norm": 0.062100812792778015,
+ "learning_rate": 7.865168539325843e-06,
+ "loss": 0.021219059824943542,
+ "step": 369
+ },
+ {
+ "epoch": 1.870886075949367,
+ "grad_norm": 0.05334998667240143,
+ "learning_rate": 7.584269662921349e-06,
+ "loss": 0.021496141329407692,
+ "step": 370
+ },
+ {
+ "epoch": 1.8759493670886076,
+ "grad_norm": 0.04744403064250946,
+ "learning_rate": 7.303370786516854e-06,
+ "loss": 0.02225729078054428,
+ "step": 371
+ },
+ {
+ "epoch": 1.8810126582278481,
+ "grad_norm": 0.04472232982516289,
+ "learning_rate": 7.022471910112361e-06,
+ "loss": 0.024288838729262352,
+ "step": 372
+ },
+ {
+ "epoch": 1.8860759493670884,
+ "grad_norm": 0.051793619990348816,
+ "learning_rate": 6.741573033707865e-06,
+ "loss": 0.02393830008804798,
+ "step": 373
+ },
+ {
+ "epoch": 1.891139240506329,
+ "grad_norm": 0.05727501958608627,
+ "learning_rate": 6.460674157303372e-06,
+ "loss": 0.02132001891732216,
+ "step": 374
+ },
+ {
+ "epoch": 1.8962025316455695,
+ "grad_norm": 0.09208142012357712,
+ "learning_rate": 6.179775280898876e-06,
+ "loss": 0.021289143711328506,
+ "step": 375
+ },
+ {
+ "epoch": 1.90126582278481,
+ "grad_norm": 0.06456775218248367,
+ "learning_rate": 5.8988764044943826e-06,
+ "loss": 0.024857791140675545,
+ "step": 376
+ },
+ {
+ "epoch": 1.9063291139240506,
+ "grad_norm": 0.07470308244228363,
+ "learning_rate": 5.617977528089888e-06,
+ "loss": 0.02537504956126213,
+ "step": 377
+ },
+ {
+ "epoch": 1.9113924050632911,
+ "grad_norm": 0.10378618538379669,
+ "learning_rate": 5.3370786516853935e-06,
+ "loss": 0.027656231075525284,
+ "step": 378
+ },
+ {
+ "epoch": 1.9164556962025316,
+ "grad_norm": 0.04435795918107033,
+ "learning_rate": 5.056179775280899e-06,
+ "loss": 0.01768098771572113,
+ "step": 379
+ },
+ {
+ "epoch": 1.9215189873417722,
+ "grad_norm": 0.04268966242671013,
+ "learning_rate": 4.7752808988764044e-06,
+ "loss": 0.019126616418361664,
+ "step": 380
+ },
+ {
+ "epoch": 1.9265822784810127,
+ "grad_norm": 0.07805328816175461,
+ "learning_rate": 4.49438202247191e-06,
+ "loss": 0.02455170452594757,
+ "step": 381
+ },
+ {
+ "epoch": 1.9316455696202532,
+ "grad_norm": 0.06378164142370224,
+ "learning_rate": 4.213483146067416e-06,
+ "loss": 0.018960915505886078,
+ "step": 382
+ },
+ {
+ "epoch": 1.9367088607594938,
+ "grad_norm": 0.08862949162721634,
+ "learning_rate": 3.932584269662922e-06,
+ "loss": 0.020694587379693985,
+ "step": 383
+ },
+ {
+ "epoch": 1.9417721518987343,
+ "grad_norm": 12.300362586975098,
+ "learning_rate": 3.651685393258427e-06,
+ "loss": 0.02603510394692421,
+ "step": 384
+ },
+ {
+ "epoch": 1.9468354430379748,
+ "grad_norm": 0.0986592024564743,
+ "learning_rate": 3.3707865168539327e-06,
+ "loss": 0.02129153348505497,
+ "step": 385
+ },
+ {
+ "epoch": 1.9518987341772152,
+ "grad_norm": 0.04578190669417381,
+ "learning_rate": 3.089887640449438e-06,
+ "loss": 0.017470583319664,
+ "step": 386
+ },
+ {
+ "epoch": 1.9569620253164557,
+ "grad_norm": 0.05844039469957352,
+ "learning_rate": 2.808988764044944e-06,
+ "loss": 0.019175710156559944,
+ "step": 387
+ },
+ {
+ "epoch": 1.9620253164556962,
+ "grad_norm": 0.04072394222021103,
+ "learning_rate": 2.5280898876404495e-06,
+ "loss": 0.020137496292591095,
+ "step": 388
+ },
+ {
+ "epoch": 1.9670886075949368,
+ "grad_norm": 0.052106134593486786,
+ "learning_rate": 2.247191011235955e-06,
+ "loss": 0.024513747543096542,
+ "step": 389
+ },
+ {
+ "epoch": 1.972151898734177,
+ "grad_norm": 0.046065039932727814,
+ "learning_rate": 1.966292134831461e-06,
+ "loss": 0.019092664122581482,
+ "step": 390
+ },
+ {
+ "epoch": 1.9772151898734176,
+ "grad_norm": 0.1259572058916092,
+ "learning_rate": 1.6853932584269663e-06,
+ "loss": 0.026434529572725296,
+ "step": 391
+ },
+ {
+ "epoch": 1.9822784810126581,
+ "grad_norm": 0.06390741467475891,
+ "learning_rate": 1.404494382022472e-06,
+ "loss": 0.024471383541822433,
+ "step": 392
+ },
+ {
+ "epoch": 1.9873417721518987,
+ "grad_norm": 0.058565881103277206,
+ "learning_rate": 1.1235955056179775e-06,
+ "loss": 0.020053330808877945,
+ "step": 393
+ },
+ {
+ "epoch": 1.9924050632911392,
+ "grad_norm": 0.05019316077232361,
+ "learning_rate": 8.426966292134832e-07,
+ "loss": 0.02157164365053177,
+ "step": 394
+ },
+ {
+ "epoch": 1.9974683544303797,
+ "grad_norm": 0.0529247522354126,
+ "learning_rate": 5.617977528089887e-07,
+ "loss": 0.024665027856826782,
+ "step": 395
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.13774892687797546,
+ "learning_rate": 2.8089887640449437e-07,
+ "loss": 0.03396236523985863,
+ "step": 396
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 396,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 2,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": true
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 2.521651115968512e+16,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-396/training_args.bin b/checkpoint-396/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..585183a4c04533c18e28404929b4927874575107
--- /dev/null
+++ b/checkpoint-396/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1dc0e6ca80cb4d9d0a2afbc3de58e711a6cae8afbebf68a073182b71aa7d48a
+size 5777
diff --git a/checkpoint-40/README.md b/checkpoint-40/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..17bc522e13c6998ab7f14e4524a99f96b2e38000
--- /dev/null
+++ b/checkpoint-40/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-40/adapter_config.json b/checkpoint-40/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b01b681148ff188ab3d162c0d6bb07268b3adfca
--- /dev/null
+++ b/checkpoint-40/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-1.7B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "o_proj",
+ "v_proj",
+ "up_proj",
+ "down_proj",
+ "q_proj",
+ "gate_proj",
+ "k_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-40/adapter_model.safetensors b/checkpoint-40/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..f41eb903084e2f4ee05168af6be06b606a48bbe0
--- /dev/null
+++ b/checkpoint-40/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6288e8ef5375754f1999e91b5759da27a29b9493defcb5e6141dcd8a92f46262
+size 69782384
diff --git a/checkpoint-40/chat_template.jinja b/checkpoint-40/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-40/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-40/optimizer.pt b/checkpoint-40/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..75a3206d84162c22b124d88c1cf297722791c992
--- /dev/null
+++ b/checkpoint-40/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3ee2e27c8733c7fc37a1fc8129012ec73a9142171c8e12e5d911e78586071a62
+size 35873029
diff --git a/checkpoint-40/rng_state.pth b/checkpoint-40/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..f2b227c0cab23c835054e23d3b4f04c526244af2
--- /dev/null
+++ b/checkpoint-40/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3f947f8aa5caa4e125266d06e9a43b5cd4aa4afba7b6e461769b4b5e73969952
+size 14645
diff --git a/checkpoint-40/scheduler.pt b/checkpoint-40/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..b996f33264e284eca64f9f6d6202daa2f75fede2
--- /dev/null
+++ b/checkpoint-40/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1562e9d4de3bc78b2c0c8e032159114fb13565f2801f2bd5752811a1c88b4cd7
+size 1465
diff --git a/checkpoint-40/tokenizer.json b/checkpoint-40/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-40/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-40/tokenizer_config.json b/checkpoint-40/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-40/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-40/trainer_state.json b/checkpoint-40/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..7f3f5b5f4f19889f6ba86d088ad89cdc057a7863
--- /dev/null
+++ b/checkpoint-40/trainer_state.json
@@ -0,0 +1,314 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 8.0,
+ "eval_steps": 500,
+ "global_step": 40,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.8728970289230347,
+ "learning_rate": 0.0,
+ "loss": 1.7144343852996826,
+ "step": 1
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.6763373613357544,
+ "learning_rate": 2e-05,
+ "loss": 1.4952771663665771,
+ "step": 2
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 1.7191307544708252,
+ "learning_rate": 4e-05,
+ "loss": 1.574378252029419,
+ "step": 3
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 1.7878174781799316,
+ "learning_rate": 6e-05,
+ "loss": 1.6600843667984009,
+ "step": 4
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 1.929695725440979,
+ "learning_rate": 8e-05,
+ "loss": 1.7657139301300049,
+ "step": 5
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 1.8718829154968262,
+ "learning_rate": 0.0001,
+ "loss": 1.6730849742889404,
+ "step": 6
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 1.7125587463378906,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 1.5219359397888184,
+ "step": 7
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 1.4176026582717896,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 1.2670559883117676,
+ "step": 8
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 1.132968544960022,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.9341962933540344,
+ "step": 9
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 1.0091828107833862,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.9576144218444824,
+ "step": 10
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.9517018795013428,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 1.0370712280273438,
+ "step": 11
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.7950196266174316,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.8810007572174072,
+ "step": 12
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.5975409150123596,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.6599255204200745,
+ "step": 13
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.670741617679596,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.7524279356002808,
+ "step": 14
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.6229442358016968,
+ "learning_rate": 8e-05,
+ "loss": 0.7022373676300049,
+ "step": 15
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.6008868217468262,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.7129132151603699,
+ "step": 16
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.4868341386318207,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.5670006275177002,
+ "step": 17
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.3936000168323517,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.4459620416164398,
+ "step": 18
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.6198397278785706,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.6668416261672974,
+ "step": 19
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.4862337112426758,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.5134721398353577,
+ "step": 20
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.4499748647212982,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.4492708444595337,
+ "step": 21
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.5525116920471191,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.4935491681098938,
+ "step": 22
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.39707908034324646,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.3448738753795624,
+ "step": 23
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.49178075790405273,
+ "learning_rate": 6e-05,
+ "loss": 0.3920281231403351,
+ "step": 24
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.5493410229682922,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.3991503119468689,
+ "step": 25
+ },
+ {
+ "epoch": 5.2,
+ "grad_norm": 0.5442111492156982,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.3687404692173004,
+ "step": 26
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.5512173175811768,
+ "learning_rate": 5.333333333333333e-05,
+ "loss": 0.3348987102508545,
+ "step": 27
+ },
+ {
+ "epoch": 5.6,
+ "grad_norm": 0.397312194108963,
+ "learning_rate": 5.111111111111111e-05,
+ "loss": 0.2330646514892578,
+ "step": 28
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.49750691652297974,
+ "learning_rate": 4.888888888888889e-05,
+ "loss": 0.25489163398742676,
+ "step": 29
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.46191564202308655,
+ "learning_rate": 4.666666666666667e-05,
+ "loss": 0.21787357330322266,
+ "step": 30
+ },
+ {
+ "epoch": 6.2,
+ "grad_norm": 0.7073832750320435,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.21505802869796753,
+ "step": 31
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.5831727385520935,
+ "learning_rate": 4.222222222222222e-05,
+ "loss": 0.17434410750865936,
+ "step": 32
+ },
+ {
+ "epoch": 6.6,
+ "grad_norm": 0.7414628267288208,
+ "learning_rate": 4e-05,
+ "loss": 0.2174021601676941,
+ "step": 33
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.47256121039390564,
+ "learning_rate": 3.777777777777778e-05,
+ "loss": 0.13752047717571259,
+ "step": 34
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.5125815272331238,
+ "learning_rate": 3.555555555555556e-05,
+ "loss": 0.1274665892124176,
+ "step": 35
+ },
+ {
+ "epoch": 7.2,
+ "grad_norm": 0.4060456454753876,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.11074981093406677,
+ "step": 36
+ },
+ {
+ "epoch": 7.4,
+ "grad_norm": 0.40927401185035706,
+ "learning_rate": 3.111111111111111e-05,
+ "loss": 0.11459425091743469,
+ "step": 37
+ },
+ {
+ "epoch": 7.6,
+ "grad_norm": 0.3621813654899597,
+ "learning_rate": 2.8888888888888888e-05,
+ "loss": 0.10723860561847687,
+ "step": 38
+ },
+ {
+ "epoch": 7.8,
+ "grad_norm": 0.41437873244285583,
+ "learning_rate": 2.6666666666666667e-05,
+ "loss": 0.11015444993972778,
+ "step": 39
+ },
+ {
+ "epoch": 8.0,
+ "grad_norm": 0.33479785919189453,
+ "learning_rate": 2.4444444444444445e-05,
+ "loss": 0.08165578544139862,
+ "step": 40
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 50,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 740634054524928.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-40/training_args.bin b/checkpoint-40/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-40/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-45/README.md b/checkpoint-45/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..17bc522e13c6998ab7f14e4524a99f96b2e38000
--- /dev/null
+++ b/checkpoint-45/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-45/adapter_config.json b/checkpoint-45/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b01b681148ff188ab3d162c0d6bb07268b3adfca
--- /dev/null
+++ b/checkpoint-45/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-1.7B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "o_proj",
+ "v_proj",
+ "up_proj",
+ "down_proj",
+ "q_proj",
+ "gate_proj",
+ "k_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-45/adapter_model.safetensors b/checkpoint-45/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..360e09c5e223805e10a984ede1e10ad3e12e1e5b
--- /dev/null
+++ b/checkpoint-45/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ab70f067adbb7b647129eecbfb6fb6cce1db2f3606d4ac045233077fd2bb8fb
+size 69782384
diff --git a/checkpoint-45/chat_template.jinja b/checkpoint-45/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-45/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-45/optimizer.pt b/checkpoint-45/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..bc0f8c1c2f745c75ce6bc6947638f4d451bdc7d4
--- /dev/null
+++ b/checkpoint-45/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:427172e8e552f28a6a35b094310e2869eae0501f8d97a45046caf69be55a1e42
+size 35873029
diff --git a/checkpoint-45/rng_state.pth b/checkpoint-45/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..77729d4bc088ad9fab197923e9ca84ef702af1bc
--- /dev/null
+++ b/checkpoint-45/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6846fcb7fd5a783ad80e0c1c5902482ea69e479e8dfeb46ebc73e2f33affb875
+size 14645
diff --git a/checkpoint-45/scheduler.pt b/checkpoint-45/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..bb1ff469b7b876401f2562304343203dcdf6c6fe
--- /dev/null
+++ b/checkpoint-45/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c29cb1d2da8216d945614e4879623692b0934b7cf51338a5ce2442b9071048fa
+size 1465
diff --git a/checkpoint-45/tokenizer.json b/checkpoint-45/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-45/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-45/tokenizer_config.json b/checkpoint-45/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-45/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-45/trainer_state.json b/checkpoint-45/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..e5fd434db765b5352dc6919048f797c3ba42921c
--- /dev/null
+++ b/checkpoint-45/trainer_state.json
@@ -0,0 +1,349 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 9.0,
+ "eval_steps": 500,
+ "global_step": 45,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.8728970289230347,
+ "learning_rate": 0.0,
+ "loss": 1.7144343852996826,
+ "step": 1
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.6763373613357544,
+ "learning_rate": 2e-05,
+ "loss": 1.4952771663665771,
+ "step": 2
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 1.7191307544708252,
+ "learning_rate": 4e-05,
+ "loss": 1.574378252029419,
+ "step": 3
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 1.7878174781799316,
+ "learning_rate": 6e-05,
+ "loss": 1.6600843667984009,
+ "step": 4
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 1.929695725440979,
+ "learning_rate": 8e-05,
+ "loss": 1.7657139301300049,
+ "step": 5
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 1.8718829154968262,
+ "learning_rate": 0.0001,
+ "loss": 1.6730849742889404,
+ "step": 6
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 1.7125587463378906,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 1.5219359397888184,
+ "step": 7
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 1.4176026582717896,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 1.2670559883117676,
+ "step": 8
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 1.132968544960022,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.9341962933540344,
+ "step": 9
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 1.0091828107833862,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.9576144218444824,
+ "step": 10
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.9517018795013428,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 1.0370712280273438,
+ "step": 11
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.7950196266174316,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.8810007572174072,
+ "step": 12
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.5975409150123596,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.6599255204200745,
+ "step": 13
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.670741617679596,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.7524279356002808,
+ "step": 14
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.6229442358016968,
+ "learning_rate": 8e-05,
+ "loss": 0.7022373676300049,
+ "step": 15
+ },
+ {
+ "epoch": 3.2,
+ "grad_norm": 0.6008868217468262,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.7129132151603699,
+ "step": 16
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.4868341386318207,
+ "learning_rate": 7.555555555555556e-05,
+ "loss": 0.5670006275177002,
+ "step": 17
+ },
+ {
+ "epoch": 3.6,
+ "grad_norm": 0.3936000168323517,
+ "learning_rate": 7.333333333333333e-05,
+ "loss": 0.4459620416164398,
+ "step": 18
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.6198397278785706,
+ "learning_rate": 7.111111111111112e-05,
+ "loss": 0.6668416261672974,
+ "step": 19
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.4862337112426758,
+ "learning_rate": 6.88888888888889e-05,
+ "loss": 0.5134721398353577,
+ "step": 20
+ },
+ {
+ "epoch": 4.2,
+ "grad_norm": 0.4499748647212982,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.4492708444595337,
+ "step": 21
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.5525116920471191,
+ "learning_rate": 6.444444444444446e-05,
+ "loss": 0.4935491681098938,
+ "step": 22
+ },
+ {
+ "epoch": 4.6,
+ "grad_norm": 0.39707908034324646,
+ "learning_rate": 6.222222222222222e-05,
+ "loss": 0.3448738753795624,
+ "step": 23
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.49178075790405273,
+ "learning_rate": 6e-05,
+ "loss": 0.3920281231403351,
+ "step": 24
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.5493410229682922,
+ "learning_rate": 5.7777777777777776e-05,
+ "loss": 0.3991503119468689,
+ "step": 25
+ },
+ {
+ "epoch": 5.2,
+ "grad_norm": 0.5442111492156982,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.3687404692173004,
+ "step": 26
+ },
+ {
+ "epoch": 5.4,
+ "grad_norm": 0.5512173175811768,
+ "learning_rate": 5.333333333333333e-05,
+ "loss": 0.3348987102508545,
+ "step": 27
+ },
+ {
+ "epoch": 5.6,
+ "grad_norm": 0.397312194108963,
+ "learning_rate": 5.111111111111111e-05,
+ "loss": 0.2330646514892578,
+ "step": 28
+ },
+ {
+ "epoch": 5.8,
+ "grad_norm": 0.49750691652297974,
+ "learning_rate": 4.888888888888889e-05,
+ "loss": 0.25489163398742676,
+ "step": 29
+ },
+ {
+ "epoch": 6.0,
+ "grad_norm": 0.46191564202308655,
+ "learning_rate": 4.666666666666667e-05,
+ "loss": 0.21787357330322266,
+ "step": 30
+ },
+ {
+ "epoch": 6.2,
+ "grad_norm": 0.7073832750320435,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.21505802869796753,
+ "step": 31
+ },
+ {
+ "epoch": 6.4,
+ "grad_norm": 0.5831727385520935,
+ "learning_rate": 4.222222222222222e-05,
+ "loss": 0.17434410750865936,
+ "step": 32
+ },
+ {
+ "epoch": 6.6,
+ "grad_norm": 0.7414628267288208,
+ "learning_rate": 4e-05,
+ "loss": 0.2174021601676941,
+ "step": 33
+ },
+ {
+ "epoch": 6.8,
+ "grad_norm": 0.47256121039390564,
+ "learning_rate": 3.777777777777778e-05,
+ "loss": 0.13752047717571259,
+ "step": 34
+ },
+ {
+ "epoch": 7.0,
+ "grad_norm": 0.5125815272331238,
+ "learning_rate": 3.555555555555556e-05,
+ "loss": 0.1274665892124176,
+ "step": 35
+ },
+ {
+ "epoch": 7.2,
+ "grad_norm": 0.4060456454753876,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.11074981093406677,
+ "step": 36
+ },
+ {
+ "epoch": 7.4,
+ "grad_norm": 0.40927401185035706,
+ "learning_rate": 3.111111111111111e-05,
+ "loss": 0.11459425091743469,
+ "step": 37
+ },
+ {
+ "epoch": 7.6,
+ "grad_norm": 0.3621813654899597,
+ "learning_rate": 2.8888888888888888e-05,
+ "loss": 0.10723860561847687,
+ "step": 38
+ },
+ {
+ "epoch": 7.8,
+ "grad_norm": 0.41437873244285583,
+ "learning_rate": 2.6666666666666667e-05,
+ "loss": 0.11015444993972778,
+ "step": 39
+ },
+ {
+ "epoch": 8.0,
+ "grad_norm": 0.33479785919189453,
+ "learning_rate": 2.4444444444444445e-05,
+ "loss": 0.08165578544139862,
+ "step": 40
+ },
+ {
+ "epoch": 8.2,
+ "grad_norm": 0.3438816964626312,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.08241143077611923,
+ "step": 41
+ },
+ {
+ "epoch": 8.4,
+ "grad_norm": 0.4332162141799927,
+ "learning_rate": 2e-05,
+ "loss": 0.08092954009771347,
+ "step": 42
+ },
+ {
+ "epoch": 8.6,
+ "grad_norm": 0.29198166728019714,
+ "learning_rate": 1.777777777777778e-05,
+ "loss": 0.06760574132204056,
+ "step": 43
+ },
+ {
+ "epoch": 8.8,
+ "grad_norm": 0.31051307916641235,
+ "learning_rate": 1.5555555555555555e-05,
+ "loss": 0.06667725741863251,
+ "step": 44
+ },
+ {
+ "epoch": 9.0,
+ "grad_norm": 0.2565516233444214,
+ "learning_rate": 1.3333333333333333e-05,
+ "loss": 0.05310295522212982,
+ "step": 45
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 50,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 833213311340544.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-45/training_args.bin b/checkpoint-45/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-45/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-5/README.md b/checkpoint-5/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..17bc522e13c6998ab7f14e4524a99f96b2e38000
--- /dev/null
+++ b/checkpoint-5/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-1.7B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-5/adapter_config.json b/checkpoint-5/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b01b681148ff188ab3d162c0d6bb07268b3adfca
--- /dev/null
+++ b/checkpoint-5/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-1.7B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "o_proj",
+ "v_proj",
+ "up_proj",
+ "down_proj",
+ "q_proj",
+ "gate_proj",
+ "k_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-5/adapter_model.safetensors b/checkpoint-5/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..cd7da38f831e6ed5440f6abd50d93b29b270df8f
--- /dev/null
+++ b/checkpoint-5/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62d6988f6bccdfcd292851c75e4d87daa294b0c977036ecbee58db4cd9323b23
+size 69782384
diff --git a/checkpoint-5/chat_template.jinja b/checkpoint-5/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-5/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-5/optimizer.pt b/checkpoint-5/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..c2edb14ec326b1e0a7c034a32c9019e25600c5f1
--- /dev/null
+++ b/checkpoint-5/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:321bb39a34faed40c7dd0cb1379e3c7ddb7b4abdacace441e99f916f2af8b89f
+size 35873029
diff --git a/checkpoint-5/rng_state.pth b/checkpoint-5/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..3ef66339b9befa098183fd5d69faed6838e526b0
--- /dev/null
+++ b/checkpoint-5/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1d565802a8e26c4e8a31328752b7a7fdc186d9401aa008e65697d0ad8c22e33
+size 14645
diff --git a/checkpoint-5/scheduler.pt b/checkpoint-5/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..8e60483118eba2191516775d2a270f2a71a54bb7
--- /dev/null
+++ b/checkpoint-5/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:451bb9aab366defadeff0ae1b62e357d42a447b829194965b58c2dff1adce7af
+size 1465
diff --git a/checkpoint-5/tokenizer.json b/checkpoint-5/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-5/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-5/tokenizer_config.json b/checkpoint-5/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-5/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-5/trainer_state.json b/checkpoint-5/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..d07c863fd48b6f290719255d0390d42613876769
--- /dev/null
+++ b/checkpoint-5/trainer_state.json
@@ -0,0 +1,69 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 1.0,
+ "eval_steps": 500,
+ "global_step": 5,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.8728970289230347,
+ "learning_rate": 0.0,
+ "loss": 1.7144343852996826,
+ "step": 1
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.6763373613357544,
+ "learning_rate": 2e-05,
+ "loss": 1.4952771663665771,
+ "step": 2
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 1.7191307544708252,
+ "learning_rate": 4e-05,
+ "loss": 1.574378252029419,
+ "step": 3
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 1.7878174781799316,
+ "learning_rate": 6e-05,
+ "loss": 1.6600843667984009,
+ "step": 4
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 1.929695725440979,
+ "learning_rate": 8e-05,
+ "loss": 1.7657139301300049,
+ "step": 5
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 50,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 92579256815616.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-5/training_args.bin b/checkpoint-5/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-5/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-50/README.md b/checkpoint-50/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-50/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-50/adapter_config.json b/checkpoint-50/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-50/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-50/adapter_model.safetensors b/checkpoint-50/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..30f2baa230fbd327c7ed7610a0afc397b5296ff3
--- /dev/null
+++ b/checkpoint-50/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:23a9cf7037c725c4ba294b16d191828fec6b3586a676ba5dc548f1d1b4a65971
+size 132187888
diff --git a/checkpoint-50/chat_template.jinja b/checkpoint-50/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-50/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-50/optimizer.pt b/checkpoint-50/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..b974c14e0dbd908f1127f69cacaa5fa4765c5aca
--- /dev/null
+++ b/checkpoint-50/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d19cbfe9f2061b0ba3582f790ddedea2f79af792f8ce0b86e250a183ce8b1eb9
+size 67688197
diff --git a/checkpoint-50/rng_state.pth b/checkpoint-50/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..a18368651274f7c0847c1b9873fe8c9f4ac945ba
--- /dev/null
+++ b/checkpoint-50/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c800b778fa7e115e4c34de8529902de8b61c9a1b4bab3eb8295d06dafff030e
+size 14645
diff --git a/checkpoint-50/scheduler.pt b/checkpoint-50/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..73e0da37009b9da76afce2d94e81fd8ad8a627e4
--- /dev/null
+++ b/checkpoint-50/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a9dba175bc5163615041e123c6aadb90b03296482538583f38222ff9127f6171
+size 1465
diff --git a/checkpoint-50/tokenizer.json b/checkpoint-50/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-50/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-50/tokenizer_config.json b/checkpoint-50/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-50/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-50/trainer_state.json b/checkpoint-50/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..6f6e965e7fefa6a7aa9458ef24f6b0c880663f1a
--- /dev/null
+++ b/checkpoint-50/trainer_state.json
@@ -0,0 +1,384 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 2.0,
+ "eval_steps": 500,
+ "global_step": 50,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ },
+ {
+ "epoch": 1.04,
+ "grad_norm": 0.36699211597442627,
+ "learning_rate": 0.0001,
+ "loss": 0.4363247752189636,
+ "step": 26
+ },
+ {
+ "epoch": 1.08,
+ "grad_norm": 0.3731786608695984,
+ "learning_rate": 9.955555555555556e-05,
+ "loss": 0.4297473430633545,
+ "step": 27
+ },
+ {
+ "epoch": 1.12,
+ "grad_norm": 0.3378784954547882,
+ "learning_rate": 9.911111111111112e-05,
+ "loss": 0.35973912477493286,
+ "step": 28
+ },
+ {
+ "epoch": 1.16,
+ "grad_norm": 0.36273664236068726,
+ "learning_rate": 9.866666666666668e-05,
+ "loss": 0.34903788566589355,
+ "step": 29
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 0.362885981798172,
+ "learning_rate": 9.822222222222223e-05,
+ "loss": 0.3119792342185974,
+ "step": 30
+ },
+ {
+ "epoch": 1.24,
+ "grad_norm": 0.3790324032306671,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 0.29530155658721924,
+ "step": 31
+ },
+ {
+ "epoch": 1.28,
+ "grad_norm": 0.37333837151527405,
+ "learning_rate": 9.733333333333335e-05,
+ "loss": 0.2653456926345825,
+ "step": 32
+ },
+ {
+ "epoch": 1.32,
+ "grad_norm": 0.32163503766059875,
+ "learning_rate": 9.68888888888889e-05,
+ "loss": 0.19654956459999084,
+ "step": 33
+ },
+ {
+ "epoch": 1.3599999999999999,
+ "grad_norm": 0.5297159552574158,
+ "learning_rate": 9.644444444444445e-05,
+ "loss": 0.23580318689346313,
+ "step": 34
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.4474238455295563,
+ "learning_rate": 9.6e-05,
+ "loss": 0.18798796832561493,
+ "step": 35
+ },
+ {
+ "epoch": 1.44,
+ "grad_norm": 0.31346794962882996,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 0.12066371738910675,
+ "step": 36
+ },
+ {
+ "epoch": 1.48,
+ "grad_norm": 0.3099532723426819,
+ "learning_rate": 9.511111111111112e-05,
+ "loss": 0.08859007060527802,
+ "step": 37
+ },
+ {
+ "epoch": 1.52,
+ "grad_norm": 0.3490828275680542,
+ "learning_rate": 9.466666666666667e-05,
+ "loss": 0.07878822088241577,
+ "step": 38
+ },
+ {
+ "epoch": 1.56,
+ "grad_norm": 0.32395538687705994,
+ "learning_rate": 9.422222222222223e-05,
+ "loss": 0.06694570928812027,
+ "step": 39
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 0.20870603621006012,
+ "learning_rate": 9.377777777777779e-05,
+ "loss": 0.04379018768668175,
+ "step": 40
+ },
+ {
+ "epoch": 1.6400000000000001,
+ "grad_norm": 0.3310009837150574,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.048647329211235046,
+ "step": 41
+ },
+ {
+ "epoch": 1.6800000000000002,
+ "grad_norm": 0.26949432492256165,
+ "learning_rate": 9.28888888888889e-05,
+ "loss": 0.039286017417907715,
+ "step": 42
+ },
+ {
+ "epoch": 1.72,
+ "grad_norm": 0.11029712855815887,
+ "learning_rate": 9.244444444444445e-05,
+ "loss": 0.029231950640678406,
+ "step": 43
+ },
+ {
+ "epoch": 1.76,
+ "grad_norm": 0.1476302146911621,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.027003085240721703,
+ "step": 44
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.18617521226406097,
+ "learning_rate": 9.155555555555557e-05,
+ "loss": 0.025106143206357956,
+ "step": 45
+ },
+ {
+ "epoch": 1.8399999999999999,
+ "grad_norm": 0.13198262453079224,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.025741657242178917,
+ "step": 46
+ },
+ {
+ "epoch": 1.88,
+ "grad_norm": 0.26712384819984436,
+ "learning_rate": 9.066666666666667e-05,
+ "loss": 0.035036977380514145,
+ "step": 47
+ },
+ {
+ "epoch": 1.92,
+ "grad_norm": 0.3569182753562927,
+ "learning_rate": 9.022222222222224e-05,
+ "loss": 0.04259534925222397,
+ "step": 48
+ },
+ {
+ "epoch": 1.96,
+ "grad_norm": 0.1843830794095993,
+ "learning_rate": 8.977777777777779e-05,
+ "loss": 0.03471647948026657,
+ "step": 49
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.1248057410120964,
+ "learning_rate": 8.933333333333334e-05,
+ "loss": 0.030936148017644882,
+ "step": 50
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 2452652660490240.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-50/training_args.bin b/checkpoint-50/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-50/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-594/README.md b/checkpoint-594/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-594/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-594/adapter_config.json b/checkpoint-594/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..879d59d17cdb2aff2a9fcb7e4537a4f740bf19f5
--- /dev/null
+++ b/checkpoint-594/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "o_proj",
+ "up_proj",
+ "down_proj",
+ "v_proj",
+ "k_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-594/adapter_model.safetensors b/checkpoint-594/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2f7570675b2806d2a5cf0e7b261fd5892a189a19
--- /dev/null
+++ b/checkpoint-594/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4bcc75f7d0ca86b5edd6948ffa07b5ec417ac21679cdfa6be1c5860178ba6649
+size 132187888
diff --git a/checkpoint-594/chat_template.jinja b/checkpoint-594/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-594/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-594/optimizer.pt b/checkpoint-594/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..99737189930b29eeaecc28e79f91d6b81fd07850
--- /dev/null
+++ b/checkpoint-594/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89e96b3fd5a06d35a6802d46178114324976fdd65ef714aa589ee0dfe6c0f6d3
+size 67688645
diff --git a/checkpoint-594/rng_state.pth b/checkpoint-594/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..9a2f1c6718be043c8a9bbc32d83f6f90b082c4d8
--- /dev/null
+++ b/checkpoint-594/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:181c5f0270cf39930062ddfa3767a2481d0c360f120b11f8e25dbf533a1cdaba
+size 14645
diff --git a/checkpoint-594/scheduler.pt b/checkpoint-594/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..4b7ef0e73797a7fe14ec351cf623b58ff848dcf8
--- /dev/null
+++ b/checkpoint-594/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ae2345990998d274fe8fc4475e1c7bb7af3ae44977616516a1907b4438b01d5c
+size 1465
diff --git a/checkpoint-594/tokenizer.json b/checkpoint-594/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-594/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-594/tokenizer_config.json b/checkpoint-594/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-594/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-594/trainer_state.json b/checkpoint-594/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..70b0ade3a447619bf4a737e200c826a75c595951
--- /dev/null
+++ b/checkpoint-594/trainer_state.json
@@ -0,0 +1,4192 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 3.0,
+ "eval_steps": 500,
+ "global_step": 594,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.54137122631073,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279057860374451,
+ "learning_rate": 5.050505050505052e-07,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.7017749547958374,
+ "learning_rate": 1.0101010101010103e-06,
+ "loss": 1.0435928106307983,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6033008098602295,
+ "learning_rate": 1.5151515151515152e-06,
+ "loss": 0.8843490481376648,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5495544672012329,
+ "learning_rate": 2.0202020202020206e-06,
+ "loss": 0.8034592866897583,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.802371621131897,
+ "learning_rate": 2.5252525252525253e-06,
+ "loss": 1.1588364839553833,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8238587975502014,
+ "learning_rate": 3.0303030303030305e-06,
+ "loss": 1.228503942489624,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6073964238166809,
+ "learning_rate": 3.5353535353535352e-06,
+ "loss": 0.8989433646202087,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 0.6492345333099365,
+ "learning_rate": 4.040404040404041e-06,
+ "loss": 0.9615614414215088,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.6880183815956116,
+ "learning_rate": 4.5454545454545455e-06,
+ "loss": 0.9233697652816772,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.470304012298584,
+ "learning_rate": 5.050505050505051e-06,
+ "loss": 0.7186562418937683,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6361913681030273,
+ "learning_rate": 5.555555555555556e-06,
+ "loss": 0.9312829375267029,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5554782152175903,
+ "learning_rate": 6.060606060606061e-06,
+ "loss": 0.8529565334320068,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5414550304412842,
+ "learning_rate": 6.565656565656567e-06,
+ "loss": 0.8071130514144897,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9267164468765259,
+ "learning_rate": 7.0707070707070704e-06,
+ "loss": 1.3577998876571655,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.6104046106338501,
+ "learning_rate": 7.5757575757575764e-06,
+ "loss": 0.923499345779419,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.7241935133934021,
+ "learning_rate": 8.080808080808082e-06,
+ "loss": 1.0400190353393555,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.6026384830474854,
+ "learning_rate": 8.585858585858587e-06,
+ "loss": 0.8413939476013184,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.7690514922142029,
+ "learning_rate": 9.090909090909091e-06,
+ "loss": 1.0870859622955322,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.5940403342247009,
+ "learning_rate": 9.595959595959595e-06,
+ "loss": 0.8468416929244995,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.669230580329895,
+ "learning_rate": 1.0101010101010101e-05,
+ "loss": 0.9340983629226685,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.5750640034675598,
+ "learning_rate": 1.0606060606060607e-05,
+ "loss": 0.8230171799659729,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.6579262614250183,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.9293508529663086,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.5956451296806335,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.8316305875778198,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.7270558476448059,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.9129499197006226,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.7505611777305603,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 1.0138367414474487,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.6870062947273254,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.901283860206604,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.7679643630981445,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.9833810329437256,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.866938591003418,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.8958402872085571,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.8687500357627869,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 1.1289801597595215,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 4.008030891418457,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 1.2739044427871704,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.7689681053161621,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.8514111638069153,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.7880434393882751,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.8862775564193726,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.6183183789253235,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.7857811450958252,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.6437809467315674,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.7093011736869812,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.5481512546539307,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.7350327968597412,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.4838634729385376,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.6584650874137878,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.523994505405426,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.7211161851882935,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.6523379683494568,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.9044773578643799,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.4274725615978241,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.568337082862854,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.5060272812843323,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.7201821208000183,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.3760877251625061,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.5880123376846313,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.3715391457080841,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.5693179368972778,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.4332570731639862,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.7277271151542664,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.38201987743377686,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.6458995938301086,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.4358846843242645,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.7559939026832581,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.4566098749637604,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.7792297601699829,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.3864676356315613,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.6894873380661011,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.31187522411346436,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.545581579208374,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.3325943350791931,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.5917496085166931,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.6410307884216309,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.44281136989593506,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.36323168873786926,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.6426926851272583,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.31924113631248474,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.5482619404792786,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.3632371723651886,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.6188253164291382,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.375381201505661,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.5487836003303528,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.3163473606109619,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.5367064476013184,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.42646294832229614,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.41221165657043457,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.41622766852378845,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.5274936556816101,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.30204030871391296,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.44855833053588867,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.3178975582122803,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.4036139249801636,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.2893930673599243,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.39234185218811035,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.2833489775657654,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.37406405806541443,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.3216562867164612,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.3938276767730713,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.26721706986427307,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.30402088165283203,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.3702670931816101,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.30594947934150696,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.2632184326648712,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.2691727876663208,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.36898860335350037,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.33992528915405273,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.2976086735725403,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.27603086829185486,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.32201430201530457,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.25665703415870667,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.35001808404922485,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.24190445244312286,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.5106059908866882,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.3093336820602417,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.3261374831199646,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.18783289194107056,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.38757652044296265,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.19549766182899475,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.4723363518714905,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.15751558542251587,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.36796173453330994,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.14514681696891785,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.3855208456516266,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.14030519127845764,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.5906668305397034,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.1478388011455536,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.2658001780509949,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.13253600895404816,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.33554506301879883,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.12156252562999725,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.2643960416316986,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.1089208647608757,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.19129537045955658,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.08515600860118866,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.22168858349323273,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.09310197830200195,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.16676382720470428,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.07711787521839142,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.23891882598400116,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.09763285517692566,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.28446146845817566,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.08980057388544083,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.146108940243721,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.06573648750782013,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.2007656991481781,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.0699995830655098,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.3082621395587921,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.0885838121175766,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.1624963879585266,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.06935172528028488,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.1562737673521042,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.07147250324487686,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.1660323292016983,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.0672944188117981,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.21427564322948456,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.07051930576562881,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.16495929658412933,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.05429624393582344,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.1978198140859604,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.07144488394260406,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.15077605843544006,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.055798254907131195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.2806876301765442,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.06058178097009659,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.1219187006354332,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.05044667422771454,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10286939144134521,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.048498690128326416,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.12813609838485718,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.06252863258123398,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10565406829118729,
+ "learning_rate": 5e-05,
+ "loss": 0.051401108503341675,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.09147113561630249,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.047376491129398346,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.08723224699497223,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.039745647460222244,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.16071128845214844,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.058398712426424026,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.1370300054550171,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.05132289230823517,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.19449608027935028,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.06682188808917999,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.13085028529167175,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.049861155450344086,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.1768050193786621,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.055694688111543655,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.2819313704967499,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.062391363084316254,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.10738537460565567,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.05093343183398247,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.11759619414806366,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.044827841222286224,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.21941131353378296,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.05238347500562668,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.1697252243757248,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.04869212955236435,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.19701889157295227,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.04484856128692627,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.11779771000146866,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.04135368764400482,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.19823911786079407,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.05097956955432892,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.17355702817440033,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.05781872197985649,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.13029292225837708,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.041528262197971344,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.1292058229446411,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.0442211888730526,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10058800131082535,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.03813612461090088,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.22936487197875977,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.056090980768203735,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.13063806295394897,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.04347142577171326,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.167104110121727,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.04442849010229111,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.11942817270755768,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.03964124619960785,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.17906631529331207,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.04372458904981613,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.13760331273078918,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.03980286419391632,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.18043340742588043,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.05500294268131256,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.31386223435401917,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.04253799840807915,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.1428707093000412,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.047894880175590515,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.11010178923606873,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.04534825310111046,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.10444525629281998,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.041347943246364594,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.18076039850711823,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.04535853862762451,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.19424672424793243,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.05037602037191391,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.1457783728837967,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.047546930611133575,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.1189681887626648,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.03254905715584755,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.18887822329998016,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.04018670320510864,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.12217189371585846,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.03981504589319229,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.10866257548332214,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.04322533681988716,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.15904399752616882,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.04488902539014816,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.12598516047000885,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.04718853533267975,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.22092872858047485,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.03646199405193329,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.1717238426208496,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.04607801511883736,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.16268078982830048,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.04759417474269867,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.19621087610721588,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.051741112023591995,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.15362979471683502,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.04363569617271423,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.1404130607843399,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.045428819954395294,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.12262272834777832,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.03828439861536026,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.10626570880413055,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.03420639410614967,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.12686072289943695,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.03474457561969757,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.153709277510643,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.03174472972750664,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.13035084307193756,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.02982976846396923,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.12288431823253632,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.03588784486055374,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.19307470321655273,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.04750734567642212,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.0996781438589096,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.027098631486296654,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.16898290812969208,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.040447790175676346,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.10996036231517792,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.02525201067328453,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.16161896288394928,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.04199359938502312,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.1536172777414322,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.02943507581949234,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.18457260727882385,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.04093889892101288,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.11232347041368484,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.029609719291329384,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.19080978631973267,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.0357801653444767,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.16634301841259003,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02980419248342514,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.28601372241973877,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.032849978655576706,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.1359848529100418,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.0230826735496521,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.11285015195608139,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.02447221614420414,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.14712421596050262,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.022657420486211777,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.18246804177761078,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.035991013050079346,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.143621563911438,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.024444863200187683,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.12458691000938416,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.039701592177152634,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05614984780550003,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.029840555042028427,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.06097931042313576,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.027426715940237045,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.09883654862642288,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031690437346696854,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.0700431764125824,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.024079838767647743,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.05957406386733055,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.02303817868232727,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.14374858140945435,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.031183632090687752,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.09187919646501541,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.031176958233118057,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.0540630929172039,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.024949276819825172,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06875574588775635,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.02890622243285179,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.10081329196691513,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.03019360452890396,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.11833225935697556,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.020365778356790543,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.08700298517942429,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.027046984061598778,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.08660133928060532,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.027088070288300514,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.06983930617570877,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.019332535564899445,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.09463227540254593,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.02780212089419365,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.10251298546791077,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.026878856122493744,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.15963847935199738,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.03437665104866028,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.11342372000217438,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.02877948433160782,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.0937543660402298,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.02759186364710331,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.07137084752321243,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.02941890060901642,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.3511611819267273,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.024331524968147278,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.12344356626272202,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.0348694771528244,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.07144290208816528,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.021711278706789017,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.09835992008447647,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.03408564254641533,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.4978399872779846,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.03810017928481102,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.06314591318368912,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.0201277956366539,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.07504695653915405,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.025770913809537888,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.1028534397482872,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.02469150349497795,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.09341974556446075,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.036506302654743195,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09348680078983307,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02507903426885605,
+ "step": 198
+ },
+ {
+ "epoch": 1.0050632911392405,
+ "grad_norm": 0.06890113651752472,
+ "learning_rate": 0.0001,
+ "loss": 0.028374083340168,
+ "step": 199
+ },
+ {
+ "epoch": 1.010126582278481,
+ "grad_norm": 0.051041170954704285,
+ "learning_rate": 9.994388327721661e-05,
+ "loss": 0.022860335186123848,
+ "step": 200
+ },
+ {
+ "epoch": 1.0151898734177216,
+ "grad_norm": 0.10253743082284927,
+ "learning_rate": 9.988776655443322e-05,
+ "loss": 0.02864072285592556,
+ "step": 201
+ },
+ {
+ "epoch": 1.0202531645569621,
+ "grad_norm": 0.08295776695013046,
+ "learning_rate": 9.983164983164983e-05,
+ "loss": 0.0327395498752594,
+ "step": 202
+ },
+ {
+ "epoch": 1.0253164556962024,
+ "grad_norm": 0.07240694016218185,
+ "learning_rate": 9.977553310886645e-05,
+ "loss": 0.029215697199106216,
+ "step": 203
+ },
+ {
+ "epoch": 1.030379746835443,
+ "grad_norm": 0.0688897892832756,
+ "learning_rate": 9.971941638608306e-05,
+ "loss": 0.027594968676567078,
+ "step": 204
+ },
+ {
+ "epoch": 1.0354430379746835,
+ "grad_norm": 0.08463896065950394,
+ "learning_rate": 9.966329966329967e-05,
+ "loss": 0.02292536199092865,
+ "step": 205
+ },
+ {
+ "epoch": 1.040506329113924,
+ "grad_norm": 0.062013301998376846,
+ "learning_rate": 9.960718294051628e-05,
+ "loss": 0.023678191006183624,
+ "step": 206
+ },
+ {
+ "epoch": 1.0455696202531646,
+ "grad_norm": 0.08735264092683792,
+ "learning_rate": 9.955106621773289e-05,
+ "loss": 0.022060325369238853,
+ "step": 207
+ },
+ {
+ "epoch": 1.0506329113924051,
+ "grad_norm": 0.07634295523166656,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02764434739947319,
+ "step": 208
+ },
+ {
+ "epoch": 1.0556962025316456,
+ "grad_norm": 0.09735682606697083,
+ "learning_rate": 9.943883277216612e-05,
+ "loss": 0.03304428607225418,
+ "step": 209
+ },
+ {
+ "epoch": 1.0607594936708862,
+ "grad_norm": 0.06860044598579407,
+ "learning_rate": 9.938271604938272e-05,
+ "loss": 0.0340178906917572,
+ "step": 210
+ },
+ {
+ "epoch": 1.0658227848101265,
+ "grad_norm": 0.3715139627456665,
+ "learning_rate": 9.932659932659934e-05,
+ "loss": 0.02541016787290573,
+ "step": 211
+ },
+ {
+ "epoch": 1.070886075949367,
+ "grad_norm": 0.07673332840204239,
+ "learning_rate": 9.927048260381594e-05,
+ "loss": 0.025950253009796143,
+ "step": 212
+ },
+ {
+ "epoch": 1.0759493670886076,
+ "grad_norm": 0.07359500974416733,
+ "learning_rate": 9.921436588103256e-05,
+ "loss": 0.024356549605727196,
+ "step": 213
+ },
+ {
+ "epoch": 1.081012658227848,
+ "grad_norm": 0.07760954648256302,
+ "learning_rate": 9.915824915824916e-05,
+ "loss": 0.02338298037648201,
+ "step": 214
+ },
+ {
+ "epoch": 1.0860759493670886,
+ "grad_norm": 0.09183681756258011,
+ "learning_rate": 9.910213243546578e-05,
+ "loss": 0.020955465734004974,
+ "step": 215
+ },
+ {
+ "epoch": 1.0911392405063292,
+ "grad_norm": 0.21278677880764008,
+ "learning_rate": 9.904601571268239e-05,
+ "loss": 0.028164055198431015,
+ "step": 216
+ },
+ {
+ "epoch": 1.0962025316455697,
+ "grad_norm": 0.22437937557697296,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.03543347865343094,
+ "step": 217
+ },
+ {
+ "epoch": 1.1012658227848102,
+ "grad_norm": 0.08677598088979721,
+ "learning_rate": 9.893378226711561e-05,
+ "loss": 0.031265974044799805,
+ "step": 218
+ },
+ {
+ "epoch": 1.1063291139240505,
+ "grad_norm": 0.09595583379268646,
+ "learning_rate": 9.887766554433222e-05,
+ "loss": 0.02384507656097412,
+ "step": 219
+ },
+ {
+ "epoch": 1.111392405063291,
+ "grad_norm": 0.08256062865257263,
+ "learning_rate": 9.882154882154883e-05,
+ "loss": 0.022209012880921364,
+ "step": 220
+ },
+ {
+ "epoch": 1.1164556962025316,
+ "grad_norm": 0.07712455838918686,
+ "learning_rate": 9.876543209876543e-05,
+ "loss": 0.025278344750404358,
+ "step": 221
+ },
+ {
+ "epoch": 1.1215189873417721,
+ "grad_norm": 0.09704182296991348,
+ "learning_rate": 9.870931537598205e-05,
+ "loss": 0.024904735386371613,
+ "step": 222
+ },
+ {
+ "epoch": 1.1265822784810127,
+ "grad_norm": 0.09094078838825226,
+ "learning_rate": 9.865319865319865e-05,
+ "loss": 0.0280012097209692,
+ "step": 223
+ },
+ {
+ "epoch": 1.1316455696202532,
+ "grad_norm": 0.07607442885637283,
+ "learning_rate": 9.859708193041527e-05,
+ "loss": 0.026181645691394806,
+ "step": 224
+ },
+ {
+ "epoch": 1.1367088607594937,
+ "grad_norm": 0.06568697839975357,
+ "learning_rate": 9.854096520763188e-05,
+ "loss": 0.02883346565067768,
+ "step": 225
+ },
+ {
+ "epoch": 1.1417721518987343,
+ "grad_norm": 0.07192376255989075,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.027345171198248863,
+ "step": 226
+ },
+ {
+ "epoch": 1.1468354430379746,
+ "grad_norm": 0.1464017778635025,
+ "learning_rate": 9.84287317620651e-05,
+ "loss": 0.03213154152035713,
+ "step": 227
+ },
+ {
+ "epoch": 1.1518987341772151,
+ "grad_norm": 0.06766578555107117,
+ "learning_rate": 9.837261503928171e-05,
+ "loss": 0.02554963156580925,
+ "step": 228
+ },
+ {
+ "epoch": 1.1569620253164556,
+ "grad_norm": 0.09428609162569046,
+ "learning_rate": 9.831649831649832e-05,
+ "loss": 0.02484097331762314,
+ "step": 229
+ },
+ {
+ "epoch": 1.1620253164556962,
+ "grad_norm": 0.1648297905921936,
+ "learning_rate": 9.826038159371493e-05,
+ "loss": 0.03450813889503479,
+ "step": 230
+ },
+ {
+ "epoch": 1.1670886075949367,
+ "grad_norm": 0.06389904767274857,
+ "learning_rate": 9.820426487093154e-05,
+ "loss": 0.02957337349653244,
+ "step": 231
+ },
+ {
+ "epoch": 1.1721518987341772,
+ "grad_norm": 0.11517420411109924,
+ "learning_rate": 9.814814814814815e-05,
+ "loss": 0.024299729615449905,
+ "step": 232
+ },
+ {
+ "epoch": 1.1772151898734178,
+ "grad_norm": 0.06960142403841019,
+ "learning_rate": 9.809203142536476e-05,
+ "loss": 0.025762220844626427,
+ "step": 233
+ },
+ {
+ "epoch": 1.1822784810126583,
+ "grad_norm": 0.11682946234941483,
+ "learning_rate": 9.803591470258137e-05,
+ "loss": 0.02457268163561821,
+ "step": 234
+ },
+ {
+ "epoch": 1.1873417721518988,
+ "grad_norm": 0.07964848726987839,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.027285631746053696,
+ "step": 235
+ },
+ {
+ "epoch": 1.1924050632911392,
+ "grad_norm": 0.053044773638248444,
+ "learning_rate": 9.79236812570146e-05,
+ "loss": 0.020997609943151474,
+ "step": 236
+ },
+ {
+ "epoch": 1.1974683544303797,
+ "grad_norm": 0.13531149923801422,
+ "learning_rate": 9.78675645342312e-05,
+ "loss": 0.02474522590637207,
+ "step": 237
+ },
+ {
+ "epoch": 1.2025316455696202,
+ "grad_norm": 0.0774424746632576,
+ "learning_rate": 9.781144781144782e-05,
+ "loss": 0.025272740051150322,
+ "step": 238
+ },
+ {
+ "epoch": 1.2075949367088608,
+ "grad_norm": 0.042708419263362885,
+ "learning_rate": 9.775533108866442e-05,
+ "loss": 0.019522909075021744,
+ "step": 239
+ },
+ {
+ "epoch": 1.2126582278481013,
+ "grad_norm": 0.10364090651273727,
+ "learning_rate": 9.769921436588104e-05,
+ "loss": 0.02728935517370701,
+ "step": 240
+ },
+ {
+ "epoch": 1.2177215189873418,
+ "grad_norm": 0.0756702646613121,
+ "learning_rate": 9.764309764309764e-05,
+ "loss": 0.02659972943365574,
+ "step": 241
+ },
+ {
+ "epoch": 1.2227848101265824,
+ "grad_norm": 0.07232004404067993,
+ "learning_rate": 9.758698092031426e-05,
+ "loss": 0.017723949626088142,
+ "step": 242
+ },
+ {
+ "epoch": 1.2278481012658227,
+ "grad_norm": 0.058345306664705276,
+ "learning_rate": 9.753086419753087e-05,
+ "loss": 0.019348861649632454,
+ "step": 243
+ },
+ {
+ "epoch": 1.2329113924050632,
+ "grad_norm": 0.14832371473312378,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.03227488696575165,
+ "step": 244
+ },
+ {
+ "epoch": 1.2379746835443037,
+ "grad_norm": 0.05343412607908249,
+ "learning_rate": 9.74186307519641e-05,
+ "loss": 0.0210015457123518,
+ "step": 245
+ },
+ {
+ "epoch": 1.2430379746835443,
+ "grad_norm": 0.054104797542095184,
+ "learning_rate": 9.736251402918069e-05,
+ "loss": 0.02430287003517151,
+ "step": 246
+ },
+ {
+ "epoch": 1.2481012658227848,
+ "grad_norm": 0.11686044931411743,
+ "learning_rate": 9.730639730639732e-05,
+ "loss": 0.029372017830610275,
+ "step": 247
+ },
+ {
+ "epoch": 1.2531645569620253,
+ "grad_norm": 0.05970177799463272,
+ "learning_rate": 9.725028058361391e-05,
+ "loss": 0.024995045736432076,
+ "step": 248
+ },
+ {
+ "epoch": 1.2582278481012659,
+ "grad_norm": 0.06506923586130142,
+ "learning_rate": 9.719416386083054e-05,
+ "loss": 0.024779727682471275,
+ "step": 249
+ },
+ {
+ "epoch": 1.2632911392405064,
+ "grad_norm": 0.12711220979690552,
+ "learning_rate": 9.713804713804715e-05,
+ "loss": 0.026196476072072983,
+ "step": 250
+ },
+ {
+ "epoch": 1.268354430379747,
+ "grad_norm": 0.056023694574832916,
+ "learning_rate": 9.708193041526376e-05,
+ "loss": 0.01813146471977234,
+ "step": 251
+ },
+ {
+ "epoch": 1.2734177215189875,
+ "grad_norm": 0.04508040472865105,
+ "learning_rate": 9.702581369248037e-05,
+ "loss": 0.019225183874368668,
+ "step": 252
+ },
+ {
+ "epoch": 1.2784810126582278,
+ "grad_norm": 0.10354425758123398,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.02940209209918976,
+ "step": 253
+ },
+ {
+ "epoch": 1.2835443037974683,
+ "grad_norm": 0.06974297761917114,
+ "learning_rate": 9.691358024691359e-05,
+ "loss": 0.02482295036315918,
+ "step": 254
+ },
+ {
+ "epoch": 1.2886075949367088,
+ "grad_norm": 0.06940010190010071,
+ "learning_rate": 9.68574635241302e-05,
+ "loss": 0.020605089142918587,
+ "step": 255
+ },
+ {
+ "epoch": 1.2936708860759494,
+ "grad_norm": 0.09167850762605667,
+ "learning_rate": 9.68013468013468e-05,
+ "loss": 0.02429921180009842,
+ "step": 256
+ },
+ {
+ "epoch": 1.29873417721519,
+ "grad_norm": 0.048866868019104004,
+ "learning_rate": 9.674523007856342e-05,
+ "loss": 0.021776504814624786,
+ "step": 257
+ },
+ {
+ "epoch": 1.3037974683544304,
+ "grad_norm": 0.06977155059576035,
+ "learning_rate": 9.668911335578003e-05,
+ "loss": 0.02758147194981575,
+ "step": 258
+ },
+ {
+ "epoch": 1.3088607594936708,
+ "grad_norm": 0.17602303624153137,
+ "learning_rate": 9.663299663299664e-05,
+ "loss": 0.026518259197473526,
+ "step": 259
+ },
+ {
+ "epoch": 1.3139240506329113,
+ "grad_norm": 0.08011946082115173,
+ "learning_rate": 9.657687991021325e-05,
+ "loss": 0.026240577921271324,
+ "step": 260
+ },
+ {
+ "epoch": 1.3189873417721518,
+ "grad_norm": 0.06296376883983612,
+ "learning_rate": 9.652076318742987e-05,
+ "loss": 0.03159455955028534,
+ "step": 261
+ },
+ {
+ "epoch": 1.3240506329113924,
+ "grad_norm": 0.04424722492694855,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.024151435121893883,
+ "step": 262
+ },
+ {
+ "epoch": 1.3291139240506329,
+ "grad_norm": 0.045779623091220856,
+ "learning_rate": 9.640852974186309e-05,
+ "loss": 0.018655993044376373,
+ "step": 263
+ },
+ {
+ "epoch": 1.3341772151898734,
+ "grad_norm": 0.06355931609869003,
+ "learning_rate": 9.635241301907969e-05,
+ "loss": 0.01999380812048912,
+ "step": 264
+ },
+ {
+ "epoch": 1.339240506329114,
+ "grad_norm": 0.04477616026997566,
+ "learning_rate": 9.62962962962963e-05,
+ "loss": 0.021614115685224533,
+ "step": 265
+ },
+ {
+ "epoch": 1.3443037974683545,
+ "grad_norm": 0.05851180478930473,
+ "learning_rate": 9.62401795735129e-05,
+ "loss": 0.023495908826589584,
+ "step": 266
+ },
+ {
+ "epoch": 1.349367088607595,
+ "grad_norm": 0.04724022373557091,
+ "learning_rate": 9.618406285072952e-05,
+ "loss": 0.02053767442703247,
+ "step": 267
+ },
+ {
+ "epoch": 1.3544303797468356,
+ "grad_norm": 0.12757639586925507,
+ "learning_rate": 9.612794612794614e-05,
+ "loss": 0.030612681061029434,
+ "step": 268
+ },
+ {
+ "epoch": 1.3594936708860759,
+ "grad_norm": 0.18316853046417236,
+ "learning_rate": 9.607182940516274e-05,
+ "loss": 0.039485104382038116,
+ "step": 269
+ },
+ {
+ "epoch": 1.3645569620253164,
+ "grad_norm": 0.09149223566055298,
+ "learning_rate": 9.601571268237936e-05,
+ "loss": 0.031156456097960472,
+ "step": 270
+ },
+ {
+ "epoch": 1.369620253164557,
+ "grad_norm": 0.07885908335447311,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.026395633816719055,
+ "step": 271
+ },
+ {
+ "epoch": 1.3746835443037975,
+ "grad_norm": 0.0984397754073143,
+ "learning_rate": 9.590347923681258e-05,
+ "loss": 0.02990398183465004,
+ "step": 272
+ },
+ {
+ "epoch": 1.379746835443038,
+ "grad_norm": 0.08566205203533173,
+ "learning_rate": 9.584736251402918e-05,
+ "loss": 0.024353420361876488,
+ "step": 273
+ },
+ {
+ "epoch": 1.3848101265822785,
+ "grad_norm": 0.16623689234256744,
+ "learning_rate": 9.57912457912458e-05,
+ "loss": 0.03626095876097679,
+ "step": 274
+ },
+ {
+ "epoch": 1.389873417721519,
+ "grad_norm": 0.07134243100881577,
+ "learning_rate": 9.57351290684624e-05,
+ "loss": 0.026036158204078674,
+ "step": 275
+ },
+ {
+ "epoch": 1.3949367088607594,
+ "grad_norm": 0.07753578573465347,
+ "learning_rate": 9.567901234567902e-05,
+ "loss": 0.03266923502087593,
+ "step": 276
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.07113673537969589,
+ "learning_rate": 9.562289562289563e-05,
+ "loss": 0.024128902703523636,
+ "step": 277
+ },
+ {
+ "epoch": 1.4050632911392404,
+ "grad_norm": 0.0954187884926796,
+ "learning_rate": 9.556677890011224e-05,
+ "loss": 0.03310588374733925,
+ "step": 278
+ },
+ {
+ "epoch": 1.410126582278481,
+ "grad_norm": 0.08755122870206833,
+ "learning_rate": 9.551066217732885e-05,
+ "loss": 0.030977975577116013,
+ "step": 279
+ },
+ {
+ "epoch": 1.4151898734177215,
+ "grad_norm": 0.06839736551046371,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.029557062312960625,
+ "step": 280
+ },
+ {
+ "epoch": 1.420253164556962,
+ "grad_norm": 0.051050763577222824,
+ "learning_rate": 9.539842873176207e-05,
+ "loss": 0.022091392427682877,
+ "step": 281
+ },
+ {
+ "epoch": 1.4253164556962026,
+ "grad_norm": 0.05898132920265198,
+ "learning_rate": 9.534231200897868e-05,
+ "loss": 0.024804875254631042,
+ "step": 282
+ },
+ {
+ "epoch": 1.4303797468354431,
+ "grad_norm": 0.04517035931348801,
+ "learning_rate": 9.528619528619529e-05,
+ "loss": 0.024234894663095474,
+ "step": 283
+ },
+ {
+ "epoch": 1.4354430379746836,
+ "grad_norm": 0.05625253543257713,
+ "learning_rate": 9.52300785634119e-05,
+ "loss": 0.02342807501554489,
+ "step": 284
+ },
+ {
+ "epoch": 1.4405063291139242,
+ "grad_norm": 0.047006960958242416,
+ "learning_rate": 9.517396184062851e-05,
+ "loss": 0.021819880232214928,
+ "step": 285
+ },
+ {
+ "epoch": 1.4455696202531645,
+ "grad_norm": 0.051774390041828156,
+ "learning_rate": 9.511784511784512e-05,
+ "loss": 0.020575571805238724,
+ "step": 286
+ },
+ {
+ "epoch": 1.450632911392405,
+ "grad_norm": 0.0684620812535286,
+ "learning_rate": 9.506172839506173e-05,
+ "loss": 0.025043494999408722,
+ "step": 287
+ },
+ {
+ "epoch": 1.4556962025316456,
+ "grad_norm": 0.05345604941248894,
+ "learning_rate": 9.500561167227834e-05,
+ "loss": 0.020829960703849792,
+ "step": 288
+ },
+ {
+ "epoch": 1.460759493670886,
+ "grad_norm": 0.07588688284158707,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.02842051535844803,
+ "step": 289
+ },
+ {
+ "epoch": 1.4658227848101266,
+ "grad_norm": 0.0371188148856163,
+ "learning_rate": 9.489337822671156e-05,
+ "loss": 0.020213091745972633,
+ "step": 290
+ },
+ {
+ "epoch": 1.4708860759493672,
+ "grad_norm": 0.03922685980796814,
+ "learning_rate": 9.483726150392817e-05,
+ "loss": 0.020665431395173073,
+ "step": 291
+ },
+ {
+ "epoch": 1.4759493670886075,
+ "grad_norm": 0.10213606059551239,
+ "learning_rate": 9.478114478114478e-05,
+ "loss": 0.024979032576084137,
+ "step": 292
+ },
+ {
+ "epoch": 1.481012658227848,
+ "grad_norm": 0.04574638605117798,
+ "learning_rate": 9.472502805836139e-05,
+ "loss": 0.0215127132833004,
+ "step": 293
+ },
+ {
+ "epoch": 1.4860759493670885,
+ "grad_norm": 0.0829704999923706,
+ "learning_rate": 9.4668911335578e-05,
+ "loss": 0.023608818650245667,
+ "step": 294
+ },
+ {
+ "epoch": 1.491139240506329,
+ "grad_norm": 0.036335594952106476,
+ "learning_rate": 9.461279461279463e-05,
+ "loss": 0.01993970200419426,
+ "step": 295
+ },
+ {
+ "epoch": 1.4962025316455696,
+ "grad_norm": 0.08291227370500565,
+ "learning_rate": 9.455667789001122e-05,
+ "loss": 0.02223093807697296,
+ "step": 296
+ },
+ {
+ "epoch": 1.5012658227848101,
+ "grad_norm": 0.048284996300935745,
+ "learning_rate": 9.450056116722785e-05,
+ "loss": 0.019440360367298126,
+ "step": 297
+ },
+ {
+ "epoch": 1.5063291139240507,
+ "grad_norm": 0.25126877427101135,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.030357610434293747,
+ "step": 298
+ },
+ {
+ "epoch": 1.5113924050632912,
+ "grad_norm": 0.08812759816646576,
+ "learning_rate": 9.438832772166107e-05,
+ "loss": 0.025407828390598297,
+ "step": 299
+ },
+ {
+ "epoch": 1.5164556962025317,
+ "grad_norm": 0.09417422115802765,
+ "learning_rate": 9.433221099887766e-05,
+ "loss": 0.028768496587872505,
+ "step": 300
+ },
+ {
+ "epoch": 1.5215189873417723,
+ "grad_norm": 0.10820329934358597,
+ "learning_rate": 9.427609427609429e-05,
+ "loss": 0.03250410035252571,
+ "step": 301
+ },
+ {
+ "epoch": 1.5265822784810128,
+ "grad_norm": 0.06633433699607849,
+ "learning_rate": 9.42199775533109e-05,
+ "loss": 0.019816454499959946,
+ "step": 302
+ },
+ {
+ "epoch": 1.5316455696202531,
+ "grad_norm": 0.05545264482498169,
+ "learning_rate": 9.41638608305275e-05,
+ "loss": 0.020919661968946457,
+ "step": 303
+ },
+ {
+ "epoch": 1.5367088607594936,
+ "grad_norm": 0.08201726526021957,
+ "learning_rate": 9.410774410774412e-05,
+ "loss": 0.0309453085064888,
+ "step": 304
+ },
+ {
+ "epoch": 1.5417721518987342,
+ "grad_norm": 0.047229036688804626,
+ "learning_rate": 9.405162738496073e-05,
+ "loss": 0.02079029008746147,
+ "step": 305
+ },
+ {
+ "epoch": 1.5468354430379747,
+ "grad_norm": 0.04493536427617073,
+ "learning_rate": 9.399551066217734e-05,
+ "loss": 0.020319776609539986,
+ "step": 306
+ },
+ {
+ "epoch": 1.5518987341772152,
+ "grad_norm": 0.07935966551303864,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.03144281357526779,
+ "step": 307
+ },
+ {
+ "epoch": 1.5569620253164556,
+ "grad_norm": 0.10108500719070435,
+ "learning_rate": 9.388327721661056e-05,
+ "loss": 0.029823362827301025,
+ "step": 308
+ },
+ {
+ "epoch": 1.562025316455696,
+ "grad_norm": 0.05187584087252617,
+ "learning_rate": 9.382716049382717e-05,
+ "loss": 0.029090257361531258,
+ "step": 309
+ },
+ {
+ "epoch": 1.5670886075949366,
+ "grad_norm": 0.09131086617708206,
+ "learning_rate": 9.377104377104378e-05,
+ "loss": 0.020090997219085693,
+ "step": 310
+ },
+ {
+ "epoch": 1.5721518987341772,
+ "grad_norm": 0.06874370574951172,
+ "learning_rate": 9.371492704826039e-05,
+ "loss": 0.022118568420410156,
+ "step": 311
+ },
+ {
+ "epoch": 1.5772151898734177,
+ "grad_norm": 0.07480651885271072,
+ "learning_rate": 9.3658810325477e-05,
+ "loss": 0.030924849212169647,
+ "step": 312
+ },
+ {
+ "epoch": 1.5822784810126582,
+ "grad_norm": 0.04049983248114586,
+ "learning_rate": 9.36026936026936e-05,
+ "loss": 0.02086808532476425,
+ "step": 313
+ },
+ {
+ "epoch": 1.5873417721518988,
+ "grad_norm": 0.037067580968141556,
+ "learning_rate": 9.354657687991022e-05,
+ "loss": 0.022019919008016586,
+ "step": 314
+ },
+ {
+ "epoch": 1.5924050632911393,
+ "grad_norm": 0.0599038302898407,
+ "learning_rate": 9.349046015712683e-05,
+ "loss": 0.02305535599589348,
+ "step": 315
+ },
+ {
+ "epoch": 1.5974683544303798,
+ "grad_norm": 0.056727997958660126,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.025360889732837677,
+ "step": 316
+ },
+ {
+ "epoch": 1.6025316455696204,
+ "grad_norm": 0.06659650057554245,
+ "learning_rate": 9.337822671156005e-05,
+ "loss": 0.02528395690023899,
+ "step": 317
+ },
+ {
+ "epoch": 1.6075949367088609,
+ "grad_norm": 0.06213822215795517,
+ "learning_rate": 9.332210998877666e-05,
+ "loss": 0.028841618448495865,
+ "step": 318
+ },
+ {
+ "epoch": 1.6126582278481014,
+ "grad_norm": 0.03757556155323982,
+ "learning_rate": 9.326599326599327e-05,
+ "loss": 0.02282278798520565,
+ "step": 319
+ },
+ {
+ "epoch": 1.6177215189873417,
+ "grad_norm": 0.061945486813783646,
+ "learning_rate": 9.320987654320989e-05,
+ "loss": 0.02733437530696392,
+ "step": 320
+ },
+ {
+ "epoch": 1.6227848101265823,
+ "grad_norm": 0.07904566079378128,
+ "learning_rate": 9.315375982042649e-05,
+ "loss": 0.02630138024687767,
+ "step": 321
+ },
+ {
+ "epoch": 1.6278481012658228,
+ "grad_norm": 0.07157077640295029,
+ "learning_rate": 9.309764309764311e-05,
+ "loss": 0.023403439670801163,
+ "step": 322
+ },
+ {
+ "epoch": 1.6329113924050633,
+ "grad_norm": 0.03518318012356758,
+ "learning_rate": 9.304152637485971e-05,
+ "loss": 0.021487422287464142,
+ "step": 323
+ },
+ {
+ "epoch": 1.6379746835443036,
+ "grad_norm": 0.11178159713745117,
+ "learning_rate": 9.298540965207633e-05,
+ "loss": 0.03142111003398895,
+ "step": 324
+ },
+ {
+ "epoch": 1.6430379746835442,
+ "grad_norm": 0.05046987161040306,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.020960725843906403,
+ "step": 325
+ },
+ {
+ "epoch": 1.6481012658227847,
+ "grad_norm": 0.05356504023075104,
+ "learning_rate": 9.287317620650955e-05,
+ "loss": 0.01934133842587471,
+ "step": 326
+ },
+ {
+ "epoch": 1.6531645569620252,
+ "grad_norm": 0.07995260506868362,
+ "learning_rate": 9.281705948372615e-05,
+ "loss": 0.0248265378177166,
+ "step": 327
+ },
+ {
+ "epoch": 1.6582278481012658,
+ "grad_norm": 0.08783978968858719,
+ "learning_rate": 9.276094276094277e-05,
+ "loss": 0.024171534925699234,
+ "step": 328
+ },
+ {
+ "epoch": 1.6632911392405063,
+ "grad_norm": 0.043143950402736664,
+ "learning_rate": 9.270482603815938e-05,
+ "loss": 0.021554211154580116,
+ "step": 329
+ },
+ {
+ "epoch": 1.6683544303797468,
+ "grad_norm": 0.05635169520974159,
+ "learning_rate": 9.264870931537598e-05,
+ "loss": 0.025942442938685417,
+ "step": 330
+ },
+ {
+ "epoch": 1.6734177215189874,
+ "grad_norm": 0.042691316455602646,
+ "learning_rate": 9.25925925925926e-05,
+ "loss": 0.021898634731769562,
+ "step": 331
+ },
+ {
+ "epoch": 1.678481012658228,
+ "grad_norm": 0.07666946202516556,
+ "learning_rate": 9.25364758698092e-05,
+ "loss": 0.02928568609058857,
+ "step": 332
+ },
+ {
+ "epoch": 1.6835443037974684,
+ "grad_norm": 0.04230545833706856,
+ "learning_rate": 9.248035914702582e-05,
+ "loss": 0.020812246948480606,
+ "step": 333
+ },
+ {
+ "epoch": 1.688607594936709,
+ "grad_norm": 0.1077270656824112,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.025568369776010513,
+ "step": 334
+ },
+ {
+ "epoch": 1.6936708860759495,
+ "grad_norm": 0.04277936369180679,
+ "learning_rate": 9.236812570145904e-05,
+ "loss": 0.018935058265924454,
+ "step": 335
+ },
+ {
+ "epoch": 1.6987341772151898,
+ "grad_norm": 0.04454135522246361,
+ "learning_rate": 9.231200897867565e-05,
+ "loss": 0.01933746598660946,
+ "step": 336
+ },
+ {
+ "epoch": 1.7037974683544304,
+ "grad_norm": 0.0674893856048584,
+ "learning_rate": 9.225589225589226e-05,
+ "loss": 0.021518435329198837,
+ "step": 337
+ },
+ {
+ "epoch": 1.7088607594936709,
+ "grad_norm": 0.06007042154669762,
+ "learning_rate": 9.219977553310887e-05,
+ "loss": 0.019427424296736717,
+ "step": 338
+ },
+ {
+ "epoch": 1.7139240506329114,
+ "grad_norm": 0.09564489126205444,
+ "learning_rate": 9.214365881032548e-05,
+ "loss": 0.027250545099377632,
+ "step": 339
+ },
+ {
+ "epoch": 1.7189873417721517,
+ "grad_norm": 0.053655482828617096,
+ "learning_rate": 9.208754208754209e-05,
+ "loss": 0.020125389099121094,
+ "step": 340
+ },
+ {
+ "epoch": 1.7240506329113923,
+ "grad_norm": 0.038283221423625946,
+ "learning_rate": 9.20314253647587e-05,
+ "loss": 0.017948098480701447,
+ "step": 341
+ },
+ {
+ "epoch": 1.7291139240506328,
+ "grad_norm": 0.04724166542291641,
+ "learning_rate": 9.197530864197531e-05,
+ "loss": 0.02523602545261383,
+ "step": 342
+ },
+ {
+ "epoch": 1.7341772151898733,
+ "grad_norm": 0.10365224629640579,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.035696640610694885,
+ "step": 343
+ },
+ {
+ "epoch": 1.7392405063291139,
+ "grad_norm": 0.07362233102321625,
+ "learning_rate": 9.186307519640853e-05,
+ "loss": 0.026104427874088287,
+ "step": 344
+ },
+ {
+ "epoch": 1.7443037974683544,
+ "grad_norm": 0.05976846069097519,
+ "learning_rate": 9.180695847362514e-05,
+ "loss": 0.026634451001882553,
+ "step": 345
+ },
+ {
+ "epoch": 1.749367088607595,
+ "grad_norm": 0.07387223839759827,
+ "learning_rate": 9.175084175084175e-05,
+ "loss": 0.025733446702361107,
+ "step": 346
+ },
+ {
+ "epoch": 1.7544303797468355,
+ "grad_norm": 0.04727378115057945,
+ "learning_rate": 9.169472502805838e-05,
+ "loss": 0.01889938861131668,
+ "step": 347
+ },
+ {
+ "epoch": 1.759493670886076,
+ "grad_norm": 0.10614906996488571,
+ "learning_rate": 9.163860830527497e-05,
+ "loss": 0.02275039628148079,
+ "step": 348
+ },
+ {
+ "epoch": 1.7645569620253165,
+ "grad_norm": 0.04877970367670059,
+ "learning_rate": 9.15824915824916e-05,
+ "loss": 0.022580452263355255,
+ "step": 349
+ },
+ {
+ "epoch": 1.769620253164557,
+ "grad_norm": 0.18825598061084747,
+ "learning_rate": 9.152637485970819e-05,
+ "loss": 0.03054988384246826,
+ "step": 350
+ },
+ {
+ "epoch": 1.7746835443037976,
+ "grad_norm": 0.06315254420042038,
+ "learning_rate": 9.147025813692482e-05,
+ "loss": 0.025584843009710312,
+ "step": 351
+ },
+ {
+ "epoch": 1.7797468354430381,
+ "grad_norm": 0.04519108682870865,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.0214737206697464,
+ "step": 352
+ },
+ {
+ "epoch": 1.7848101265822784,
+ "grad_norm": 0.07401937246322632,
+ "learning_rate": 9.135802469135802e-05,
+ "loss": 0.02984039857983589,
+ "step": 353
+ },
+ {
+ "epoch": 1.789873417721519,
+ "grad_norm": 0.05138625577092171,
+ "learning_rate": 9.130190796857465e-05,
+ "loss": 0.024221282452344894,
+ "step": 354
+ },
+ {
+ "epoch": 1.7949367088607595,
+ "grad_norm": 0.10182037204504013,
+ "learning_rate": 9.124579124579124e-05,
+ "loss": 0.0237903892993927,
+ "step": 355
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.056737013161182404,
+ "learning_rate": 9.118967452300787e-05,
+ "loss": 0.026514701545238495,
+ "step": 356
+ },
+ {
+ "epoch": 1.8050632911392404,
+ "grad_norm": 0.04826146364212036,
+ "learning_rate": 9.113355780022446e-05,
+ "loss": 0.021808844059705734,
+ "step": 357
+ },
+ {
+ "epoch": 1.810126582278481,
+ "grad_norm": 0.07099983841180801,
+ "learning_rate": 9.107744107744109e-05,
+ "loss": 0.028031716123223305,
+ "step": 358
+ },
+ {
+ "epoch": 1.8151898734177214,
+ "grad_norm": 0.04242753982543945,
+ "learning_rate": 9.102132435465768e-05,
+ "loss": 0.018858186900615692,
+ "step": 359
+ },
+ {
+ "epoch": 1.820253164556962,
+ "grad_norm": 0.053701240569353104,
+ "learning_rate": 9.096520763187431e-05,
+ "loss": 0.025603849440813065,
+ "step": 360
+ },
+ {
+ "epoch": 1.8253164556962025,
+ "grad_norm": 0.05277755856513977,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.021214714273810387,
+ "step": 361
+ },
+ {
+ "epoch": 1.830379746835443,
+ "grad_norm": 0.048843637108802795,
+ "learning_rate": 9.085297418630753e-05,
+ "loss": 0.024215007200837135,
+ "step": 362
+ },
+ {
+ "epoch": 1.8354430379746836,
+ "grad_norm": 0.04203329607844353,
+ "learning_rate": 9.079685746352414e-05,
+ "loss": 0.022748971357941628,
+ "step": 363
+ },
+ {
+ "epoch": 1.840506329113924,
+ "grad_norm": 0.04655196890234947,
+ "learning_rate": 9.074074074074075e-05,
+ "loss": 0.019658325240015984,
+ "step": 364
+ },
+ {
+ "epoch": 1.8455696202531646,
+ "grad_norm": 0.10654491931200027,
+ "learning_rate": 9.068462401795736e-05,
+ "loss": 0.03210999816656113,
+ "step": 365
+ },
+ {
+ "epoch": 1.8506329113924052,
+ "grad_norm": 0.04377336800098419,
+ "learning_rate": 9.062850729517397e-05,
+ "loss": 0.01867927983403206,
+ "step": 366
+ },
+ {
+ "epoch": 1.8556962025316457,
+ "grad_norm": 0.04619381204247475,
+ "learning_rate": 9.057239057239058e-05,
+ "loss": 0.01952965185046196,
+ "step": 367
+ },
+ {
+ "epoch": 1.8607594936708862,
+ "grad_norm": 0.04015986621379852,
+ "learning_rate": 9.051627384960719e-05,
+ "loss": 0.017353296279907227,
+ "step": 368
+ },
+ {
+ "epoch": 1.8658227848101265,
+ "grad_norm": 0.11403095722198486,
+ "learning_rate": 9.04601571268238e-05,
+ "loss": 0.02238992229104042,
+ "step": 369
+ },
+ {
+ "epoch": 1.870886075949367,
+ "grad_norm": 0.043767284601926804,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.02202833816409111,
+ "step": 370
+ },
+ {
+ "epoch": 1.8759493670886076,
+ "grad_norm": 0.053445883095264435,
+ "learning_rate": 9.034792368125702e-05,
+ "loss": 0.023765750229358673,
+ "step": 371
+ },
+ {
+ "epoch": 1.8810126582278481,
+ "grad_norm": 0.05750055983662605,
+ "learning_rate": 9.029180695847364e-05,
+ "loss": 0.026259474456310272,
+ "step": 372
+ },
+ {
+ "epoch": 1.8860759493670884,
+ "grad_norm": 0.04525497183203697,
+ "learning_rate": 9.023569023569024e-05,
+ "loss": 0.024194583296775818,
+ "step": 373
+ },
+ {
+ "epoch": 1.891139240506329,
+ "grad_norm": 0.04918856918811798,
+ "learning_rate": 9.017957351290685e-05,
+ "loss": 0.020951319485902786,
+ "step": 374
+ },
+ {
+ "epoch": 1.8962025316455695,
+ "grad_norm": 0.08538687229156494,
+ "learning_rate": 9.012345679012346e-05,
+ "loss": 0.022266045212745667,
+ "step": 375
+ },
+ {
+ "epoch": 1.90126582278481,
+ "grad_norm": 0.07101748883724213,
+ "learning_rate": 9.006734006734007e-05,
+ "loss": 0.028090521693229675,
+ "step": 376
+ },
+ {
+ "epoch": 1.9063291139240506,
+ "grad_norm": 0.06256446987390518,
+ "learning_rate": 9.001122334455668e-05,
+ "loss": 0.027174800634384155,
+ "step": 377
+ },
+ {
+ "epoch": 1.9113924050632911,
+ "grad_norm": 0.07588270306587219,
+ "learning_rate": 8.995510662177329e-05,
+ "loss": 0.028438206762075424,
+ "step": 378
+ },
+ {
+ "epoch": 1.9164556962025316,
+ "grad_norm": 5.8829851150512695,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.01749270409345627,
+ "step": 379
+ },
+ {
+ "epoch": 1.9215189873417722,
+ "grad_norm": 0.038905344903469086,
+ "learning_rate": 8.984287317620651e-05,
+ "loss": 0.019571108743548393,
+ "step": 380
+ },
+ {
+ "epoch": 1.9265822784810127,
+ "grad_norm": 0.05960959196090698,
+ "learning_rate": 8.978675645342313e-05,
+ "loss": 0.024591946974396706,
+ "step": 381
+ },
+ {
+ "epoch": 1.9316455696202532,
+ "grad_norm": 0.07935867458581924,
+ "learning_rate": 8.973063973063973e-05,
+ "loss": 0.020205039530992508,
+ "step": 382
+ },
+ {
+ "epoch": 1.9367088607594938,
+ "grad_norm": 0.08682888746261597,
+ "learning_rate": 8.967452300785635e-05,
+ "loss": 0.023299653083086014,
+ "step": 383
+ },
+ {
+ "epoch": 1.9417721518987343,
+ "grad_norm": 0.07220255583524704,
+ "learning_rate": 8.961840628507295e-05,
+ "loss": 0.025364618748426437,
+ "step": 384
+ },
+ {
+ "epoch": 1.9468354430379748,
+ "grad_norm": 0.08230294287204742,
+ "learning_rate": 8.956228956228957e-05,
+ "loss": 0.023587457835674286,
+ "step": 385
+ },
+ {
+ "epoch": 1.9518987341772152,
+ "grad_norm": 0.05176795646548271,
+ "learning_rate": 8.950617283950617e-05,
+ "loss": 0.018942706286907196,
+ "step": 386
+ },
+ {
+ "epoch": 1.9569620253164557,
+ "grad_norm": 0.04784144088625908,
+ "learning_rate": 8.945005611672279e-05,
+ "loss": 0.020134730264544487,
+ "step": 387
+ },
+ {
+ "epoch": 1.9620253164556962,
+ "grad_norm": 0.04668115824460983,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.022084465250372887,
+ "step": 388
+ },
+ {
+ "epoch": 1.9670886075949368,
+ "grad_norm": 0.05892647057771683,
+ "learning_rate": 8.933782267115601e-05,
+ "loss": 0.02586008608341217,
+ "step": 389
+ },
+ {
+ "epoch": 1.972151898734177,
+ "grad_norm": 0.048669006675481796,
+ "learning_rate": 8.928170594837262e-05,
+ "loss": 0.020011097192764282,
+ "step": 390
+ },
+ {
+ "epoch": 1.9772151898734176,
+ "grad_norm": 0.0973723903298378,
+ "learning_rate": 8.922558922558923e-05,
+ "loss": 0.030240919440984726,
+ "step": 391
+ },
+ {
+ "epoch": 1.9822784810126581,
+ "grad_norm": 0.090507872402668,
+ "learning_rate": 8.916947250280584e-05,
+ "loss": 0.028250183910131454,
+ "step": 392
+ },
+ {
+ "epoch": 1.9873417721518987,
+ "grad_norm": 0.03921318054199219,
+ "learning_rate": 8.911335578002245e-05,
+ "loss": 0.02076716348528862,
+ "step": 393
+ },
+ {
+ "epoch": 1.9924050632911392,
+ "grad_norm": 0.04830043017864227,
+ "learning_rate": 8.905723905723906e-05,
+ "loss": 0.02241525426506996,
+ "step": 394
+ },
+ {
+ "epoch": 1.9974683544303797,
+ "grad_norm": 0.04455797001719475,
+ "learning_rate": 8.900112233445567e-05,
+ "loss": 0.026035301387310028,
+ "step": 395
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.10931648313999176,
+ "learning_rate": 8.894500561167228e-05,
+ "loss": 0.03514251485466957,
+ "step": 396
+ },
+ {
+ "epoch": 2.0050632911392405,
+ "grad_norm": 0.07531362026929855,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.021771814674139023,
+ "step": 397
+ },
+ {
+ "epoch": 2.010126582278481,
+ "grad_norm": 0.0649140477180481,
+ "learning_rate": 8.88327721661055e-05,
+ "loss": 0.02932022325694561,
+ "step": 398
+ },
+ {
+ "epoch": 2.0151898734177216,
+ "grad_norm": 0.07461163401603699,
+ "learning_rate": 8.877665544332211e-05,
+ "loss": 0.023864082992076874,
+ "step": 399
+ },
+ {
+ "epoch": 2.020253164556962,
+ "grad_norm": 0.054510265588760376,
+ "learning_rate": 8.872053872053872e-05,
+ "loss": 0.027578316628932953,
+ "step": 400
+ },
+ {
+ "epoch": 2.0253164556962027,
+ "grad_norm": 0.04434451460838318,
+ "learning_rate": 8.866442199775533e-05,
+ "loss": 0.022873830050230026,
+ "step": 401
+ },
+ {
+ "epoch": 2.030379746835443,
+ "grad_norm": 0.052791960537433624,
+ "learning_rate": 8.860830527497194e-05,
+ "loss": 0.021092431619763374,
+ "step": 402
+ },
+ {
+ "epoch": 2.0354430379746837,
+ "grad_norm": 0.04550998657941818,
+ "learning_rate": 8.855218855218855e-05,
+ "loss": 0.022475749254226685,
+ "step": 403
+ },
+ {
+ "epoch": 2.0405063291139243,
+ "grad_norm": 0.2512972354888916,
+ "learning_rate": 8.849607182940516e-05,
+ "loss": 0.02201610803604126,
+ "step": 404
+ },
+ {
+ "epoch": 2.0455696202531644,
+ "grad_norm": 0.04554569348692894,
+ "learning_rate": 8.843995510662177e-05,
+ "loss": 0.02180359698832035,
+ "step": 405
+ },
+ {
+ "epoch": 2.050632911392405,
+ "grad_norm": 0.04094229266047478,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.01960112899541855,
+ "step": 406
+ },
+ {
+ "epoch": 2.0556962025316454,
+ "grad_norm": 0.07398641109466553,
+ "learning_rate": 8.8327721661055e-05,
+ "loss": 0.02206597849726677,
+ "step": 407
+ },
+ {
+ "epoch": 2.060759493670886,
+ "grad_norm": 0.07659231871366501,
+ "learning_rate": 8.827160493827162e-05,
+ "loss": 0.019660351797938347,
+ "step": 408
+ },
+ {
+ "epoch": 2.0658227848101265,
+ "grad_norm": 0.05986466258764267,
+ "learning_rate": 8.821548821548821e-05,
+ "loss": 0.027121691033244133,
+ "step": 409
+ },
+ {
+ "epoch": 2.070886075949367,
+ "grad_norm": 0.03376661241054535,
+ "learning_rate": 8.815937149270484e-05,
+ "loss": 0.021059338003396988,
+ "step": 410
+ },
+ {
+ "epoch": 2.0759493670886076,
+ "grad_norm": 0.081104576587677,
+ "learning_rate": 8.810325476992143e-05,
+ "loss": 0.031228341162204742,
+ "step": 411
+ },
+ {
+ "epoch": 2.081012658227848,
+ "grad_norm": 0.04295242205262184,
+ "learning_rate": 8.804713804713806e-05,
+ "loss": 0.020738180726766586,
+ "step": 412
+ },
+ {
+ "epoch": 2.0860759493670886,
+ "grad_norm": 0.03715268895030022,
+ "learning_rate": 8.799102132435467e-05,
+ "loss": 0.018579209223389626,
+ "step": 413
+ },
+ {
+ "epoch": 2.091139240506329,
+ "grad_norm": 0.06769359856843948,
+ "learning_rate": 8.793490460157128e-05,
+ "loss": 0.026761794462800026,
+ "step": 414
+ },
+ {
+ "epoch": 2.0962025316455697,
+ "grad_norm": 0.03715744614601135,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.022879980504512787,
+ "step": 415
+ },
+ {
+ "epoch": 2.1012658227848102,
+ "grad_norm": 0.04305677488446236,
+ "learning_rate": 8.78226711560045e-05,
+ "loss": 0.022773049771785736,
+ "step": 416
+ },
+ {
+ "epoch": 2.1063291139240508,
+ "grad_norm": 0.0449112169444561,
+ "learning_rate": 8.776655443322111e-05,
+ "loss": 0.022499293088912964,
+ "step": 417
+ },
+ {
+ "epoch": 2.1113924050632913,
+ "grad_norm": 0.0457427054643631,
+ "learning_rate": 8.77104377104377e-05,
+ "loss": 0.024978693574666977,
+ "step": 418
+ },
+ {
+ "epoch": 2.116455696202532,
+ "grad_norm": 0.04705161228775978,
+ "learning_rate": 8.765432098765433e-05,
+ "loss": 0.024807877838611603,
+ "step": 419
+ },
+ {
+ "epoch": 2.1215189873417724,
+ "grad_norm": 0.04377812147140503,
+ "learning_rate": 8.759820426487092e-05,
+ "loss": 0.025857431814074516,
+ "step": 420
+ },
+ {
+ "epoch": 2.1265822784810124,
+ "grad_norm": 0.08598720282316208,
+ "learning_rate": 8.754208754208755e-05,
+ "loss": 0.021972455084323883,
+ "step": 421
+ },
+ {
+ "epoch": 2.131645569620253,
+ "grad_norm": 0.4669632017612457,
+ "learning_rate": 8.748597081930416e-05,
+ "loss": 0.02055199444293976,
+ "step": 422
+ },
+ {
+ "epoch": 2.1367088607594935,
+ "grad_norm": 0.05292733013629913,
+ "learning_rate": 8.742985409652077e-05,
+ "loss": 0.020852137356996536,
+ "step": 423
+ },
+ {
+ "epoch": 2.141772151898734,
+ "grad_norm": 0.05878116562962532,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.02444305270910263,
+ "step": 424
+ },
+ {
+ "epoch": 2.1468354430379746,
+ "grad_norm": 0.05234210565686226,
+ "learning_rate": 8.731762065095399e-05,
+ "loss": 0.02202335000038147,
+ "step": 425
+ },
+ {
+ "epoch": 2.151898734177215,
+ "grad_norm": 0.04706348851323128,
+ "learning_rate": 8.72615039281706e-05,
+ "loss": 0.019998187199234962,
+ "step": 426
+ },
+ {
+ "epoch": 2.1569620253164556,
+ "grad_norm": 0.05263376981019974,
+ "learning_rate": 8.720538720538721e-05,
+ "loss": 0.028126951307058334,
+ "step": 427
+ },
+ {
+ "epoch": 2.162025316455696,
+ "grad_norm": 0.062016960233449936,
+ "learning_rate": 8.714927048260382e-05,
+ "loss": 0.0286184661090374,
+ "step": 428
+ },
+ {
+ "epoch": 2.1670886075949367,
+ "grad_norm": 0.13798244297504425,
+ "learning_rate": 8.709315375982043e-05,
+ "loss": 0.026699248701334,
+ "step": 429
+ },
+ {
+ "epoch": 2.1721518987341772,
+ "grad_norm": 0.09159042686223984,
+ "learning_rate": 8.703703703703704e-05,
+ "loss": 0.025515643879771233,
+ "step": 430
+ },
+ {
+ "epoch": 2.1772151898734178,
+ "grad_norm": 0.0828855037689209,
+ "learning_rate": 8.698092031425365e-05,
+ "loss": 0.025481123477220535,
+ "step": 431
+ },
+ {
+ "epoch": 2.1822784810126583,
+ "grad_norm": 0.09840776771306992,
+ "learning_rate": 8.692480359147026e-05,
+ "loss": 0.020968927070498466,
+ "step": 432
+ },
+ {
+ "epoch": 2.187341772151899,
+ "grad_norm": 0.10999752581119537,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.028588412329554558,
+ "step": 433
+ },
+ {
+ "epoch": 2.1924050632911394,
+ "grad_norm": 0.06938561797142029,
+ "learning_rate": 8.681257014590348e-05,
+ "loss": 0.024119220674037933,
+ "step": 434
+ },
+ {
+ "epoch": 2.19746835443038,
+ "grad_norm": 0.054689887911081314,
+ "learning_rate": 8.67564534231201e-05,
+ "loss": 0.02173299714922905,
+ "step": 435
+ },
+ {
+ "epoch": 2.2025316455696204,
+ "grad_norm": 0.09605880081653595,
+ "learning_rate": 8.67003367003367e-05,
+ "loss": 0.02312455326318741,
+ "step": 436
+ },
+ {
+ "epoch": 2.207594936708861,
+ "grad_norm": 0.06863043457269669,
+ "learning_rate": 8.664421997755332e-05,
+ "loss": 0.020868321880698204,
+ "step": 437
+ },
+ {
+ "epoch": 2.212658227848101,
+ "grad_norm": 0.11743242293596268,
+ "learning_rate": 8.658810325476992e-05,
+ "loss": 0.029748965054750443,
+ "step": 438
+ },
+ {
+ "epoch": 2.2177215189873416,
+ "grad_norm": 0.08399086445569992,
+ "learning_rate": 8.653198653198653e-05,
+ "loss": 0.02379520982503891,
+ "step": 439
+ },
+ {
+ "epoch": 2.222784810126582,
+ "grad_norm": 0.052164461463689804,
+ "learning_rate": 8.647586980920315e-05,
+ "loss": 0.02010851353406906,
+ "step": 440
+ },
+ {
+ "epoch": 2.2278481012658227,
+ "grad_norm": 0.11834696680307388,
+ "learning_rate": 8.641975308641975e-05,
+ "loss": 0.02748255990445614,
+ "step": 441
+ },
+ {
+ "epoch": 2.232911392405063,
+ "grad_norm": 0.06718999892473221,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.026828233152627945,
+ "step": 442
+ },
+ {
+ "epoch": 2.2379746835443037,
+ "grad_norm": 0.042458854615688324,
+ "learning_rate": 8.630751964085297e-05,
+ "loss": 0.021280258893966675,
+ "step": 443
+ },
+ {
+ "epoch": 2.2430379746835443,
+ "grad_norm": 0.036516617983579636,
+ "learning_rate": 8.62514029180696e-05,
+ "loss": 0.021773381158709526,
+ "step": 444
+ },
+ {
+ "epoch": 2.248101265822785,
+ "grad_norm": 0.04317261651158333,
+ "learning_rate": 8.619528619528619e-05,
+ "loss": 0.022671079263091087,
+ "step": 445
+ },
+ {
+ "epoch": 2.2531645569620253,
+ "grad_norm": 0.08610037714242935,
+ "learning_rate": 8.613916947250281e-05,
+ "loss": 0.02425701916217804,
+ "step": 446
+ },
+ {
+ "epoch": 2.258227848101266,
+ "grad_norm": 0.03478290140628815,
+ "learning_rate": 8.608305274971942e-05,
+ "loss": 0.022291556000709534,
+ "step": 447
+ },
+ {
+ "epoch": 2.2632911392405064,
+ "grad_norm": 0.04682233929634094,
+ "learning_rate": 8.602693602693603e-05,
+ "loss": 0.02036888152360916,
+ "step": 448
+ },
+ {
+ "epoch": 2.268354430379747,
+ "grad_norm": 0.0808606892824173,
+ "learning_rate": 8.597081930415264e-05,
+ "loss": 0.025470012798905373,
+ "step": 449
+ },
+ {
+ "epoch": 2.2734177215189875,
+ "grad_norm": 0.042830612510442734,
+ "learning_rate": 8.591470258136925e-05,
+ "loss": 0.020565971732139587,
+ "step": 450
+ },
+ {
+ "epoch": 2.278481012658228,
+ "grad_norm": 0.06374406069517136,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031990330666303635,
+ "step": 451
+ },
+ {
+ "epoch": 2.2835443037974685,
+ "grad_norm": 0.05716697871685028,
+ "learning_rate": 8.580246913580247e-05,
+ "loss": 0.024125374853610992,
+ "step": 452
+ },
+ {
+ "epoch": 2.2886075949367086,
+ "grad_norm": 0.04057484492659569,
+ "learning_rate": 8.574635241301908e-05,
+ "loss": 0.021739482879638672,
+ "step": 453
+ },
+ {
+ "epoch": 2.293670886075949,
+ "grad_norm": 0.07754945009946823,
+ "learning_rate": 8.56902356902357e-05,
+ "loss": 0.02694481424987316,
+ "step": 454
+ },
+ {
+ "epoch": 2.2987341772151897,
+ "grad_norm": 0.06022442877292633,
+ "learning_rate": 8.56341189674523e-05,
+ "loss": 0.021221034228801727,
+ "step": 455
+ },
+ {
+ "epoch": 2.3037974683544302,
+ "grad_norm": 0.06909896433353424,
+ "learning_rate": 8.557800224466891e-05,
+ "loss": 0.02247895672917366,
+ "step": 456
+ },
+ {
+ "epoch": 2.3088607594936708,
+ "grad_norm": 0.05362236499786377,
+ "learning_rate": 8.552188552188552e-05,
+ "loss": 0.020700538530945778,
+ "step": 457
+ },
+ {
+ "epoch": 2.3139240506329113,
+ "grad_norm": 0.09836408495903015,
+ "learning_rate": 8.546576879910215e-05,
+ "loss": 0.02611887827515602,
+ "step": 458
+ },
+ {
+ "epoch": 2.318987341772152,
+ "grad_norm": 0.036625102162361145,
+ "learning_rate": 8.540965207631874e-05,
+ "loss": 0.0196938905864954,
+ "step": 459
+ },
+ {
+ "epoch": 2.3240506329113924,
+ "grad_norm": 0.07372298091650009,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.020545657724142075,
+ "step": 460
+ },
+ {
+ "epoch": 2.329113924050633,
+ "grad_norm": 0.20502988994121552,
+ "learning_rate": 8.529741863075196e-05,
+ "loss": 0.02884715050458908,
+ "step": 461
+ },
+ {
+ "epoch": 2.3341772151898734,
+ "grad_norm": 0.04867224395275116,
+ "learning_rate": 8.524130190796857e-05,
+ "loss": 0.019854716956615448,
+ "step": 462
+ },
+ {
+ "epoch": 2.339240506329114,
+ "grad_norm": 0.029550092294812202,
+ "learning_rate": 8.518518518518518e-05,
+ "loss": 0.01884104311466217,
+ "step": 463
+ },
+ {
+ "epoch": 2.3443037974683545,
+ "grad_norm": 0.04299351945519447,
+ "learning_rate": 8.51290684624018e-05,
+ "loss": 0.01954217068850994,
+ "step": 464
+ },
+ {
+ "epoch": 2.349367088607595,
+ "grad_norm": 0.043467242270708084,
+ "learning_rate": 8.507295173961842e-05,
+ "loss": 0.024274462834000587,
+ "step": 465
+ },
+ {
+ "epoch": 2.3544303797468356,
+ "grad_norm": 0.05131510645151138,
+ "learning_rate": 8.501683501683501e-05,
+ "loss": 0.026246599853038788,
+ "step": 466
+ },
+ {
+ "epoch": 2.359493670886076,
+ "grad_norm": 0.06280570477247238,
+ "learning_rate": 8.496071829405164e-05,
+ "loss": 0.024986159056425095,
+ "step": 467
+ },
+ {
+ "epoch": 2.3645569620253166,
+ "grad_norm": 0.04968208447098732,
+ "learning_rate": 8.490460157126824e-05,
+ "loss": 0.02912936732172966,
+ "step": 468
+ },
+ {
+ "epoch": 2.369620253164557,
+ "grad_norm": 0.08504039794206619,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.027097277343273163,
+ "step": 469
+ },
+ {
+ "epoch": 2.3746835443037977,
+ "grad_norm": 0.18385924398899078,
+ "learning_rate": 8.479236812570146e-05,
+ "loss": 0.02459462732076645,
+ "step": 470
+ },
+ {
+ "epoch": 2.379746835443038,
+ "grad_norm": 0.0663745328783989,
+ "learning_rate": 8.473625140291808e-05,
+ "loss": 0.020224973559379578,
+ "step": 471
+ },
+ {
+ "epoch": 2.3848101265822783,
+ "grad_norm": 0.04759671539068222,
+ "learning_rate": 8.468013468013468e-05,
+ "loss": 0.02591642364859581,
+ "step": 472
+ },
+ {
+ "epoch": 2.389873417721519,
+ "grad_norm": 0.044010091572999954,
+ "learning_rate": 8.46240179573513e-05,
+ "loss": 0.025122515857219696,
+ "step": 473
+ },
+ {
+ "epoch": 2.3949367088607594,
+ "grad_norm": 0.035054467618465424,
+ "learning_rate": 8.456790123456791e-05,
+ "loss": 0.019854065030813217,
+ "step": 474
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.03171153366565704,
+ "learning_rate": 8.451178451178452e-05,
+ "loss": 0.02009584940969944,
+ "step": 475
+ },
+ {
+ "epoch": 2.4050632911392404,
+ "grad_norm": 0.17388089001178741,
+ "learning_rate": 8.445566778900113e-05,
+ "loss": 0.02714207023382187,
+ "step": 476
+ },
+ {
+ "epoch": 2.410126582278481,
+ "grad_norm": 0.038392502814531326,
+ "learning_rate": 8.439955106621774e-05,
+ "loss": 0.020382478833198547,
+ "step": 477
+ },
+ {
+ "epoch": 2.4151898734177215,
+ "grad_norm": 0.04264051839709282,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.022726822644472122,
+ "step": 478
+ },
+ {
+ "epoch": 2.420253164556962,
+ "grad_norm": 0.046432014554739,
+ "learning_rate": 8.428731762065096e-05,
+ "loss": 0.021431483328342438,
+ "step": 479
+ },
+ {
+ "epoch": 2.4253164556962026,
+ "grad_norm": 0.07288242876529694,
+ "learning_rate": 8.423120089786757e-05,
+ "loss": 0.026229504495859146,
+ "step": 480
+ },
+ {
+ "epoch": 2.430379746835443,
+ "grad_norm": 0.04801097884774208,
+ "learning_rate": 8.417508417508418e-05,
+ "loss": 0.020924456417560577,
+ "step": 481
+ },
+ {
+ "epoch": 2.4354430379746836,
+ "grad_norm": 0.11201190203428268,
+ "learning_rate": 8.411896745230079e-05,
+ "loss": 0.022652529180049896,
+ "step": 482
+ },
+ {
+ "epoch": 2.440506329113924,
+ "grad_norm": 0.06151285395026207,
+ "learning_rate": 8.40628507295174e-05,
+ "loss": 0.02416859194636345,
+ "step": 483
+ },
+ {
+ "epoch": 2.4455696202531647,
+ "grad_norm": 0.04006446525454521,
+ "learning_rate": 8.400673400673401e-05,
+ "loss": 0.02390255406498909,
+ "step": 484
+ },
+ {
+ "epoch": 2.4506329113924052,
+ "grad_norm": 0.027193108573555946,
+ "learning_rate": 8.395061728395062e-05,
+ "loss": 0.015282701700925827,
+ "step": 485
+ },
+ {
+ "epoch": 2.4556962025316453,
+ "grad_norm": 0.05453994497656822,
+ "learning_rate": 8.389450056116723e-05,
+ "loss": 0.025738034397363663,
+ "step": 486
+ },
+ {
+ "epoch": 2.460759493670886,
+ "grad_norm": 0.03226681798696518,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.02111941948533058,
+ "step": 487
+ },
+ {
+ "epoch": 2.4658227848101264,
+ "grad_norm": 0.0451083667576313,
+ "learning_rate": 8.378226711560045e-05,
+ "loss": 0.020694585517048836,
+ "step": 488
+ },
+ {
+ "epoch": 2.470886075949367,
+ "grad_norm": 0.0390113927423954,
+ "learning_rate": 8.372615039281706e-05,
+ "loss": 0.022557765245437622,
+ "step": 489
+ },
+ {
+ "epoch": 2.4759493670886075,
+ "grad_norm": 0.05983779951930046,
+ "learning_rate": 8.367003367003367e-05,
+ "loss": 0.02489873766899109,
+ "step": 490
+ },
+ {
+ "epoch": 2.481012658227848,
+ "grad_norm": 0.03961458057165146,
+ "learning_rate": 8.361391694725028e-05,
+ "loss": 0.021655399352312088,
+ "step": 491
+ },
+ {
+ "epoch": 2.4860759493670885,
+ "grad_norm": 0.03814523667097092,
+ "learning_rate": 8.35578002244669e-05,
+ "loss": 0.02217719703912735,
+ "step": 492
+ },
+ {
+ "epoch": 2.491139240506329,
+ "grad_norm": 0.030563514679670334,
+ "learning_rate": 8.35016835016835e-05,
+ "loss": 0.01679009571671486,
+ "step": 493
+ },
+ {
+ "epoch": 2.4962025316455696,
+ "grad_norm": 0.04566824436187744,
+ "learning_rate": 8.344556677890012e-05,
+ "loss": 0.019699417054653168,
+ "step": 494
+ },
+ {
+ "epoch": 2.50126582278481,
+ "grad_norm": 0.06117499992251396,
+ "learning_rate": 8.338945005611672e-05,
+ "loss": 0.028571851551532745,
+ "step": 495
+ },
+ {
+ "epoch": 2.5063291139240507,
+ "grad_norm": 0.03510760888457298,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.023387223482131958,
+ "step": 496
+ },
+ {
+ "epoch": 2.511392405063291,
+ "grad_norm": 0.028878437355160713,
+ "learning_rate": 8.327721661054994e-05,
+ "loss": 0.023329850286245346,
+ "step": 497
+ },
+ {
+ "epoch": 2.5164556962025317,
+ "grad_norm": 0.02818676456809044,
+ "learning_rate": 8.322109988776656e-05,
+ "loss": 0.017786618322134018,
+ "step": 498
+ },
+ {
+ "epoch": 2.5215189873417723,
+ "grad_norm": 0.06660276651382446,
+ "learning_rate": 8.316498316498317e-05,
+ "loss": 0.023636367172002792,
+ "step": 499
+ },
+ {
+ "epoch": 2.526582278481013,
+ "grad_norm": 0.05663186311721802,
+ "learning_rate": 8.310886644219978e-05,
+ "loss": 0.02607567049562931,
+ "step": 500
+ },
+ {
+ "epoch": 2.5316455696202533,
+ "grad_norm": 0.04156090319156647,
+ "learning_rate": 8.30527497194164e-05,
+ "loss": 0.024936942383646965,
+ "step": 501
+ },
+ {
+ "epoch": 2.536708860759494,
+ "grad_norm": 0.036135219037532806,
+ "learning_rate": 8.2996632996633e-05,
+ "loss": 0.023583384230732918,
+ "step": 502
+ },
+ {
+ "epoch": 2.5417721518987344,
+ "grad_norm": 0.052026644349098206,
+ "learning_rate": 8.294051627384961e-05,
+ "loss": 0.02324807643890381,
+ "step": 503
+ },
+ {
+ "epoch": 2.546835443037975,
+ "grad_norm": 0.03599514439702034,
+ "learning_rate": 8.288439955106621e-05,
+ "loss": 0.01879853755235672,
+ "step": 504
+ },
+ {
+ "epoch": 2.5518987341772155,
+ "grad_norm": 0.03505280241370201,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.017342131584882736,
+ "step": 505
+ },
+ {
+ "epoch": 2.5569620253164556,
+ "grad_norm": 0.0403706431388855,
+ "learning_rate": 8.277216610549943e-05,
+ "loss": 0.02082991972565651,
+ "step": 506
+ },
+ {
+ "epoch": 2.562025316455696,
+ "grad_norm": 0.031072309240698814,
+ "learning_rate": 8.271604938271605e-05,
+ "loss": 0.01711331121623516,
+ "step": 507
+ },
+ {
+ "epoch": 2.5670886075949366,
+ "grad_norm": 0.04118587449193001,
+ "learning_rate": 8.265993265993266e-05,
+ "loss": 0.01940922439098358,
+ "step": 508
+ },
+ {
+ "epoch": 2.572151898734177,
+ "grad_norm": 0.039908040314912796,
+ "learning_rate": 8.260381593714927e-05,
+ "loss": 0.021229952573776245,
+ "step": 509
+ },
+ {
+ "epoch": 2.5772151898734177,
+ "grad_norm": 0.02886618860065937,
+ "learning_rate": 8.254769921436589e-05,
+ "loss": 0.02004890888929367,
+ "step": 510
+ },
+ {
+ "epoch": 2.5822784810126582,
+ "grad_norm": 0.04229263588786125,
+ "learning_rate": 8.24915824915825e-05,
+ "loss": 0.019512392580509186,
+ "step": 511
+ },
+ {
+ "epoch": 2.5873417721518988,
+ "grad_norm": 0.030951635912060738,
+ "learning_rate": 8.24354657687991e-05,
+ "loss": 0.01836536079645157,
+ "step": 512
+ },
+ {
+ "epoch": 2.5924050632911393,
+ "grad_norm": 0.057054903358221054,
+ "learning_rate": 8.237934904601572e-05,
+ "loss": 0.028897594660520554,
+ "step": 513
+ },
+ {
+ "epoch": 2.59746835443038,
+ "grad_norm": 0.10734204202890396,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.024986904114484787,
+ "step": 514
+ },
+ {
+ "epoch": 2.6025316455696204,
+ "grad_norm": 0.029653102159500122,
+ "learning_rate": 8.226711560044894e-05,
+ "loss": 0.02242947742342949,
+ "step": 515
+ },
+ {
+ "epoch": 2.607594936708861,
+ "grad_norm": 0.05601462349295616,
+ "learning_rate": 8.221099887766555e-05,
+ "loss": 0.020091768354177475,
+ "step": 516
+ },
+ {
+ "epoch": 2.6126582278481014,
+ "grad_norm": 0.04170191287994385,
+ "learning_rate": 8.215488215488217e-05,
+ "loss": 0.021796470507979393,
+ "step": 517
+ },
+ {
+ "epoch": 2.6177215189873415,
+ "grad_norm": 0.06347091495990753,
+ "learning_rate": 8.209876543209877e-05,
+ "loss": 0.024338826537132263,
+ "step": 518
+ },
+ {
+ "epoch": 2.622784810126582,
+ "grad_norm": 0.06084204465150833,
+ "learning_rate": 8.204264870931539e-05,
+ "loss": 0.02493124082684517,
+ "step": 519
+ },
+ {
+ "epoch": 2.6278481012658226,
+ "grad_norm": 0.03094005584716797,
+ "learning_rate": 8.198653198653199e-05,
+ "loss": 0.021345658227801323,
+ "step": 520
+ },
+ {
+ "epoch": 2.632911392405063,
+ "grad_norm": 0.04017730429768562,
+ "learning_rate": 8.193041526374861e-05,
+ "loss": 0.019823770970106125,
+ "step": 521
+ },
+ {
+ "epoch": 2.6379746835443036,
+ "grad_norm": 0.045351576060056686,
+ "learning_rate": 8.18742985409652e-05,
+ "loss": 0.02385132387280464,
+ "step": 522
+ },
+ {
+ "epoch": 2.643037974683544,
+ "grad_norm": 0.04823896288871765,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.021753432229161263,
+ "step": 523
+ },
+ {
+ "epoch": 2.6481012658227847,
+ "grad_norm": 0.0442446693778038,
+ "learning_rate": 8.176206509539843e-05,
+ "loss": 0.022134695202112198,
+ "step": 524
+ },
+ {
+ "epoch": 2.6531645569620252,
+ "grad_norm": 0.07998359203338623,
+ "learning_rate": 8.170594837261504e-05,
+ "loss": 0.021159570664167404,
+ "step": 525
+ },
+ {
+ "epoch": 2.6582278481012658,
+ "grad_norm": 0.07844395190477371,
+ "learning_rate": 8.164983164983166e-05,
+ "loss": 0.023695990443229675,
+ "step": 526
+ },
+ {
+ "epoch": 2.6632911392405063,
+ "grad_norm": 0.025296518579125404,
+ "learning_rate": 8.159371492704826e-05,
+ "loss": 0.020914766937494278,
+ "step": 527
+ },
+ {
+ "epoch": 2.668354430379747,
+ "grad_norm": 0.337454617023468,
+ "learning_rate": 8.153759820426488e-05,
+ "loss": 0.02948678657412529,
+ "step": 528
+ },
+ {
+ "epoch": 2.6734177215189874,
+ "grad_norm": 0.03531114012002945,
+ "learning_rate": 8.148148148148148e-05,
+ "loss": 0.020608587190508842,
+ "step": 529
+ },
+ {
+ "epoch": 2.678481012658228,
+ "grad_norm": 0.0496559739112854,
+ "learning_rate": 8.14253647586981e-05,
+ "loss": 0.023600757122039795,
+ "step": 530
+ },
+ {
+ "epoch": 2.6835443037974684,
+ "grad_norm": 0.04093128815293312,
+ "learning_rate": 8.13692480359147e-05,
+ "loss": 0.022392068058252335,
+ "step": 531
+ },
+ {
+ "epoch": 2.688607594936709,
+ "grad_norm": 0.05343819782137871,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.01882098615169525,
+ "step": 532
+ },
+ {
+ "epoch": 2.6936708860759495,
+ "grad_norm": 0.0334453359246254,
+ "learning_rate": 8.125701459034793e-05,
+ "loss": 0.020492104813456535,
+ "step": 533
+ },
+ {
+ "epoch": 2.69873417721519,
+ "grad_norm": 0.045540470629930496,
+ "learning_rate": 8.120089786756454e-05,
+ "loss": 0.021309707313776016,
+ "step": 534
+ },
+ {
+ "epoch": 2.7037974683544306,
+ "grad_norm": 0.03238926827907562,
+ "learning_rate": 8.114478114478115e-05,
+ "loss": 0.01929772086441517,
+ "step": 535
+ },
+ {
+ "epoch": 2.708860759493671,
+ "grad_norm": 0.10985280573368073,
+ "learning_rate": 8.108866442199776e-05,
+ "loss": 0.02431013062596321,
+ "step": 536
+ },
+ {
+ "epoch": 2.7139240506329116,
+ "grad_norm": 0.039785534143447876,
+ "learning_rate": 8.103254769921437e-05,
+ "loss": 0.022708022966980934,
+ "step": 537
+ },
+ {
+ "epoch": 2.7189873417721517,
+ "grad_norm": 0.06239910051226616,
+ "learning_rate": 8.097643097643098e-05,
+ "loss": 0.02715257555246353,
+ "step": 538
+ },
+ {
+ "epoch": 2.7240506329113923,
+ "grad_norm": 0.03662843257188797,
+ "learning_rate": 8.092031425364759e-05,
+ "loss": 0.024876421317458153,
+ "step": 539
+ },
+ {
+ "epoch": 2.729113924050633,
+ "grad_norm": 0.05869411304593086,
+ "learning_rate": 8.08641975308642e-05,
+ "loss": 0.022937750443816185,
+ "step": 540
+ },
+ {
+ "epoch": 2.7341772151898733,
+ "grad_norm": 0.07220412790775299,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02227093279361725,
+ "step": 541
+ },
+ {
+ "epoch": 2.739240506329114,
+ "grad_norm": 0.03881363570690155,
+ "learning_rate": 8.075196408529742e-05,
+ "loss": 0.020784813910722733,
+ "step": 542
+ },
+ {
+ "epoch": 2.7443037974683544,
+ "grad_norm": 0.04756273329257965,
+ "learning_rate": 8.069584736251403e-05,
+ "loss": 0.02334344945847988,
+ "step": 543
+ },
+ {
+ "epoch": 2.749367088607595,
+ "grad_norm": 0.05327540263533592,
+ "learning_rate": 8.063973063973065e-05,
+ "loss": 0.026313351467251778,
+ "step": 544
+ },
+ {
+ "epoch": 2.7544303797468355,
+ "grad_norm": 0.1605764925479889,
+ "learning_rate": 8.058361391694725e-05,
+ "loss": 0.02474561519920826,
+ "step": 545
+ },
+ {
+ "epoch": 2.759493670886076,
+ "grad_norm": 0.044486165046691895,
+ "learning_rate": 8.052749719416387e-05,
+ "loss": 0.023557808250188828,
+ "step": 546
+ },
+ {
+ "epoch": 2.7645569620253165,
+ "grad_norm": 0.04645116999745369,
+ "learning_rate": 8.047138047138047e-05,
+ "loss": 0.017340417951345444,
+ "step": 547
+ },
+ {
+ "epoch": 2.769620253164557,
+ "grad_norm": 0.04009381681680679,
+ "learning_rate": 8.041526374859708e-05,
+ "loss": 0.018324140459299088,
+ "step": 548
+ },
+ {
+ "epoch": 2.7746835443037976,
+ "grad_norm": 0.12476589530706406,
+ "learning_rate": 8.035914702581369e-05,
+ "loss": 0.023337965831160545,
+ "step": 549
+ },
+ {
+ "epoch": 2.779746835443038,
+ "grad_norm": 0.04257349297404289,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.021878249943256378,
+ "step": 550
+ },
+ {
+ "epoch": 2.7848101265822782,
+ "grad_norm": 0.044377341866493225,
+ "learning_rate": 8.024691358024692e-05,
+ "loss": 0.019643619656562805,
+ "step": 551
+ },
+ {
+ "epoch": 2.7898734177215188,
+ "grad_norm": 0.0801771879196167,
+ "learning_rate": 8.019079685746352e-05,
+ "loss": 0.021452955901622772,
+ "step": 552
+ },
+ {
+ "epoch": 2.7949367088607593,
+ "grad_norm": 0.04462383687496185,
+ "learning_rate": 8.013468013468015e-05,
+ "loss": 0.02363801747560501,
+ "step": 553
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.05768737941980362,
+ "learning_rate": 8.007856341189674e-05,
+ "loss": 0.03572218120098114,
+ "step": 554
+ },
+ {
+ "epoch": 2.8050632911392404,
+ "grad_norm": 0.03812364116311073,
+ "learning_rate": 8.002244668911337e-05,
+ "loss": 0.01964751072227955,
+ "step": 555
+ },
+ {
+ "epoch": 2.810126582278481,
+ "grad_norm": 0.03297588974237442,
+ "learning_rate": 7.996632996632996e-05,
+ "loss": 0.019139982759952545,
+ "step": 556
+ },
+ {
+ "epoch": 2.8151898734177214,
+ "grad_norm": 0.024627596139907837,
+ "learning_rate": 7.991021324354659e-05,
+ "loss": 0.021029513329267502,
+ "step": 557
+ },
+ {
+ "epoch": 2.820253164556962,
+ "grad_norm": 0.058927983045578,
+ "learning_rate": 7.985409652076318e-05,
+ "loss": 0.03308084234595299,
+ "step": 558
+ },
+ {
+ "epoch": 2.8253164556962025,
+ "grad_norm": 0.11811497062444687,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.028271127492189407,
+ "step": 559
+ },
+ {
+ "epoch": 2.830379746835443,
+ "grad_norm": 0.043665409088134766,
+ "learning_rate": 7.974186307519642e-05,
+ "loss": 0.02708129584789276,
+ "step": 560
+ },
+ {
+ "epoch": 2.8354430379746836,
+ "grad_norm": 0.034729309380054474,
+ "learning_rate": 7.968574635241303e-05,
+ "loss": 0.023845072835683823,
+ "step": 561
+ },
+ {
+ "epoch": 2.840506329113924,
+ "grad_norm": 0.028991155326366425,
+ "learning_rate": 7.962962962962964e-05,
+ "loss": 0.018426496535539627,
+ "step": 562
+ },
+ {
+ "epoch": 2.8455696202531646,
+ "grad_norm": 0.04660327732563019,
+ "learning_rate": 7.957351290684625e-05,
+ "loss": 0.02610144019126892,
+ "step": 563
+ },
+ {
+ "epoch": 2.850632911392405,
+ "grad_norm": 0.03947063535451889,
+ "learning_rate": 7.951739618406286e-05,
+ "loss": 0.025909483432769775,
+ "step": 564
+ },
+ {
+ "epoch": 2.8556962025316457,
+ "grad_norm": 0.06056501716375351,
+ "learning_rate": 7.946127946127947e-05,
+ "loss": 0.030405592173337936,
+ "step": 565
+ },
+ {
+ "epoch": 2.8607594936708862,
+ "grad_norm": 0.03398960456252098,
+ "learning_rate": 7.940516273849608e-05,
+ "loss": 0.02486085705459118,
+ "step": 566
+ },
+ {
+ "epoch": 2.8658227848101268,
+ "grad_norm": 0.03136906027793884,
+ "learning_rate": 7.934904601571269e-05,
+ "loss": 0.020573778077960014,
+ "step": 567
+ },
+ {
+ "epoch": 2.8708860759493673,
+ "grad_norm": 0.03404523804783821,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.021034879609942436,
+ "step": 568
+ },
+ {
+ "epoch": 2.875949367088608,
+ "grad_norm": 0.02937588468194008,
+ "learning_rate": 7.92368125701459e-05,
+ "loss": 0.02275373972952366,
+ "step": 569
+ },
+ {
+ "epoch": 2.8810126582278484,
+ "grad_norm": 0.03971172124147415,
+ "learning_rate": 7.918069584736252e-05,
+ "loss": 0.021558552980422974,
+ "step": 570
+ },
+ {
+ "epoch": 2.8860759493670884,
+ "grad_norm": 0.05636494606733322,
+ "learning_rate": 7.912457912457913e-05,
+ "loss": 0.025583568960428238,
+ "step": 571
+ },
+ {
+ "epoch": 2.891139240506329,
+ "grad_norm": 0.2013683319091797,
+ "learning_rate": 7.906846240179574e-05,
+ "loss": 0.025386696681380272,
+ "step": 572
+ },
+ {
+ "epoch": 2.8962025316455695,
+ "grad_norm": 0.05875328183174133,
+ "learning_rate": 7.901234567901235e-05,
+ "loss": 0.023778585717082024,
+ "step": 573
+ },
+ {
+ "epoch": 2.90126582278481,
+ "grad_norm": 0.031178263947367668,
+ "learning_rate": 7.895622895622896e-05,
+ "loss": 0.02130977436900139,
+ "step": 574
+ },
+ {
+ "epoch": 2.9063291139240506,
+ "grad_norm": 0.028125282377004623,
+ "learning_rate": 7.890011223344557e-05,
+ "loss": 0.023941578343510628,
+ "step": 575
+ },
+ {
+ "epoch": 2.911392405063291,
+ "grad_norm": 0.03701331466436386,
+ "learning_rate": 7.884399551066218e-05,
+ "loss": 0.01856887713074684,
+ "step": 576
+ },
+ {
+ "epoch": 2.9164556962025316,
+ "grad_norm": 0.05281993746757507,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.023393619805574417,
+ "step": 577
+ },
+ {
+ "epoch": 2.921518987341772,
+ "grad_norm": 0.03958812728524208,
+ "learning_rate": 7.873176206509541e-05,
+ "loss": 0.019871000200510025,
+ "step": 578
+ },
+ {
+ "epoch": 2.9265822784810127,
+ "grad_norm": 0.0439714752137661,
+ "learning_rate": 7.867564534231201e-05,
+ "loss": 0.025316016748547554,
+ "step": 579
+ },
+ {
+ "epoch": 2.9316455696202532,
+ "grad_norm": 0.03543296083807945,
+ "learning_rate": 7.861952861952863e-05,
+ "loss": 0.022549735382199287,
+ "step": 580
+ },
+ {
+ "epoch": 2.9367088607594938,
+ "grad_norm": 0.05503656715154648,
+ "learning_rate": 7.856341189674523e-05,
+ "loss": 0.02716357260942459,
+ "step": 581
+ },
+ {
+ "epoch": 2.9417721518987343,
+ "grad_norm": 0.03273561969399452,
+ "learning_rate": 7.850729517396185e-05,
+ "loss": 0.017606684938073158,
+ "step": 582
+ },
+ {
+ "epoch": 2.946835443037975,
+ "grad_norm": 0.04668378457427025,
+ "learning_rate": 7.845117845117845e-05,
+ "loss": 0.022529952228069305,
+ "step": 583
+ },
+ {
+ "epoch": 2.951898734177215,
+ "grad_norm": 0.034348756074905396,
+ "learning_rate": 7.839506172839507e-05,
+ "loss": 0.02549612522125244,
+ "step": 584
+ },
+ {
+ "epoch": 2.9569620253164555,
+ "grad_norm": 0.03485729172825813,
+ "learning_rate": 7.833894500561168e-05,
+ "loss": 0.019362375140190125,
+ "step": 585
+ },
+ {
+ "epoch": 2.962025316455696,
+ "grad_norm": 0.034695904701948166,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.023550841957330704,
+ "step": 586
+ },
+ {
+ "epoch": 2.9670886075949365,
+ "grad_norm": 0.02703205682337284,
+ "learning_rate": 7.82267115600449e-05,
+ "loss": 0.016860410571098328,
+ "step": 587
+ },
+ {
+ "epoch": 2.972151898734177,
+ "grad_norm": 0.0694100558757782,
+ "learning_rate": 7.817059483726151e-05,
+ "loss": 0.02669605240225792,
+ "step": 588
+ },
+ {
+ "epoch": 2.9772151898734176,
+ "grad_norm": 0.02641797810792923,
+ "learning_rate": 7.811447811447812e-05,
+ "loss": 0.019620027393102646,
+ "step": 589
+ },
+ {
+ "epoch": 2.982278481012658,
+ "grad_norm": 0.03643452376127243,
+ "learning_rate": 7.805836139169473e-05,
+ "loss": 0.018797604367136955,
+ "step": 590
+ },
+ {
+ "epoch": 2.9873417721518987,
+ "grad_norm": 0.04125158116221428,
+ "learning_rate": 7.800224466891134e-05,
+ "loss": 0.020387161523103714,
+ "step": 591
+ },
+ {
+ "epoch": 2.992405063291139,
+ "grad_norm": 0.037161167711019516,
+ "learning_rate": 7.794612794612795e-05,
+ "loss": 0.02484878897666931,
+ "step": 592
+ },
+ {
+ "epoch": 2.9974683544303797,
+ "grad_norm": 0.03352266550064087,
+ "learning_rate": 7.789001122334456e-05,
+ "loss": 0.022045889869332314,
+ "step": 593
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.07333379238843918,
+ "learning_rate": 7.783389450056117e-05,
+ "loss": 0.025806350633502007,
+ "step": 594
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 1980,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 3.782476673952768e+16,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-594/training_args.bin b/checkpoint-594/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ce6b9228ad6cf155da5af64a370f864d5fe04e56
--- /dev/null
+++ b/checkpoint-594/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3a4d7936dc7001e3baf6e9cead308b6188ace221538f9d436668bdf0b1d43a1
+size 5777
diff --git a/checkpoint-75/README.md b/checkpoint-75/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-75/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-75/adapter_config.json b/checkpoint-75/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ba16254b41e3c492f1b7c31471ce2298d3131394
--- /dev/null
+++ b/checkpoint-75/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "up_proj",
+ "v_proj",
+ "o_proj",
+ "gate_proj",
+ "k_proj",
+ "down_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-75/adapter_model.safetensors b/checkpoint-75/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..93d25fae6439892450955012d764a44778966c71
--- /dev/null
+++ b/checkpoint-75/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f890cc7be4e5170cf9adc36c5a07570449d88ad95055c0e6b7009c104e2842d5
+size 132187888
diff --git a/checkpoint-75/chat_template.jinja b/checkpoint-75/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-75/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-75/optimizer.pt b/checkpoint-75/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..9fcd5ed343c648f3827db9f458382b4bfbe664f1
--- /dev/null
+++ b/checkpoint-75/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df151db7be2325a2a4e82ad474a7ed0c062f1579d725d56f70740d81b81997c6
+size 67688197
diff --git a/checkpoint-75/rng_state.pth b/checkpoint-75/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..9a2f1c6718be043c8a9bbc32d83f6f90b082c4d8
--- /dev/null
+++ b/checkpoint-75/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:181c5f0270cf39930062ddfa3767a2481d0c360f120b11f8e25dbf533a1cdaba
+size 14645
diff --git a/checkpoint-75/scheduler.pt b/checkpoint-75/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..7270d4bcda2c6bdcd733264f4e6c0118f3472d56
--- /dev/null
+++ b/checkpoint-75/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:685c52591808b6e0d20e17ff131fd05058b3e7e907200e8e4d23e85e6fe162ab
+size 1465
diff --git a/checkpoint-75/tokenizer.json b/checkpoint-75/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-75/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-75/tokenizer_config.json b/checkpoint-75/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..be591e1c5a0155985c74bdaf62635b1c237cf2b6
--- /dev/null
+++ b/checkpoint-75/tokenizer_config.json
@@ -0,0 +1,233 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-75/trainer_state.json b/checkpoint-75/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..2d6f26b0a133db616876d69dade2c90471e1227a
--- /dev/null
+++ b/checkpoint-75/trainer_state.json
@@ -0,0 +1,559 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 3.0,
+ "eval_steps": 500,
+ "global_step": 75,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.04,
+ "grad_norm": 0.932260274887085,
+ "learning_rate": 0.0,
+ "loss": 1.2812691926956177,
+ "step": 1
+ },
+ {
+ "epoch": 0.08,
+ "grad_norm": 0.9258549213409424,
+ "learning_rate": 4.000000000000001e-06,
+ "loss": 1.2036092281341553,
+ "step": 2
+ },
+ {
+ "epoch": 0.12,
+ "grad_norm": 1.000679612159729,
+ "learning_rate": 8.000000000000001e-06,
+ "loss": 1.3914015293121338,
+ "step": 3
+ },
+ {
+ "epoch": 0.16,
+ "grad_norm": 1.4800903797149658,
+ "learning_rate": 1.2e-05,
+ "loss": 1.3741575479507446,
+ "step": 4
+ },
+ {
+ "epoch": 0.2,
+ "grad_norm": 1.1617510318756104,
+ "learning_rate": 1.6000000000000003e-05,
+ "loss": 1.3682291507720947,
+ "step": 5
+ },
+ {
+ "epoch": 0.24,
+ "grad_norm": 0.9225307703018188,
+ "learning_rate": 2e-05,
+ "loss": 1.2719311714172363,
+ "step": 6
+ },
+ {
+ "epoch": 0.28,
+ "grad_norm": 0.9139644503593445,
+ "learning_rate": 2.4e-05,
+ "loss": 1.264675259590149,
+ "step": 7
+ },
+ {
+ "epoch": 0.32,
+ "grad_norm": 1.1364861726760864,
+ "learning_rate": 2.8000000000000003e-05,
+ "loss": 1.4782798290252686,
+ "step": 8
+ },
+ {
+ "epoch": 0.36,
+ "grad_norm": 1.0468904972076416,
+ "learning_rate": 3.2000000000000005e-05,
+ "loss": 1.2322373390197754,
+ "step": 9
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 1.0078755617141724,
+ "learning_rate": 3.6e-05,
+ "loss": 1.2988958358764648,
+ "step": 10
+ },
+ {
+ "epoch": 0.44,
+ "grad_norm": 0.9352118372917175,
+ "learning_rate": 4e-05,
+ "loss": 1.1669442653656006,
+ "step": 11
+ },
+ {
+ "epoch": 0.48,
+ "grad_norm": 1.2074038982391357,
+ "learning_rate": 4.4000000000000006e-05,
+ "loss": 1.4638183116912842,
+ "step": 12
+ },
+ {
+ "epoch": 0.52,
+ "grad_norm": 0.9746712446212769,
+ "learning_rate": 4.8e-05,
+ "loss": 1.0547767877578735,
+ "step": 13
+ },
+ {
+ "epoch": 0.56,
+ "grad_norm": 0.8821120262145996,
+ "learning_rate": 5.2000000000000004e-05,
+ "loss": 1.1713128089904785,
+ "step": 14
+ },
+ {
+ "epoch": 0.6,
+ "grad_norm": 0.7680985927581787,
+ "learning_rate": 5.6000000000000006e-05,
+ "loss": 1.0929949283599854,
+ "step": 15
+ },
+ {
+ "epoch": 0.64,
+ "grad_norm": 0.6305053234100342,
+ "learning_rate": 6e-05,
+ "loss": 0.9419608116149902,
+ "step": 16
+ },
+ {
+ "epoch": 0.68,
+ "grad_norm": 0.5025432705879211,
+ "learning_rate": 6.400000000000001e-05,
+ "loss": 0.8088782429695129,
+ "step": 17
+ },
+ {
+ "epoch": 0.72,
+ "grad_norm": 0.43731531500816345,
+ "learning_rate": 6.800000000000001e-05,
+ "loss": 0.7616404294967651,
+ "step": 18
+ },
+ {
+ "epoch": 0.76,
+ "grad_norm": 0.37003830075263977,
+ "learning_rate": 7.2e-05,
+ "loss": 0.6315687894821167,
+ "step": 19
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.7235175967216492,
+ "learning_rate": 7.6e-05,
+ "loss": 0.6364619731903076,
+ "step": 20
+ },
+ {
+ "epoch": 0.84,
+ "grad_norm": 0.5470916628837585,
+ "learning_rate": 8e-05,
+ "loss": 0.8687893748283386,
+ "step": 21
+ },
+ {
+ "epoch": 0.88,
+ "grad_norm": 0.3039744794368744,
+ "learning_rate": 8.4e-05,
+ "loss": 0.4590837061405182,
+ "step": 22
+ },
+ {
+ "epoch": 0.92,
+ "grad_norm": 0.37839385867118835,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.5385509133338928,
+ "step": 23
+ },
+ {
+ "epoch": 0.96,
+ "grad_norm": 0.37729412317276,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.5465127229690552,
+ "step": 24
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.38146528601646423,
+ "learning_rate": 9.6e-05,
+ "loss": 0.509769082069397,
+ "step": 25
+ },
+ {
+ "epoch": 1.04,
+ "grad_norm": 0.36699211597442627,
+ "learning_rate": 0.0001,
+ "loss": 0.4363247752189636,
+ "step": 26
+ },
+ {
+ "epoch": 1.08,
+ "grad_norm": 0.3731786608695984,
+ "learning_rate": 9.955555555555556e-05,
+ "loss": 0.4297473430633545,
+ "step": 27
+ },
+ {
+ "epoch": 1.12,
+ "grad_norm": 0.3378784954547882,
+ "learning_rate": 9.911111111111112e-05,
+ "loss": 0.35973912477493286,
+ "step": 28
+ },
+ {
+ "epoch": 1.16,
+ "grad_norm": 0.36273664236068726,
+ "learning_rate": 9.866666666666668e-05,
+ "loss": 0.34903788566589355,
+ "step": 29
+ },
+ {
+ "epoch": 1.2,
+ "grad_norm": 0.362885981798172,
+ "learning_rate": 9.822222222222223e-05,
+ "loss": 0.3119792342185974,
+ "step": 30
+ },
+ {
+ "epoch": 1.24,
+ "grad_norm": 0.3790324032306671,
+ "learning_rate": 9.777777777777778e-05,
+ "loss": 0.29530155658721924,
+ "step": 31
+ },
+ {
+ "epoch": 1.28,
+ "grad_norm": 0.37333837151527405,
+ "learning_rate": 9.733333333333335e-05,
+ "loss": 0.2653456926345825,
+ "step": 32
+ },
+ {
+ "epoch": 1.32,
+ "grad_norm": 0.32163503766059875,
+ "learning_rate": 9.68888888888889e-05,
+ "loss": 0.19654956459999084,
+ "step": 33
+ },
+ {
+ "epoch": 1.3599999999999999,
+ "grad_norm": 0.5297159552574158,
+ "learning_rate": 9.644444444444445e-05,
+ "loss": 0.23580318689346313,
+ "step": 34
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.4474238455295563,
+ "learning_rate": 9.6e-05,
+ "loss": 0.18798796832561493,
+ "step": 35
+ },
+ {
+ "epoch": 1.44,
+ "grad_norm": 0.31346794962882996,
+ "learning_rate": 9.555555555555557e-05,
+ "loss": 0.12066371738910675,
+ "step": 36
+ },
+ {
+ "epoch": 1.48,
+ "grad_norm": 0.3099532723426819,
+ "learning_rate": 9.511111111111112e-05,
+ "loss": 0.08859007060527802,
+ "step": 37
+ },
+ {
+ "epoch": 1.52,
+ "grad_norm": 0.3490828275680542,
+ "learning_rate": 9.466666666666667e-05,
+ "loss": 0.07878822088241577,
+ "step": 38
+ },
+ {
+ "epoch": 1.56,
+ "grad_norm": 0.32395538687705994,
+ "learning_rate": 9.422222222222223e-05,
+ "loss": 0.06694570928812027,
+ "step": 39
+ },
+ {
+ "epoch": 1.6,
+ "grad_norm": 0.20870603621006012,
+ "learning_rate": 9.377777777777779e-05,
+ "loss": 0.04379018768668175,
+ "step": 40
+ },
+ {
+ "epoch": 1.6400000000000001,
+ "grad_norm": 0.3310009837150574,
+ "learning_rate": 9.333333333333334e-05,
+ "loss": 0.048647329211235046,
+ "step": 41
+ },
+ {
+ "epoch": 1.6800000000000002,
+ "grad_norm": 0.26949432492256165,
+ "learning_rate": 9.28888888888889e-05,
+ "loss": 0.039286017417907715,
+ "step": 42
+ },
+ {
+ "epoch": 1.72,
+ "grad_norm": 0.11029712855815887,
+ "learning_rate": 9.244444444444445e-05,
+ "loss": 0.029231950640678406,
+ "step": 43
+ },
+ {
+ "epoch": 1.76,
+ "grad_norm": 0.1476302146911621,
+ "learning_rate": 9.200000000000001e-05,
+ "loss": 0.027003085240721703,
+ "step": 44
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.18617521226406097,
+ "learning_rate": 9.155555555555557e-05,
+ "loss": 0.025106143206357956,
+ "step": 45
+ },
+ {
+ "epoch": 1.8399999999999999,
+ "grad_norm": 0.13198262453079224,
+ "learning_rate": 9.111111111111112e-05,
+ "loss": 0.025741657242178917,
+ "step": 46
+ },
+ {
+ "epoch": 1.88,
+ "grad_norm": 0.26712384819984436,
+ "learning_rate": 9.066666666666667e-05,
+ "loss": 0.035036977380514145,
+ "step": 47
+ },
+ {
+ "epoch": 1.92,
+ "grad_norm": 0.3569182753562927,
+ "learning_rate": 9.022222222222224e-05,
+ "loss": 0.04259534925222397,
+ "step": 48
+ },
+ {
+ "epoch": 1.96,
+ "grad_norm": 0.1843830794095993,
+ "learning_rate": 8.977777777777779e-05,
+ "loss": 0.03471647948026657,
+ "step": 49
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.1248057410120964,
+ "learning_rate": 8.933333333333334e-05,
+ "loss": 0.030936148017644882,
+ "step": 50
+ },
+ {
+ "epoch": 2.04,
+ "grad_norm": 0.12060711532831192,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.032452136278152466,
+ "step": 51
+ },
+ {
+ "epoch": 2.08,
+ "grad_norm": 0.2026030570268631,
+ "learning_rate": 8.844444444444445e-05,
+ "loss": 0.03268110007047653,
+ "step": 52
+ },
+ {
+ "epoch": 2.12,
+ "grad_norm": 0.21289987862110138,
+ "learning_rate": 8.800000000000001e-05,
+ "loss": 0.03406357392668724,
+ "step": 53
+ },
+ {
+ "epoch": 2.16,
+ "grad_norm": 0.14732478559017181,
+ "learning_rate": 8.755555555555556e-05,
+ "loss": 0.02936721034348011,
+ "step": 54
+ },
+ {
+ "epoch": 2.2,
+ "grad_norm": 0.10120426118373871,
+ "learning_rate": 8.711111111111112e-05,
+ "loss": 0.02511693350970745,
+ "step": 55
+ },
+ {
+ "epoch": 2.24,
+ "grad_norm": 0.08917918056249619,
+ "learning_rate": 8.666666666666667e-05,
+ "loss": 0.025877539068460464,
+ "step": 56
+ },
+ {
+ "epoch": 2.2800000000000002,
+ "grad_norm": 0.08735086023807526,
+ "learning_rate": 8.622222222222222e-05,
+ "loss": 0.02145460993051529,
+ "step": 57
+ },
+ {
+ "epoch": 2.32,
+ "grad_norm": 0.07835431396961212,
+ "learning_rate": 8.577777777777777e-05,
+ "loss": 0.021244943141937256,
+ "step": 58
+ },
+ {
+ "epoch": 2.36,
+ "grad_norm": 0.06953317672014236,
+ "learning_rate": 8.533333333333334e-05,
+ "loss": 0.02279437705874443,
+ "step": 59
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.0854259729385376,
+ "learning_rate": 8.488888888888889e-05,
+ "loss": 0.023704543709754944,
+ "step": 60
+ },
+ {
+ "epoch": 2.44,
+ "grad_norm": 0.17068363726139069,
+ "learning_rate": 8.444444444444444e-05,
+ "loss": 0.035272784531116486,
+ "step": 61
+ },
+ {
+ "epoch": 2.48,
+ "grad_norm": 0.11971863359212875,
+ "learning_rate": 8.4e-05,
+ "loss": 0.02707826718688011,
+ "step": 62
+ },
+ {
+ "epoch": 2.52,
+ "grad_norm": 0.05303095281124115,
+ "learning_rate": 8.355555555555556e-05,
+ "loss": 0.01696968823671341,
+ "step": 63
+ },
+ {
+ "epoch": 2.56,
+ "grad_norm": 0.06503961980342865,
+ "learning_rate": 8.311111111111111e-05,
+ "loss": 0.018413860350847244,
+ "step": 64
+ },
+ {
+ "epoch": 2.6,
+ "grad_norm": 0.05390244349837303,
+ "learning_rate": 8.266666666666667e-05,
+ "loss": 0.01641814410686493,
+ "step": 65
+ },
+ {
+ "epoch": 2.64,
+ "grad_norm": 0.07149611413478851,
+ "learning_rate": 8.222222222222222e-05,
+ "loss": 0.020658448338508606,
+ "step": 66
+ },
+ {
+ "epoch": 2.68,
+ "grad_norm": 0.09244706481695175,
+ "learning_rate": 8.177777777777778e-05,
+ "loss": 0.022394295781850815,
+ "step": 67
+ },
+ {
+ "epoch": 2.7199999999999998,
+ "grad_norm": 0.11381954699754715,
+ "learning_rate": 8.133333333333334e-05,
+ "loss": 0.028476765379309654,
+ "step": 68
+ },
+ {
+ "epoch": 2.76,
+ "grad_norm": 0.07354001700878143,
+ "learning_rate": 8.088888888888889e-05,
+ "loss": 0.019497834146022797,
+ "step": 69
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.06727641820907593,
+ "learning_rate": 8.044444444444444e-05,
+ "loss": 0.014356930740177631,
+ "step": 70
+ },
+ {
+ "epoch": 2.84,
+ "grad_norm": 0.07417713105678558,
+ "learning_rate": 8e-05,
+ "loss": 0.01823577657341957,
+ "step": 71
+ },
+ {
+ "epoch": 2.88,
+ "grad_norm": 0.09163317829370499,
+ "learning_rate": 7.955555555555556e-05,
+ "loss": 0.02139071188867092,
+ "step": 72
+ },
+ {
+ "epoch": 2.92,
+ "grad_norm": 0.08178975433111191,
+ "learning_rate": 7.911111111111111e-05,
+ "loss": 0.018335483968257904,
+ "step": 73
+ },
+ {
+ "epoch": 2.96,
+ "grad_norm": 0.08015220612287521,
+ "learning_rate": 7.866666666666666e-05,
+ "loss": 0.016001513227820396,
+ "step": 74
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.08509402722120285,
+ "learning_rate": 7.822222222222223e-05,
+ "loss": 0.017747700214385986,
+ "step": 75
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 250,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 3678978990735360.0,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-75/training_args.bin b/checkpoint-75/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..35e442d18e637826d55f008f1005835c57f9cbf8
--- /dev/null
+++ b/checkpoint-75/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:645419f21f4d6019a05370e7bbe3d7fc33fe5acc897c23264b7af2a7ed0d0af0
+size 5713
diff --git a/checkpoint-792/README.md b/checkpoint-792/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-792/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-792/adapter_config.json b/checkpoint-792/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..879d59d17cdb2aff2a9fcb7e4537a4f740bf19f5
--- /dev/null
+++ b/checkpoint-792/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "o_proj",
+ "up_proj",
+ "down_proj",
+ "v_proj",
+ "k_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-792/adapter_model.safetensors b/checkpoint-792/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..6b10a2c5a1c05a502c9ca0a41110dd3aea2fb04c
--- /dev/null
+++ b/checkpoint-792/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:13aef8995c745962afe97868c5afc3da6de0dfe34ec7afc489905dd637465ae9
+size 132187888
diff --git a/checkpoint-792/chat_template.jinja b/checkpoint-792/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-792/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-792/optimizer.pt b/checkpoint-792/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..2cead8b519004cb25a40be693d756494ab24055c
--- /dev/null
+++ b/checkpoint-792/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb3cc5cd71d2a5b9a3d149d9a0a051cd87019fb25c41bd170d852c34bd58e370
+size 67688645
diff --git a/checkpoint-792/rng_state.pth b/checkpoint-792/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..fead4304753e2900e172284781541c879e4507c4
--- /dev/null
+++ b/checkpoint-792/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d6d8fafcd1ee268414be5acf0366296af5b03d60871978712eac1979cb42d65
+size 14645
diff --git a/checkpoint-792/scheduler.pt b/checkpoint-792/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..f284056b8ec21a4b45171efaa3f7cd2337333685
--- /dev/null
+++ b/checkpoint-792/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cf977ba2a53e306c1709ebc992760c8119a698640d5ce64e1ef33ff2d72986f2
+size 1465
diff --git a/checkpoint-792/tokenizer.json b/checkpoint-792/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-792/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-792/tokenizer_config.json b/checkpoint-792/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-792/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-792/trainer_state.json b/checkpoint-792/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..76883820b165e8ca9c70851a551fd5070c3d26b2
--- /dev/null
+++ b/checkpoint-792/trainer_state.json
@@ -0,0 +1,5578 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 4.0,
+ "eval_steps": 500,
+ "global_step": 792,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.54137122631073,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279057860374451,
+ "learning_rate": 5.050505050505052e-07,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.7017749547958374,
+ "learning_rate": 1.0101010101010103e-06,
+ "loss": 1.0435928106307983,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6033008098602295,
+ "learning_rate": 1.5151515151515152e-06,
+ "loss": 0.8843490481376648,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5495544672012329,
+ "learning_rate": 2.0202020202020206e-06,
+ "loss": 0.8034592866897583,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.802371621131897,
+ "learning_rate": 2.5252525252525253e-06,
+ "loss": 1.1588364839553833,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8238587975502014,
+ "learning_rate": 3.0303030303030305e-06,
+ "loss": 1.228503942489624,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6073964238166809,
+ "learning_rate": 3.5353535353535352e-06,
+ "loss": 0.8989433646202087,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 0.6492345333099365,
+ "learning_rate": 4.040404040404041e-06,
+ "loss": 0.9615614414215088,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.6880183815956116,
+ "learning_rate": 4.5454545454545455e-06,
+ "loss": 0.9233697652816772,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.470304012298584,
+ "learning_rate": 5.050505050505051e-06,
+ "loss": 0.7186562418937683,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6361913681030273,
+ "learning_rate": 5.555555555555556e-06,
+ "loss": 0.9312829375267029,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5554782152175903,
+ "learning_rate": 6.060606060606061e-06,
+ "loss": 0.8529565334320068,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5414550304412842,
+ "learning_rate": 6.565656565656567e-06,
+ "loss": 0.8071130514144897,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9267164468765259,
+ "learning_rate": 7.0707070707070704e-06,
+ "loss": 1.3577998876571655,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.6104046106338501,
+ "learning_rate": 7.5757575757575764e-06,
+ "loss": 0.923499345779419,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.7241935133934021,
+ "learning_rate": 8.080808080808082e-06,
+ "loss": 1.0400190353393555,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.6026384830474854,
+ "learning_rate": 8.585858585858587e-06,
+ "loss": 0.8413939476013184,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.7690514922142029,
+ "learning_rate": 9.090909090909091e-06,
+ "loss": 1.0870859622955322,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.5940403342247009,
+ "learning_rate": 9.595959595959595e-06,
+ "loss": 0.8468416929244995,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.669230580329895,
+ "learning_rate": 1.0101010101010101e-05,
+ "loss": 0.9340983629226685,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.5750640034675598,
+ "learning_rate": 1.0606060606060607e-05,
+ "loss": 0.8230171799659729,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.6579262614250183,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.9293508529663086,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.5956451296806335,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.8316305875778198,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.7270558476448059,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.9129499197006226,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.7505611777305603,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 1.0138367414474487,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.6870062947273254,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.901283860206604,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.7679643630981445,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.9833810329437256,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.866938591003418,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.8958402872085571,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.8687500357627869,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 1.1289801597595215,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 4.008030891418457,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 1.2739044427871704,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.7689681053161621,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.8514111638069153,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.7880434393882751,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.8862775564193726,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.6183183789253235,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.7857811450958252,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.6437809467315674,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.7093011736869812,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.5481512546539307,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.7350327968597412,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.4838634729385376,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.6584650874137878,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.523994505405426,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.7211161851882935,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.6523379683494568,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.9044773578643799,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.4274725615978241,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.568337082862854,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.5060272812843323,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.7201821208000183,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.3760877251625061,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.5880123376846313,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.3715391457080841,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.5693179368972778,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.4332570731639862,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.7277271151542664,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.38201987743377686,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.6458995938301086,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.4358846843242645,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.7559939026832581,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.4566098749637604,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.7792297601699829,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.3864676356315613,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.6894873380661011,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.31187522411346436,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.545581579208374,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.3325943350791931,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.5917496085166931,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.6410307884216309,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.44281136989593506,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.36323168873786926,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.6426926851272583,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.31924113631248474,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.5482619404792786,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.3632371723651886,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.6188253164291382,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.375381201505661,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.5487836003303528,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.3163473606109619,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.5367064476013184,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.42646294832229614,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.41221165657043457,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.41622766852378845,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.5274936556816101,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.30204030871391296,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.44855833053588867,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.3178975582122803,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.4036139249801636,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.2893930673599243,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.39234185218811035,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.2833489775657654,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.37406405806541443,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.3216562867164612,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.3938276767730713,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.26721706986427307,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.30402088165283203,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.3702670931816101,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.30594947934150696,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.2632184326648712,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.2691727876663208,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.36898860335350037,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.33992528915405273,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.2976086735725403,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.27603086829185486,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.32201430201530457,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.25665703415870667,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.35001808404922485,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.24190445244312286,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.5106059908866882,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.3093336820602417,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.3261374831199646,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.18783289194107056,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.38757652044296265,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.19549766182899475,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.4723363518714905,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.15751558542251587,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.36796173453330994,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.14514681696891785,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.3855208456516266,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.14030519127845764,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.5906668305397034,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.1478388011455536,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.2658001780509949,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.13253600895404816,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.33554506301879883,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.12156252562999725,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.2643960416316986,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.1089208647608757,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.19129537045955658,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.08515600860118866,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.22168858349323273,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.09310197830200195,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.16676382720470428,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.07711787521839142,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.23891882598400116,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.09763285517692566,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.28446146845817566,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.08980057388544083,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.146108940243721,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.06573648750782013,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.2007656991481781,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.0699995830655098,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.3082621395587921,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.0885838121175766,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.1624963879585266,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.06935172528028488,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.1562737673521042,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.07147250324487686,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.1660323292016983,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.0672944188117981,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.21427564322948456,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.07051930576562881,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.16495929658412933,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.05429624393582344,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.1978198140859604,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.07144488394260406,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.15077605843544006,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.055798254907131195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.2806876301765442,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.06058178097009659,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.1219187006354332,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.05044667422771454,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10286939144134521,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.048498690128326416,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.12813609838485718,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.06252863258123398,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10565406829118729,
+ "learning_rate": 5e-05,
+ "loss": 0.051401108503341675,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.09147113561630249,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.047376491129398346,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.08723224699497223,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.039745647460222244,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.16071128845214844,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.058398712426424026,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.1370300054550171,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.05132289230823517,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.19449608027935028,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.06682188808917999,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.13085028529167175,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.049861155450344086,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.1768050193786621,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.055694688111543655,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.2819313704967499,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.062391363084316254,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.10738537460565567,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.05093343183398247,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.11759619414806366,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.044827841222286224,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.21941131353378296,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.05238347500562668,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.1697252243757248,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.04869212955236435,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.19701889157295227,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.04484856128692627,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.11779771000146866,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.04135368764400482,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.19823911786079407,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.05097956955432892,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.17355702817440033,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.05781872197985649,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.13029292225837708,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.041528262197971344,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.1292058229446411,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.0442211888730526,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10058800131082535,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.03813612461090088,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.22936487197875977,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.056090980768203735,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.13063806295394897,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.04347142577171326,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.167104110121727,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.04442849010229111,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.11942817270755768,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.03964124619960785,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.17906631529331207,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.04372458904981613,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.13760331273078918,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.03980286419391632,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.18043340742588043,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.05500294268131256,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.31386223435401917,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.04253799840807915,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.1428707093000412,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.047894880175590515,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.11010178923606873,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.04534825310111046,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.10444525629281998,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.041347943246364594,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.18076039850711823,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.04535853862762451,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.19424672424793243,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.05037602037191391,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.1457783728837967,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.047546930611133575,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.1189681887626648,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.03254905715584755,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.18887822329998016,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.04018670320510864,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.12217189371585846,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.03981504589319229,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.10866257548332214,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.04322533681988716,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.15904399752616882,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.04488902539014816,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.12598516047000885,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.04718853533267975,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.22092872858047485,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.03646199405193329,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.1717238426208496,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.04607801511883736,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.16268078982830048,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.04759417474269867,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.19621087610721588,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.051741112023591995,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.15362979471683502,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.04363569617271423,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.1404130607843399,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.045428819954395294,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.12262272834777832,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.03828439861536026,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.10626570880413055,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.03420639410614967,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.12686072289943695,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.03474457561969757,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.153709277510643,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.03174472972750664,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.13035084307193756,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.02982976846396923,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.12288431823253632,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.03588784486055374,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.19307470321655273,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.04750734567642212,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.0996781438589096,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.027098631486296654,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.16898290812969208,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.040447790175676346,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.10996036231517792,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.02525201067328453,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.16161896288394928,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.04199359938502312,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.1536172777414322,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.02943507581949234,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.18457260727882385,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.04093889892101288,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.11232347041368484,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.029609719291329384,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.19080978631973267,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.0357801653444767,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.16634301841259003,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02980419248342514,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.28601372241973877,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.032849978655576706,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.1359848529100418,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.0230826735496521,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.11285015195608139,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.02447221614420414,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.14712421596050262,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.022657420486211777,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.18246804177761078,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.035991013050079346,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.143621563911438,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.024444863200187683,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.12458691000938416,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.039701592177152634,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05614984780550003,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.029840555042028427,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.06097931042313576,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.027426715940237045,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.09883654862642288,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031690437346696854,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.0700431764125824,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.024079838767647743,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.05957406386733055,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.02303817868232727,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.14374858140945435,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.031183632090687752,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.09187919646501541,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.031176958233118057,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.0540630929172039,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.024949276819825172,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06875574588775635,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.02890622243285179,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.10081329196691513,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.03019360452890396,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.11833225935697556,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.020365778356790543,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.08700298517942429,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.027046984061598778,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.08660133928060532,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.027088070288300514,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.06983930617570877,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.019332535564899445,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.09463227540254593,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.02780212089419365,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.10251298546791077,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.026878856122493744,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.15963847935199738,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.03437665104866028,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.11342372000217438,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.02877948433160782,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.0937543660402298,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.02759186364710331,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.07137084752321243,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.02941890060901642,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.3511611819267273,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.024331524968147278,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.12344356626272202,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.0348694771528244,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.07144290208816528,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.021711278706789017,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.09835992008447647,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.03408564254641533,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.4978399872779846,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.03810017928481102,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.06314591318368912,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.0201277956366539,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.07504695653915405,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.025770913809537888,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.1028534397482872,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.02469150349497795,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.09341974556446075,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.036506302654743195,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09348680078983307,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02507903426885605,
+ "step": 198
+ },
+ {
+ "epoch": 1.0050632911392405,
+ "grad_norm": 0.06890113651752472,
+ "learning_rate": 0.0001,
+ "loss": 0.028374083340168,
+ "step": 199
+ },
+ {
+ "epoch": 1.010126582278481,
+ "grad_norm": 0.051041170954704285,
+ "learning_rate": 9.994388327721661e-05,
+ "loss": 0.022860335186123848,
+ "step": 200
+ },
+ {
+ "epoch": 1.0151898734177216,
+ "grad_norm": 0.10253743082284927,
+ "learning_rate": 9.988776655443322e-05,
+ "loss": 0.02864072285592556,
+ "step": 201
+ },
+ {
+ "epoch": 1.0202531645569621,
+ "grad_norm": 0.08295776695013046,
+ "learning_rate": 9.983164983164983e-05,
+ "loss": 0.0327395498752594,
+ "step": 202
+ },
+ {
+ "epoch": 1.0253164556962024,
+ "grad_norm": 0.07240694016218185,
+ "learning_rate": 9.977553310886645e-05,
+ "loss": 0.029215697199106216,
+ "step": 203
+ },
+ {
+ "epoch": 1.030379746835443,
+ "grad_norm": 0.0688897892832756,
+ "learning_rate": 9.971941638608306e-05,
+ "loss": 0.027594968676567078,
+ "step": 204
+ },
+ {
+ "epoch": 1.0354430379746835,
+ "grad_norm": 0.08463896065950394,
+ "learning_rate": 9.966329966329967e-05,
+ "loss": 0.02292536199092865,
+ "step": 205
+ },
+ {
+ "epoch": 1.040506329113924,
+ "grad_norm": 0.062013301998376846,
+ "learning_rate": 9.960718294051628e-05,
+ "loss": 0.023678191006183624,
+ "step": 206
+ },
+ {
+ "epoch": 1.0455696202531646,
+ "grad_norm": 0.08735264092683792,
+ "learning_rate": 9.955106621773289e-05,
+ "loss": 0.022060325369238853,
+ "step": 207
+ },
+ {
+ "epoch": 1.0506329113924051,
+ "grad_norm": 0.07634295523166656,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02764434739947319,
+ "step": 208
+ },
+ {
+ "epoch": 1.0556962025316456,
+ "grad_norm": 0.09735682606697083,
+ "learning_rate": 9.943883277216612e-05,
+ "loss": 0.03304428607225418,
+ "step": 209
+ },
+ {
+ "epoch": 1.0607594936708862,
+ "grad_norm": 0.06860044598579407,
+ "learning_rate": 9.938271604938272e-05,
+ "loss": 0.0340178906917572,
+ "step": 210
+ },
+ {
+ "epoch": 1.0658227848101265,
+ "grad_norm": 0.3715139627456665,
+ "learning_rate": 9.932659932659934e-05,
+ "loss": 0.02541016787290573,
+ "step": 211
+ },
+ {
+ "epoch": 1.070886075949367,
+ "grad_norm": 0.07673332840204239,
+ "learning_rate": 9.927048260381594e-05,
+ "loss": 0.025950253009796143,
+ "step": 212
+ },
+ {
+ "epoch": 1.0759493670886076,
+ "grad_norm": 0.07359500974416733,
+ "learning_rate": 9.921436588103256e-05,
+ "loss": 0.024356549605727196,
+ "step": 213
+ },
+ {
+ "epoch": 1.081012658227848,
+ "grad_norm": 0.07760954648256302,
+ "learning_rate": 9.915824915824916e-05,
+ "loss": 0.02338298037648201,
+ "step": 214
+ },
+ {
+ "epoch": 1.0860759493670886,
+ "grad_norm": 0.09183681756258011,
+ "learning_rate": 9.910213243546578e-05,
+ "loss": 0.020955465734004974,
+ "step": 215
+ },
+ {
+ "epoch": 1.0911392405063292,
+ "grad_norm": 0.21278677880764008,
+ "learning_rate": 9.904601571268239e-05,
+ "loss": 0.028164055198431015,
+ "step": 216
+ },
+ {
+ "epoch": 1.0962025316455697,
+ "grad_norm": 0.22437937557697296,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.03543347865343094,
+ "step": 217
+ },
+ {
+ "epoch": 1.1012658227848102,
+ "grad_norm": 0.08677598088979721,
+ "learning_rate": 9.893378226711561e-05,
+ "loss": 0.031265974044799805,
+ "step": 218
+ },
+ {
+ "epoch": 1.1063291139240505,
+ "grad_norm": 0.09595583379268646,
+ "learning_rate": 9.887766554433222e-05,
+ "loss": 0.02384507656097412,
+ "step": 219
+ },
+ {
+ "epoch": 1.111392405063291,
+ "grad_norm": 0.08256062865257263,
+ "learning_rate": 9.882154882154883e-05,
+ "loss": 0.022209012880921364,
+ "step": 220
+ },
+ {
+ "epoch": 1.1164556962025316,
+ "grad_norm": 0.07712455838918686,
+ "learning_rate": 9.876543209876543e-05,
+ "loss": 0.025278344750404358,
+ "step": 221
+ },
+ {
+ "epoch": 1.1215189873417721,
+ "grad_norm": 0.09704182296991348,
+ "learning_rate": 9.870931537598205e-05,
+ "loss": 0.024904735386371613,
+ "step": 222
+ },
+ {
+ "epoch": 1.1265822784810127,
+ "grad_norm": 0.09094078838825226,
+ "learning_rate": 9.865319865319865e-05,
+ "loss": 0.0280012097209692,
+ "step": 223
+ },
+ {
+ "epoch": 1.1316455696202532,
+ "grad_norm": 0.07607442885637283,
+ "learning_rate": 9.859708193041527e-05,
+ "loss": 0.026181645691394806,
+ "step": 224
+ },
+ {
+ "epoch": 1.1367088607594937,
+ "grad_norm": 0.06568697839975357,
+ "learning_rate": 9.854096520763188e-05,
+ "loss": 0.02883346565067768,
+ "step": 225
+ },
+ {
+ "epoch": 1.1417721518987343,
+ "grad_norm": 0.07192376255989075,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.027345171198248863,
+ "step": 226
+ },
+ {
+ "epoch": 1.1468354430379746,
+ "grad_norm": 0.1464017778635025,
+ "learning_rate": 9.84287317620651e-05,
+ "loss": 0.03213154152035713,
+ "step": 227
+ },
+ {
+ "epoch": 1.1518987341772151,
+ "grad_norm": 0.06766578555107117,
+ "learning_rate": 9.837261503928171e-05,
+ "loss": 0.02554963156580925,
+ "step": 228
+ },
+ {
+ "epoch": 1.1569620253164556,
+ "grad_norm": 0.09428609162569046,
+ "learning_rate": 9.831649831649832e-05,
+ "loss": 0.02484097331762314,
+ "step": 229
+ },
+ {
+ "epoch": 1.1620253164556962,
+ "grad_norm": 0.1648297905921936,
+ "learning_rate": 9.826038159371493e-05,
+ "loss": 0.03450813889503479,
+ "step": 230
+ },
+ {
+ "epoch": 1.1670886075949367,
+ "grad_norm": 0.06389904767274857,
+ "learning_rate": 9.820426487093154e-05,
+ "loss": 0.02957337349653244,
+ "step": 231
+ },
+ {
+ "epoch": 1.1721518987341772,
+ "grad_norm": 0.11517420411109924,
+ "learning_rate": 9.814814814814815e-05,
+ "loss": 0.024299729615449905,
+ "step": 232
+ },
+ {
+ "epoch": 1.1772151898734178,
+ "grad_norm": 0.06960142403841019,
+ "learning_rate": 9.809203142536476e-05,
+ "loss": 0.025762220844626427,
+ "step": 233
+ },
+ {
+ "epoch": 1.1822784810126583,
+ "grad_norm": 0.11682946234941483,
+ "learning_rate": 9.803591470258137e-05,
+ "loss": 0.02457268163561821,
+ "step": 234
+ },
+ {
+ "epoch": 1.1873417721518988,
+ "grad_norm": 0.07964848726987839,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.027285631746053696,
+ "step": 235
+ },
+ {
+ "epoch": 1.1924050632911392,
+ "grad_norm": 0.053044773638248444,
+ "learning_rate": 9.79236812570146e-05,
+ "loss": 0.020997609943151474,
+ "step": 236
+ },
+ {
+ "epoch": 1.1974683544303797,
+ "grad_norm": 0.13531149923801422,
+ "learning_rate": 9.78675645342312e-05,
+ "loss": 0.02474522590637207,
+ "step": 237
+ },
+ {
+ "epoch": 1.2025316455696202,
+ "grad_norm": 0.0774424746632576,
+ "learning_rate": 9.781144781144782e-05,
+ "loss": 0.025272740051150322,
+ "step": 238
+ },
+ {
+ "epoch": 1.2075949367088608,
+ "grad_norm": 0.042708419263362885,
+ "learning_rate": 9.775533108866442e-05,
+ "loss": 0.019522909075021744,
+ "step": 239
+ },
+ {
+ "epoch": 1.2126582278481013,
+ "grad_norm": 0.10364090651273727,
+ "learning_rate": 9.769921436588104e-05,
+ "loss": 0.02728935517370701,
+ "step": 240
+ },
+ {
+ "epoch": 1.2177215189873418,
+ "grad_norm": 0.0756702646613121,
+ "learning_rate": 9.764309764309764e-05,
+ "loss": 0.02659972943365574,
+ "step": 241
+ },
+ {
+ "epoch": 1.2227848101265824,
+ "grad_norm": 0.07232004404067993,
+ "learning_rate": 9.758698092031426e-05,
+ "loss": 0.017723949626088142,
+ "step": 242
+ },
+ {
+ "epoch": 1.2278481012658227,
+ "grad_norm": 0.058345306664705276,
+ "learning_rate": 9.753086419753087e-05,
+ "loss": 0.019348861649632454,
+ "step": 243
+ },
+ {
+ "epoch": 1.2329113924050632,
+ "grad_norm": 0.14832371473312378,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.03227488696575165,
+ "step": 244
+ },
+ {
+ "epoch": 1.2379746835443037,
+ "grad_norm": 0.05343412607908249,
+ "learning_rate": 9.74186307519641e-05,
+ "loss": 0.0210015457123518,
+ "step": 245
+ },
+ {
+ "epoch": 1.2430379746835443,
+ "grad_norm": 0.054104797542095184,
+ "learning_rate": 9.736251402918069e-05,
+ "loss": 0.02430287003517151,
+ "step": 246
+ },
+ {
+ "epoch": 1.2481012658227848,
+ "grad_norm": 0.11686044931411743,
+ "learning_rate": 9.730639730639732e-05,
+ "loss": 0.029372017830610275,
+ "step": 247
+ },
+ {
+ "epoch": 1.2531645569620253,
+ "grad_norm": 0.05970177799463272,
+ "learning_rate": 9.725028058361391e-05,
+ "loss": 0.024995045736432076,
+ "step": 248
+ },
+ {
+ "epoch": 1.2582278481012659,
+ "grad_norm": 0.06506923586130142,
+ "learning_rate": 9.719416386083054e-05,
+ "loss": 0.024779727682471275,
+ "step": 249
+ },
+ {
+ "epoch": 1.2632911392405064,
+ "grad_norm": 0.12711220979690552,
+ "learning_rate": 9.713804713804715e-05,
+ "loss": 0.026196476072072983,
+ "step": 250
+ },
+ {
+ "epoch": 1.268354430379747,
+ "grad_norm": 0.056023694574832916,
+ "learning_rate": 9.708193041526376e-05,
+ "loss": 0.01813146471977234,
+ "step": 251
+ },
+ {
+ "epoch": 1.2734177215189875,
+ "grad_norm": 0.04508040472865105,
+ "learning_rate": 9.702581369248037e-05,
+ "loss": 0.019225183874368668,
+ "step": 252
+ },
+ {
+ "epoch": 1.2784810126582278,
+ "grad_norm": 0.10354425758123398,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.02940209209918976,
+ "step": 253
+ },
+ {
+ "epoch": 1.2835443037974683,
+ "grad_norm": 0.06974297761917114,
+ "learning_rate": 9.691358024691359e-05,
+ "loss": 0.02482295036315918,
+ "step": 254
+ },
+ {
+ "epoch": 1.2886075949367088,
+ "grad_norm": 0.06940010190010071,
+ "learning_rate": 9.68574635241302e-05,
+ "loss": 0.020605089142918587,
+ "step": 255
+ },
+ {
+ "epoch": 1.2936708860759494,
+ "grad_norm": 0.09167850762605667,
+ "learning_rate": 9.68013468013468e-05,
+ "loss": 0.02429921180009842,
+ "step": 256
+ },
+ {
+ "epoch": 1.29873417721519,
+ "grad_norm": 0.048866868019104004,
+ "learning_rate": 9.674523007856342e-05,
+ "loss": 0.021776504814624786,
+ "step": 257
+ },
+ {
+ "epoch": 1.3037974683544304,
+ "grad_norm": 0.06977155059576035,
+ "learning_rate": 9.668911335578003e-05,
+ "loss": 0.02758147194981575,
+ "step": 258
+ },
+ {
+ "epoch": 1.3088607594936708,
+ "grad_norm": 0.17602303624153137,
+ "learning_rate": 9.663299663299664e-05,
+ "loss": 0.026518259197473526,
+ "step": 259
+ },
+ {
+ "epoch": 1.3139240506329113,
+ "grad_norm": 0.08011946082115173,
+ "learning_rate": 9.657687991021325e-05,
+ "loss": 0.026240577921271324,
+ "step": 260
+ },
+ {
+ "epoch": 1.3189873417721518,
+ "grad_norm": 0.06296376883983612,
+ "learning_rate": 9.652076318742987e-05,
+ "loss": 0.03159455955028534,
+ "step": 261
+ },
+ {
+ "epoch": 1.3240506329113924,
+ "grad_norm": 0.04424722492694855,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.024151435121893883,
+ "step": 262
+ },
+ {
+ "epoch": 1.3291139240506329,
+ "grad_norm": 0.045779623091220856,
+ "learning_rate": 9.640852974186309e-05,
+ "loss": 0.018655993044376373,
+ "step": 263
+ },
+ {
+ "epoch": 1.3341772151898734,
+ "grad_norm": 0.06355931609869003,
+ "learning_rate": 9.635241301907969e-05,
+ "loss": 0.01999380812048912,
+ "step": 264
+ },
+ {
+ "epoch": 1.339240506329114,
+ "grad_norm": 0.04477616026997566,
+ "learning_rate": 9.62962962962963e-05,
+ "loss": 0.021614115685224533,
+ "step": 265
+ },
+ {
+ "epoch": 1.3443037974683545,
+ "grad_norm": 0.05851180478930473,
+ "learning_rate": 9.62401795735129e-05,
+ "loss": 0.023495908826589584,
+ "step": 266
+ },
+ {
+ "epoch": 1.349367088607595,
+ "grad_norm": 0.04724022373557091,
+ "learning_rate": 9.618406285072952e-05,
+ "loss": 0.02053767442703247,
+ "step": 267
+ },
+ {
+ "epoch": 1.3544303797468356,
+ "grad_norm": 0.12757639586925507,
+ "learning_rate": 9.612794612794614e-05,
+ "loss": 0.030612681061029434,
+ "step": 268
+ },
+ {
+ "epoch": 1.3594936708860759,
+ "grad_norm": 0.18316853046417236,
+ "learning_rate": 9.607182940516274e-05,
+ "loss": 0.039485104382038116,
+ "step": 269
+ },
+ {
+ "epoch": 1.3645569620253164,
+ "grad_norm": 0.09149223566055298,
+ "learning_rate": 9.601571268237936e-05,
+ "loss": 0.031156456097960472,
+ "step": 270
+ },
+ {
+ "epoch": 1.369620253164557,
+ "grad_norm": 0.07885908335447311,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.026395633816719055,
+ "step": 271
+ },
+ {
+ "epoch": 1.3746835443037975,
+ "grad_norm": 0.0984397754073143,
+ "learning_rate": 9.590347923681258e-05,
+ "loss": 0.02990398183465004,
+ "step": 272
+ },
+ {
+ "epoch": 1.379746835443038,
+ "grad_norm": 0.08566205203533173,
+ "learning_rate": 9.584736251402918e-05,
+ "loss": 0.024353420361876488,
+ "step": 273
+ },
+ {
+ "epoch": 1.3848101265822785,
+ "grad_norm": 0.16623689234256744,
+ "learning_rate": 9.57912457912458e-05,
+ "loss": 0.03626095876097679,
+ "step": 274
+ },
+ {
+ "epoch": 1.389873417721519,
+ "grad_norm": 0.07134243100881577,
+ "learning_rate": 9.57351290684624e-05,
+ "loss": 0.026036158204078674,
+ "step": 275
+ },
+ {
+ "epoch": 1.3949367088607594,
+ "grad_norm": 0.07753578573465347,
+ "learning_rate": 9.567901234567902e-05,
+ "loss": 0.03266923502087593,
+ "step": 276
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.07113673537969589,
+ "learning_rate": 9.562289562289563e-05,
+ "loss": 0.024128902703523636,
+ "step": 277
+ },
+ {
+ "epoch": 1.4050632911392404,
+ "grad_norm": 0.0954187884926796,
+ "learning_rate": 9.556677890011224e-05,
+ "loss": 0.03310588374733925,
+ "step": 278
+ },
+ {
+ "epoch": 1.410126582278481,
+ "grad_norm": 0.08755122870206833,
+ "learning_rate": 9.551066217732885e-05,
+ "loss": 0.030977975577116013,
+ "step": 279
+ },
+ {
+ "epoch": 1.4151898734177215,
+ "grad_norm": 0.06839736551046371,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.029557062312960625,
+ "step": 280
+ },
+ {
+ "epoch": 1.420253164556962,
+ "grad_norm": 0.051050763577222824,
+ "learning_rate": 9.539842873176207e-05,
+ "loss": 0.022091392427682877,
+ "step": 281
+ },
+ {
+ "epoch": 1.4253164556962026,
+ "grad_norm": 0.05898132920265198,
+ "learning_rate": 9.534231200897868e-05,
+ "loss": 0.024804875254631042,
+ "step": 282
+ },
+ {
+ "epoch": 1.4303797468354431,
+ "grad_norm": 0.04517035931348801,
+ "learning_rate": 9.528619528619529e-05,
+ "loss": 0.024234894663095474,
+ "step": 283
+ },
+ {
+ "epoch": 1.4354430379746836,
+ "grad_norm": 0.05625253543257713,
+ "learning_rate": 9.52300785634119e-05,
+ "loss": 0.02342807501554489,
+ "step": 284
+ },
+ {
+ "epoch": 1.4405063291139242,
+ "grad_norm": 0.047006960958242416,
+ "learning_rate": 9.517396184062851e-05,
+ "loss": 0.021819880232214928,
+ "step": 285
+ },
+ {
+ "epoch": 1.4455696202531645,
+ "grad_norm": 0.051774390041828156,
+ "learning_rate": 9.511784511784512e-05,
+ "loss": 0.020575571805238724,
+ "step": 286
+ },
+ {
+ "epoch": 1.450632911392405,
+ "grad_norm": 0.0684620812535286,
+ "learning_rate": 9.506172839506173e-05,
+ "loss": 0.025043494999408722,
+ "step": 287
+ },
+ {
+ "epoch": 1.4556962025316456,
+ "grad_norm": 0.05345604941248894,
+ "learning_rate": 9.500561167227834e-05,
+ "loss": 0.020829960703849792,
+ "step": 288
+ },
+ {
+ "epoch": 1.460759493670886,
+ "grad_norm": 0.07588688284158707,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.02842051535844803,
+ "step": 289
+ },
+ {
+ "epoch": 1.4658227848101266,
+ "grad_norm": 0.0371188148856163,
+ "learning_rate": 9.489337822671156e-05,
+ "loss": 0.020213091745972633,
+ "step": 290
+ },
+ {
+ "epoch": 1.4708860759493672,
+ "grad_norm": 0.03922685980796814,
+ "learning_rate": 9.483726150392817e-05,
+ "loss": 0.020665431395173073,
+ "step": 291
+ },
+ {
+ "epoch": 1.4759493670886075,
+ "grad_norm": 0.10213606059551239,
+ "learning_rate": 9.478114478114478e-05,
+ "loss": 0.024979032576084137,
+ "step": 292
+ },
+ {
+ "epoch": 1.481012658227848,
+ "grad_norm": 0.04574638605117798,
+ "learning_rate": 9.472502805836139e-05,
+ "loss": 0.0215127132833004,
+ "step": 293
+ },
+ {
+ "epoch": 1.4860759493670885,
+ "grad_norm": 0.0829704999923706,
+ "learning_rate": 9.4668911335578e-05,
+ "loss": 0.023608818650245667,
+ "step": 294
+ },
+ {
+ "epoch": 1.491139240506329,
+ "grad_norm": 0.036335594952106476,
+ "learning_rate": 9.461279461279463e-05,
+ "loss": 0.01993970200419426,
+ "step": 295
+ },
+ {
+ "epoch": 1.4962025316455696,
+ "grad_norm": 0.08291227370500565,
+ "learning_rate": 9.455667789001122e-05,
+ "loss": 0.02223093807697296,
+ "step": 296
+ },
+ {
+ "epoch": 1.5012658227848101,
+ "grad_norm": 0.048284996300935745,
+ "learning_rate": 9.450056116722785e-05,
+ "loss": 0.019440360367298126,
+ "step": 297
+ },
+ {
+ "epoch": 1.5063291139240507,
+ "grad_norm": 0.25126877427101135,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.030357610434293747,
+ "step": 298
+ },
+ {
+ "epoch": 1.5113924050632912,
+ "grad_norm": 0.08812759816646576,
+ "learning_rate": 9.438832772166107e-05,
+ "loss": 0.025407828390598297,
+ "step": 299
+ },
+ {
+ "epoch": 1.5164556962025317,
+ "grad_norm": 0.09417422115802765,
+ "learning_rate": 9.433221099887766e-05,
+ "loss": 0.028768496587872505,
+ "step": 300
+ },
+ {
+ "epoch": 1.5215189873417723,
+ "grad_norm": 0.10820329934358597,
+ "learning_rate": 9.427609427609429e-05,
+ "loss": 0.03250410035252571,
+ "step": 301
+ },
+ {
+ "epoch": 1.5265822784810128,
+ "grad_norm": 0.06633433699607849,
+ "learning_rate": 9.42199775533109e-05,
+ "loss": 0.019816454499959946,
+ "step": 302
+ },
+ {
+ "epoch": 1.5316455696202531,
+ "grad_norm": 0.05545264482498169,
+ "learning_rate": 9.41638608305275e-05,
+ "loss": 0.020919661968946457,
+ "step": 303
+ },
+ {
+ "epoch": 1.5367088607594936,
+ "grad_norm": 0.08201726526021957,
+ "learning_rate": 9.410774410774412e-05,
+ "loss": 0.0309453085064888,
+ "step": 304
+ },
+ {
+ "epoch": 1.5417721518987342,
+ "grad_norm": 0.047229036688804626,
+ "learning_rate": 9.405162738496073e-05,
+ "loss": 0.02079029008746147,
+ "step": 305
+ },
+ {
+ "epoch": 1.5468354430379747,
+ "grad_norm": 0.04493536427617073,
+ "learning_rate": 9.399551066217734e-05,
+ "loss": 0.020319776609539986,
+ "step": 306
+ },
+ {
+ "epoch": 1.5518987341772152,
+ "grad_norm": 0.07935966551303864,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.03144281357526779,
+ "step": 307
+ },
+ {
+ "epoch": 1.5569620253164556,
+ "grad_norm": 0.10108500719070435,
+ "learning_rate": 9.388327721661056e-05,
+ "loss": 0.029823362827301025,
+ "step": 308
+ },
+ {
+ "epoch": 1.562025316455696,
+ "grad_norm": 0.05187584087252617,
+ "learning_rate": 9.382716049382717e-05,
+ "loss": 0.029090257361531258,
+ "step": 309
+ },
+ {
+ "epoch": 1.5670886075949366,
+ "grad_norm": 0.09131086617708206,
+ "learning_rate": 9.377104377104378e-05,
+ "loss": 0.020090997219085693,
+ "step": 310
+ },
+ {
+ "epoch": 1.5721518987341772,
+ "grad_norm": 0.06874370574951172,
+ "learning_rate": 9.371492704826039e-05,
+ "loss": 0.022118568420410156,
+ "step": 311
+ },
+ {
+ "epoch": 1.5772151898734177,
+ "grad_norm": 0.07480651885271072,
+ "learning_rate": 9.3658810325477e-05,
+ "loss": 0.030924849212169647,
+ "step": 312
+ },
+ {
+ "epoch": 1.5822784810126582,
+ "grad_norm": 0.04049983248114586,
+ "learning_rate": 9.36026936026936e-05,
+ "loss": 0.02086808532476425,
+ "step": 313
+ },
+ {
+ "epoch": 1.5873417721518988,
+ "grad_norm": 0.037067580968141556,
+ "learning_rate": 9.354657687991022e-05,
+ "loss": 0.022019919008016586,
+ "step": 314
+ },
+ {
+ "epoch": 1.5924050632911393,
+ "grad_norm": 0.0599038302898407,
+ "learning_rate": 9.349046015712683e-05,
+ "loss": 0.02305535599589348,
+ "step": 315
+ },
+ {
+ "epoch": 1.5974683544303798,
+ "grad_norm": 0.056727997958660126,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.025360889732837677,
+ "step": 316
+ },
+ {
+ "epoch": 1.6025316455696204,
+ "grad_norm": 0.06659650057554245,
+ "learning_rate": 9.337822671156005e-05,
+ "loss": 0.02528395690023899,
+ "step": 317
+ },
+ {
+ "epoch": 1.6075949367088609,
+ "grad_norm": 0.06213822215795517,
+ "learning_rate": 9.332210998877666e-05,
+ "loss": 0.028841618448495865,
+ "step": 318
+ },
+ {
+ "epoch": 1.6126582278481014,
+ "grad_norm": 0.03757556155323982,
+ "learning_rate": 9.326599326599327e-05,
+ "loss": 0.02282278798520565,
+ "step": 319
+ },
+ {
+ "epoch": 1.6177215189873417,
+ "grad_norm": 0.061945486813783646,
+ "learning_rate": 9.320987654320989e-05,
+ "loss": 0.02733437530696392,
+ "step": 320
+ },
+ {
+ "epoch": 1.6227848101265823,
+ "grad_norm": 0.07904566079378128,
+ "learning_rate": 9.315375982042649e-05,
+ "loss": 0.02630138024687767,
+ "step": 321
+ },
+ {
+ "epoch": 1.6278481012658228,
+ "grad_norm": 0.07157077640295029,
+ "learning_rate": 9.309764309764311e-05,
+ "loss": 0.023403439670801163,
+ "step": 322
+ },
+ {
+ "epoch": 1.6329113924050633,
+ "grad_norm": 0.03518318012356758,
+ "learning_rate": 9.304152637485971e-05,
+ "loss": 0.021487422287464142,
+ "step": 323
+ },
+ {
+ "epoch": 1.6379746835443036,
+ "grad_norm": 0.11178159713745117,
+ "learning_rate": 9.298540965207633e-05,
+ "loss": 0.03142111003398895,
+ "step": 324
+ },
+ {
+ "epoch": 1.6430379746835442,
+ "grad_norm": 0.05046987161040306,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.020960725843906403,
+ "step": 325
+ },
+ {
+ "epoch": 1.6481012658227847,
+ "grad_norm": 0.05356504023075104,
+ "learning_rate": 9.287317620650955e-05,
+ "loss": 0.01934133842587471,
+ "step": 326
+ },
+ {
+ "epoch": 1.6531645569620252,
+ "grad_norm": 0.07995260506868362,
+ "learning_rate": 9.281705948372615e-05,
+ "loss": 0.0248265378177166,
+ "step": 327
+ },
+ {
+ "epoch": 1.6582278481012658,
+ "grad_norm": 0.08783978968858719,
+ "learning_rate": 9.276094276094277e-05,
+ "loss": 0.024171534925699234,
+ "step": 328
+ },
+ {
+ "epoch": 1.6632911392405063,
+ "grad_norm": 0.043143950402736664,
+ "learning_rate": 9.270482603815938e-05,
+ "loss": 0.021554211154580116,
+ "step": 329
+ },
+ {
+ "epoch": 1.6683544303797468,
+ "grad_norm": 0.05635169520974159,
+ "learning_rate": 9.264870931537598e-05,
+ "loss": 0.025942442938685417,
+ "step": 330
+ },
+ {
+ "epoch": 1.6734177215189874,
+ "grad_norm": 0.042691316455602646,
+ "learning_rate": 9.25925925925926e-05,
+ "loss": 0.021898634731769562,
+ "step": 331
+ },
+ {
+ "epoch": 1.678481012658228,
+ "grad_norm": 0.07666946202516556,
+ "learning_rate": 9.25364758698092e-05,
+ "loss": 0.02928568609058857,
+ "step": 332
+ },
+ {
+ "epoch": 1.6835443037974684,
+ "grad_norm": 0.04230545833706856,
+ "learning_rate": 9.248035914702582e-05,
+ "loss": 0.020812246948480606,
+ "step": 333
+ },
+ {
+ "epoch": 1.688607594936709,
+ "grad_norm": 0.1077270656824112,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.025568369776010513,
+ "step": 334
+ },
+ {
+ "epoch": 1.6936708860759495,
+ "grad_norm": 0.04277936369180679,
+ "learning_rate": 9.236812570145904e-05,
+ "loss": 0.018935058265924454,
+ "step": 335
+ },
+ {
+ "epoch": 1.6987341772151898,
+ "grad_norm": 0.04454135522246361,
+ "learning_rate": 9.231200897867565e-05,
+ "loss": 0.01933746598660946,
+ "step": 336
+ },
+ {
+ "epoch": 1.7037974683544304,
+ "grad_norm": 0.0674893856048584,
+ "learning_rate": 9.225589225589226e-05,
+ "loss": 0.021518435329198837,
+ "step": 337
+ },
+ {
+ "epoch": 1.7088607594936709,
+ "grad_norm": 0.06007042154669762,
+ "learning_rate": 9.219977553310887e-05,
+ "loss": 0.019427424296736717,
+ "step": 338
+ },
+ {
+ "epoch": 1.7139240506329114,
+ "grad_norm": 0.09564489126205444,
+ "learning_rate": 9.214365881032548e-05,
+ "loss": 0.027250545099377632,
+ "step": 339
+ },
+ {
+ "epoch": 1.7189873417721517,
+ "grad_norm": 0.053655482828617096,
+ "learning_rate": 9.208754208754209e-05,
+ "loss": 0.020125389099121094,
+ "step": 340
+ },
+ {
+ "epoch": 1.7240506329113923,
+ "grad_norm": 0.038283221423625946,
+ "learning_rate": 9.20314253647587e-05,
+ "loss": 0.017948098480701447,
+ "step": 341
+ },
+ {
+ "epoch": 1.7291139240506328,
+ "grad_norm": 0.04724166542291641,
+ "learning_rate": 9.197530864197531e-05,
+ "loss": 0.02523602545261383,
+ "step": 342
+ },
+ {
+ "epoch": 1.7341772151898733,
+ "grad_norm": 0.10365224629640579,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.035696640610694885,
+ "step": 343
+ },
+ {
+ "epoch": 1.7392405063291139,
+ "grad_norm": 0.07362233102321625,
+ "learning_rate": 9.186307519640853e-05,
+ "loss": 0.026104427874088287,
+ "step": 344
+ },
+ {
+ "epoch": 1.7443037974683544,
+ "grad_norm": 0.05976846069097519,
+ "learning_rate": 9.180695847362514e-05,
+ "loss": 0.026634451001882553,
+ "step": 345
+ },
+ {
+ "epoch": 1.749367088607595,
+ "grad_norm": 0.07387223839759827,
+ "learning_rate": 9.175084175084175e-05,
+ "loss": 0.025733446702361107,
+ "step": 346
+ },
+ {
+ "epoch": 1.7544303797468355,
+ "grad_norm": 0.04727378115057945,
+ "learning_rate": 9.169472502805838e-05,
+ "loss": 0.01889938861131668,
+ "step": 347
+ },
+ {
+ "epoch": 1.759493670886076,
+ "grad_norm": 0.10614906996488571,
+ "learning_rate": 9.163860830527497e-05,
+ "loss": 0.02275039628148079,
+ "step": 348
+ },
+ {
+ "epoch": 1.7645569620253165,
+ "grad_norm": 0.04877970367670059,
+ "learning_rate": 9.15824915824916e-05,
+ "loss": 0.022580452263355255,
+ "step": 349
+ },
+ {
+ "epoch": 1.769620253164557,
+ "grad_norm": 0.18825598061084747,
+ "learning_rate": 9.152637485970819e-05,
+ "loss": 0.03054988384246826,
+ "step": 350
+ },
+ {
+ "epoch": 1.7746835443037976,
+ "grad_norm": 0.06315254420042038,
+ "learning_rate": 9.147025813692482e-05,
+ "loss": 0.025584843009710312,
+ "step": 351
+ },
+ {
+ "epoch": 1.7797468354430381,
+ "grad_norm": 0.04519108682870865,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.0214737206697464,
+ "step": 352
+ },
+ {
+ "epoch": 1.7848101265822784,
+ "grad_norm": 0.07401937246322632,
+ "learning_rate": 9.135802469135802e-05,
+ "loss": 0.02984039857983589,
+ "step": 353
+ },
+ {
+ "epoch": 1.789873417721519,
+ "grad_norm": 0.05138625577092171,
+ "learning_rate": 9.130190796857465e-05,
+ "loss": 0.024221282452344894,
+ "step": 354
+ },
+ {
+ "epoch": 1.7949367088607595,
+ "grad_norm": 0.10182037204504013,
+ "learning_rate": 9.124579124579124e-05,
+ "loss": 0.0237903892993927,
+ "step": 355
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.056737013161182404,
+ "learning_rate": 9.118967452300787e-05,
+ "loss": 0.026514701545238495,
+ "step": 356
+ },
+ {
+ "epoch": 1.8050632911392404,
+ "grad_norm": 0.04826146364212036,
+ "learning_rate": 9.113355780022446e-05,
+ "loss": 0.021808844059705734,
+ "step": 357
+ },
+ {
+ "epoch": 1.810126582278481,
+ "grad_norm": 0.07099983841180801,
+ "learning_rate": 9.107744107744109e-05,
+ "loss": 0.028031716123223305,
+ "step": 358
+ },
+ {
+ "epoch": 1.8151898734177214,
+ "grad_norm": 0.04242753982543945,
+ "learning_rate": 9.102132435465768e-05,
+ "loss": 0.018858186900615692,
+ "step": 359
+ },
+ {
+ "epoch": 1.820253164556962,
+ "grad_norm": 0.053701240569353104,
+ "learning_rate": 9.096520763187431e-05,
+ "loss": 0.025603849440813065,
+ "step": 360
+ },
+ {
+ "epoch": 1.8253164556962025,
+ "grad_norm": 0.05277755856513977,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.021214714273810387,
+ "step": 361
+ },
+ {
+ "epoch": 1.830379746835443,
+ "grad_norm": 0.048843637108802795,
+ "learning_rate": 9.085297418630753e-05,
+ "loss": 0.024215007200837135,
+ "step": 362
+ },
+ {
+ "epoch": 1.8354430379746836,
+ "grad_norm": 0.04203329607844353,
+ "learning_rate": 9.079685746352414e-05,
+ "loss": 0.022748971357941628,
+ "step": 363
+ },
+ {
+ "epoch": 1.840506329113924,
+ "grad_norm": 0.04655196890234947,
+ "learning_rate": 9.074074074074075e-05,
+ "loss": 0.019658325240015984,
+ "step": 364
+ },
+ {
+ "epoch": 1.8455696202531646,
+ "grad_norm": 0.10654491931200027,
+ "learning_rate": 9.068462401795736e-05,
+ "loss": 0.03210999816656113,
+ "step": 365
+ },
+ {
+ "epoch": 1.8506329113924052,
+ "grad_norm": 0.04377336800098419,
+ "learning_rate": 9.062850729517397e-05,
+ "loss": 0.01867927983403206,
+ "step": 366
+ },
+ {
+ "epoch": 1.8556962025316457,
+ "grad_norm": 0.04619381204247475,
+ "learning_rate": 9.057239057239058e-05,
+ "loss": 0.01952965185046196,
+ "step": 367
+ },
+ {
+ "epoch": 1.8607594936708862,
+ "grad_norm": 0.04015986621379852,
+ "learning_rate": 9.051627384960719e-05,
+ "loss": 0.017353296279907227,
+ "step": 368
+ },
+ {
+ "epoch": 1.8658227848101265,
+ "grad_norm": 0.11403095722198486,
+ "learning_rate": 9.04601571268238e-05,
+ "loss": 0.02238992229104042,
+ "step": 369
+ },
+ {
+ "epoch": 1.870886075949367,
+ "grad_norm": 0.043767284601926804,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.02202833816409111,
+ "step": 370
+ },
+ {
+ "epoch": 1.8759493670886076,
+ "grad_norm": 0.053445883095264435,
+ "learning_rate": 9.034792368125702e-05,
+ "loss": 0.023765750229358673,
+ "step": 371
+ },
+ {
+ "epoch": 1.8810126582278481,
+ "grad_norm": 0.05750055983662605,
+ "learning_rate": 9.029180695847364e-05,
+ "loss": 0.026259474456310272,
+ "step": 372
+ },
+ {
+ "epoch": 1.8860759493670884,
+ "grad_norm": 0.04525497183203697,
+ "learning_rate": 9.023569023569024e-05,
+ "loss": 0.024194583296775818,
+ "step": 373
+ },
+ {
+ "epoch": 1.891139240506329,
+ "grad_norm": 0.04918856918811798,
+ "learning_rate": 9.017957351290685e-05,
+ "loss": 0.020951319485902786,
+ "step": 374
+ },
+ {
+ "epoch": 1.8962025316455695,
+ "grad_norm": 0.08538687229156494,
+ "learning_rate": 9.012345679012346e-05,
+ "loss": 0.022266045212745667,
+ "step": 375
+ },
+ {
+ "epoch": 1.90126582278481,
+ "grad_norm": 0.07101748883724213,
+ "learning_rate": 9.006734006734007e-05,
+ "loss": 0.028090521693229675,
+ "step": 376
+ },
+ {
+ "epoch": 1.9063291139240506,
+ "grad_norm": 0.06256446987390518,
+ "learning_rate": 9.001122334455668e-05,
+ "loss": 0.027174800634384155,
+ "step": 377
+ },
+ {
+ "epoch": 1.9113924050632911,
+ "grad_norm": 0.07588270306587219,
+ "learning_rate": 8.995510662177329e-05,
+ "loss": 0.028438206762075424,
+ "step": 378
+ },
+ {
+ "epoch": 1.9164556962025316,
+ "grad_norm": 5.8829851150512695,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.01749270409345627,
+ "step": 379
+ },
+ {
+ "epoch": 1.9215189873417722,
+ "grad_norm": 0.038905344903469086,
+ "learning_rate": 8.984287317620651e-05,
+ "loss": 0.019571108743548393,
+ "step": 380
+ },
+ {
+ "epoch": 1.9265822784810127,
+ "grad_norm": 0.05960959196090698,
+ "learning_rate": 8.978675645342313e-05,
+ "loss": 0.024591946974396706,
+ "step": 381
+ },
+ {
+ "epoch": 1.9316455696202532,
+ "grad_norm": 0.07935867458581924,
+ "learning_rate": 8.973063973063973e-05,
+ "loss": 0.020205039530992508,
+ "step": 382
+ },
+ {
+ "epoch": 1.9367088607594938,
+ "grad_norm": 0.08682888746261597,
+ "learning_rate": 8.967452300785635e-05,
+ "loss": 0.023299653083086014,
+ "step": 383
+ },
+ {
+ "epoch": 1.9417721518987343,
+ "grad_norm": 0.07220255583524704,
+ "learning_rate": 8.961840628507295e-05,
+ "loss": 0.025364618748426437,
+ "step": 384
+ },
+ {
+ "epoch": 1.9468354430379748,
+ "grad_norm": 0.08230294287204742,
+ "learning_rate": 8.956228956228957e-05,
+ "loss": 0.023587457835674286,
+ "step": 385
+ },
+ {
+ "epoch": 1.9518987341772152,
+ "grad_norm": 0.05176795646548271,
+ "learning_rate": 8.950617283950617e-05,
+ "loss": 0.018942706286907196,
+ "step": 386
+ },
+ {
+ "epoch": 1.9569620253164557,
+ "grad_norm": 0.04784144088625908,
+ "learning_rate": 8.945005611672279e-05,
+ "loss": 0.020134730264544487,
+ "step": 387
+ },
+ {
+ "epoch": 1.9620253164556962,
+ "grad_norm": 0.04668115824460983,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.022084465250372887,
+ "step": 388
+ },
+ {
+ "epoch": 1.9670886075949368,
+ "grad_norm": 0.05892647057771683,
+ "learning_rate": 8.933782267115601e-05,
+ "loss": 0.02586008608341217,
+ "step": 389
+ },
+ {
+ "epoch": 1.972151898734177,
+ "grad_norm": 0.048669006675481796,
+ "learning_rate": 8.928170594837262e-05,
+ "loss": 0.020011097192764282,
+ "step": 390
+ },
+ {
+ "epoch": 1.9772151898734176,
+ "grad_norm": 0.0973723903298378,
+ "learning_rate": 8.922558922558923e-05,
+ "loss": 0.030240919440984726,
+ "step": 391
+ },
+ {
+ "epoch": 1.9822784810126581,
+ "grad_norm": 0.090507872402668,
+ "learning_rate": 8.916947250280584e-05,
+ "loss": 0.028250183910131454,
+ "step": 392
+ },
+ {
+ "epoch": 1.9873417721518987,
+ "grad_norm": 0.03921318054199219,
+ "learning_rate": 8.911335578002245e-05,
+ "loss": 0.02076716348528862,
+ "step": 393
+ },
+ {
+ "epoch": 1.9924050632911392,
+ "grad_norm": 0.04830043017864227,
+ "learning_rate": 8.905723905723906e-05,
+ "loss": 0.02241525426506996,
+ "step": 394
+ },
+ {
+ "epoch": 1.9974683544303797,
+ "grad_norm": 0.04455797001719475,
+ "learning_rate": 8.900112233445567e-05,
+ "loss": 0.026035301387310028,
+ "step": 395
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.10931648313999176,
+ "learning_rate": 8.894500561167228e-05,
+ "loss": 0.03514251485466957,
+ "step": 396
+ },
+ {
+ "epoch": 2.0050632911392405,
+ "grad_norm": 0.07531362026929855,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.021771814674139023,
+ "step": 397
+ },
+ {
+ "epoch": 2.010126582278481,
+ "grad_norm": 0.0649140477180481,
+ "learning_rate": 8.88327721661055e-05,
+ "loss": 0.02932022325694561,
+ "step": 398
+ },
+ {
+ "epoch": 2.0151898734177216,
+ "grad_norm": 0.07461163401603699,
+ "learning_rate": 8.877665544332211e-05,
+ "loss": 0.023864082992076874,
+ "step": 399
+ },
+ {
+ "epoch": 2.020253164556962,
+ "grad_norm": 0.054510265588760376,
+ "learning_rate": 8.872053872053872e-05,
+ "loss": 0.027578316628932953,
+ "step": 400
+ },
+ {
+ "epoch": 2.0253164556962027,
+ "grad_norm": 0.04434451460838318,
+ "learning_rate": 8.866442199775533e-05,
+ "loss": 0.022873830050230026,
+ "step": 401
+ },
+ {
+ "epoch": 2.030379746835443,
+ "grad_norm": 0.052791960537433624,
+ "learning_rate": 8.860830527497194e-05,
+ "loss": 0.021092431619763374,
+ "step": 402
+ },
+ {
+ "epoch": 2.0354430379746837,
+ "grad_norm": 0.04550998657941818,
+ "learning_rate": 8.855218855218855e-05,
+ "loss": 0.022475749254226685,
+ "step": 403
+ },
+ {
+ "epoch": 2.0405063291139243,
+ "grad_norm": 0.2512972354888916,
+ "learning_rate": 8.849607182940516e-05,
+ "loss": 0.02201610803604126,
+ "step": 404
+ },
+ {
+ "epoch": 2.0455696202531644,
+ "grad_norm": 0.04554569348692894,
+ "learning_rate": 8.843995510662177e-05,
+ "loss": 0.02180359698832035,
+ "step": 405
+ },
+ {
+ "epoch": 2.050632911392405,
+ "grad_norm": 0.04094229266047478,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.01960112899541855,
+ "step": 406
+ },
+ {
+ "epoch": 2.0556962025316454,
+ "grad_norm": 0.07398641109466553,
+ "learning_rate": 8.8327721661055e-05,
+ "loss": 0.02206597849726677,
+ "step": 407
+ },
+ {
+ "epoch": 2.060759493670886,
+ "grad_norm": 0.07659231871366501,
+ "learning_rate": 8.827160493827162e-05,
+ "loss": 0.019660351797938347,
+ "step": 408
+ },
+ {
+ "epoch": 2.0658227848101265,
+ "grad_norm": 0.05986466258764267,
+ "learning_rate": 8.821548821548821e-05,
+ "loss": 0.027121691033244133,
+ "step": 409
+ },
+ {
+ "epoch": 2.070886075949367,
+ "grad_norm": 0.03376661241054535,
+ "learning_rate": 8.815937149270484e-05,
+ "loss": 0.021059338003396988,
+ "step": 410
+ },
+ {
+ "epoch": 2.0759493670886076,
+ "grad_norm": 0.081104576587677,
+ "learning_rate": 8.810325476992143e-05,
+ "loss": 0.031228341162204742,
+ "step": 411
+ },
+ {
+ "epoch": 2.081012658227848,
+ "grad_norm": 0.04295242205262184,
+ "learning_rate": 8.804713804713806e-05,
+ "loss": 0.020738180726766586,
+ "step": 412
+ },
+ {
+ "epoch": 2.0860759493670886,
+ "grad_norm": 0.03715268895030022,
+ "learning_rate": 8.799102132435467e-05,
+ "loss": 0.018579209223389626,
+ "step": 413
+ },
+ {
+ "epoch": 2.091139240506329,
+ "grad_norm": 0.06769359856843948,
+ "learning_rate": 8.793490460157128e-05,
+ "loss": 0.026761794462800026,
+ "step": 414
+ },
+ {
+ "epoch": 2.0962025316455697,
+ "grad_norm": 0.03715744614601135,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.022879980504512787,
+ "step": 415
+ },
+ {
+ "epoch": 2.1012658227848102,
+ "grad_norm": 0.04305677488446236,
+ "learning_rate": 8.78226711560045e-05,
+ "loss": 0.022773049771785736,
+ "step": 416
+ },
+ {
+ "epoch": 2.1063291139240508,
+ "grad_norm": 0.0449112169444561,
+ "learning_rate": 8.776655443322111e-05,
+ "loss": 0.022499293088912964,
+ "step": 417
+ },
+ {
+ "epoch": 2.1113924050632913,
+ "grad_norm": 0.0457427054643631,
+ "learning_rate": 8.77104377104377e-05,
+ "loss": 0.024978693574666977,
+ "step": 418
+ },
+ {
+ "epoch": 2.116455696202532,
+ "grad_norm": 0.04705161228775978,
+ "learning_rate": 8.765432098765433e-05,
+ "loss": 0.024807877838611603,
+ "step": 419
+ },
+ {
+ "epoch": 2.1215189873417724,
+ "grad_norm": 0.04377812147140503,
+ "learning_rate": 8.759820426487092e-05,
+ "loss": 0.025857431814074516,
+ "step": 420
+ },
+ {
+ "epoch": 2.1265822784810124,
+ "grad_norm": 0.08598720282316208,
+ "learning_rate": 8.754208754208755e-05,
+ "loss": 0.021972455084323883,
+ "step": 421
+ },
+ {
+ "epoch": 2.131645569620253,
+ "grad_norm": 0.4669632017612457,
+ "learning_rate": 8.748597081930416e-05,
+ "loss": 0.02055199444293976,
+ "step": 422
+ },
+ {
+ "epoch": 2.1367088607594935,
+ "grad_norm": 0.05292733013629913,
+ "learning_rate": 8.742985409652077e-05,
+ "loss": 0.020852137356996536,
+ "step": 423
+ },
+ {
+ "epoch": 2.141772151898734,
+ "grad_norm": 0.05878116562962532,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.02444305270910263,
+ "step": 424
+ },
+ {
+ "epoch": 2.1468354430379746,
+ "grad_norm": 0.05234210565686226,
+ "learning_rate": 8.731762065095399e-05,
+ "loss": 0.02202335000038147,
+ "step": 425
+ },
+ {
+ "epoch": 2.151898734177215,
+ "grad_norm": 0.04706348851323128,
+ "learning_rate": 8.72615039281706e-05,
+ "loss": 0.019998187199234962,
+ "step": 426
+ },
+ {
+ "epoch": 2.1569620253164556,
+ "grad_norm": 0.05263376981019974,
+ "learning_rate": 8.720538720538721e-05,
+ "loss": 0.028126951307058334,
+ "step": 427
+ },
+ {
+ "epoch": 2.162025316455696,
+ "grad_norm": 0.062016960233449936,
+ "learning_rate": 8.714927048260382e-05,
+ "loss": 0.0286184661090374,
+ "step": 428
+ },
+ {
+ "epoch": 2.1670886075949367,
+ "grad_norm": 0.13798244297504425,
+ "learning_rate": 8.709315375982043e-05,
+ "loss": 0.026699248701334,
+ "step": 429
+ },
+ {
+ "epoch": 2.1721518987341772,
+ "grad_norm": 0.09159042686223984,
+ "learning_rate": 8.703703703703704e-05,
+ "loss": 0.025515643879771233,
+ "step": 430
+ },
+ {
+ "epoch": 2.1772151898734178,
+ "grad_norm": 0.0828855037689209,
+ "learning_rate": 8.698092031425365e-05,
+ "loss": 0.025481123477220535,
+ "step": 431
+ },
+ {
+ "epoch": 2.1822784810126583,
+ "grad_norm": 0.09840776771306992,
+ "learning_rate": 8.692480359147026e-05,
+ "loss": 0.020968927070498466,
+ "step": 432
+ },
+ {
+ "epoch": 2.187341772151899,
+ "grad_norm": 0.10999752581119537,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.028588412329554558,
+ "step": 433
+ },
+ {
+ "epoch": 2.1924050632911394,
+ "grad_norm": 0.06938561797142029,
+ "learning_rate": 8.681257014590348e-05,
+ "loss": 0.024119220674037933,
+ "step": 434
+ },
+ {
+ "epoch": 2.19746835443038,
+ "grad_norm": 0.054689887911081314,
+ "learning_rate": 8.67564534231201e-05,
+ "loss": 0.02173299714922905,
+ "step": 435
+ },
+ {
+ "epoch": 2.2025316455696204,
+ "grad_norm": 0.09605880081653595,
+ "learning_rate": 8.67003367003367e-05,
+ "loss": 0.02312455326318741,
+ "step": 436
+ },
+ {
+ "epoch": 2.207594936708861,
+ "grad_norm": 0.06863043457269669,
+ "learning_rate": 8.664421997755332e-05,
+ "loss": 0.020868321880698204,
+ "step": 437
+ },
+ {
+ "epoch": 2.212658227848101,
+ "grad_norm": 0.11743242293596268,
+ "learning_rate": 8.658810325476992e-05,
+ "loss": 0.029748965054750443,
+ "step": 438
+ },
+ {
+ "epoch": 2.2177215189873416,
+ "grad_norm": 0.08399086445569992,
+ "learning_rate": 8.653198653198653e-05,
+ "loss": 0.02379520982503891,
+ "step": 439
+ },
+ {
+ "epoch": 2.222784810126582,
+ "grad_norm": 0.052164461463689804,
+ "learning_rate": 8.647586980920315e-05,
+ "loss": 0.02010851353406906,
+ "step": 440
+ },
+ {
+ "epoch": 2.2278481012658227,
+ "grad_norm": 0.11834696680307388,
+ "learning_rate": 8.641975308641975e-05,
+ "loss": 0.02748255990445614,
+ "step": 441
+ },
+ {
+ "epoch": 2.232911392405063,
+ "grad_norm": 0.06718999892473221,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.026828233152627945,
+ "step": 442
+ },
+ {
+ "epoch": 2.2379746835443037,
+ "grad_norm": 0.042458854615688324,
+ "learning_rate": 8.630751964085297e-05,
+ "loss": 0.021280258893966675,
+ "step": 443
+ },
+ {
+ "epoch": 2.2430379746835443,
+ "grad_norm": 0.036516617983579636,
+ "learning_rate": 8.62514029180696e-05,
+ "loss": 0.021773381158709526,
+ "step": 444
+ },
+ {
+ "epoch": 2.248101265822785,
+ "grad_norm": 0.04317261651158333,
+ "learning_rate": 8.619528619528619e-05,
+ "loss": 0.022671079263091087,
+ "step": 445
+ },
+ {
+ "epoch": 2.2531645569620253,
+ "grad_norm": 0.08610037714242935,
+ "learning_rate": 8.613916947250281e-05,
+ "loss": 0.02425701916217804,
+ "step": 446
+ },
+ {
+ "epoch": 2.258227848101266,
+ "grad_norm": 0.03478290140628815,
+ "learning_rate": 8.608305274971942e-05,
+ "loss": 0.022291556000709534,
+ "step": 447
+ },
+ {
+ "epoch": 2.2632911392405064,
+ "grad_norm": 0.04682233929634094,
+ "learning_rate": 8.602693602693603e-05,
+ "loss": 0.02036888152360916,
+ "step": 448
+ },
+ {
+ "epoch": 2.268354430379747,
+ "grad_norm": 0.0808606892824173,
+ "learning_rate": 8.597081930415264e-05,
+ "loss": 0.025470012798905373,
+ "step": 449
+ },
+ {
+ "epoch": 2.2734177215189875,
+ "grad_norm": 0.042830612510442734,
+ "learning_rate": 8.591470258136925e-05,
+ "loss": 0.020565971732139587,
+ "step": 450
+ },
+ {
+ "epoch": 2.278481012658228,
+ "grad_norm": 0.06374406069517136,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031990330666303635,
+ "step": 451
+ },
+ {
+ "epoch": 2.2835443037974685,
+ "grad_norm": 0.05716697871685028,
+ "learning_rate": 8.580246913580247e-05,
+ "loss": 0.024125374853610992,
+ "step": 452
+ },
+ {
+ "epoch": 2.2886075949367086,
+ "grad_norm": 0.04057484492659569,
+ "learning_rate": 8.574635241301908e-05,
+ "loss": 0.021739482879638672,
+ "step": 453
+ },
+ {
+ "epoch": 2.293670886075949,
+ "grad_norm": 0.07754945009946823,
+ "learning_rate": 8.56902356902357e-05,
+ "loss": 0.02694481424987316,
+ "step": 454
+ },
+ {
+ "epoch": 2.2987341772151897,
+ "grad_norm": 0.06022442877292633,
+ "learning_rate": 8.56341189674523e-05,
+ "loss": 0.021221034228801727,
+ "step": 455
+ },
+ {
+ "epoch": 2.3037974683544302,
+ "grad_norm": 0.06909896433353424,
+ "learning_rate": 8.557800224466891e-05,
+ "loss": 0.02247895672917366,
+ "step": 456
+ },
+ {
+ "epoch": 2.3088607594936708,
+ "grad_norm": 0.05362236499786377,
+ "learning_rate": 8.552188552188552e-05,
+ "loss": 0.020700538530945778,
+ "step": 457
+ },
+ {
+ "epoch": 2.3139240506329113,
+ "grad_norm": 0.09836408495903015,
+ "learning_rate": 8.546576879910215e-05,
+ "loss": 0.02611887827515602,
+ "step": 458
+ },
+ {
+ "epoch": 2.318987341772152,
+ "grad_norm": 0.036625102162361145,
+ "learning_rate": 8.540965207631874e-05,
+ "loss": 0.0196938905864954,
+ "step": 459
+ },
+ {
+ "epoch": 2.3240506329113924,
+ "grad_norm": 0.07372298091650009,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.020545657724142075,
+ "step": 460
+ },
+ {
+ "epoch": 2.329113924050633,
+ "grad_norm": 0.20502988994121552,
+ "learning_rate": 8.529741863075196e-05,
+ "loss": 0.02884715050458908,
+ "step": 461
+ },
+ {
+ "epoch": 2.3341772151898734,
+ "grad_norm": 0.04867224395275116,
+ "learning_rate": 8.524130190796857e-05,
+ "loss": 0.019854716956615448,
+ "step": 462
+ },
+ {
+ "epoch": 2.339240506329114,
+ "grad_norm": 0.029550092294812202,
+ "learning_rate": 8.518518518518518e-05,
+ "loss": 0.01884104311466217,
+ "step": 463
+ },
+ {
+ "epoch": 2.3443037974683545,
+ "grad_norm": 0.04299351945519447,
+ "learning_rate": 8.51290684624018e-05,
+ "loss": 0.01954217068850994,
+ "step": 464
+ },
+ {
+ "epoch": 2.349367088607595,
+ "grad_norm": 0.043467242270708084,
+ "learning_rate": 8.507295173961842e-05,
+ "loss": 0.024274462834000587,
+ "step": 465
+ },
+ {
+ "epoch": 2.3544303797468356,
+ "grad_norm": 0.05131510645151138,
+ "learning_rate": 8.501683501683501e-05,
+ "loss": 0.026246599853038788,
+ "step": 466
+ },
+ {
+ "epoch": 2.359493670886076,
+ "grad_norm": 0.06280570477247238,
+ "learning_rate": 8.496071829405164e-05,
+ "loss": 0.024986159056425095,
+ "step": 467
+ },
+ {
+ "epoch": 2.3645569620253166,
+ "grad_norm": 0.04968208447098732,
+ "learning_rate": 8.490460157126824e-05,
+ "loss": 0.02912936732172966,
+ "step": 468
+ },
+ {
+ "epoch": 2.369620253164557,
+ "grad_norm": 0.08504039794206619,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.027097277343273163,
+ "step": 469
+ },
+ {
+ "epoch": 2.3746835443037977,
+ "grad_norm": 0.18385924398899078,
+ "learning_rate": 8.479236812570146e-05,
+ "loss": 0.02459462732076645,
+ "step": 470
+ },
+ {
+ "epoch": 2.379746835443038,
+ "grad_norm": 0.0663745328783989,
+ "learning_rate": 8.473625140291808e-05,
+ "loss": 0.020224973559379578,
+ "step": 471
+ },
+ {
+ "epoch": 2.3848101265822783,
+ "grad_norm": 0.04759671539068222,
+ "learning_rate": 8.468013468013468e-05,
+ "loss": 0.02591642364859581,
+ "step": 472
+ },
+ {
+ "epoch": 2.389873417721519,
+ "grad_norm": 0.044010091572999954,
+ "learning_rate": 8.46240179573513e-05,
+ "loss": 0.025122515857219696,
+ "step": 473
+ },
+ {
+ "epoch": 2.3949367088607594,
+ "grad_norm": 0.035054467618465424,
+ "learning_rate": 8.456790123456791e-05,
+ "loss": 0.019854065030813217,
+ "step": 474
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.03171153366565704,
+ "learning_rate": 8.451178451178452e-05,
+ "loss": 0.02009584940969944,
+ "step": 475
+ },
+ {
+ "epoch": 2.4050632911392404,
+ "grad_norm": 0.17388089001178741,
+ "learning_rate": 8.445566778900113e-05,
+ "loss": 0.02714207023382187,
+ "step": 476
+ },
+ {
+ "epoch": 2.410126582278481,
+ "grad_norm": 0.038392502814531326,
+ "learning_rate": 8.439955106621774e-05,
+ "loss": 0.020382478833198547,
+ "step": 477
+ },
+ {
+ "epoch": 2.4151898734177215,
+ "grad_norm": 0.04264051839709282,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.022726822644472122,
+ "step": 478
+ },
+ {
+ "epoch": 2.420253164556962,
+ "grad_norm": 0.046432014554739,
+ "learning_rate": 8.428731762065096e-05,
+ "loss": 0.021431483328342438,
+ "step": 479
+ },
+ {
+ "epoch": 2.4253164556962026,
+ "grad_norm": 0.07288242876529694,
+ "learning_rate": 8.423120089786757e-05,
+ "loss": 0.026229504495859146,
+ "step": 480
+ },
+ {
+ "epoch": 2.430379746835443,
+ "grad_norm": 0.04801097884774208,
+ "learning_rate": 8.417508417508418e-05,
+ "loss": 0.020924456417560577,
+ "step": 481
+ },
+ {
+ "epoch": 2.4354430379746836,
+ "grad_norm": 0.11201190203428268,
+ "learning_rate": 8.411896745230079e-05,
+ "loss": 0.022652529180049896,
+ "step": 482
+ },
+ {
+ "epoch": 2.440506329113924,
+ "grad_norm": 0.06151285395026207,
+ "learning_rate": 8.40628507295174e-05,
+ "loss": 0.02416859194636345,
+ "step": 483
+ },
+ {
+ "epoch": 2.4455696202531647,
+ "grad_norm": 0.04006446525454521,
+ "learning_rate": 8.400673400673401e-05,
+ "loss": 0.02390255406498909,
+ "step": 484
+ },
+ {
+ "epoch": 2.4506329113924052,
+ "grad_norm": 0.027193108573555946,
+ "learning_rate": 8.395061728395062e-05,
+ "loss": 0.015282701700925827,
+ "step": 485
+ },
+ {
+ "epoch": 2.4556962025316453,
+ "grad_norm": 0.05453994497656822,
+ "learning_rate": 8.389450056116723e-05,
+ "loss": 0.025738034397363663,
+ "step": 486
+ },
+ {
+ "epoch": 2.460759493670886,
+ "grad_norm": 0.03226681798696518,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.02111941948533058,
+ "step": 487
+ },
+ {
+ "epoch": 2.4658227848101264,
+ "grad_norm": 0.0451083667576313,
+ "learning_rate": 8.378226711560045e-05,
+ "loss": 0.020694585517048836,
+ "step": 488
+ },
+ {
+ "epoch": 2.470886075949367,
+ "grad_norm": 0.0390113927423954,
+ "learning_rate": 8.372615039281706e-05,
+ "loss": 0.022557765245437622,
+ "step": 489
+ },
+ {
+ "epoch": 2.4759493670886075,
+ "grad_norm": 0.05983779951930046,
+ "learning_rate": 8.367003367003367e-05,
+ "loss": 0.02489873766899109,
+ "step": 490
+ },
+ {
+ "epoch": 2.481012658227848,
+ "grad_norm": 0.03961458057165146,
+ "learning_rate": 8.361391694725028e-05,
+ "loss": 0.021655399352312088,
+ "step": 491
+ },
+ {
+ "epoch": 2.4860759493670885,
+ "grad_norm": 0.03814523667097092,
+ "learning_rate": 8.35578002244669e-05,
+ "loss": 0.02217719703912735,
+ "step": 492
+ },
+ {
+ "epoch": 2.491139240506329,
+ "grad_norm": 0.030563514679670334,
+ "learning_rate": 8.35016835016835e-05,
+ "loss": 0.01679009571671486,
+ "step": 493
+ },
+ {
+ "epoch": 2.4962025316455696,
+ "grad_norm": 0.04566824436187744,
+ "learning_rate": 8.344556677890012e-05,
+ "loss": 0.019699417054653168,
+ "step": 494
+ },
+ {
+ "epoch": 2.50126582278481,
+ "grad_norm": 0.06117499992251396,
+ "learning_rate": 8.338945005611672e-05,
+ "loss": 0.028571851551532745,
+ "step": 495
+ },
+ {
+ "epoch": 2.5063291139240507,
+ "grad_norm": 0.03510760888457298,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.023387223482131958,
+ "step": 496
+ },
+ {
+ "epoch": 2.511392405063291,
+ "grad_norm": 0.028878437355160713,
+ "learning_rate": 8.327721661054994e-05,
+ "loss": 0.023329850286245346,
+ "step": 497
+ },
+ {
+ "epoch": 2.5164556962025317,
+ "grad_norm": 0.02818676456809044,
+ "learning_rate": 8.322109988776656e-05,
+ "loss": 0.017786618322134018,
+ "step": 498
+ },
+ {
+ "epoch": 2.5215189873417723,
+ "grad_norm": 0.06660276651382446,
+ "learning_rate": 8.316498316498317e-05,
+ "loss": 0.023636367172002792,
+ "step": 499
+ },
+ {
+ "epoch": 2.526582278481013,
+ "grad_norm": 0.05663186311721802,
+ "learning_rate": 8.310886644219978e-05,
+ "loss": 0.02607567049562931,
+ "step": 500
+ },
+ {
+ "epoch": 2.5316455696202533,
+ "grad_norm": 0.04156090319156647,
+ "learning_rate": 8.30527497194164e-05,
+ "loss": 0.024936942383646965,
+ "step": 501
+ },
+ {
+ "epoch": 2.536708860759494,
+ "grad_norm": 0.036135219037532806,
+ "learning_rate": 8.2996632996633e-05,
+ "loss": 0.023583384230732918,
+ "step": 502
+ },
+ {
+ "epoch": 2.5417721518987344,
+ "grad_norm": 0.052026644349098206,
+ "learning_rate": 8.294051627384961e-05,
+ "loss": 0.02324807643890381,
+ "step": 503
+ },
+ {
+ "epoch": 2.546835443037975,
+ "grad_norm": 0.03599514439702034,
+ "learning_rate": 8.288439955106621e-05,
+ "loss": 0.01879853755235672,
+ "step": 504
+ },
+ {
+ "epoch": 2.5518987341772155,
+ "grad_norm": 0.03505280241370201,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.017342131584882736,
+ "step": 505
+ },
+ {
+ "epoch": 2.5569620253164556,
+ "grad_norm": 0.0403706431388855,
+ "learning_rate": 8.277216610549943e-05,
+ "loss": 0.02082991972565651,
+ "step": 506
+ },
+ {
+ "epoch": 2.562025316455696,
+ "grad_norm": 0.031072309240698814,
+ "learning_rate": 8.271604938271605e-05,
+ "loss": 0.01711331121623516,
+ "step": 507
+ },
+ {
+ "epoch": 2.5670886075949366,
+ "grad_norm": 0.04118587449193001,
+ "learning_rate": 8.265993265993266e-05,
+ "loss": 0.01940922439098358,
+ "step": 508
+ },
+ {
+ "epoch": 2.572151898734177,
+ "grad_norm": 0.039908040314912796,
+ "learning_rate": 8.260381593714927e-05,
+ "loss": 0.021229952573776245,
+ "step": 509
+ },
+ {
+ "epoch": 2.5772151898734177,
+ "grad_norm": 0.02886618860065937,
+ "learning_rate": 8.254769921436589e-05,
+ "loss": 0.02004890888929367,
+ "step": 510
+ },
+ {
+ "epoch": 2.5822784810126582,
+ "grad_norm": 0.04229263588786125,
+ "learning_rate": 8.24915824915825e-05,
+ "loss": 0.019512392580509186,
+ "step": 511
+ },
+ {
+ "epoch": 2.5873417721518988,
+ "grad_norm": 0.030951635912060738,
+ "learning_rate": 8.24354657687991e-05,
+ "loss": 0.01836536079645157,
+ "step": 512
+ },
+ {
+ "epoch": 2.5924050632911393,
+ "grad_norm": 0.057054903358221054,
+ "learning_rate": 8.237934904601572e-05,
+ "loss": 0.028897594660520554,
+ "step": 513
+ },
+ {
+ "epoch": 2.59746835443038,
+ "grad_norm": 0.10734204202890396,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.024986904114484787,
+ "step": 514
+ },
+ {
+ "epoch": 2.6025316455696204,
+ "grad_norm": 0.029653102159500122,
+ "learning_rate": 8.226711560044894e-05,
+ "loss": 0.02242947742342949,
+ "step": 515
+ },
+ {
+ "epoch": 2.607594936708861,
+ "grad_norm": 0.05601462349295616,
+ "learning_rate": 8.221099887766555e-05,
+ "loss": 0.020091768354177475,
+ "step": 516
+ },
+ {
+ "epoch": 2.6126582278481014,
+ "grad_norm": 0.04170191287994385,
+ "learning_rate": 8.215488215488217e-05,
+ "loss": 0.021796470507979393,
+ "step": 517
+ },
+ {
+ "epoch": 2.6177215189873415,
+ "grad_norm": 0.06347091495990753,
+ "learning_rate": 8.209876543209877e-05,
+ "loss": 0.024338826537132263,
+ "step": 518
+ },
+ {
+ "epoch": 2.622784810126582,
+ "grad_norm": 0.06084204465150833,
+ "learning_rate": 8.204264870931539e-05,
+ "loss": 0.02493124082684517,
+ "step": 519
+ },
+ {
+ "epoch": 2.6278481012658226,
+ "grad_norm": 0.03094005584716797,
+ "learning_rate": 8.198653198653199e-05,
+ "loss": 0.021345658227801323,
+ "step": 520
+ },
+ {
+ "epoch": 2.632911392405063,
+ "grad_norm": 0.04017730429768562,
+ "learning_rate": 8.193041526374861e-05,
+ "loss": 0.019823770970106125,
+ "step": 521
+ },
+ {
+ "epoch": 2.6379746835443036,
+ "grad_norm": 0.045351576060056686,
+ "learning_rate": 8.18742985409652e-05,
+ "loss": 0.02385132387280464,
+ "step": 522
+ },
+ {
+ "epoch": 2.643037974683544,
+ "grad_norm": 0.04823896288871765,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.021753432229161263,
+ "step": 523
+ },
+ {
+ "epoch": 2.6481012658227847,
+ "grad_norm": 0.0442446693778038,
+ "learning_rate": 8.176206509539843e-05,
+ "loss": 0.022134695202112198,
+ "step": 524
+ },
+ {
+ "epoch": 2.6531645569620252,
+ "grad_norm": 0.07998359203338623,
+ "learning_rate": 8.170594837261504e-05,
+ "loss": 0.021159570664167404,
+ "step": 525
+ },
+ {
+ "epoch": 2.6582278481012658,
+ "grad_norm": 0.07844395190477371,
+ "learning_rate": 8.164983164983166e-05,
+ "loss": 0.023695990443229675,
+ "step": 526
+ },
+ {
+ "epoch": 2.6632911392405063,
+ "grad_norm": 0.025296518579125404,
+ "learning_rate": 8.159371492704826e-05,
+ "loss": 0.020914766937494278,
+ "step": 527
+ },
+ {
+ "epoch": 2.668354430379747,
+ "grad_norm": 0.337454617023468,
+ "learning_rate": 8.153759820426488e-05,
+ "loss": 0.02948678657412529,
+ "step": 528
+ },
+ {
+ "epoch": 2.6734177215189874,
+ "grad_norm": 0.03531114012002945,
+ "learning_rate": 8.148148148148148e-05,
+ "loss": 0.020608587190508842,
+ "step": 529
+ },
+ {
+ "epoch": 2.678481012658228,
+ "grad_norm": 0.0496559739112854,
+ "learning_rate": 8.14253647586981e-05,
+ "loss": 0.023600757122039795,
+ "step": 530
+ },
+ {
+ "epoch": 2.6835443037974684,
+ "grad_norm": 0.04093128815293312,
+ "learning_rate": 8.13692480359147e-05,
+ "loss": 0.022392068058252335,
+ "step": 531
+ },
+ {
+ "epoch": 2.688607594936709,
+ "grad_norm": 0.05343819782137871,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.01882098615169525,
+ "step": 532
+ },
+ {
+ "epoch": 2.6936708860759495,
+ "grad_norm": 0.0334453359246254,
+ "learning_rate": 8.125701459034793e-05,
+ "loss": 0.020492104813456535,
+ "step": 533
+ },
+ {
+ "epoch": 2.69873417721519,
+ "grad_norm": 0.045540470629930496,
+ "learning_rate": 8.120089786756454e-05,
+ "loss": 0.021309707313776016,
+ "step": 534
+ },
+ {
+ "epoch": 2.7037974683544306,
+ "grad_norm": 0.03238926827907562,
+ "learning_rate": 8.114478114478115e-05,
+ "loss": 0.01929772086441517,
+ "step": 535
+ },
+ {
+ "epoch": 2.708860759493671,
+ "grad_norm": 0.10985280573368073,
+ "learning_rate": 8.108866442199776e-05,
+ "loss": 0.02431013062596321,
+ "step": 536
+ },
+ {
+ "epoch": 2.7139240506329116,
+ "grad_norm": 0.039785534143447876,
+ "learning_rate": 8.103254769921437e-05,
+ "loss": 0.022708022966980934,
+ "step": 537
+ },
+ {
+ "epoch": 2.7189873417721517,
+ "grad_norm": 0.06239910051226616,
+ "learning_rate": 8.097643097643098e-05,
+ "loss": 0.02715257555246353,
+ "step": 538
+ },
+ {
+ "epoch": 2.7240506329113923,
+ "grad_norm": 0.03662843257188797,
+ "learning_rate": 8.092031425364759e-05,
+ "loss": 0.024876421317458153,
+ "step": 539
+ },
+ {
+ "epoch": 2.729113924050633,
+ "grad_norm": 0.05869411304593086,
+ "learning_rate": 8.08641975308642e-05,
+ "loss": 0.022937750443816185,
+ "step": 540
+ },
+ {
+ "epoch": 2.7341772151898733,
+ "grad_norm": 0.07220412790775299,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02227093279361725,
+ "step": 541
+ },
+ {
+ "epoch": 2.739240506329114,
+ "grad_norm": 0.03881363570690155,
+ "learning_rate": 8.075196408529742e-05,
+ "loss": 0.020784813910722733,
+ "step": 542
+ },
+ {
+ "epoch": 2.7443037974683544,
+ "grad_norm": 0.04756273329257965,
+ "learning_rate": 8.069584736251403e-05,
+ "loss": 0.02334344945847988,
+ "step": 543
+ },
+ {
+ "epoch": 2.749367088607595,
+ "grad_norm": 0.05327540263533592,
+ "learning_rate": 8.063973063973065e-05,
+ "loss": 0.026313351467251778,
+ "step": 544
+ },
+ {
+ "epoch": 2.7544303797468355,
+ "grad_norm": 0.1605764925479889,
+ "learning_rate": 8.058361391694725e-05,
+ "loss": 0.02474561519920826,
+ "step": 545
+ },
+ {
+ "epoch": 2.759493670886076,
+ "grad_norm": 0.044486165046691895,
+ "learning_rate": 8.052749719416387e-05,
+ "loss": 0.023557808250188828,
+ "step": 546
+ },
+ {
+ "epoch": 2.7645569620253165,
+ "grad_norm": 0.04645116999745369,
+ "learning_rate": 8.047138047138047e-05,
+ "loss": 0.017340417951345444,
+ "step": 547
+ },
+ {
+ "epoch": 2.769620253164557,
+ "grad_norm": 0.04009381681680679,
+ "learning_rate": 8.041526374859708e-05,
+ "loss": 0.018324140459299088,
+ "step": 548
+ },
+ {
+ "epoch": 2.7746835443037976,
+ "grad_norm": 0.12476589530706406,
+ "learning_rate": 8.035914702581369e-05,
+ "loss": 0.023337965831160545,
+ "step": 549
+ },
+ {
+ "epoch": 2.779746835443038,
+ "grad_norm": 0.04257349297404289,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.021878249943256378,
+ "step": 550
+ },
+ {
+ "epoch": 2.7848101265822782,
+ "grad_norm": 0.044377341866493225,
+ "learning_rate": 8.024691358024692e-05,
+ "loss": 0.019643619656562805,
+ "step": 551
+ },
+ {
+ "epoch": 2.7898734177215188,
+ "grad_norm": 0.0801771879196167,
+ "learning_rate": 8.019079685746352e-05,
+ "loss": 0.021452955901622772,
+ "step": 552
+ },
+ {
+ "epoch": 2.7949367088607593,
+ "grad_norm": 0.04462383687496185,
+ "learning_rate": 8.013468013468015e-05,
+ "loss": 0.02363801747560501,
+ "step": 553
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.05768737941980362,
+ "learning_rate": 8.007856341189674e-05,
+ "loss": 0.03572218120098114,
+ "step": 554
+ },
+ {
+ "epoch": 2.8050632911392404,
+ "grad_norm": 0.03812364116311073,
+ "learning_rate": 8.002244668911337e-05,
+ "loss": 0.01964751072227955,
+ "step": 555
+ },
+ {
+ "epoch": 2.810126582278481,
+ "grad_norm": 0.03297588974237442,
+ "learning_rate": 7.996632996632996e-05,
+ "loss": 0.019139982759952545,
+ "step": 556
+ },
+ {
+ "epoch": 2.8151898734177214,
+ "grad_norm": 0.024627596139907837,
+ "learning_rate": 7.991021324354659e-05,
+ "loss": 0.021029513329267502,
+ "step": 557
+ },
+ {
+ "epoch": 2.820253164556962,
+ "grad_norm": 0.058927983045578,
+ "learning_rate": 7.985409652076318e-05,
+ "loss": 0.03308084234595299,
+ "step": 558
+ },
+ {
+ "epoch": 2.8253164556962025,
+ "grad_norm": 0.11811497062444687,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.028271127492189407,
+ "step": 559
+ },
+ {
+ "epoch": 2.830379746835443,
+ "grad_norm": 0.043665409088134766,
+ "learning_rate": 7.974186307519642e-05,
+ "loss": 0.02708129584789276,
+ "step": 560
+ },
+ {
+ "epoch": 2.8354430379746836,
+ "grad_norm": 0.034729309380054474,
+ "learning_rate": 7.968574635241303e-05,
+ "loss": 0.023845072835683823,
+ "step": 561
+ },
+ {
+ "epoch": 2.840506329113924,
+ "grad_norm": 0.028991155326366425,
+ "learning_rate": 7.962962962962964e-05,
+ "loss": 0.018426496535539627,
+ "step": 562
+ },
+ {
+ "epoch": 2.8455696202531646,
+ "grad_norm": 0.04660327732563019,
+ "learning_rate": 7.957351290684625e-05,
+ "loss": 0.02610144019126892,
+ "step": 563
+ },
+ {
+ "epoch": 2.850632911392405,
+ "grad_norm": 0.03947063535451889,
+ "learning_rate": 7.951739618406286e-05,
+ "loss": 0.025909483432769775,
+ "step": 564
+ },
+ {
+ "epoch": 2.8556962025316457,
+ "grad_norm": 0.06056501716375351,
+ "learning_rate": 7.946127946127947e-05,
+ "loss": 0.030405592173337936,
+ "step": 565
+ },
+ {
+ "epoch": 2.8607594936708862,
+ "grad_norm": 0.03398960456252098,
+ "learning_rate": 7.940516273849608e-05,
+ "loss": 0.02486085705459118,
+ "step": 566
+ },
+ {
+ "epoch": 2.8658227848101268,
+ "grad_norm": 0.03136906027793884,
+ "learning_rate": 7.934904601571269e-05,
+ "loss": 0.020573778077960014,
+ "step": 567
+ },
+ {
+ "epoch": 2.8708860759493673,
+ "grad_norm": 0.03404523804783821,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.021034879609942436,
+ "step": 568
+ },
+ {
+ "epoch": 2.875949367088608,
+ "grad_norm": 0.02937588468194008,
+ "learning_rate": 7.92368125701459e-05,
+ "loss": 0.02275373972952366,
+ "step": 569
+ },
+ {
+ "epoch": 2.8810126582278484,
+ "grad_norm": 0.03971172124147415,
+ "learning_rate": 7.918069584736252e-05,
+ "loss": 0.021558552980422974,
+ "step": 570
+ },
+ {
+ "epoch": 2.8860759493670884,
+ "grad_norm": 0.05636494606733322,
+ "learning_rate": 7.912457912457913e-05,
+ "loss": 0.025583568960428238,
+ "step": 571
+ },
+ {
+ "epoch": 2.891139240506329,
+ "grad_norm": 0.2013683319091797,
+ "learning_rate": 7.906846240179574e-05,
+ "loss": 0.025386696681380272,
+ "step": 572
+ },
+ {
+ "epoch": 2.8962025316455695,
+ "grad_norm": 0.05875328183174133,
+ "learning_rate": 7.901234567901235e-05,
+ "loss": 0.023778585717082024,
+ "step": 573
+ },
+ {
+ "epoch": 2.90126582278481,
+ "grad_norm": 0.031178263947367668,
+ "learning_rate": 7.895622895622896e-05,
+ "loss": 0.02130977436900139,
+ "step": 574
+ },
+ {
+ "epoch": 2.9063291139240506,
+ "grad_norm": 0.028125282377004623,
+ "learning_rate": 7.890011223344557e-05,
+ "loss": 0.023941578343510628,
+ "step": 575
+ },
+ {
+ "epoch": 2.911392405063291,
+ "grad_norm": 0.03701331466436386,
+ "learning_rate": 7.884399551066218e-05,
+ "loss": 0.01856887713074684,
+ "step": 576
+ },
+ {
+ "epoch": 2.9164556962025316,
+ "grad_norm": 0.05281993746757507,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.023393619805574417,
+ "step": 577
+ },
+ {
+ "epoch": 2.921518987341772,
+ "grad_norm": 0.03958812728524208,
+ "learning_rate": 7.873176206509541e-05,
+ "loss": 0.019871000200510025,
+ "step": 578
+ },
+ {
+ "epoch": 2.9265822784810127,
+ "grad_norm": 0.0439714752137661,
+ "learning_rate": 7.867564534231201e-05,
+ "loss": 0.025316016748547554,
+ "step": 579
+ },
+ {
+ "epoch": 2.9316455696202532,
+ "grad_norm": 0.03543296083807945,
+ "learning_rate": 7.861952861952863e-05,
+ "loss": 0.022549735382199287,
+ "step": 580
+ },
+ {
+ "epoch": 2.9367088607594938,
+ "grad_norm": 0.05503656715154648,
+ "learning_rate": 7.856341189674523e-05,
+ "loss": 0.02716357260942459,
+ "step": 581
+ },
+ {
+ "epoch": 2.9417721518987343,
+ "grad_norm": 0.03273561969399452,
+ "learning_rate": 7.850729517396185e-05,
+ "loss": 0.017606684938073158,
+ "step": 582
+ },
+ {
+ "epoch": 2.946835443037975,
+ "grad_norm": 0.04668378457427025,
+ "learning_rate": 7.845117845117845e-05,
+ "loss": 0.022529952228069305,
+ "step": 583
+ },
+ {
+ "epoch": 2.951898734177215,
+ "grad_norm": 0.034348756074905396,
+ "learning_rate": 7.839506172839507e-05,
+ "loss": 0.02549612522125244,
+ "step": 584
+ },
+ {
+ "epoch": 2.9569620253164555,
+ "grad_norm": 0.03485729172825813,
+ "learning_rate": 7.833894500561168e-05,
+ "loss": 0.019362375140190125,
+ "step": 585
+ },
+ {
+ "epoch": 2.962025316455696,
+ "grad_norm": 0.034695904701948166,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.023550841957330704,
+ "step": 586
+ },
+ {
+ "epoch": 2.9670886075949365,
+ "grad_norm": 0.02703205682337284,
+ "learning_rate": 7.82267115600449e-05,
+ "loss": 0.016860410571098328,
+ "step": 587
+ },
+ {
+ "epoch": 2.972151898734177,
+ "grad_norm": 0.0694100558757782,
+ "learning_rate": 7.817059483726151e-05,
+ "loss": 0.02669605240225792,
+ "step": 588
+ },
+ {
+ "epoch": 2.9772151898734176,
+ "grad_norm": 0.02641797810792923,
+ "learning_rate": 7.811447811447812e-05,
+ "loss": 0.019620027393102646,
+ "step": 589
+ },
+ {
+ "epoch": 2.982278481012658,
+ "grad_norm": 0.03643452376127243,
+ "learning_rate": 7.805836139169473e-05,
+ "loss": 0.018797604367136955,
+ "step": 590
+ },
+ {
+ "epoch": 2.9873417721518987,
+ "grad_norm": 0.04125158116221428,
+ "learning_rate": 7.800224466891134e-05,
+ "loss": 0.020387161523103714,
+ "step": 591
+ },
+ {
+ "epoch": 2.992405063291139,
+ "grad_norm": 0.037161167711019516,
+ "learning_rate": 7.794612794612795e-05,
+ "loss": 0.02484878897666931,
+ "step": 592
+ },
+ {
+ "epoch": 2.9974683544303797,
+ "grad_norm": 0.03352266550064087,
+ "learning_rate": 7.789001122334456e-05,
+ "loss": 0.022045889869332314,
+ "step": 593
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.07333379238843918,
+ "learning_rate": 7.783389450056117e-05,
+ "loss": 0.025806350633502007,
+ "step": 594
+ },
+ {
+ "epoch": 3.0050632911392405,
+ "grad_norm": 0.05492037162184715,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.025387149304151535,
+ "step": 595
+ },
+ {
+ "epoch": 3.010126582278481,
+ "grad_norm": 0.03932039067149162,
+ "learning_rate": 7.772166105499439e-05,
+ "loss": 0.020961906760931015,
+ "step": 596
+ },
+ {
+ "epoch": 3.0151898734177216,
+ "grad_norm": 0.03346814960241318,
+ "learning_rate": 7.7665544332211e-05,
+ "loss": 0.018602946773171425,
+ "step": 597
+ },
+ {
+ "epoch": 3.020253164556962,
+ "grad_norm": 0.041588157415390015,
+ "learning_rate": 7.760942760942761e-05,
+ "loss": 0.02350936457514763,
+ "step": 598
+ },
+ {
+ "epoch": 3.0253164556962027,
+ "grad_norm": 0.0634593740105629,
+ "learning_rate": 7.755331088664422e-05,
+ "loss": 0.02807607129216194,
+ "step": 599
+ },
+ {
+ "epoch": 3.030379746835443,
+ "grad_norm": 0.037369582802057266,
+ "learning_rate": 7.749719416386083e-05,
+ "loss": 0.01987743005156517,
+ "step": 600
+ },
+ {
+ "epoch": 3.0354430379746837,
+ "grad_norm": 0.051795534789562225,
+ "learning_rate": 7.744107744107744e-05,
+ "loss": 0.02273828536272049,
+ "step": 601
+ },
+ {
+ "epoch": 3.0405063291139243,
+ "grad_norm": 0.06508016586303711,
+ "learning_rate": 7.738496071829405e-05,
+ "loss": 0.022526375949382782,
+ "step": 602
+ },
+ {
+ "epoch": 3.0455696202531644,
+ "grad_norm": 0.05076521635055542,
+ "learning_rate": 7.732884399551068e-05,
+ "loss": 0.030540699139237404,
+ "step": 603
+ },
+ {
+ "epoch": 3.050632911392405,
+ "grad_norm": 0.05223327502608299,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.025222979485988617,
+ "step": 604
+ },
+ {
+ "epoch": 3.0556962025316454,
+ "grad_norm": 0.040298622101545334,
+ "learning_rate": 7.72166105499439e-05,
+ "loss": 0.024349395185709,
+ "step": 605
+ },
+ {
+ "epoch": 3.060759493670886,
+ "grad_norm": 0.031546592712402344,
+ "learning_rate": 7.716049382716049e-05,
+ "loss": 0.022118842229247093,
+ "step": 606
+ },
+ {
+ "epoch": 3.0658227848101265,
+ "grad_norm": 0.03639276325702667,
+ "learning_rate": 7.710437710437712e-05,
+ "loss": 0.019809089601039886,
+ "step": 607
+ },
+ {
+ "epoch": 3.070886075949367,
+ "grad_norm": 0.03702636435627937,
+ "learning_rate": 7.704826038159371e-05,
+ "loss": 0.023927533999085426,
+ "step": 608
+ },
+ {
+ "epoch": 3.0759493670886076,
+ "grad_norm": 0.027585966512560844,
+ "learning_rate": 7.699214365881034e-05,
+ "loss": 0.017853228375315666,
+ "step": 609
+ },
+ {
+ "epoch": 3.081012658227848,
+ "grad_norm": 0.036372315138578415,
+ "learning_rate": 7.693602693602693e-05,
+ "loss": 0.027036674320697784,
+ "step": 610
+ },
+ {
+ "epoch": 3.0860759493670886,
+ "grad_norm": 0.03734718635678291,
+ "learning_rate": 7.687991021324356e-05,
+ "loss": 0.021930409595370293,
+ "step": 611
+ },
+ {
+ "epoch": 3.091139240506329,
+ "grad_norm": 0.04167135804891586,
+ "learning_rate": 7.682379349046017e-05,
+ "loss": 0.02211524173617363,
+ "step": 612
+ },
+ {
+ "epoch": 3.0962025316455697,
+ "grad_norm": 0.06541049480438232,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.02102654054760933,
+ "step": 613
+ },
+ {
+ "epoch": 3.1012658227848102,
+ "grad_norm": 0.03505360335111618,
+ "learning_rate": 7.671156004489339e-05,
+ "loss": 0.021799035370349884,
+ "step": 614
+ },
+ {
+ "epoch": 3.1063291139240508,
+ "grad_norm": 0.038781505078077316,
+ "learning_rate": 7.665544332210998e-05,
+ "loss": 0.020275672897696495,
+ "step": 615
+ },
+ {
+ "epoch": 3.1113924050632913,
+ "grad_norm": 0.05527551844716072,
+ "learning_rate": 7.65993265993266e-05,
+ "loss": 0.02752656675875187,
+ "step": 616
+ },
+ {
+ "epoch": 3.116455696202532,
+ "grad_norm": 0.092417873442173,
+ "learning_rate": 7.65432098765432e-05,
+ "loss": 0.034416262060403824,
+ "step": 617
+ },
+ {
+ "epoch": 3.1215189873417724,
+ "grad_norm": 0.04619184136390686,
+ "learning_rate": 7.648709315375983e-05,
+ "loss": 0.028675489127635956,
+ "step": 618
+ },
+ {
+ "epoch": 3.1265822784810124,
+ "grad_norm": 0.027103425934910774,
+ "learning_rate": 7.643097643097644e-05,
+ "loss": 0.01944906637072563,
+ "step": 619
+ },
+ {
+ "epoch": 3.131645569620253,
+ "grad_norm": 0.062025271356105804,
+ "learning_rate": 7.637485970819305e-05,
+ "loss": 0.030966270714998245,
+ "step": 620
+ },
+ {
+ "epoch": 3.1367088607594935,
+ "grad_norm": 0.029828928411006927,
+ "learning_rate": 7.631874298540966e-05,
+ "loss": 0.02199825644493103,
+ "step": 621
+ },
+ {
+ "epoch": 3.141772151898734,
+ "grad_norm": 0.029867300763726234,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.02649630233645439,
+ "step": 622
+ },
+ {
+ "epoch": 3.1468354430379746,
+ "grad_norm": 0.055938251316547394,
+ "learning_rate": 7.620650953984288e-05,
+ "loss": 0.03135379031300545,
+ "step": 623
+ },
+ {
+ "epoch": 3.151898734177215,
+ "grad_norm": 0.035160645842552185,
+ "learning_rate": 7.615039281705949e-05,
+ "loss": 0.025492198765277863,
+ "step": 624
+ },
+ {
+ "epoch": 3.1569620253164556,
+ "grad_norm": 0.0550227165222168,
+ "learning_rate": 7.60942760942761e-05,
+ "loss": 0.024527709931135178,
+ "step": 625
+ },
+ {
+ "epoch": 3.162025316455696,
+ "grad_norm": 0.045406773686409,
+ "learning_rate": 7.603815937149271e-05,
+ "loss": 0.021749500185251236,
+ "step": 626
+ },
+ {
+ "epoch": 3.1670886075949367,
+ "grad_norm": 0.03407207131385803,
+ "learning_rate": 7.598204264870932e-05,
+ "loss": 0.022218957543373108,
+ "step": 627
+ },
+ {
+ "epoch": 3.1721518987341772,
+ "grad_norm": 0.07292751222848892,
+ "learning_rate": 7.592592592592593e-05,
+ "loss": 0.027731608599424362,
+ "step": 628
+ },
+ {
+ "epoch": 3.1772151898734178,
+ "grad_norm": 0.05087915435433388,
+ "learning_rate": 7.586980920314254e-05,
+ "loss": 0.025174522772431374,
+ "step": 629
+ },
+ {
+ "epoch": 3.1822784810126583,
+ "grad_norm": 0.03146078437566757,
+ "learning_rate": 7.581369248035916e-05,
+ "loss": 0.023854102939367294,
+ "step": 630
+ },
+ {
+ "epoch": 3.187341772151899,
+ "grad_norm": 0.03517632558941841,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.021264635026454926,
+ "step": 631
+ },
+ {
+ "epoch": 3.1924050632911394,
+ "grad_norm": 0.0355447381734848,
+ "learning_rate": 7.570145903479238e-05,
+ "loss": 0.023219801485538483,
+ "step": 632
+ },
+ {
+ "epoch": 3.19746835443038,
+ "grad_norm": 0.03751067817211151,
+ "learning_rate": 7.564534231200898e-05,
+ "loss": 0.02329118922352791,
+ "step": 633
+ },
+ {
+ "epoch": 3.2025316455696204,
+ "grad_norm": 0.03923696279525757,
+ "learning_rate": 7.558922558922559e-05,
+ "loss": 0.025390561670064926,
+ "step": 634
+ },
+ {
+ "epoch": 3.207594936708861,
+ "grad_norm": 0.03601266071200371,
+ "learning_rate": 7.55331088664422e-05,
+ "loss": 0.02001899480819702,
+ "step": 635
+ },
+ {
+ "epoch": 3.212658227848101,
+ "grad_norm": 0.032203998416662216,
+ "learning_rate": 7.547699214365881e-05,
+ "loss": 0.022725094109773636,
+ "step": 636
+ },
+ {
+ "epoch": 3.2177215189873416,
+ "grad_norm": 0.040842000395059586,
+ "learning_rate": 7.542087542087543e-05,
+ "loss": 0.021683380007743835,
+ "step": 637
+ },
+ {
+ "epoch": 3.222784810126582,
+ "grad_norm": 0.03078434057533741,
+ "learning_rate": 7.536475869809203e-05,
+ "loss": 0.02051977440714836,
+ "step": 638
+ },
+ {
+ "epoch": 3.2278481012658227,
+ "grad_norm": 0.025937417522072792,
+ "learning_rate": 7.530864197530865e-05,
+ "loss": 0.01884596049785614,
+ "step": 639
+ },
+ {
+ "epoch": 3.232911392405063,
+ "grad_norm": 0.0464826263487339,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.018389636650681496,
+ "step": 640
+ },
+ {
+ "epoch": 3.2379746835443037,
+ "grad_norm": 0.04150732606649399,
+ "learning_rate": 7.519640852974187e-05,
+ "loss": 0.020952530205249786,
+ "step": 641
+ },
+ {
+ "epoch": 3.2430379746835443,
+ "grad_norm": 0.04317227005958557,
+ "learning_rate": 7.514029180695847e-05,
+ "loss": 0.024093877524137497,
+ "step": 642
+ },
+ {
+ "epoch": 3.248101265822785,
+ "grad_norm": 0.04621734470129013,
+ "learning_rate": 7.508417508417509e-05,
+ "loss": 0.029940858483314514,
+ "step": 643
+ },
+ {
+ "epoch": 3.2531645569620253,
+ "grad_norm": 0.03514556586742401,
+ "learning_rate": 7.50280583613917e-05,
+ "loss": 0.022350966930389404,
+ "step": 644
+ },
+ {
+ "epoch": 3.258227848101266,
+ "grad_norm": 0.025245223194360733,
+ "learning_rate": 7.497194163860831e-05,
+ "loss": 0.018291346728801727,
+ "step": 645
+ },
+ {
+ "epoch": 3.2632911392405064,
+ "grad_norm": 0.02498617395758629,
+ "learning_rate": 7.491582491582492e-05,
+ "loss": 0.01909235306084156,
+ "step": 646
+ },
+ {
+ "epoch": 3.268354430379747,
+ "grad_norm": 0.022831663489341736,
+ "learning_rate": 7.485970819304153e-05,
+ "loss": 0.01462332159280777,
+ "step": 647
+ },
+ {
+ "epoch": 3.2734177215189875,
+ "grad_norm": 0.03779070824384689,
+ "learning_rate": 7.480359147025814e-05,
+ "loss": 0.019472766667604446,
+ "step": 648
+ },
+ {
+ "epoch": 3.278481012658228,
+ "grad_norm": 0.030341917648911476,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.018727967515587807,
+ "step": 649
+ },
+ {
+ "epoch": 3.2835443037974685,
+ "grad_norm": 0.045589644461870193,
+ "learning_rate": 7.469135802469136e-05,
+ "loss": 0.023640938103199005,
+ "step": 650
+ },
+ {
+ "epoch": 3.2886075949367086,
+ "grad_norm": 0.023883633315563202,
+ "learning_rate": 7.463524130190797e-05,
+ "loss": 0.019227800890803337,
+ "step": 651
+ },
+ {
+ "epoch": 3.293670886075949,
+ "grad_norm": 0.03794898837804794,
+ "learning_rate": 7.457912457912458e-05,
+ "loss": 0.02445095032453537,
+ "step": 652
+ },
+ {
+ "epoch": 3.2987341772151897,
+ "grad_norm": 0.1442285180091858,
+ "learning_rate": 7.452300785634119e-05,
+ "loss": 0.023129010573029518,
+ "step": 653
+ },
+ {
+ "epoch": 3.3037974683544302,
+ "grad_norm": 0.03197013959288597,
+ "learning_rate": 7.44668911335578e-05,
+ "loss": 0.02768155373632908,
+ "step": 654
+ },
+ {
+ "epoch": 3.3088607594936708,
+ "grad_norm": 0.0434270016849041,
+ "learning_rate": 7.441077441077443e-05,
+ "loss": 0.02330004796385765,
+ "step": 655
+ },
+ {
+ "epoch": 3.3139240506329113,
+ "grad_norm": 0.03878983482718468,
+ "learning_rate": 7.435465768799102e-05,
+ "loss": 0.028383342549204826,
+ "step": 656
+ },
+ {
+ "epoch": 3.318987341772152,
+ "grad_norm": 0.035334642976522446,
+ "learning_rate": 7.429854096520763e-05,
+ "loss": 0.02583262138068676,
+ "step": 657
+ },
+ {
+ "epoch": 3.3240506329113924,
+ "grad_norm": 0.0473608672618866,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.030471306294202805,
+ "step": 658
+ },
+ {
+ "epoch": 3.329113924050633,
+ "grad_norm": 0.04193368926644325,
+ "learning_rate": 7.418630751964085e-05,
+ "loss": 0.016215423122048378,
+ "step": 659
+ },
+ {
+ "epoch": 3.3341772151898734,
+ "grad_norm": 0.023891586810350418,
+ "learning_rate": 7.413019079685746e-05,
+ "loss": 0.021040987223386765,
+ "step": 660
+ },
+ {
+ "epoch": 3.339240506329114,
+ "grad_norm": 0.029971614480018616,
+ "learning_rate": 7.407407407407407e-05,
+ "loss": 0.022258542478084564,
+ "step": 661
+ },
+ {
+ "epoch": 3.3443037974683545,
+ "grad_norm": 0.035308364778757095,
+ "learning_rate": 7.401795735129068e-05,
+ "loss": 0.02215534821152687,
+ "step": 662
+ },
+ {
+ "epoch": 3.349367088607595,
+ "grad_norm": 0.036979664117097855,
+ "learning_rate": 7.39618406285073e-05,
+ "loss": 0.027577020227909088,
+ "step": 663
+ },
+ {
+ "epoch": 3.3544303797468356,
+ "grad_norm": 0.03403281047940254,
+ "learning_rate": 7.390572390572392e-05,
+ "loss": 0.024540117010474205,
+ "step": 664
+ },
+ {
+ "epoch": 3.359493670886076,
+ "grad_norm": 0.04739405959844589,
+ "learning_rate": 7.384960718294051e-05,
+ "loss": 0.01647120714187622,
+ "step": 665
+ },
+ {
+ "epoch": 3.3645569620253166,
+ "grad_norm": 0.036933764815330505,
+ "learning_rate": 7.379349046015714e-05,
+ "loss": 0.02817656472325325,
+ "step": 666
+ },
+ {
+ "epoch": 3.369620253164557,
+ "grad_norm": 0.05966564640402794,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.028103439137339592,
+ "step": 667
+ },
+ {
+ "epoch": 3.3746835443037977,
+ "grad_norm": 0.09403033554553986,
+ "learning_rate": 7.368125701459036e-05,
+ "loss": 0.024899154901504517,
+ "step": 668
+ },
+ {
+ "epoch": 3.379746835443038,
+ "grad_norm": 0.056374453008174896,
+ "learning_rate": 7.362514029180695e-05,
+ "loss": 0.025570789352059364,
+ "step": 669
+ },
+ {
+ "epoch": 3.3848101265822783,
+ "grad_norm": 0.056454673409461975,
+ "learning_rate": 7.356902356902358e-05,
+ "loss": 0.02471453696489334,
+ "step": 670
+ },
+ {
+ "epoch": 3.389873417721519,
+ "grad_norm": 0.04115903005003929,
+ "learning_rate": 7.351290684624019e-05,
+ "loss": 0.017306309193372726,
+ "step": 671
+ },
+ {
+ "epoch": 3.3949367088607594,
+ "grad_norm": 0.030604340136051178,
+ "learning_rate": 7.34567901234568e-05,
+ "loss": 0.019510511308908463,
+ "step": 672
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.059018854051828384,
+ "learning_rate": 7.340067340067341e-05,
+ "loss": 0.02810611203312874,
+ "step": 673
+ },
+ {
+ "epoch": 3.4050632911392404,
+ "grad_norm": 0.026413513347506523,
+ "learning_rate": 7.334455667789002e-05,
+ "loss": 0.018966296687722206,
+ "step": 674
+ },
+ {
+ "epoch": 3.410126582278481,
+ "grad_norm": 0.03285476937890053,
+ "learning_rate": 7.328843995510663e-05,
+ "loss": 0.026708189398050308,
+ "step": 675
+ },
+ {
+ "epoch": 3.4151898734177215,
+ "grad_norm": 0.0392388291656971,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.022320115938782692,
+ "step": 676
+ },
+ {
+ "epoch": 3.420253164556962,
+ "grad_norm": 0.0305775236338377,
+ "learning_rate": 7.317620650953985e-05,
+ "loss": 0.018710114061832428,
+ "step": 677
+ },
+ {
+ "epoch": 3.4253164556962026,
+ "grad_norm": 0.033393554389476776,
+ "learning_rate": 7.312008978675646e-05,
+ "loss": 0.018753021955490112,
+ "step": 678
+ },
+ {
+ "epoch": 3.430379746835443,
+ "grad_norm": 0.02704286389052868,
+ "learning_rate": 7.306397306397307e-05,
+ "loss": 0.01539788581430912,
+ "step": 679
+ },
+ {
+ "epoch": 3.4354430379746836,
+ "grad_norm": 0.038779884576797485,
+ "learning_rate": 7.300785634118968e-05,
+ "loss": 0.024458929896354675,
+ "step": 680
+ },
+ {
+ "epoch": 3.440506329113924,
+ "grad_norm": 0.061135295778512955,
+ "learning_rate": 7.295173961840629e-05,
+ "loss": 0.021106259897351265,
+ "step": 681
+ },
+ {
+ "epoch": 3.4455696202531647,
+ "grad_norm": 0.02436748333275318,
+ "learning_rate": 7.28956228956229e-05,
+ "loss": 0.019037332385778427,
+ "step": 682
+ },
+ {
+ "epoch": 3.4506329113924052,
+ "grad_norm": 0.037567682564258575,
+ "learning_rate": 7.283950617283951e-05,
+ "loss": 0.02065495029091835,
+ "step": 683
+ },
+ {
+ "epoch": 3.4556962025316453,
+ "grad_norm": 0.03743781894445419,
+ "learning_rate": 7.278338945005612e-05,
+ "loss": 0.02559451386332512,
+ "step": 684
+ },
+ {
+ "epoch": 3.460759493670886,
+ "grad_norm": 0.04715351387858391,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.021420618519186974,
+ "step": 685
+ },
+ {
+ "epoch": 3.4658227848101264,
+ "grad_norm": 0.02502383477985859,
+ "learning_rate": 7.267115600448934e-05,
+ "loss": 0.019398193806409836,
+ "step": 686
+ },
+ {
+ "epoch": 3.470886075949367,
+ "grad_norm": 0.02199714072048664,
+ "learning_rate": 7.261503928170595e-05,
+ "loss": 0.019068796187639236,
+ "step": 687
+ },
+ {
+ "epoch": 3.4759493670886075,
+ "grad_norm": 0.034711211919784546,
+ "learning_rate": 7.255892255892256e-05,
+ "loss": 0.021794648841023445,
+ "step": 688
+ },
+ {
+ "epoch": 3.481012658227848,
+ "grad_norm": 0.040784433484077454,
+ "learning_rate": 7.250280583613918e-05,
+ "loss": 0.022812314331531525,
+ "step": 689
+ },
+ {
+ "epoch": 3.4860759493670885,
+ "grad_norm": 0.035993628203868866,
+ "learning_rate": 7.244668911335578e-05,
+ "loss": 0.026385463774204254,
+ "step": 690
+ },
+ {
+ "epoch": 3.491139240506329,
+ "grad_norm": 0.031834330409765244,
+ "learning_rate": 7.23905723905724e-05,
+ "loss": 0.022114556282758713,
+ "step": 691
+ },
+ {
+ "epoch": 3.4962025316455696,
+ "grad_norm": 0.025820165872573853,
+ "learning_rate": 7.2334455667789e-05,
+ "loss": 0.01813361421227455,
+ "step": 692
+ },
+ {
+ "epoch": 3.50126582278481,
+ "grad_norm": 0.04998617246747017,
+ "learning_rate": 7.227833894500562e-05,
+ "loss": 0.022573690861463547,
+ "step": 693
+ },
+ {
+ "epoch": 3.5063291139240507,
+ "grad_norm": 0.04184528812766075,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.026092834770679474,
+ "step": 694
+ },
+ {
+ "epoch": 3.511392405063291,
+ "grad_norm": 0.050683457404375076,
+ "learning_rate": 7.216610549943884e-05,
+ "loss": 0.021743692457675934,
+ "step": 695
+ },
+ {
+ "epoch": 3.5164556962025317,
+ "grad_norm": 0.07393304258584976,
+ "learning_rate": 7.210998877665545e-05,
+ "loss": 0.024253465235233307,
+ "step": 696
+ },
+ {
+ "epoch": 3.5215189873417723,
+ "grad_norm": 0.02564188838005066,
+ "learning_rate": 7.205387205387206e-05,
+ "loss": 0.019201550632715225,
+ "step": 697
+ },
+ {
+ "epoch": 3.526582278481013,
+ "grad_norm": 0.035527680069208145,
+ "learning_rate": 7.199775533108867e-05,
+ "loss": 0.02153913676738739,
+ "step": 698
+ },
+ {
+ "epoch": 3.5316455696202533,
+ "grad_norm": 0.036737874150276184,
+ "learning_rate": 7.194163860830527e-05,
+ "loss": 0.025572702288627625,
+ "step": 699
+ },
+ {
+ "epoch": 3.536708860759494,
+ "grad_norm": 0.03383871540427208,
+ "learning_rate": 7.188552188552189e-05,
+ "loss": 0.017153475433588028,
+ "step": 700
+ },
+ {
+ "epoch": 3.5417721518987344,
+ "grad_norm": 0.0350637212395668,
+ "learning_rate": 7.182940516273849e-05,
+ "loss": 0.018297579139471054,
+ "step": 701
+ },
+ {
+ "epoch": 3.546835443037975,
+ "grad_norm": 0.029637211933732033,
+ "learning_rate": 7.177328843995511e-05,
+ "loss": 0.017981912940740585,
+ "step": 702
+ },
+ {
+ "epoch": 3.5518987341772155,
+ "grad_norm": 0.03611799329519272,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.02710491605103016,
+ "step": 703
+ },
+ {
+ "epoch": 3.5569620253164556,
+ "grad_norm": 0.02008277364075184,
+ "learning_rate": 7.166105499438833e-05,
+ "loss": 0.02035117708146572,
+ "step": 704
+ },
+ {
+ "epoch": 3.562025316455696,
+ "grad_norm": 0.026698170229792595,
+ "learning_rate": 7.160493827160494e-05,
+ "loss": 0.017481079325079918,
+ "step": 705
+ },
+ {
+ "epoch": 3.5670886075949366,
+ "grad_norm": 0.036382947117090225,
+ "learning_rate": 7.154882154882155e-05,
+ "loss": 0.019109399989247322,
+ "step": 706
+ },
+ {
+ "epoch": 3.572151898734177,
+ "grad_norm": 0.04591331630945206,
+ "learning_rate": 7.149270482603816e-05,
+ "loss": 0.023143479600548744,
+ "step": 707
+ },
+ {
+ "epoch": 3.5772151898734177,
+ "grad_norm": 0.04864713177084923,
+ "learning_rate": 7.143658810325477e-05,
+ "loss": 0.022374317049980164,
+ "step": 708
+ },
+ {
+ "epoch": 3.5822784810126582,
+ "grad_norm": 0.03528938442468643,
+ "learning_rate": 7.138047138047138e-05,
+ "loss": 0.021928273141384125,
+ "step": 709
+ },
+ {
+ "epoch": 3.5873417721518988,
+ "grad_norm": 0.03548784181475639,
+ "learning_rate": 7.1324354657688e-05,
+ "loss": 0.02179766446352005,
+ "step": 710
+ },
+ {
+ "epoch": 3.5924050632911393,
+ "grad_norm": 0.041786350309848785,
+ "learning_rate": 7.12682379349046e-05,
+ "loss": 0.028576329350471497,
+ "step": 711
+ },
+ {
+ "epoch": 3.59746835443038,
+ "grad_norm": 0.03197047486901283,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.018731534481048584,
+ "step": 712
+ },
+ {
+ "epoch": 3.6025316455696204,
+ "grad_norm": 0.04037933051586151,
+ "learning_rate": 7.115600448933782e-05,
+ "loss": 0.024375513195991516,
+ "step": 713
+ },
+ {
+ "epoch": 3.607594936708861,
+ "grad_norm": 0.032266534864902496,
+ "learning_rate": 7.109988776655443e-05,
+ "loss": 0.016232451424002647,
+ "step": 714
+ },
+ {
+ "epoch": 3.6126582278481014,
+ "grad_norm": 0.02890392392873764,
+ "learning_rate": 7.104377104377104e-05,
+ "loss": 0.018303632736206055,
+ "step": 715
+ },
+ {
+ "epoch": 3.6177215189873415,
+ "grad_norm": 0.032750677317380905,
+ "learning_rate": 7.098765432098767e-05,
+ "loss": 0.021466076374053955,
+ "step": 716
+ },
+ {
+ "epoch": 3.622784810126582,
+ "grad_norm": 0.05076618492603302,
+ "learning_rate": 7.093153759820426e-05,
+ "loss": 0.022349126636981964,
+ "step": 717
+ },
+ {
+ "epoch": 3.6278481012658226,
+ "grad_norm": 0.034143563359975815,
+ "learning_rate": 7.087542087542089e-05,
+ "loss": 0.02274998091161251,
+ "step": 718
+ },
+ {
+ "epoch": 3.632911392405063,
+ "grad_norm": 0.025406064465641975,
+ "learning_rate": 7.081930415263748e-05,
+ "loss": 0.016980832442641258,
+ "step": 719
+ },
+ {
+ "epoch": 3.6379746835443036,
+ "grad_norm": 0.031938597559928894,
+ "learning_rate": 7.076318742985411e-05,
+ "loss": 0.023153938353061676,
+ "step": 720
+ },
+ {
+ "epoch": 3.643037974683544,
+ "grad_norm": 0.03354712948203087,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.018384695053100586,
+ "step": 721
+ },
+ {
+ "epoch": 3.6481012658227847,
+ "grad_norm": 0.028671689331531525,
+ "learning_rate": 7.065095398428731e-05,
+ "loss": 0.021795600652694702,
+ "step": 722
+ },
+ {
+ "epoch": 3.6531645569620252,
+ "grad_norm": 0.057982735335826874,
+ "learning_rate": 7.059483726150394e-05,
+ "loss": 0.026870068162679672,
+ "step": 723
+ },
+ {
+ "epoch": 3.6582278481012658,
+ "grad_norm": 0.036460306495428085,
+ "learning_rate": 7.053872053872053e-05,
+ "loss": 0.019742611795663834,
+ "step": 724
+ },
+ {
+ "epoch": 3.6632911392405063,
+ "grad_norm": 0.06633497029542923,
+ "learning_rate": 7.048260381593716e-05,
+ "loss": 0.01737678050994873,
+ "step": 725
+ },
+ {
+ "epoch": 3.668354430379747,
+ "grad_norm": 0.0410747192800045,
+ "learning_rate": 7.042648709315375e-05,
+ "loss": 0.023570548743009567,
+ "step": 726
+ },
+ {
+ "epoch": 3.6734177215189874,
+ "grad_norm": 0.04499414190649986,
+ "learning_rate": 7.037037037037038e-05,
+ "loss": 0.024305228143930435,
+ "step": 727
+ },
+ {
+ "epoch": 3.678481012658228,
+ "grad_norm": 0.024429699406027794,
+ "learning_rate": 7.031425364758697e-05,
+ "loss": 0.018056385219097137,
+ "step": 728
+ },
+ {
+ "epoch": 3.6835443037974684,
+ "grad_norm": 0.03042393922805786,
+ "learning_rate": 7.02581369248036e-05,
+ "loss": 0.019678741693496704,
+ "step": 729
+ },
+ {
+ "epoch": 3.688607594936709,
+ "grad_norm": 0.04088849946856499,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.026466136798262596,
+ "step": 730
+ },
+ {
+ "epoch": 3.6936708860759495,
+ "grad_norm": 0.03353559225797653,
+ "learning_rate": 7.014590347923682e-05,
+ "loss": 0.021056771278381348,
+ "step": 731
+ },
+ {
+ "epoch": 3.69873417721519,
+ "grad_norm": 0.03120904415845871,
+ "learning_rate": 7.008978675645343e-05,
+ "loss": 0.020675398409366608,
+ "step": 732
+ },
+ {
+ "epoch": 3.7037974683544306,
+ "grad_norm": 0.05723356828093529,
+ "learning_rate": 7.003367003367004e-05,
+ "loss": 0.033802516758441925,
+ "step": 733
+ },
+ {
+ "epoch": 3.708860759493671,
+ "grad_norm": 0.03580084443092346,
+ "learning_rate": 6.997755331088665e-05,
+ "loss": 0.026392754167318344,
+ "step": 734
+ },
+ {
+ "epoch": 3.7139240506329116,
+ "grad_norm": 0.05164967477321625,
+ "learning_rate": 6.992143658810326e-05,
+ "loss": 0.0241309255361557,
+ "step": 735
+ },
+ {
+ "epoch": 3.7189873417721517,
+ "grad_norm": 0.02190530300140381,
+ "learning_rate": 6.986531986531987e-05,
+ "loss": 0.018209822475910187,
+ "step": 736
+ },
+ {
+ "epoch": 3.7240506329113923,
+ "grad_norm": 0.027256503701210022,
+ "learning_rate": 6.980920314253648e-05,
+ "loss": 0.022063471376895905,
+ "step": 737
+ },
+ {
+ "epoch": 3.729113924050633,
+ "grad_norm": 0.03337831795215607,
+ "learning_rate": 6.975308641975309e-05,
+ "loss": 0.018506363034248352,
+ "step": 738
+ },
+ {
+ "epoch": 3.7341772151898733,
+ "grad_norm": 0.025730784982442856,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.016883976757526398,
+ "step": 739
+ },
+ {
+ "epoch": 3.739240506329114,
+ "grad_norm": 0.026203135028481483,
+ "learning_rate": 6.964085297418631e-05,
+ "loss": 0.023329125717282295,
+ "step": 740
+ },
+ {
+ "epoch": 3.7443037974683544,
+ "grad_norm": 0.02676830254495144,
+ "learning_rate": 6.958473625140293e-05,
+ "loss": 0.020962664857506752,
+ "step": 741
+ },
+ {
+ "epoch": 3.749367088607595,
+ "grad_norm": 0.019974667578935623,
+ "learning_rate": 6.952861952861953e-05,
+ "loss": 0.018353454768657684,
+ "step": 742
+ },
+ {
+ "epoch": 3.7544303797468355,
+ "grad_norm": 0.02399631030857563,
+ "learning_rate": 6.947250280583614e-05,
+ "loss": 0.01820143684744835,
+ "step": 743
+ },
+ {
+ "epoch": 3.759493670886076,
+ "grad_norm": 0.02083951234817505,
+ "learning_rate": 6.941638608305275e-05,
+ "loss": 0.02312408946454525,
+ "step": 744
+ },
+ {
+ "epoch": 3.7645569620253165,
+ "grad_norm": 0.025636207312345505,
+ "learning_rate": 6.936026936026936e-05,
+ "loss": 0.01757936365902424,
+ "step": 745
+ },
+ {
+ "epoch": 3.769620253164557,
+ "grad_norm": 0.036856744438409805,
+ "learning_rate": 6.930415263748597e-05,
+ "loss": 0.028933756053447723,
+ "step": 746
+ },
+ {
+ "epoch": 3.7746835443037976,
+ "grad_norm": 0.037415456026792526,
+ "learning_rate": 6.924803591470258e-05,
+ "loss": 0.022136090323328972,
+ "step": 747
+ },
+ {
+ "epoch": 3.779746835443038,
+ "grad_norm": 0.027949288487434387,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.022943630814552307,
+ "step": 748
+ },
+ {
+ "epoch": 3.7848101265822782,
+ "grad_norm": 0.037508148699998856,
+ "learning_rate": 6.91358024691358e-05,
+ "loss": 0.020460065454244614,
+ "step": 749
+ },
+ {
+ "epoch": 3.7898734177215188,
+ "grad_norm": 0.037965189665555954,
+ "learning_rate": 6.907968574635242e-05,
+ "loss": 0.024793215095996857,
+ "step": 750
+ },
+ {
+ "epoch": 3.7949367088607593,
+ "grad_norm": 0.027956753969192505,
+ "learning_rate": 6.902356902356902e-05,
+ "loss": 0.02188705839216709,
+ "step": 751
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.027417965233325958,
+ "learning_rate": 6.896745230078564e-05,
+ "loss": 0.01465995516628027,
+ "step": 752
+ },
+ {
+ "epoch": 3.8050632911392404,
+ "grad_norm": 0.036644525825977325,
+ "learning_rate": 6.891133557800224e-05,
+ "loss": 0.020246809348464012,
+ "step": 753
+ },
+ {
+ "epoch": 3.810126582278481,
+ "grad_norm": 0.027043674141168594,
+ "learning_rate": 6.885521885521886e-05,
+ "loss": 0.02293788641691208,
+ "step": 754
+ },
+ {
+ "epoch": 3.8151898734177214,
+ "grad_norm": 0.033968694508075714,
+ "learning_rate": 6.879910213243546e-05,
+ "loss": 0.024979766458272934,
+ "step": 755
+ },
+ {
+ "epoch": 3.820253164556962,
+ "grad_norm": 0.022790739312767982,
+ "learning_rate": 6.874298540965208e-05,
+ "loss": 0.019254112616181374,
+ "step": 756
+ },
+ {
+ "epoch": 3.8253164556962025,
+ "grad_norm": 0.028349611908197403,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.018624842166900635,
+ "step": 757
+ },
+ {
+ "epoch": 3.830379746835443,
+ "grad_norm": 0.034140367060899734,
+ "learning_rate": 6.86307519640853e-05,
+ "loss": 0.01691599376499653,
+ "step": 758
+ },
+ {
+ "epoch": 3.8354430379746836,
+ "grad_norm": 0.03422265127301216,
+ "learning_rate": 6.857463524130191e-05,
+ "loss": 0.01864086464047432,
+ "step": 759
+ },
+ {
+ "epoch": 3.840506329113924,
+ "grad_norm": 0.037322208285331726,
+ "learning_rate": 6.851851851851852e-05,
+ "loss": 0.024382904171943665,
+ "step": 760
+ },
+ {
+ "epoch": 3.8455696202531646,
+ "grad_norm": 0.022540392354130745,
+ "learning_rate": 6.846240179573513e-05,
+ "loss": 0.017390096560120583,
+ "step": 761
+ },
+ {
+ "epoch": 3.850632911392405,
+ "grad_norm": 0.035701289772987366,
+ "learning_rate": 6.840628507295174e-05,
+ "loss": 0.01928594335913658,
+ "step": 762
+ },
+ {
+ "epoch": 3.8556962025316457,
+ "grad_norm": 0.047425150871276855,
+ "learning_rate": 6.835016835016835e-05,
+ "loss": 0.026818927377462387,
+ "step": 763
+ },
+ {
+ "epoch": 3.8607594936708862,
+ "grad_norm": 0.0244912076741457,
+ "learning_rate": 6.829405162738496e-05,
+ "loss": 0.01811584085226059,
+ "step": 764
+ },
+ {
+ "epoch": 3.8658227848101268,
+ "grad_norm": 0.03282126039266586,
+ "learning_rate": 6.823793490460157e-05,
+ "loss": 0.01521163061261177,
+ "step": 765
+ },
+ {
+ "epoch": 3.8708860759493673,
+ "grad_norm": 0.030519530177116394,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.023735523223876953,
+ "step": 766
+ },
+ {
+ "epoch": 3.875949367088608,
+ "grad_norm": 0.03829387575387955,
+ "learning_rate": 6.81257014590348e-05,
+ "loss": 0.02391430363059044,
+ "step": 767
+ },
+ {
+ "epoch": 3.8810126582278484,
+ "grad_norm": 0.03133988752961159,
+ "learning_rate": 6.80695847362514e-05,
+ "loss": 0.022026970982551575,
+ "step": 768
+ },
+ {
+ "epoch": 3.8860759493670884,
+ "grad_norm": 0.036327920854091644,
+ "learning_rate": 6.801346801346801e-05,
+ "loss": 0.01740797609090805,
+ "step": 769
+ },
+ {
+ "epoch": 3.891139240506329,
+ "grad_norm": 0.06766671687364578,
+ "learning_rate": 6.795735129068462e-05,
+ "loss": 0.02804078534245491,
+ "step": 770
+ },
+ {
+ "epoch": 3.8962025316455695,
+ "grad_norm": 0.06390757858753204,
+ "learning_rate": 6.790123456790123e-05,
+ "loss": 0.032084181904792786,
+ "step": 771
+ },
+ {
+ "epoch": 3.90126582278481,
+ "grad_norm": 0.03238178789615631,
+ "learning_rate": 6.784511784511784e-05,
+ "loss": 0.02189403772354126,
+ "step": 772
+ },
+ {
+ "epoch": 3.9063291139240506,
+ "grad_norm": 0.03206197917461395,
+ "learning_rate": 6.778900112233445e-05,
+ "loss": 0.022829271852970123,
+ "step": 773
+ },
+ {
+ "epoch": 3.911392405063291,
+ "grad_norm": 0.030897945165634155,
+ "learning_rate": 6.773288439955107e-05,
+ "loss": 0.021807631477713585,
+ "step": 774
+ },
+ {
+ "epoch": 3.9164556962025316,
+ "grad_norm": 0.04285162314772606,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.023028545081615448,
+ "step": 775
+ },
+ {
+ "epoch": 3.921518987341772,
+ "grad_norm": 0.02819208987057209,
+ "learning_rate": 6.762065095398429e-05,
+ "loss": 0.02110828459262848,
+ "step": 776
+ },
+ {
+ "epoch": 3.9265822784810127,
+ "grad_norm": 0.03159799054265022,
+ "learning_rate": 6.756453423120091e-05,
+ "loss": 0.02116553671658039,
+ "step": 777
+ },
+ {
+ "epoch": 3.9316455696202532,
+ "grad_norm": 0.028514137491583824,
+ "learning_rate": 6.75084175084175e-05,
+ "loss": 0.020262988284230232,
+ "step": 778
+ },
+ {
+ "epoch": 3.9367088607594938,
+ "grad_norm": 0.03610249608755112,
+ "learning_rate": 6.745230078563413e-05,
+ "loss": 0.016928158700466156,
+ "step": 779
+ },
+ {
+ "epoch": 3.9417721518987343,
+ "grad_norm": 0.02753387950360775,
+ "learning_rate": 6.739618406285073e-05,
+ "loss": 0.022629719227552414,
+ "step": 780
+ },
+ {
+ "epoch": 3.946835443037975,
+ "grad_norm": 0.026071136817336082,
+ "learning_rate": 6.734006734006735e-05,
+ "loss": 0.020297978073358536,
+ "step": 781
+ },
+ {
+ "epoch": 3.951898734177215,
+ "grad_norm": 0.04774617776274681,
+ "learning_rate": 6.728395061728396e-05,
+ "loss": 0.01858438178896904,
+ "step": 782
+ },
+ {
+ "epoch": 3.9569620253164555,
+ "grad_norm": 0.03666248545050621,
+ "learning_rate": 6.722783389450057e-05,
+ "loss": 0.024037979543209076,
+ "step": 783
+ },
+ {
+ "epoch": 3.962025316455696,
+ "grad_norm": 0.04990983009338379,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.027675451710820198,
+ "step": 784
+ },
+ {
+ "epoch": 3.9670886075949365,
+ "grad_norm": 0.04734862968325615,
+ "learning_rate": 6.711560044893379e-05,
+ "loss": 0.02003151923418045,
+ "step": 785
+ },
+ {
+ "epoch": 3.972151898734177,
+ "grad_norm": 0.031911976635456085,
+ "learning_rate": 6.70594837261504e-05,
+ "loss": 0.02302616462111473,
+ "step": 786
+ },
+ {
+ "epoch": 3.9772151898734176,
+ "grad_norm": 0.03199504688382149,
+ "learning_rate": 6.7003367003367e-05,
+ "loss": 0.020066704601049423,
+ "step": 787
+ },
+ {
+ "epoch": 3.982278481012658,
+ "grad_norm": 0.02664150856435299,
+ "learning_rate": 6.694725028058362e-05,
+ "loss": 0.01888475939631462,
+ "step": 788
+ },
+ {
+ "epoch": 3.9873417721518987,
+ "grad_norm": 0.03886157646775246,
+ "learning_rate": 6.689113355780023e-05,
+ "loss": 0.016029106453061104,
+ "step": 789
+ },
+ {
+ "epoch": 3.992405063291139,
+ "grad_norm": 0.025033561512827873,
+ "learning_rate": 6.683501683501684e-05,
+ "loss": 0.01627909578382969,
+ "step": 790
+ },
+ {
+ "epoch": 3.9974683544303797,
+ "grad_norm": 0.04991500452160835,
+ "learning_rate": 6.677890011223345e-05,
+ "loss": 0.02633330039680004,
+ "step": 791
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.0552835538983345,
+ "learning_rate": 6.672278338945006e-05,
+ "loss": 0.025268658995628357,
+ "step": 792
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 1980,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 5.043302231937024e+16,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-792/training_args.bin b/checkpoint-792/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ce6b9228ad6cf155da5af64a370f864d5fe04e56
--- /dev/null
+++ b/checkpoint-792/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3a4d7936dc7001e3baf6e9cead308b6188ace221538f9d436668bdf0b1d43a1
+size 5777
diff --git a/checkpoint-990/README.md b/checkpoint-990/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/checkpoint-990/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/checkpoint-990/adapter_config.json b/checkpoint-990/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..879d59d17cdb2aff2a9fcb7e4537a4f740bf19f5
--- /dev/null
+++ b/checkpoint-990/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "q_proj",
+ "o_proj",
+ "up_proj",
+ "down_proj",
+ "v_proj",
+ "k_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/checkpoint-990/adapter_model.safetensors b/checkpoint-990/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..4255a598b9888d55a70954fc870d496776419f1b
--- /dev/null
+++ b/checkpoint-990/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73d030621a9c1074202f5af321d431d50dc6fd0b99c1986d24ba43ac8d6ab0ee
+size 132187888
diff --git a/checkpoint-990/chat_template.jinja b/checkpoint-990/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/checkpoint-990/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/checkpoint-990/optimizer.pt b/checkpoint-990/optimizer.pt
new file mode 100644
index 0000000000000000000000000000000000000000..780594db6c378c00ad4f43a6b880bd056c288b96
--- /dev/null
+++ b/checkpoint-990/optimizer.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:30b3749507cc4ebf2063e99f53d2b444a98ba547bf58435b566a2839ce585b66
+size 67688645
diff --git a/checkpoint-990/rng_state.pth b/checkpoint-990/rng_state.pth
new file mode 100644
index 0000000000000000000000000000000000000000..ecd5163c23b56be6c4d0a107794dc7b316f940a1
--- /dev/null
+++ b/checkpoint-990/rng_state.pth
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89645f9f6a2a8823b334e0748e4f5ea683a27b3d02632f0a241397db55d82fad
+size 14645
diff --git a/checkpoint-990/scheduler.pt b/checkpoint-990/scheduler.pt
new file mode 100644
index 0000000000000000000000000000000000000000..03d2cf252056199285c7187c6cbd52b3ad56bbef
--- /dev/null
+++ b/checkpoint-990/scheduler.pt
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6349da64557b66376073e62beaaf27c2d935587cba51954959d0a8f81b6bf193
+size 1465
diff --git a/checkpoint-990/tokenizer.json b/checkpoint-990/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/checkpoint-990/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/checkpoint-990/tokenizer_config.json b/checkpoint-990/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..89c493adc6c466aa455f7fa81967d7029bb19edf
--- /dev/null
+++ b/checkpoint-990/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "right",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}
diff --git a/checkpoint-990/trainer_state.json b/checkpoint-990/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..8bbe88c2b570ac7f34799ca1204fe88a7468bf89
--- /dev/null
+++ b/checkpoint-990/trainer_state.json
@@ -0,0 +1,6964 @@
+{
+ "best_global_step": null,
+ "best_metric": null,
+ "best_model_checkpoint": null,
+ "epoch": 5.0,
+ "eval_steps": 500,
+ "global_step": 990,
+ "is_hyper_param_search": false,
+ "is_local_process_zero": true,
+ "is_world_process_zero": true,
+ "log_history": [
+ {
+ "epoch": 0.005063291139240506,
+ "grad_norm": 0.54137122631073,
+ "learning_rate": 0.0,
+ "loss": 0.8150296211242676,
+ "step": 1
+ },
+ {
+ "epoch": 0.010126582278481013,
+ "grad_norm": 0.6279057860374451,
+ "learning_rate": 5.050505050505052e-07,
+ "loss": 0.9252954721450806,
+ "step": 2
+ },
+ {
+ "epoch": 0.015189873417721518,
+ "grad_norm": 0.7017749547958374,
+ "learning_rate": 1.0101010101010103e-06,
+ "loss": 1.0435928106307983,
+ "step": 3
+ },
+ {
+ "epoch": 0.020253164556962026,
+ "grad_norm": 0.6033008098602295,
+ "learning_rate": 1.5151515151515152e-06,
+ "loss": 0.8843490481376648,
+ "step": 4
+ },
+ {
+ "epoch": 0.02531645569620253,
+ "grad_norm": 0.5495544672012329,
+ "learning_rate": 2.0202020202020206e-06,
+ "loss": 0.8034592866897583,
+ "step": 5
+ },
+ {
+ "epoch": 0.030379746835443037,
+ "grad_norm": 0.802371621131897,
+ "learning_rate": 2.5252525252525253e-06,
+ "loss": 1.1588364839553833,
+ "step": 6
+ },
+ {
+ "epoch": 0.035443037974683546,
+ "grad_norm": 0.8238587975502014,
+ "learning_rate": 3.0303030303030305e-06,
+ "loss": 1.228503942489624,
+ "step": 7
+ },
+ {
+ "epoch": 0.04050632911392405,
+ "grad_norm": 0.6073964238166809,
+ "learning_rate": 3.5353535353535352e-06,
+ "loss": 0.8989433646202087,
+ "step": 8
+ },
+ {
+ "epoch": 0.04556962025316456,
+ "grad_norm": 0.6492345333099365,
+ "learning_rate": 4.040404040404041e-06,
+ "loss": 0.9615614414215088,
+ "step": 9
+ },
+ {
+ "epoch": 0.05063291139240506,
+ "grad_norm": 0.6880183815956116,
+ "learning_rate": 4.5454545454545455e-06,
+ "loss": 0.9233697652816772,
+ "step": 10
+ },
+ {
+ "epoch": 0.05569620253164557,
+ "grad_norm": 0.470304012298584,
+ "learning_rate": 5.050505050505051e-06,
+ "loss": 0.7186562418937683,
+ "step": 11
+ },
+ {
+ "epoch": 0.060759493670886074,
+ "grad_norm": 0.6361913681030273,
+ "learning_rate": 5.555555555555556e-06,
+ "loss": 0.9312829375267029,
+ "step": 12
+ },
+ {
+ "epoch": 0.06582278481012659,
+ "grad_norm": 0.5554782152175903,
+ "learning_rate": 6.060606060606061e-06,
+ "loss": 0.8529565334320068,
+ "step": 13
+ },
+ {
+ "epoch": 0.07088607594936709,
+ "grad_norm": 0.5414550304412842,
+ "learning_rate": 6.565656565656567e-06,
+ "loss": 0.8071130514144897,
+ "step": 14
+ },
+ {
+ "epoch": 0.0759493670886076,
+ "grad_norm": 0.9267164468765259,
+ "learning_rate": 7.0707070707070704e-06,
+ "loss": 1.3577998876571655,
+ "step": 15
+ },
+ {
+ "epoch": 0.0810126582278481,
+ "grad_norm": 0.6104046106338501,
+ "learning_rate": 7.5757575757575764e-06,
+ "loss": 0.923499345779419,
+ "step": 16
+ },
+ {
+ "epoch": 0.08607594936708861,
+ "grad_norm": 0.7241935133934021,
+ "learning_rate": 8.080808080808082e-06,
+ "loss": 1.0400190353393555,
+ "step": 17
+ },
+ {
+ "epoch": 0.09113924050632911,
+ "grad_norm": 0.6026384830474854,
+ "learning_rate": 8.585858585858587e-06,
+ "loss": 0.8413939476013184,
+ "step": 18
+ },
+ {
+ "epoch": 0.09620253164556962,
+ "grad_norm": 0.7690514922142029,
+ "learning_rate": 9.090909090909091e-06,
+ "loss": 1.0870859622955322,
+ "step": 19
+ },
+ {
+ "epoch": 0.10126582278481013,
+ "grad_norm": 0.5940403342247009,
+ "learning_rate": 9.595959595959595e-06,
+ "loss": 0.8468416929244995,
+ "step": 20
+ },
+ {
+ "epoch": 0.10632911392405063,
+ "grad_norm": 0.669230580329895,
+ "learning_rate": 1.0101010101010101e-05,
+ "loss": 0.9340983629226685,
+ "step": 21
+ },
+ {
+ "epoch": 0.11139240506329114,
+ "grad_norm": 0.5750640034675598,
+ "learning_rate": 1.0606060606060607e-05,
+ "loss": 0.8230171799659729,
+ "step": 22
+ },
+ {
+ "epoch": 0.11645569620253164,
+ "grad_norm": 0.6579262614250183,
+ "learning_rate": 1.1111111111111112e-05,
+ "loss": 0.9293508529663086,
+ "step": 23
+ },
+ {
+ "epoch": 0.12151898734177215,
+ "grad_norm": 0.5956451296806335,
+ "learning_rate": 1.1616161616161616e-05,
+ "loss": 0.8316305875778198,
+ "step": 24
+ },
+ {
+ "epoch": 0.12658227848101267,
+ "grad_norm": 0.7270558476448059,
+ "learning_rate": 1.2121212121212122e-05,
+ "loss": 0.9129499197006226,
+ "step": 25
+ },
+ {
+ "epoch": 0.13164556962025317,
+ "grad_norm": 0.7505611777305603,
+ "learning_rate": 1.2626262626262628e-05,
+ "loss": 1.0138367414474487,
+ "step": 26
+ },
+ {
+ "epoch": 0.13670886075949368,
+ "grad_norm": 0.6870062947273254,
+ "learning_rate": 1.3131313131313134e-05,
+ "loss": 0.901283860206604,
+ "step": 27
+ },
+ {
+ "epoch": 0.14177215189873418,
+ "grad_norm": 0.7679643630981445,
+ "learning_rate": 1.3636363636363637e-05,
+ "loss": 0.9833810329437256,
+ "step": 28
+ },
+ {
+ "epoch": 0.1468354430379747,
+ "grad_norm": 0.866938591003418,
+ "learning_rate": 1.4141414141414141e-05,
+ "loss": 0.8958402872085571,
+ "step": 29
+ },
+ {
+ "epoch": 0.1518987341772152,
+ "grad_norm": 0.8687500357627869,
+ "learning_rate": 1.4646464646464647e-05,
+ "loss": 1.1289801597595215,
+ "step": 30
+ },
+ {
+ "epoch": 0.1569620253164557,
+ "grad_norm": 4.008030891418457,
+ "learning_rate": 1.5151515151515153e-05,
+ "loss": 1.2739044427871704,
+ "step": 31
+ },
+ {
+ "epoch": 0.1620253164556962,
+ "grad_norm": 0.7689681053161621,
+ "learning_rate": 1.565656565656566e-05,
+ "loss": 0.8514111638069153,
+ "step": 32
+ },
+ {
+ "epoch": 0.1670886075949367,
+ "grad_norm": 0.7880434393882751,
+ "learning_rate": 1.6161616161616165e-05,
+ "loss": 0.8862775564193726,
+ "step": 33
+ },
+ {
+ "epoch": 0.17215189873417722,
+ "grad_norm": 0.6183183789253235,
+ "learning_rate": 1.6666666666666667e-05,
+ "loss": 0.7857811450958252,
+ "step": 34
+ },
+ {
+ "epoch": 0.17721518987341772,
+ "grad_norm": 0.6437809467315674,
+ "learning_rate": 1.7171717171717173e-05,
+ "loss": 0.7093011736869812,
+ "step": 35
+ },
+ {
+ "epoch": 0.18227848101265823,
+ "grad_norm": 0.5481512546539307,
+ "learning_rate": 1.7676767676767676e-05,
+ "loss": 0.7350327968597412,
+ "step": 36
+ },
+ {
+ "epoch": 0.18734177215189873,
+ "grad_norm": 0.4838634729385376,
+ "learning_rate": 1.8181818181818182e-05,
+ "loss": 0.6584650874137878,
+ "step": 37
+ },
+ {
+ "epoch": 0.19240506329113924,
+ "grad_norm": 0.523994505405426,
+ "learning_rate": 1.8686868686868688e-05,
+ "loss": 0.7211161851882935,
+ "step": 38
+ },
+ {
+ "epoch": 0.19746835443037974,
+ "grad_norm": 0.6523379683494568,
+ "learning_rate": 1.919191919191919e-05,
+ "loss": 0.9044773578643799,
+ "step": 39
+ },
+ {
+ "epoch": 0.20253164556962025,
+ "grad_norm": 0.4274725615978241,
+ "learning_rate": 1.9696969696969697e-05,
+ "loss": 0.568337082862854,
+ "step": 40
+ },
+ {
+ "epoch": 0.20759493670886076,
+ "grad_norm": 0.5060272812843323,
+ "learning_rate": 2.0202020202020203e-05,
+ "loss": 0.7201821208000183,
+ "step": 41
+ },
+ {
+ "epoch": 0.21265822784810126,
+ "grad_norm": 0.3760877251625061,
+ "learning_rate": 2.070707070707071e-05,
+ "loss": 0.5880123376846313,
+ "step": 42
+ },
+ {
+ "epoch": 0.21772151898734177,
+ "grad_norm": 0.3715391457080841,
+ "learning_rate": 2.1212121212121215e-05,
+ "loss": 0.5693179368972778,
+ "step": 43
+ },
+ {
+ "epoch": 0.22278481012658227,
+ "grad_norm": 0.4332570731639862,
+ "learning_rate": 2.171717171717172e-05,
+ "loss": 0.7277271151542664,
+ "step": 44
+ },
+ {
+ "epoch": 0.22784810126582278,
+ "grad_norm": 0.38201987743377686,
+ "learning_rate": 2.2222222222222223e-05,
+ "loss": 0.6458995938301086,
+ "step": 45
+ },
+ {
+ "epoch": 0.23291139240506328,
+ "grad_norm": 0.4358846843242645,
+ "learning_rate": 2.272727272727273e-05,
+ "loss": 0.7559939026832581,
+ "step": 46
+ },
+ {
+ "epoch": 0.2379746835443038,
+ "grad_norm": 0.4566098749637604,
+ "learning_rate": 2.3232323232323232e-05,
+ "loss": 0.7792297601699829,
+ "step": 47
+ },
+ {
+ "epoch": 0.2430379746835443,
+ "grad_norm": 0.3864676356315613,
+ "learning_rate": 2.3737373737373738e-05,
+ "loss": 0.6894873380661011,
+ "step": 48
+ },
+ {
+ "epoch": 0.2481012658227848,
+ "grad_norm": 0.31187522411346436,
+ "learning_rate": 2.4242424242424244e-05,
+ "loss": 0.545581579208374,
+ "step": 49
+ },
+ {
+ "epoch": 0.25316455696202533,
+ "grad_norm": 0.3325943350791931,
+ "learning_rate": 2.474747474747475e-05,
+ "loss": 0.5917496085166931,
+ "step": 50
+ },
+ {
+ "epoch": 0.2582278481012658,
+ "grad_norm": 0.6410307884216309,
+ "learning_rate": 2.5252525252525256e-05,
+ "loss": 0.44281136989593506,
+ "step": 51
+ },
+ {
+ "epoch": 0.26329113924050634,
+ "grad_norm": 0.36323168873786926,
+ "learning_rate": 2.575757575757576e-05,
+ "loss": 0.6426926851272583,
+ "step": 52
+ },
+ {
+ "epoch": 0.2683544303797468,
+ "grad_norm": 0.31924113631248474,
+ "learning_rate": 2.6262626262626268e-05,
+ "loss": 0.5482619404792786,
+ "step": 53
+ },
+ {
+ "epoch": 0.27341772151898736,
+ "grad_norm": 0.3632371723651886,
+ "learning_rate": 2.676767676767677e-05,
+ "loss": 0.6188253164291382,
+ "step": 54
+ },
+ {
+ "epoch": 0.27848101265822783,
+ "grad_norm": 0.375381201505661,
+ "learning_rate": 2.7272727272727273e-05,
+ "loss": 0.5487836003303528,
+ "step": 55
+ },
+ {
+ "epoch": 0.28354430379746837,
+ "grad_norm": 0.3163473606109619,
+ "learning_rate": 2.777777777777778e-05,
+ "loss": 0.5367064476013184,
+ "step": 56
+ },
+ {
+ "epoch": 0.28860759493670884,
+ "grad_norm": 0.42646294832229614,
+ "learning_rate": 2.8282828282828282e-05,
+ "loss": 0.41221165657043457,
+ "step": 57
+ },
+ {
+ "epoch": 0.2936708860759494,
+ "grad_norm": 0.41622766852378845,
+ "learning_rate": 2.878787878787879e-05,
+ "loss": 0.5274936556816101,
+ "step": 58
+ },
+ {
+ "epoch": 0.29873417721518986,
+ "grad_norm": 0.30204030871391296,
+ "learning_rate": 2.9292929292929294e-05,
+ "loss": 0.44855833053588867,
+ "step": 59
+ },
+ {
+ "epoch": 0.3037974683544304,
+ "grad_norm": 0.3178975582122803,
+ "learning_rate": 2.9797979797979796e-05,
+ "loss": 0.4036139249801636,
+ "step": 60
+ },
+ {
+ "epoch": 0.30886075949367087,
+ "grad_norm": 0.2893930673599243,
+ "learning_rate": 3.0303030303030306e-05,
+ "loss": 0.39234185218811035,
+ "step": 61
+ },
+ {
+ "epoch": 0.3139240506329114,
+ "grad_norm": 0.2833489775657654,
+ "learning_rate": 3.080808080808081e-05,
+ "loss": 0.37406405806541443,
+ "step": 62
+ },
+ {
+ "epoch": 0.3189873417721519,
+ "grad_norm": 0.3216562867164612,
+ "learning_rate": 3.131313131313132e-05,
+ "loss": 0.3938276767730713,
+ "step": 63
+ },
+ {
+ "epoch": 0.3240506329113924,
+ "grad_norm": 0.26721706986427307,
+ "learning_rate": 3.181818181818182e-05,
+ "loss": 0.30402088165283203,
+ "step": 64
+ },
+ {
+ "epoch": 0.3291139240506329,
+ "grad_norm": 0.3702670931816101,
+ "learning_rate": 3.232323232323233e-05,
+ "loss": 0.30594947934150696,
+ "step": 65
+ },
+ {
+ "epoch": 0.3341772151898734,
+ "grad_norm": 0.2632184326648712,
+ "learning_rate": 3.282828282828283e-05,
+ "loss": 0.2691727876663208,
+ "step": 66
+ },
+ {
+ "epoch": 0.3392405063291139,
+ "grad_norm": 0.36898860335350037,
+ "learning_rate": 3.3333333333333335e-05,
+ "loss": 0.33992528915405273,
+ "step": 67
+ },
+ {
+ "epoch": 0.34430379746835443,
+ "grad_norm": 0.2976086735725403,
+ "learning_rate": 3.3838383838383844e-05,
+ "loss": 0.27603086829185486,
+ "step": 68
+ },
+ {
+ "epoch": 0.3493670886075949,
+ "grad_norm": 0.32201430201530457,
+ "learning_rate": 3.434343434343435e-05,
+ "loss": 0.25665703415870667,
+ "step": 69
+ },
+ {
+ "epoch": 0.35443037974683544,
+ "grad_norm": 0.35001808404922485,
+ "learning_rate": 3.484848484848485e-05,
+ "loss": 0.24190445244312286,
+ "step": 70
+ },
+ {
+ "epoch": 0.3594936708860759,
+ "grad_norm": 0.5106059908866882,
+ "learning_rate": 3.535353535353535e-05,
+ "loss": 0.3093336820602417,
+ "step": 71
+ },
+ {
+ "epoch": 0.36455696202531646,
+ "grad_norm": 0.3261374831199646,
+ "learning_rate": 3.5858585858585855e-05,
+ "loss": 0.18783289194107056,
+ "step": 72
+ },
+ {
+ "epoch": 0.369620253164557,
+ "grad_norm": 0.38757652044296265,
+ "learning_rate": 3.6363636363636364e-05,
+ "loss": 0.19549766182899475,
+ "step": 73
+ },
+ {
+ "epoch": 0.37468354430379747,
+ "grad_norm": 0.4723363518714905,
+ "learning_rate": 3.686868686868687e-05,
+ "loss": 0.15751558542251587,
+ "step": 74
+ },
+ {
+ "epoch": 0.379746835443038,
+ "grad_norm": 0.36796173453330994,
+ "learning_rate": 3.7373737373737376e-05,
+ "loss": 0.14514681696891785,
+ "step": 75
+ },
+ {
+ "epoch": 0.3848101265822785,
+ "grad_norm": 0.3855208456516266,
+ "learning_rate": 3.787878787878788e-05,
+ "loss": 0.14030519127845764,
+ "step": 76
+ },
+ {
+ "epoch": 0.389873417721519,
+ "grad_norm": 0.5906668305397034,
+ "learning_rate": 3.838383838383838e-05,
+ "loss": 0.1478388011455536,
+ "step": 77
+ },
+ {
+ "epoch": 0.3949367088607595,
+ "grad_norm": 0.2658001780509949,
+ "learning_rate": 3.888888888888889e-05,
+ "loss": 0.13253600895404816,
+ "step": 78
+ },
+ {
+ "epoch": 0.4,
+ "grad_norm": 0.33554506301879883,
+ "learning_rate": 3.939393939393939e-05,
+ "loss": 0.12156252562999725,
+ "step": 79
+ },
+ {
+ "epoch": 0.4050632911392405,
+ "grad_norm": 0.2643960416316986,
+ "learning_rate": 3.98989898989899e-05,
+ "loss": 0.1089208647608757,
+ "step": 80
+ },
+ {
+ "epoch": 0.41012658227848103,
+ "grad_norm": 0.19129537045955658,
+ "learning_rate": 4.0404040404040405e-05,
+ "loss": 0.08515600860118866,
+ "step": 81
+ },
+ {
+ "epoch": 0.4151898734177215,
+ "grad_norm": 0.22168858349323273,
+ "learning_rate": 4.0909090909090915e-05,
+ "loss": 0.09310197830200195,
+ "step": 82
+ },
+ {
+ "epoch": 0.42025316455696204,
+ "grad_norm": 0.16676382720470428,
+ "learning_rate": 4.141414141414142e-05,
+ "loss": 0.07711787521839142,
+ "step": 83
+ },
+ {
+ "epoch": 0.4253164556962025,
+ "grad_norm": 0.23891882598400116,
+ "learning_rate": 4.191919191919192e-05,
+ "loss": 0.09763285517692566,
+ "step": 84
+ },
+ {
+ "epoch": 0.43037974683544306,
+ "grad_norm": 0.28446146845817566,
+ "learning_rate": 4.242424242424243e-05,
+ "loss": 0.08980057388544083,
+ "step": 85
+ },
+ {
+ "epoch": 0.43544303797468353,
+ "grad_norm": 0.146108940243721,
+ "learning_rate": 4.292929292929293e-05,
+ "loss": 0.06573648750782013,
+ "step": 86
+ },
+ {
+ "epoch": 0.44050632911392407,
+ "grad_norm": 0.2007656991481781,
+ "learning_rate": 4.343434343434344e-05,
+ "loss": 0.0699995830655098,
+ "step": 87
+ },
+ {
+ "epoch": 0.44556962025316454,
+ "grad_norm": 0.3082621395587921,
+ "learning_rate": 4.3939393939393944e-05,
+ "loss": 0.0885838121175766,
+ "step": 88
+ },
+ {
+ "epoch": 0.4506329113924051,
+ "grad_norm": 0.1624963879585266,
+ "learning_rate": 4.4444444444444447e-05,
+ "loss": 0.06935172528028488,
+ "step": 89
+ },
+ {
+ "epoch": 0.45569620253164556,
+ "grad_norm": 0.1562737673521042,
+ "learning_rate": 4.494949494949495e-05,
+ "loss": 0.07147250324487686,
+ "step": 90
+ },
+ {
+ "epoch": 0.4607594936708861,
+ "grad_norm": 0.1660323292016983,
+ "learning_rate": 4.545454545454546e-05,
+ "loss": 0.0672944188117981,
+ "step": 91
+ },
+ {
+ "epoch": 0.46582278481012657,
+ "grad_norm": 0.21427564322948456,
+ "learning_rate": 4.595959595959596e-05,
+ "loss": 0.07051930576562881,
+ "step": 92
+ },
+ {
+ "epoch": 0.4708860759493671,
+ "grad_norm": 0.16495929658412933,
+ "learning_rate": 4.6464646464646464e-05,
+ "loss": 0.05429624393582344,
+ "step": 93
+ },
+ {
+ "epoch": 0.4759493670886076,
+ "grad_norm": 0.1978198140859604,
+ "learning_rate": 4.696969696969697e-05,
+ "loss": 0.07144488394260406,
+ "step": 94
+ },
+ {
+ "epoch": 0.4810126582278481,
+ "grad_norm": 0.15077605843544006,
+ "learning_rate": 4.7474747474747476e-05,
+ "loss": 0.055798254907131195,
+ "step": 95
+ },
+ {
+ "epoch": 0.4860759493670886,
+ "grad_norm": 0.2806876301765442,
+ "learning_rate": 4.797979797979798e-05,
+ "loss": 0.06058178097009659,
+ "step": 96
+ },
+ {
+ "epoch": 0.4911392405063291,
+ "grad_norm": 0.1219187006354332,
+ "learning_rate": 4.848484848484849e-05,
+ "loss": 0.05044667422771454,
+ "step": 97
+ },
+ {
+ "epoch": 0.4962025316455696,
+ "grad_norm": 0.10286939144134521,
+ "learning_rate": 4.898989898989899e-05,
+ "loss": 0.048498690128326416,
+ "step": 98
+ },
+ {
+ "epoch": 0.5012658227848101,
+ "grad_norm": 0.12813609838485718,
+ "learning_rate": 4.94949494949495e-05,
+ "loss": 0.06252863258123398,
+ "step": 99
+ },
+ {
+ "epoch": 0.5063291139240507,
+ "grad_norm": 0.10565406829118729,
+ "learning_rate": 5e-05,
+ "loss": 0.051401108503341675,
+ "step": 100
+ },
+ {
+ "epoch": 0.5113924050632911,
+ "grad_norm": 0.09147113561630249,
+ "learning_rate": 5.050505050505051e-05,
+ "loss": 0.047376491129398346,
+ "step": 101
+ },
+ {
+ "epoch": 0.5164556962025316,
+ "grad_norm": 0.08723224699497223,
+ "learning_rate": 5.101010101010101e-05,
+ "loss": 0.039745647460222244,
+ "step": 102
+ },
+ {
+ "epoch": 0.5215189873417722,
+ "grad_norm": 0.16071128845214844,
+ "learning_rate": 5.151515151515152e-05,
+ "loss": 0.058398712426424026,
+ "step": 103
+ },
+ {
+ "epoch": 0.5265822784810127,
+ "grad_norm": 0.1370300054550171,
+ "learning_rate": 5.2020202020202026e-05,
+ "loss": 0.05132289230823517,
+ "step": 104
+ },
+ {
+ "epoch": 0.5316455696202531,
+ "grad_norm": 0.19449608027935028,
+ "learning_rate": 5.2525252525252536e-05,
+ "loss": 0.06682188808917999,
+ "step": 105
+ },
+ {
+ "epoch": 0.5367088607594936,
+ "grad_norm": 0.13085028529167175,
+ "learning_rate": 5.303030303030303e-05,
+ "loss": 0.049861155450344086,
+ "step": 106
+ },
+ {
+ "epoch": 0.5417721518987342,
+ "grad_norm": 0.1768050193786621,
+ "learning_rate": 5.353535353535354e-05,
+ "loss": 0.055694688111543655,
+ "step": 107
+ },
+ {
+ "epoch": 0.5468354430379747,
+ "grad_norm": 0.2819313704967499,
+ "learning_rate": 5.4040404040404044e-05,
+ "loss": 0.062391363084316254,
+ "step": 108
+ },
+ {
+ "epoch": 0.5518987341772152,
+ "grad_norm": 0.10738537460565567,
+ "learning_rate": 5.4545454545454546e-05,
+ "loss": 0.05093343183398247,
+ "step": 109
+ },
+ {
+ "epoch": 0.5569620253164557,
+ "grad_norm": 0.11759619414806366,
+ "learning_rate": 5.5050505050505056e-05,
+ "loss": 0.044827841222286224,
+ "step": 110
+ },
+ {
+ "epoch": 0.5620253164556962,
+ "grad_norm": 0.21941131353378296,
+ "learning_rate": 5.555555555555556e-05,
+ "loss": 0.05238347500562668,
+ "step": 111
+ },
+ {
+ "epoch": 0.5670886075949367,
+ "grad_norm": 0.1697252243757248,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.04869212955236435,
+ "step": 112
+ },
+ {
+ "epoch": 0.5721518987341773,
+ "grad_norm": 0.19701889157295227,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.04484856128692627,
+ "step": 113
+ },
+ {
+ "epoch": 0.5772151898734177,
+ "grad_norm": 0.11779771000146866,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.04135368764400482,
+ "step": 114
+ },
+ {
+ "epoch": 0.5822784810126582,
+ "grad_norm": 0.19823911786079407,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.05097956955432892,
+ "step": 115
+ },
+ {
+ "epoch": 0.5873417721518988,
+ "grad_norm": 0.17355702817440033,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.05781872197985649,
+ "step": 116
+ },
+ {
+ "epoch": 0.5924050632911393,
+ "grad_norm": 0.13029292225837708,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.041528262197971344,
+ "step": 117
+ },
+ {
+ "epoch": 0.5974683544303797,
+ "grad_norm": 0.1292058229446411,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.0442211888730526,
+ "step": 118
+ },
+ {
+ "epoch": 0.6025316455696202,
+ "grad_norm": 0.10058800131082535,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.03813612461090088,
+ "step": 119
+ },
+ {
+ "epoch": 0.6075949367088608,
+ "grad_norm": 0.22936487197875977,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.056090980768203735,
+ "step": 120
+ },
+ {
+ "epoch": 0.6126582278481013,
+ "grad_norm": 0.13063806295394897,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.04347142577171326,
+ "step": 121
+ },
+ {
+ "epoch": 0.6177215189873417,
+ "grad_norm": 0.167104110121727,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.04442849010229111,
+ "step": 122
+ },
+ {
+ "epoch": 0.6227848101265823,
+ "grad_norm": 0.11942817270755768,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.03964124619960785,
+ "step": 123
+ },
+ {
+ "epoch": 0.6278481012658228,
+ "grad_norm": 0.17906631529331207,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.04372458904981613,
+ "step": 124
+ },
+ {
+ "epoch": 0.6329113924050633,
+ "grad_norm": 0.13760331273078918,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.03980286419391632,
+ "step": 125
+ },
+ {
+ "epoch": 0.6379746835443038,
+ "grad_norm": 0.18043340742588043,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.05500294268131256,
+ "step": 126
+ },
+ {
+ "epoch": 0.6430379746835443,
+ "grad_norm": 0.31386223435401917,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.04253799840807915,
+ "step": 127
+ },
+ {
+ "epoch": 0.6481012658227848,
+ "grad_norm": 0.1428707093000412,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.047894880175590515,
+ "step": 128
+ },
+ {
+ "epoch": 0.6531645569620254,
+ "grad_norm": 0.11010178923606873,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.04534825310111046,
+ "step": 129
+ },
+ {
+ "epoch": 0.6582278481012658,
+ "grad_norm": 0.10444525629281998,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.041347943246364594,
+ "step": 130
+ },
+ {
+ "epoch": 0.6632911392405063,
+ "grad_norm": 0.18076039850711823,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.04535853862762451,
+ "step": 131
+ },
+ {
+ "epoch": 0.6683544303797468,
+ "grad_norm": 0.19424672424793243,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.05037602037191391,
+ "step": 132
+ },
+ {
+ "epoch": 0.6734177215189874,
+ "grad_norm": 0.1457783728837967,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.047546930611133575,
+ "step": 133
+ },
+ {
+ "epoch": 0.6784810126582278,
+ "grad_norm": 0.1189681887626648,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.03254905715584755,
+ "step": 134
+ },
+ {
+ "epoch": 0.6835443037974683,
+ "grad_norm": 0.18887822329998016,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.04018670320510864,
+ "step": 135
+ },
+ {
+ "epoch": 0.6886075949367089,
+ "grad_norm": 0.12217189371585846,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.03981504589319229,
+ "step": 136
+ },
+ {
+ "epoch": 0.6936708860759494,
+ "grad_norm": 0.10866257548332214,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.04322533681988716,
+ "step": 137
+ },
+ {
+ "epoch": 0.6987341772151898,
+ "grad_norm": 0.15904399752616882,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.04488902539014816,
+ "step": 138
+ },
+ {
+ "epoch": 0.7037974683544304,
+ "grad_norm": 0.12598516047000885,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.04718853533267975,
+ "step": 139
+ },
+ {
+ "epoch": 0.7088607594936709,
+ "grad_norm": 0.22092872858047485,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.03646199405193329,
+ "step": 140
+ },
+ {
+ "epoch": 0.7139240506329114,
+ "grad_norm": 0.1717238426208496,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.04607801511883736,
+ "step": 141
+ },
+ {
+ "epoch": 0.7189873417721518,
+ "grad_norm": 0.16268078982830048,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.04759417474269867,
+ "step": 142
+ },
+ {
+ "epoch": 0.7240506329113924,
+ "grad_norm": 0.19621087610721588,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.051741112023591995,
+ "step": 143
+ },
+ {
+ "epoch": 0.7291139240506329,
+ "grad_norm": 0.15362979471683502,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.04363569617271423,
+ "step": 144
+ },
+ {
+ "epoch": 0.7341772151898734,
+ "grad_norm": 0.1404130607843399,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.045428819954395294,
+ "step": 145
+ },
+ {
+ "epoch": 0.739240506329114,
+ "grad_norm": 0.12262272834777832,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.03828439861536026,
+ "step": 146
+ },
+ {
+ "epoch": 0.7443037974683544,
+ "grad_norm": 0.10626570880413055,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.03420639410614967,
+ "step": 147
+ },
+ {
+ "epoch": 0.7493670886075949,
+ "grad_norm": 0.12686072289943695,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.03474457561969757,
+ "step": 148
+ },
+ {
+ "epoch": 0.7544303797468355,
+ "grad_norm": 0.153709277510643,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.03174472972750664,
+ "step": 149
+ },
+ {
+ "epoch": 0.759493670886076,
+ "grad_norm": 0.13035084307193756,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.02982976846396923,
+ "step": 150
+ },
+ {
+ "epoch": 0.7645569620253164,
+ "grad_norm": 0.12288431823253632,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.03588784486055374,
+ "step": 151
+ },
+ {
+ "epoch": 0.769620253164557,
+ "grad_norm": 0.19307470321655273,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.04750734567642212,
+ "step": 152
+ },
+ {
+ "epoch": 0.7746835443037975,
+ "grad_norm": 0.0996781438589096,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.027098631486296654,
+ "step": 153
+ },
+ {
+ "epoch": 0.779746835443038,
+ "grad_norm": 0.16898290812969208,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.040447790175676346,
+ "step": 154
+ },
+ {
+ "epoch": 0.7848101265822784,
+ "grad_norm": 0.10996036231517792,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.02525201067328453,
+ "step": 155
+ },
+ {
+ "epoch": 0.789873417721519,
+ "grad_norm": 0.16161896288394928,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.04199359938502312,
+ "step": 156
+ },
+ {
+ "epoch": 0.7949367088607595,
+ "grad_norm": 0.1536172777414322,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.02943507581949234,
+ "step": 157
+ },
+ {
+ "epoch": 0.8,
+ "grad_norm": 0.18457260727882385,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.04093889892101288,
+ "step": 158
+ },
+ {
+ "epoch": 0.8050632911392405,
+ "grad_norm": 0.11232347041368484,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.029609719291329384,
+ "step": 159
+ },
+ {
+ "epoch": 0.810126582278481,
+ "grad_norm": 0.19080978631973267,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.0357801653444767,
+ "step": 160
+ },
+ {
+ "epoch": 0.8151898734177215,
+ "grad_norm": 0.16634301841259003,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02980419248342514,
+ "step": 161
+ },
+ {
+ "epoch": 0.8202531645569621,
+ "grad_norm": 0.28601372241973877,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.032849978655576706,
+ "step": 162
+ },
+ {
+ "epoch": 0.8253164556962025,
+ "grad_norm": 0.1359848529100418,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.0230826735496521,
+ "step": 163
+ },
+ {
+ "epoch": 0.830379746835443,
+ "grad_norm": 0.11285015195608139,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.02447221614420414,
+ "step": 164
+ },
+ {
+ "epoch": 0.8354430379746836,
+ "grad_norm": 0.14712421596050262,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.022657420486211777,
+ "step": 165
+ },
+ {
+ "epoch": 0.8405063291139241,
+ "grad_norm": 0.18246804177761078,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.035991013050079346,
+ "step": 166
+ },
+ {
+ "epoch": 0.8455696202531645,
+ "grad_norm": 0.143621563911438,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.024444863200187683,
+ "step": 167
+ },
+ {
+ "epoch": 0.850632911392405,
+ "grad_norm": 0.12458691000938416,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.039701592177152634,
+ "step": 168
+ },
+ {
+ "epoch": 0.8556962025316456,
+ "grad_norm": 0.05614984780550003,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.029840555042028427,
+ "step": 169
+ },
+ {
+ "epoch": 0.8607594936708861,
+ "grad_norm": 0.06097931042313576,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.027426715940237045,
+ "step": 170
+ },
+ {
+ "epoch": 0.8658227848101265,
+ "grad_norm": 0.09883654862642288,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031690437346696854,
+ "step": 171
+ },
+ {
+ "epoch": 0.8708860759493671,
+ "grad_norm": 0.0700431764125824,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.024079838767647743,
+ "step": 172
+ },
+ {
+ "epoch": 0.8759493670886076,
+ "grad_norm": 0.05957406386733055,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.02303817868232727,
+ "step": 173
+ },
+ {
+ "epoch": 0.8810126582278481,
+ "grad_norm": 0.14374858140945435,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.031183632090687752,
+ "step": 174
+ },
+ {
+ "epoch": 0.8860759493670886,
+ "grad_norm": 0.09187919646501541,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.031176958233118057,
+ "step": 175
+ },
+ {
+ "epoch": 0.8911392405063291,
+ "grad_norm": 0.0540630929172039,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.024949276819825172,
+ "step": 176
+ },
+ {
+ "epoch": 0.8962025316455696,
+ "grad_norm": 0.06875574588775635,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.02890622243285179,
+ "step": 177
+ },
+ {
+ "epoch": 0.9012658227848102,
+ "grad_norm": 0.10081329196691513,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.03019360452890396,
+ "step": 178
+ },
+ {
+ "epoch": 0.9063291139240506,
+ "grad_norm": 0.11833225935697556,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.020365778356790543,
+ "step": 179
+ },
+ {
+ "epoch": 0.9113924050632911,
+ "grad_norm": 0.08700298517942429,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.027046984061598778,
+ "step": 180
+ },
+ {
+ "epoch": 0.9164556962025316,
+ "grad_norm": 0.08660133928060532,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.027088070288300514,
+ "step": 181
+ },
+ {
+ "epoch": 0.9215189873417722,
+ "grad_norm": 0.06983930617570877,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.019332535564899445,
+ "step": 182
+ },
+ {
+ "epoch": 0.9265822784810127,
+ "grad_norm": 0.09463227540254593,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.02780212089419365,
+ "step": 183
+ },
+ {
+ "epoch": 0.9316455696202531,
+ "grad_norm": 0.10251298546791077,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.026878856122493744,
+ "step": 184
+ },
+ {
+ "epoch": 0.9367088607594937,
+ "grad_norm": 0.15963847935199738,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.03437665104866028,
+ "step": 185
+ },
+ {
+ "epoch": 0.9417721518987342,
+ "grad_norm": 0.11342372000217438,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.02877948433160782,
+ "step": 186
+ },
+ {
+ "epoch": 0.9468354430379747,
+ "grad_norm": 0.0937543660402298,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.02759186364710331,
+ "step": 187
+ },
+ {
+ "epoch": 0.9518987341772152,
+ "grad_norm": 0.07137084752321243,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.02941890060901642,
+ "step": 188
+ },
+ {
+ "epoch": 0.9569620253164557,
+ "grad_norm": 0.3511611819267273,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.024331524968147278,
+ "step": 189
+ },
+ {
+ "epoch": 0.9620253164556962,
+ "grad_norm": 0.12344356626272202,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.0348694771528244,
+ "step": 190
+ },
+ {
+ "epoch": 0.9670886075949368,
+ "grad_norm": 0.07144290208816528,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.021711278706789017,
+ "step": 191
+ },
+ {
+ "epoch": 0.9721518987341772,
+ "grad_norm": 0.09835992008447647,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.03408564254641533,
+ "step": 192
+ },
+ {
+ "epoch": 0.9772151898734177,
+ "grad_norm": 0.4978399872779846,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.03810017928481102,
+ "step": 193
+ },
+ {
+ "epoch": 0.9822784810126582,
+ "grad_norm": 0.06314591318368912,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.0201277956366539,
+ "step": 194
+ },
+ {
+ "epoch": 0.9873417721518988,
+ "grad_norm": 0.07504695653915405,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.025770913809537888,
+ "step": 195
+ },
+ {
+ "epoch": 0.9924050632911392,
+ "grad_norm": 0.1028534397482872,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.02469150349497795,
+ "step": 196
+ },
+ {
+ "epoch": 0.9974683544303797,
+ "grad_norm": 0.09341974556446075,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.036506302654743195,
+ "step": 197
+ },
+ {
+ "epoch": 1.0,
+ "grad_norm": 0.09348680078983307,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02507903426885605,
+ "step": 198
+ },
+ {
+ "epoch": 1.0050632911392405,
+ "grad_norm": 0.06890113651752472,
+ "learning_rate": 0.0001,
+ "loss": 0.028374083340168,
+ "step": 199
+ },
+ {
+ "epoch": 1.010126582278481,
+ "grad_norm": 0.051041170954704285,
+ "learning_rate": 9.994388327721661e-05,
+ "loss": 0.022860335186123848,
+ "step": 200
+ },
+ {
+ "epoch": 1.0151898734177216,
+ "grad_norm": 0.10253743082284927,
+ "learning_rate": 9.988776655443322e-05,
+ "loss": 0.02864072285592556,
+ "step": 201
+ },
+ {
+ "epoch": 1.0202531645569621,
+ "grad_norm": 0.08295776695013046,
+ "learning_rate": 9.983164983164983e-05,
+ "loss": 0.0327395498752594,
+ "step": 202
+ },
+ {
+ "epoch": 1.0253164556962024,
+ "grad_norm": 0.07240694016218185,
+ "learning_rate": 9.977553310886645e-05,
+ "loss": 0.029215697199106216,
+ "step": 203
+ },
+ {
+ "epoch": 1.030379746835443,
+ "grad_norm": 0.0688897892832756,
+ "learning_rate": 9.971941638608306e-05,
+ "loss": 0.027594968676567078,
+ "step": 204
+ },
+ {
+ "epoch": 1.0354430379746835,
+ "grad_norm": 0.08463896065950394,
+ "learning_rate": 9.966329966329967e-05,
+ "loss": 0.02292536199092865,
+ "step": 205
+ },
+ {
+ "epoch": 1.040506329113924,
+ "grad_norm": 0.062013301998376846,
+ "learning_rate": 9.960718294051628e-05,
+ "loss": 0.023678191006183624,
+ "step": 206
+ },
+ {
+ "epoch": 1.0455696202531646,
+ "grad_norm": 0.08735264092683792,
+ "learning_rate": 9.955106621773289e-05,
+ "loss": 0.022060325369238853,
+ "step": 207
+ },
+ {
+ "epoch": 1.0506329113924051,
+ "grad_norm": 0.07634295523166656,
+ "learning_rate": 9.94949494949495e-05,
+ "loss": 0.02764434739947319,
+ "step": 208
+ },
+ {
+ "epoch": 1.0556962025316456,
+ "grad_norm": 0.09735682606697083,
+ "learning_rate": 9.943883277216612e-05,
+ "loss": 0.03304428607225418,
+ "step": 209
+ },
+ {
+ "epoch": 1.0607594936708862,
+ "grad_norm": 0.06860044598579407,
+ "learning_rate": 9.938271604938272e-05,
+ "loss": 0.0340178906917572,
+ "step": 210
+ },
+ {
+ "epoch": 1.0658227848101265,
+ "grad_norm": 0.3715139627456665,
+ "learning_rate": 9.932659932659934e-05,
+ "loss": 0.02541016787290573,
+ "step": 211
+ },
+ {
+ "epoch": 1.070886075949367,
+ "grad_norm": 0.07673332840204239,
+ "learning_rate": 9.927048260381594e-05,
+ "loss": 0.025950253009796143,
+ "step": 212
+ },
+ {
+ "epoch": 1.0759493670886076,
+ "grad_norm": 0.07359500974416733,
+ "learning_rate": 9.921436588103256e-05,
+ "loss": 0.024356549605727196,
+ "step": 213
+ },
+ {
+ "epoch": 1.081012658227848,
+ "grad_norm": 0.07760954648256302,
+ "learning_rate": 9.915824915824916e-05,
+ "loss": 0.02338298037648201,
+ "step": 214
+ },
+ {
+ "epoch": 1.0860759493670886,
+ "grad_norm": 0.09183681756258011,
+ "learning_rate": 9.910213243546578e-05,
+ "loss": 0.020955465734004974,
+ "step": 215
+ },
+ {
+ "epoch": 1.0911392405063292,
+ "grad_norm": 0.21278677880764008,
+ "learning_rate": 9.904601571268239e-05,
+ "loss": 0.028164055198431015,
+ "step": 216
+ },
+ {
+ "epoch": 1.0962025316455697,
+ "grad_norm": 0.22437937557697296,
+ "learning_rate": 9.8989898989899e-05,
+ "loss": 0.03543347865343094,
+ "step": 217
+ },
+ {
+ "epoch": 1.1012658227848102,
+ "grad_norm": 0.08677598088979721,
+ "learning_rate": 9.893378226711561e-05,
+ "loss": 0.031265974044799805,
+ "step": 218
+ },
+ {
+ "epoch": 1.1063291139240505,
+ "grad_norm": 0.09595583379268646,
+ "learning_rate": 9.887766554433222e-05,
+ "loss": 0.02384507656097412,
+ "step": 219
+ },
+ {
+ "epoch": 1.111392405063291,
+ "grad_norm": 0.08256062865257263,
+ "learning_rate": 9.882154882154883e-05,
+ "loss": 0.022209012880921364,
+ "step": 220
+ },
+ {
+ "epoch": 1.1164556962025316,
+ "grad_norm": 0.07712455838918686,
+ "learning_rate": 9.876543209876543e-05,
+ "loss": 0.025278344750404358,
+ "step": 221
+ },
+ {
+ "epoch": 1.1215189873417721,
+ "grad_norm": 0.09704182296991348,
+ "learning_rate": 9.870931537598205e-05,
+ "loss": 0.024904735386371613,
+ "step": 222
+ },
+ {
+ "epoch": 1.1265822784810127,
+ "grad_norm": 0.09094078838825226,
+ "learning_rate": 9.865319865319865e-05,
+ "loss": 0.0280012097209692,
+ "step": 223
+ },
+ {
+ "epoch": 1.1316455696202532,
+ "grad_norm": 0.07607442885637283,
+ "learning_rate": 9.859708193041527e-05,
+ "loss": 0.026181645691394806,
+ "step": 224
+ },
+ {
+ "epoch": 1.1367088607594937,
+ "grad_norm": 0.06568697839975357,
+ "learning_rate": 9.854096520763188e-05,
+ "loss": 0.02883346565067768,
+ "step": 225
+ },
+ {
+ "epoch": 1.1417721518987343,
+ "grad_norm": 0.07192376255989075,
+ "learning_rate": 9.848484848484849e-05,
+ "loss": 0.027345171198248863,
+ "step": 226
+ },
+ {
+ "epoch": 1.1468354430379746,
+ "grad_norm": 0.1464017778635025,
+ "learning_rate": 9.84287317620651e-05,
+ "loss": 0.03213154152035713,
+ "step": 227
+ },
+ {
+ "epoch": 1.1518987341772151,
+ "grad_norm": 0.06766578555107117,
+ "learning_rate": 9.837261503928171e-05,
+ "loss": 0.02554963156580925,
+ "step": 228
+ },
+ {
+ "epoch": 1.1569620253164556,
+ "grad_norm": 0.09428609162569046,
+ "learning_rate": 9.831649831649832e-05,
+ "loss": 0.02484097331762314,
+ "step": 229
+ },
+ {
+ "epoch": 1.1620253164556962,
+ "grad_norm": 0.1648297905921936,
+ "learning_rate": 9.826038159371493e-05,
+ "loss": 0.03450813889503479,
+ "step": 230
+ },
+ {
+ "epoch": 1.1670886075949367,
+ "grad_norm": 0.06389904767274857,
+ "learning_rate": 9.820426487093154e-05,
+ "loss": 0.02957337349653244,
+ "step": 231
+ },
+ {
+ "epoch": 1.1721518987341772,
+ "grad_norm": 0.11517420411109924,
+ "learning_rate": 9.814814814814815e-05,
+ "loss": 0.024299729615449905,
+ "step": 232
+ },
+ {
+ "epoch": 1.1772151898734178,
+ "grad_norm": 0.06960142403841019,
+ "learning_rate": 9.809203142536476e-05,
+ "loss": 0.025762220844626427,
+ "step": 233
+ },
+ {
+ "epoch": 1.1822784810126583,
+ "grad_norm": 0.11682946234941483,
+ "learning_rate": 9.803591470258137e-05,
+ "loss": 0.02457268163561821,
+ "step": 234
+ },
+ {
+ "epoch": 1.1873417721518988,
+ "grad_norm": 0.07964848726987839,
+ "learning_rate": 9.797979797979798e-05,
+ "loss": 0.027285631746053696,
+ "step": 235
+ },
+ {
+ "epoch": 1.1924050632911392,
+ "grad_norm": 0.053044773638248444,
+ "learning_rate": 9.79236812570146e-05,
+ "loss": 0.020997609943151474,
+ "step": 236
+ },
+ {
+ "epoch": 1.1974683544303797,
+ "grad_norm": 0.13531149923801422,
+ "learning_rate": 9.78675645342312e-05,
+ "loss": 0.02474522590637207,
+ "step": 237
+ },
+ {
+ "epoch": 1.2025316455696202,
+ "grad_norm": 0.0774424746632576,
+ "learning_rate": 9.781144781144782e-05,
+ "loss": 0.025272740051150322,
+ "step": 238
+ },
+ {
+ "epoch": 1.2075949367088608,
+ "grad_norm": 0.042708419263362885,
+ "learning_rate": 9.775533108866442e-05,
+ "loss": 0.019522909075021744,
+ "step": 239
+ },
+ {
+ "epoch": 1.2126582278481013,
+ "grad_norm": 0.10364090651273727,
+ "learning_rate": 9.769921436588104e-05,
+ "loss": 0.02728935517370701,
+ "step": 240
+ },
+ {
+ "epoch": 1.2177215189873418,
+ "grad_norm": 0.0756702646613121,
+ "learning_rate": 9.764309764309764e-05,
+ "loss": 0.02659972943365574,
+ "step": 241
+ },
+ {
+ "epoch": 1.2227848101265824,
+ "grad_norm": 0.07232004404067993,
+ "learning_rate": 9.758698092031426e-05,
+ "loss": 0.017723949626088142,
+ "step": 242
+ },
+ {
+ "epoch": 1.2278481012658227,
+ "grad_norm": 0.058345306664705276,
+ "learning_rate": 9.753086419753087e-05,
+ "loss": 0.019348861649632454,
+ "step": 243
+ },
+ {
+ "epoch": 1.2329113924050632,
+ "grad_norm": 0.14832371473312378,
+ "learning_rate": 9.747474747474747e-05,
+ "loss": 0.03227488696575165,
+ "step": 244
+ },
+ {
+ "epoch": 1.2379746835443037,
+ "grad_norm": 0.05343412607908249,
+ "learning_rate": 9.74186307519641e-05,
+ "loss": 0.0210015457123518,
+ "step": 245
+ },
+ {
+ "epoch": 1.2430379746835443,
+ "grad_norm": 0.054104797542095184,
+ "learning_rate": 9.736251402918069e-05,
+ "loss": 0.02430287003517151,
+ "step": 246
+ },
+ {
+ "epoch": 1.2481012658227848,
+ "grad_norm": 0.11686044931411743,
+ "learning_rate": 9.730639730639732e-05,
+ "loss": 0.029372017830610275,
+ "step": 247
+ },
+ {
+ "epoch": 1.2531645569620253,
+ "grad_norm": 0.05970177799463272,
+ "learning_rate": 9.725028058361391e-05,
+ "loss": 0.024995045736432076,
+ "step": 248
+ },
+ {
+ "epoch": 1.2582278481012659,
+ "grad_norm": 0.06506923586130142,
+ "learning_rate": 9.719416386083054e-05,
+ "loss": 0.024779727682471275,
+ "step": 249
+ },
+ {
+ "epoch": 1.2632911392405064,
+ "grad_norm": 0.12711220979690552,
+ "learning_rate": 9.713804713804715e-05,
+ "loss": 0.026196476072072983,
+ "step": 250
+ },
+ {
+ "epoch": 1.268354430379747,
+ "grad_norm": 0.056023694574832916,
+ "learning_rate": 9.708193041526376e-05,
+ "loss": 0.01813146471977234,
+ "step": 251
+ },
+ {
+ "epoch": 1.2734177215189875,
+ "grad_norm": 0.04508040472865105,
+ "learning_rate": 9.702581369248037e-05,
+ "loss": 0.019225183874368668,
+ "step": 252
+ },
+ {
+ "epoch": 1.2784810126582278,
+ "grad_norm": 0.10354425758123398,
+ "learning_rate": 9.696969696969698e-05,
+ "loss": 0.02940209209918976,
+ "step": 253
+ },
+ {
+ "epoch": 1.2835443037974683,
+ "grad_norm": 0.06974297761917114,
+ "learning_rate": 9.691358024691359e-05,
+ "loss": 0.02482295036315918,
+ "step": 254
+ },
+ {
+ "epoch": 1.2886075949367088,
+ "grad_norm": 0.06940010190010071,
+ "learning_rate": 9.68574635241302e-05,
+ "loss": 0.020605089142918587,
+ "step": 255
+ },
+ {
+ "epoch": 1.2936708860759494,
+ "grad_norm": 0.09167850762605667,
+ "learning_rate": 9.68013468013468e-05,
+ "loss": 0.02429921180009842,
+ "step": 256
+ },
+ {
+ "epoch": 1.29873417721519,
+ "grad_norm": 0.048866868019104004,
+ "learning_rate": 9.674523007856342e-05,
+ "loss": 0.021776504814624786,
+ "step": 257
+ },
+ {
+ "epoch": 1.3037974683544304,
+ "grad_norm": 0.06977155059576035,
+ "learning_rate": 9.668911335578003e-05,
+ "loss": 0.02758147194981575,
+ "step": 258
+ },
+ {
+ "epoch": 1.3088607594936708,
+ "grad_norm": 0.17602303624153137,
+ "learning_rate": 9.663299663299664e-05,
+ "loss": 0.026518259197473526,
+ "step": 259
+ },
+ {
+ "epoch": 1.3139240506329113,
+ "grad_norm": 0.08011946082115173,
+ "learning_rate": 9.657687991021325e-05,
+ "loss": 0.026240577921271324,
+ "step": 260
+ },
+ {
+ "epoch": 1.3189873417721518,
+ "grad_norm": 0.06296376883983612,
+ "learning_rate": 9.652076318742987e-05,
+ "loss": 0.03159455955028534,
+ "step": 261
+ },
+ {
+ "epoch": 1.3240506329113924,
+ "grad_norm": 0.04424722492694855,
+ "learning_rate": 9.646464646464647e-05,
+ "loss": 0.024151435121893883,
+ "step": 262
+ },
+ {
+ "epoch": 1.3291139240506329,
+ "grad_norm": 0.045779623091220856,
+ "learning_rate": 9.640852974186309e-05,
+ "loss": 0.018655993044376373,
+ "step": 263
+ },
+ {
+ "epoch": 1.3341772151898734,
+ "grad_norm": 0.06355931609869003,
+ "learning_rate": 9.635241301907969e-05,
+ "loss": 0.01999380812048912,
+ "step": 264
+ },
+ {
+ "epoch": 1.339240506329114,
+ "grad_norm": 0.04477616026997566,
+ "learning_rate": 9.62962962962963e-05,
+ "loss": 0.021614115685224533,
+ "step": 265
+ },
+ {
+ "epoch": 1.3443037974683545,
+ "grad_norm": 0.05851180478930473,
+ "learning_rate": 9.62401795735129e-05,
+ "loss": 0.023495908826589584,
+ "step": 266
+ },
+ {
+ "epoch": 1.349367088607595,
+ "grad_norm": 0.04724022373557091,
+ "learning_rate": 9.618406285072952e-05,
+ "loss": 0.02053767442703247,
+ "step": 267
+ },
+ {
+ "epoch": 1.3544303797468356,
+ "grad_norm": 0.12757639586925507,
+ "learning_rate": 9.612794612794614e-05,
+ "loss": 0.030612681061029434,
+ "step": 268
+ },
+ {
+ "epoch": 1.3594936708860759,
+ "grad_norm": 0.18316853046417236,
+ "learning_rate": 9.607182940516274e-05,
+ "loss": 0.039485104382038116,
+ "step": 269
+ },
+ {
+ "epoch": 1.3645569620253164,
+ "grad_norm": 0.09149223566055298,
+ "learning_rate": 9.601571268237936e-05,
+ "loss": 0.031156456097960472,
+ "step": 270
+ },
+ {
+ "epoch": 1.369620253164557,
+ "grad_norm": 0.07885908335447311,
+ "learning_rate": 9.595959595959596e-05,
+ "loss": 0.026395633816719055,
+ "step": 271
+ },
+ {
+ "epoch": 1.3746835443037975,
+ "grad_norm": 0.0984397754073143,
+ "learning_rate": 9.590347923681258e-05,
+ "loss": 0.02990398183465004,
+ "step": 272
+ },
+ {
+ "epoch": 1.379746835443038,
+ "grad_norm": 0.08566205203533173,
+ "learning_rate": 9.584736251402918e-05,
+ "loss": 0.024353420361876488,
+ "step": 273
+ },
+ {
+ "epoch": 1.3848101265822785,
+ "grad_norm": 0.16623689234256744,
+ "learning_rate": 9.57912457912458e-05,
+ "loss": 0.03626095876097679,
+ "step": 274
+ },
+ {
+ "epoch": 1.389873417721519,
+ "grad_norm": 0.07134243100881577,
+ "learning_rate": 9.57351290684624e-05,
+ "loss": 0.026036158204078674,
+ "step": 275
+ },
+ {
+ "epoch": 1.3949367088607594,
+ "grad_norm": 0.07753578573465347,
+ "learning_rate": 9.567901234567902e-05,
+ "loss": 0.03266923502087593,
+ "step": 276
+ },
+ {
+ "epoch": 1.4,
+ "grad_norm": 0.07113673537969589,
+ "learning_rate": 9.562289562289563e-05,
+ "loss": 0.024128902703523636,
+ "step": 277
+ },
+ {
+ "epoch": 1.4050632911392404,
+ "grad_norm": 0.0954187884926796,
+ "learning_rate": 9.556677890011224e-05,
+ "loss": 0.03310588374733925,
+ "step": 278
+ },
+ {
+ "epoch": 1.410126582278481,
+ "grad_norm": 0.08755122870206833,
+ "learning_rate": 9.551066217732885e-05,
+ "loss": 0.030977975577116013,
+ "step": 279
+ },
+ {
+ "epoch": 1.4151898734177215,
+ "grad_norm": 0.06839736551046371,
+ "learning_rate": 9.545454545454546e-05,
+ "loss": 0.029557062312960625,
+ "step": 280
+ },
+ {
+ "epoch": 1.420253164556962,
+ "grad_norm": 0.051050763577222824,
+ "learning_rate": 9.539842873176207e-05,
+ "loss": 0.022091392427682877,
+ "step": 281
+ },
+ {
+ "epoch": 1.4253164556962026,
+ "grad_norm": 0.05898132920265198,
+ "learning_rate": 9.534231200897868e-05,
+ "loss": 0.024804875254631042,
+ "step": 282
+ },
+ {
+ "epoch": 1.4303797468354431,
+ "grad_norm": 0.04517035931348801,
+ "learning_rate": 9.528619528619529e-05,
+ "loss": 0.024234894663095474,
+ "step": 283
+ },
+ {
+ "epoch": 1.4354430379746836,
+ "grad_norm": 0.05625253543257713,
+ "learning_rate": 9.52300785634119e-05,
+ "loss": 0.02342807501554489,
+ "step": 284
+ },
+ {
+ "epoch": 1.4405063291139242,
+ "grad_norm": 0.047006960958242416,
+ "learning_rate": 9.517396184062851e-05,
+ "loss": 0.021819880232214928,
+ "step": 285
+ },
+ {
+ "epoch": 1.4455696202531645,
+ "grad_norm": 0.051774390041828156,
+ "learning_rate": 9.511784511784512e-05,
+ "loss": 0.020575571805238724,
+ "step": 286
+ },
+ {
+ "epoch": 1.450632911392405,
+ "grad_norm": 0.0684620812535286,
+ "learning_rate": 9.506172839506173e-05,
+ "loss": 0.025043494999408722,
+ "step": 287
+ },
+ {
+ "epoch": 1.4556962025316456,
+ "grad_norm": 0.05345604941248894,
+ "learning_rate": 9.500561167227834e-05,
+ "loss": 0.020829960703849792,
+ "step": 288
+ },
+ {
+ "epoch": 1.460759493670886,
+ "grad_norm": 0.07588688284158707,
+ "learning_rate": 9.494949494949495e-05,
+ "loss": 0.02842051535844803,
+ "step": 289
+ },
+ {
+ "epoch": 1.4658227848101266,
+ "grad_norm": 0.0371188148856163,
+ "learning_rate": 9.489337822671156e-05,
+ "loss": 0.020213091745972633,
+ "step": 290
+ },
+ {
+ "epoch": 1.4708860759493672,
+ "grad_norm": 0.03922685980796814,
+ "learning_rate": 9.483726150392817e-05,
+ "loss": 0.020665431395173073,
+ "step": 291
+ },
+ {
+ "epoch": 1.4759493670886075,
+ "grad_norm": 0.10213606059551239,
+ "learning_rate": 9.478114478114478e-05,
+ "loss": 0.024979032576084137,
+ "step": 292
+ },
+ {
+ "epoch": 1.481012658227848,
+ "grad_norm": 0.04574638605117798,
+ "learning_rate": 9.472502805836139e-05,
+ "loss": 0.0215127132833004,
+ "step": 293
+ },
+ {
+ "epoch": 1.4860759493670885,
+ "grad_norm": 0.0829704999923706,
+ "learning_rate": 9.4668911335578e-05,
+ "loss": 0.023608818650245667,
+ "step": 294
+ },
+ {
+ "epoch": 1.491139240506329,
+ "grad_norm": 0.036335594952106476,
+ "learning_rate": 9.461279461279463e-05,
+ "loss": 0.01993970200419426,
+ "step": 295
+ },
+ {
+ "epoch": 1.4962025316455696,
+ "grad_norm": 0.08291227370500565,
+ "learning_rate": 9.455667789001122e-05,
+ "loss": 0.02223093807697296,
+ "step": 296
+ },
+ {
+ "epoch": 1.5012658227848101,
+ "grad_norm": 0.048284996300935745,
+ "learning_rate": 9.450056116722785e-05,
+ "loss": 0.019440360367298126,
+ "step": 297
+ },
+ {
+ "epoch": 1.5063291139240507,
+ "grad_norm": 0.25126877427101135,
+ "learning_rate": 9.444444444444444e-05,
+ "loss": 0.030357610434293747,
+ "step": 298
+ },
+ {
+ "epoch": 1.5113924050632912,
+ "grad_norm": 0.08812759816646576,
+ "learning_rate": 9.438832772166107e-05,
+ "loss": 0.025407828390598297,
+ "step": 299
+ },
+ {
+ "epoch": 1.5164556962025317,
+ "grad_norm": 0.09417422115802765,
+ "learning_rate": 9.433221099887766e-05,
+ "loss": 0.028768496587872505,
+ "step": 300
+ },
+ {
+ "epoch": 1.5215189873417723,
+ "grad_norm": 0.10820329934358597,
+ "learning_rate": 9.427609427609429e-05,
+ "loss": 0.03250410035252571,
+ "step": 301
+ },
+ {
+ "epoch": 1.5265822784810128,
+ "grad_norm": 0.06633433699607849,
+ "learning_rate": 9.42199775533109e-05,
+ "loss": 0.019816454499959946,
+ "step": 302
+ },
+ {
+ "epoch": 1.5316455696202531,
+ "grad_norm": 0.05545264482498169,
+ "learning_rate": 9.41638608305275e-05,
+ "loss": 0.020919661968946457,
+ "step": 303
+ },
+ {
+ "epoch": 1.5367088607594936,
+ "grad_norm": 0.08201726526021957,
+ "learning_rate": 9.410774410774412e-05,
+ "loss": 0.0309453085064888,
+ "step": 304
+ },
+ {
+ "epoch": 1.5417721518987342,
+ "grad_norm": 0.047229036688804626,
+ "learning_rate": 9.405162738496073e-05,
+ "loss": 0.02079029008746147,
+ "step": 305
+ },
+ {
+ "epoch": 1.5468354430379747,
+ "grad_norm": 0.04493536427617073,
+ "learning_rate": 9.399551066217734e-05,
+ "loss": 0.020319776609539986,
+ "step": 306
+ },
+ {
+ "epoch": 1.5518987341772152,
+ "grad_norm": 0.07935966551303864,
+ "learning_rate": 9.393939393939395e-05,
+ "loss": 0.03144281357526779,
+ "step": 307
+ },
+ {
+ "epoch": 1.5569620253164556,
+ "grad_norm": 0.10108500719070435,
+ "learning_rate": 9.388327721661056e-05,
+ "loss": 0.029823362827301025,
+ "step": 308
+ },
+ {
+ "epoch": 1.562025316455696,
+ "grad_norm": 0.05187584087252617,
+ "learning_rate": 9.382716049382717e-05,
+ "loss": 0.029090257361531258,
+ "step": 309
+ },
+ {
+ "epoch": 1.5670886075949366,
+ "grad_norm": 0.09131086617708206,
+ "learning_rate": 9.377104377104378e-05,
+ "loss": 0.020090997219085693,
+ "step": 310
+ },
+ {
+ "epoch": 1.5721518987341772,
+ "grad_norm": 0.06874370574951172,
+ "learning_rate": 9.371492704826039e-05,
+ "loss": 0.022118568420410156,
+ "step": 311
+ },
+ {
+ "epoch": 1.5772151898734177,
+ "grad_norm": 0.07480651885271072,
+ "learning_rate": 9.3658810325477e-05,
+ "loss": 0.030924849212169647,
+ "step": 312
+ },
+ {
+ "epoch": 1.5822784810126582,
+ "grad_norm": 0.04049983248114586,
+ "learning_rate": 9.36026936026936e-05,
+ "loss": 0.02086808532476425,
+ "step": 313
+ },
+ {
+ "epoch": 1.5873417721518988,
+ "grad_norm": 0.037067580968141556,
+ "learning_rate": 9.354657687991022e-05,
+ "loss": 0.022019919008016586,
+ "step": 314
+ },
+ {
+ "epoch": 1.5924050632911393,
+ "grad_norm": 0.0599038302898407,
+ "learning_rate": 9.349046015712683e-05,
+ "loss": 0.02305535599589348,
+ "step": 315
+ },
+ {
+ "epoch": 1.5974683544303798,
+ "grad_norm": 0.056727997958660126,
+ "learning_rate": 9.343434343434344e-05,
+ "loss": 0.025360889732837677,
+ "step": 316
+ },
+ {
+ "epoch": 1.6025316455696204,
+ "grad_norm": 0.06659650057554245,
+ "learning_rate": 9.337822671156005e-05,
+ "loss": 0.02528395690023899,
+ "step": 317
+ },
+ {
+ "epoch": 1.6075949367088609,
+ "grad_norm": 0.06213822215795517,
+ "learning_rate": 9.332210998877666e-05,
+ "loss": 0.028841618448495865,
+ "step": 318
+ },
+ {
+ "epoch": 1.6126582278481014,
+ "grad_norm": 0.03757556155323982,
+ "learning_rate": 9.326599326599327e-05,
+ "loss": 0.02282278798520565,
+ "step": 319
+ },
+ {
+ "epoch": 1.6177215189873417,
+ "grad_norm": 0.061945486813783646,
+ "learning_rate": 9.320987654320989e-05,
+ "loss": 0.02733437530696392,
+ "step": 320
+ },
+ {
+ "epoch": 1.6227848101265823,
+ "grad_norm": 0.07904566079378128,
+ "learning_rate": 9.315375982042649e-05,
+ "loss": 0.02630138024687767,
+ "step": 321
+ },
+ {
+ "epoch": 1.6278481012658228,
+ "grad_norm": 0.07157077640295029,
+ "learning_rate": 9.309764309764311e-05,
+ "loss": 0.023403439670801163,
+ "step": 322
+ },
+ {
+ "epoch": 1.6329113924050633,
+ "grad_norm": 0.03518318012356758,
+ "learning_rate": 9.304152637485971e-05,
+ "loss": 0.021487422287464142,
+ "step": 323
+ },
+ {
+ "epoch": 1.6379746835443036,
+ "grad_norm": 0.11178159713745117,
+ "learning_rate": 9.298540965207633e-05,
+ "loss": 0.03142111003398895,
+ "step": 324
+ },
+ {
+ "epoch": 1.6430379746835442,
+ "grad_norm": 0.05046987161040306,
+ "learning_rate": 9.292929292929293e-05,
+ "loss": 0.020960725843906403,
+ "step": 325
+ },
+ {
+ "epoch": 1.6481012658227847,
+ "grad_norm": 0.05356504023075104,
+ "learning_rate": 9.287317620650955e-05,
+ "loss": 0.01934133842587471,
+ "step": 326
+ },
+ {
+ "epoch": 1.6531645569620252,
+ "grad_norm": 0.07995260506868362,
+ "learning_rate": 9.281705948372615e-05,
+ "loss": 0.0248265378177166,
+ "step": 327
+ },
+ {
+ "epoch": 1.6582278481012658,
+ "grad_norm": 0.08783978968858719,
+ "learning_rate": 9.276094276094277e-05,
+ "loss": 0.024171534925699234,
+ "step": 328
+ },
+ {
+ "epoch": 1.6632911392405063,
+ "grad_norm": 0.043143950402736664,
+ "learning_rate": 9.270482603815938e-05,
+ "loss": 0.021554211154580116,
+ "step": 329
+ },
+ {
+ "epoch": 1.6683544303797468,
+ "grad_norm": 0.05635169520974159,
+ "learning_rate": 9.264870931537598e-05,
+ "loss": 0.025942442938685417,
+ "step": 330
+ },
+ {
+ "epoch": 1.6734177215189874,
+ "grad_norm": 0.042691316455602646,
+ "learning_rate": 9.25925925925926e-05,
+ "loss": 0.021898634731769562,
+ "step": 331
+ },
+ {
+ "epoch": 1.678481012658228,
+ "grad_norm": 0.07666946202516556,
+ "learning_rate": 9.25364758698092e-05,
+ "loss": 0.02928568609058857,
+ "step": 332
+ },
+ {
+ "epoch": 1.6835443037974684,
+ "grad_norm": 0.04230545833706856,
+ "learning_rate": 9.248035914702582e-05,
+ "loss": 0.020812246948480606,
+ "step": 333
+ },
+ {
+ "epoch": 1.688607594936709,
+ "grad_norm": 0.1077270656824112,
+ "learning_rate": 9.242424242424242e-05,
+ "loss": 0.025568369776010513,
+ "step": 334
+ },
+ {
+ "epoch": 1.6936708860759495,
+ "grad_norm": 0.04277936369180679,
+ "learning_rate": 9.236812570145904e-05,
+ "loss": 0.018935058265924454,
+ "step": 335
+ },
+ {
+ "epoch": 1.6987341772151898,
+ "grad_norm": 0.04454135522246361,
+ "learning_rate": 9.231200897867565e-05,
+ "loss": 0.01933746598660946,
+ "step": 336
+ },
+ {
+ "epoch": 1.7037974683544304,
+ "grad_norm": 0.0674893856048584,
+ "learning_rate": 9.225589225589226e-05,
+ "loss": 0.021518435329198837,
+ "step": 337
+ },
+ {
+ "epoch": 1.7088607594936709,
+ "grad_norm": 0.06007042154669762,
+ "learning_rate": 9.219977553310887e-05,
+ "loss": 0.019427424296736717,
+ "step": 338
+ },
+ {
+ "epoch": 1.7139240506329114,
+ "grad_norm": 0.09564489126205444,
+ "learning_rate": 9.214365881032548e-05,
+ "loss": 0.027250545099377632,
+ "step": 339
+ },
+ {
+ "epoch": 1.7189873417721517,
+ "grad_norm": 0.053655482828617096,
+ "learning_rate": 9.208754208754209e-05,
+ "loss": 0.020125389099121094,
+ "step": 340
+ },
+ {
+ "epoch": 1.7240506329113923,
+ "grad_norm": 0.038283221423625946,
+ "learning_rate": 9.20314253647587e-05,
+ "loss": 0.017948098480701447,
+ "step": 341
+ },
+ {
+ "epoch": 1.7291139240506328,
+ "grad_norm": 0.04724166542291641,
+ "learning_rate": 9.197530864197531e-05,
+ "loss": 0.02523602545261383,
+ "step": 342
+ },
+ {
+ "epoch": 1.7341772151898733,
+ "grad_norm": 0.10365224629640579,
+ "learning_rate": 9.191919191919192e-05,
+ "loss": 0.035696640610694885,
+ "step": 343
+ },
+ {
+ "epoch": 1.7392405063291139,
+ "grad_norm": 0.07362233102321625,
+ "learning_rate": 9.186307519640853e-05,
+ "loss": 0.026104427874088287,
+ "step": 344
+ },
+ {
+ "epoch": 1.7443037974683544,
+ "grad_norm": 0.05976846069097519,
+ "learning_rate": 9.180695847362514e-05,
+ "loss": 0.026634451001882553,
+ "step": 345
+ },
+ {
+ "epoch": 1.749367088607595,
+ "grad_norm": 0.07387223839759827,
+ "learning_rate": 9.175084175084175e-05,
+ "loss": 0.025733446702361107,
+ "step": 346
+ },
+ {
+ "epoch": 1.7544303797468355,
+ "grad_norm": 0.04727378115057945,
+ "learning_rate": 9.169472502805838e-05,
+ "loss": 0.01889938861131668,
+ "step": 347
+ },
+ {
+ "epoch": 1.759493670886076,
+ "grad_norm": 0.10614906996488571,
+ "learning_rate": 9.163860830527497e-05,
+ "loss": 0.02275039628148079,
+ "step": 348
+ },
+ {
+ "epoch": 1.7645569620253165,
+ "grad_norm": 0.04877970367670059,
+ "learning_rate": 9.15824915824916e-05,
+ "loss": 0.022580452263355255,
+ "step": 349
+ },
+ {
+ "epoch": 1.769620253164557,
+ "grad_norm": 0.18825598061084747,
+ "learning_rate": 9.152637485970819e-05,
+ "loss": 0.03054988384246826,
+ "step": 350
+ },
+ {
+ "epoch": 1.7746835443037976,
+ "grad_norm": 0.06315254420042038,
+ "learning_rate": 9.147025813692482e-05,
+ "loss": 0.025584843009710312,
+ "step": 351
+ },
+ {
+ "epoch": 1.7797468354430381,
+ "grad_norm": 0.04519108682870865,
+ "learning_rate": 9.141414141414141e-05,
+ "loss": 0.0214737206697464,
+ "step": 352
+ },
+ {
+ "epoch": 1.7848101265822784,
+ "grad_norm": 0.07401937246322632,
+ "learning_rate": 9.135802469135802e-05,
+ "loss": 0.02984039857983589,
+ "step": 353
+ },
+ {
+ "epoch": 1.789873417721519,
+ "grad_norm": 0.05138625577092171,
+ "learning_rate": 9.130190796857465e-05,
+ "loss": 0.024221282452344894,
+ "step": 354
+ },
+ {
+ "epoch": 1.7949367088607595,
+ "grad_norm": 0.10182037204504013,
+ "learning_rate": 9.124579124579124e-05,
+ "loss": 0.0237903892993927,
+ "step": 355
+ },
+ {
+ "epoch": 1.8,
+ "grad_norm": 0.056737013161182404,
+ "learning_rate": 9.118967452300787e-05,
+ "loss": 0.026514701545238495,
+ "step": 356
+ },
+ {
+ "epoch": 1.8050632911392404,
+ "grad_norm": 0.04826146364212036,
+ "learning_rate": 9.113355780022446e-05,
+ "loss": 0.021808844059705734,
+ "step": 357
+ },
+ {
+ "epoch": 1.810126582278481,
+ "grad_norm": 0.07099983841180801,
+ "learning_rate": 9.107744107744109e-05,
+ "loss": 0.028031716123223305,
+ "step": 358
+ },
+ {
+ "epoch": 1.8151898734177214,
+ "grad_norm": 0.04242753982543945,
+ "learning_rate": 9.102132435465768e-05,
+ "loss": 0.018858186900615692,
+ "step": 359
+ },
+ {
+ "epoch": 1.820253164556962,
+ "grad_norm": 0.053701240569353104,
+ "learning_rate": 9.096520763187431e-05,
+ "loss": 0.025603849440813065,
+ "step": 360
+ },
+ {
+ "epoch": 1.8253164556962025,
+ "grad_norm": 0.05277755856513977,
+ "learning_rate": 9.090909090909092e-05,
+ "loss": 0.021214714273810387,
+ "step": 361
+ },
+ {
+ "epoch": 1.830379746835443,
+ "grad_norm": 0.048843637108802795,
+ "learning_rate": 9.085297418630753e-05,
+ "loss": 0.024215007200837135,
+ "step": 362
+ },
+ {
+ "epoch": 1.8354430379746836,
+ "grad_norm": 0.04203329607844353,
+ "learning_rate": 9.079685746352414e-05,
+ "loss": 0.022748971357941628,
+ "step": 363
+ },
+ {
+ "epoch": 1.840506329113924,
+ "grad_norm": 0.04655196890234947,
+ "learning_rate": 9.074074074074075e-05,
+ "loss": 0.019658325240015984,
+ "step": 364
+ },
+ {
+ "epoch": 1.8455696202531646,
+ "grad_norm": 0.10654491931200027,
+ "learning_rate": 9.068462401795736e-05,
+ "loss": 0.03210999816656113,
+ "step": 365
+ },
+ {
+ "epoch": 1.8506329113924052,
+ "grad_norm": 0.04377336800098419,
+ "learning_rate": 9.062850729517397e-05,
+ "loss": 0.01867927983403206,
+ "step": 366
+ },
+ {
+ "epoch": 1.8556962025316457,
+ "grad_norm": 0.04619381204247475,
+ "learning_rate": 9.057239057239058e-05,
+ "loss": 0.01952965185046196,
+ "step": 367
+ },
+ {
+ "epoch": 1.8607594936708862,
+ "grad_norm": 0.04015986621379852,
+ "learning_rate": 9.051627384960719e-05,
+ "loss": 0.017353296279907227,
+ "step": 368
+ },
+ {
+ "epoch": 1.8658227848101265,
+ "grad_norm": 0.11403095722198486,
+ "learning_rate": 9.04601571268238e-05,
+ "loss": 0.02238992229104042,
+ "step": 369
+ },
+ {
+ "epoch": 1.870886075949367,
+ "grad_norm": 0.043767284601926804,
+ "learning_rate": 9.040404040404041e-05,
+ "loss": 0.02202833816409111,
+ "step": 370
+ },
+ {
+ "epoch": 1.8759493670886076,
+ "grad_norm": 0.053445883095264435,
+ "learning_rate": 9.034792368125702e-05,
+ "loss": 0.023765750229358673,
+ "step": 371
+ },
+ {
+ "epoch": 1.8810126582278481,
+ "grad_norm": 0.05750055983662605,
+ "learning_rate": 9.029180695847364e-05,
+ "loss": 0.026259474456310272,
+ "step": 372
+ },
+ {
+ "epoch": 1.8860759493670884,
+ "grad_norm": 0.04525497183203697,
+ "learning_rate": 9.023569023569024e-05,
+ "loss": 0.024194583296775818,
+ "step": 373
+ },
+ {
+ "epoch": 1.891139240506329,
+ "grad_norm": 0.04918856918811798,
+ "learning_rate": 9.017957351290685e-05,
+ "loss": 0.020951319485902786,
+ "step": 374
+ },
+ {
+ "epoch": 1.8962025316455695,
+ "grad_norm": 0.08538687229156494,
+ "learning_rate": 9.012345679012346e-05,
+ "loss": 0.022266045212745667,
+ "step": 375
+ },
+ {
+ "epoch": 1.90126582278481,
+ "grad_norm": 0.07101748883724213,
+ "learning_rate": 9.006734006734007e-05,
+ "loss": 0.028090521693229675,
+ "step": 376
+ },
+ {
+ "epoch": 1.9063291139240506,
+ "grad_norm": 0.06256446987390518,
+ "learning_rate": 9.001122334455668e-05,
+ "loss": 0.027174800634384155,
+ "step": 377
+ },
+ {
+ "epoch": 1.9113924050632911,
+ "grad_norm": 0.07588270306587219,
+ "learning_rate": 8.995510662177329e-05,
+ "loss": 0.028438206762075424,
+ "step": 378
+ },
+ {
+ "epoch": 1.9164556962025316,
+ "grad_norm": 5.8829851150512695,
+ "learning_rate": 8.98989898989899e-05,
+ "loss": 0.01749270409345627,
+ "step": 379
+ },
+ {
+ "epoch": 1.9215189873417722,
+ "grad_norm": 0.038905344903469086,
+ "learning_rate": 8.984287317620651e-05,
+ "loss": 0.019571108743548393,
+ "step": 380
+ },
+ {
+ "epoch": 1.9265822784810127,
+ "grad_norm": 0.05960959196090698,
+ "learning_rate": 8.978675645342313e-05,
+ "loss": 0.024591946974396706,
+ "step": 381
+ },
+ {
+ "epoch": 1.9316455696202532,
+ "grad_norm": 0.07935867458581924,
+ "learning_rate": 8.973063973063973e-05,
+ "loss": 0.020205039530992508,
+ "step": 382
+ },
+ {
+ "epoch": 1.9367088607594938,
+ "grad_norm": 0.08682888746261597,
+ "learning_rate": 8.967452300785635e-05,
+ "loss": 0.023299653083086014,
+ "step": 383
+ },
+ {
+ "epoch": 1.9417721518987343,
+ "grad_norm": 0.07220255583524704,
+ "learning_rate": 8.961840628507295e-05,
+ "loss": 0.025364618748426437,
+ "step": 384
+ },
+ {
+ "epoch": 1.9468354430379748,
+ "grad_norm": 0.08230294287204742,
+ "learning_rate": 8.956228956228957e-05,
+ "loss": 0.023587457835674286,
+ "step": 385
+ },
+ {
+ "epoch": 1.9518987341772152,
+ "grad_norm": 0.05176795646548271,
+ "learning_rate": 8.950617283950617e-05,
+ "loss": 0.018942706286907196,
+ "step": 386
+ },
+ {
+ "epoch": 1.9569620253164557,
+ "grad_norm": 0.04784144088625908,
+ "learning_rate": 8.945005611672279e-05,
+ "loss": 0.020134730264544487,
+ "step": 387
+ },
+ {
+ "epoch": 1.9620253164556962,
+ "grad_norm": 0.04668115824460983,
+ "learning_rate": 8.93939393939394e-05,
+ "loss": 0.022084465250372887,
+ "step": 388
+ },
+ {
+ "epoch": 1.9670886075949368,
+ "grad_norm": 0.05892647057771683,
+ "learning_rate": 8.933782267115601e-05,
+ "loss": 0.02586008608341217,
+ "step": 389
+ },
+ {
+ "epoch": 1.972151898734177,
+ "grad_norm": 0.048669006675481796,
+ "learning_rate": 8.928170594837262e-05,
+ "loss": 0.020011097192764282,
+ "step": 390
+ },
+ {
+ "epoch": 1.9772151898734176,
+ "grad_norm": 0.0973723903298378,
+ "learning_rate": 8.922558922558923e-05,
+ "loss": 0.030240919440984726,
+ "step": 391
+ },
+ {
+ "epoch": 1.9822784810126581,
+ "grad_norm": 0.090507872402668,
+ "learning_rate": 8.916947250280584e-05,
+ "loss": 0.028250183910131454,
+ "step": 392
+ },
+ {
+ "epoch": 1.9873417721518987,
+ "grad_norm": 0.03921318054199219,
+ "learning_rate": 8.911335578002245e-05,
+ "loss": 0.02076716348528862,
+ "step": 393
+ },
+ {
+ "epoch": 1.9924050632911392,
+ "grad_norm": 0.04830043017864227,
+ "learning_rate": 8.905723905723906e-05,
+ "loss": 0.02241525426506996,
+ "step": 394
+ },
+ {
+ "epoch": 1.9974683544303797,
+ "grad_norm": 0.04455797001719475,
+ "learning_rate": 8.900112233445567e-05,
+ "loss": 0.026035301387310028,
+ "step": 395
+ },
+ {
+ "epoch": 2.0,
+ "grad_norm": 0.10931648313999176,
+ "learning_rate": 8.894500561167228e-05,
+ "loss": 0.03514251485466957,
+ "step": 396
+ },
+ {
+ "epoch": 2.0050632911392405,
+ "grad_norm": 0.07531362026929855,
+ "learning_rate": 8.888888888888889e-05,
+ "loss": 0.021771814674139023,
+ "step": 397
+ },
+ {
+ "epoch": 2.010126582278481,
+ "grad_norm": 0.0649140477180481,
+ "learning_rate": 8.88327721661055e-05,
+ "loss": 0.02932022325694561,
+ "step": 398
+ },
+ {
+ "epoch": 2.0151898734177216,
+ "grad_norm": 0.07461163401603699,
+ "learning_rate": 8.877665544332211e-05,
+ "loss": 0.023864082992076874,
+ "step": 399
+ },
+ {
+ "epoch": 2.020253164556962,
+ "grad_norm": 0.054510265588760376,
+ "learning_rate": 8.872053872053872e-05,
+ "loss": 0.027578316628932953,
+ "step": 400
+ },
+ {
+ "epoch": 2.0253164556962027,
+ "grad_norm": 0.04434451460838318,
+ "learning_rate": 8.866442199775533e-05,
+ "loss": 0.022873830050230026,
+ "step": 401
+ },
+ {
+ "epoch": 2.030379746835443,
+ "grad_norm": 0.052791960537433624,
+ "learning_rate": 8.860830527497194e-05,
+ "loss": 0.021092431619763374,
+ "step": 402
+ },
+ {
+ "epoch": 2.0354430379746837,
+ "grad_norm": 0.04550998657941818,
+ "learning_rate": 8.855218855218855e-05,
+ "loss": 0.022475749254226685,
+ "step": 403
+ },
+ {
+ "epoch": 2.0405063291139243,
+ "grad_norm": 0.2512972354888916,
+ "learning_rate": 8.849607182940516e-05,
+ "loss": 0.02201610803604126,
+ "step": 404
+ },
+ {
+ "epoch": 2.0455696202531644,
+ "grad_norm": 0.04554569348692894,
+ "learning_rate": 8.843995510662177e-05,
+ "loss": 0.02180359698832035,
+ "step": 405
+ },
+ {
+ "epoch": 2.050632911392405,
+ "grad_norm": 0.04094229266047478,
+ "learning_rate": 8.83838383838384e-05,
+ "loss": 0.01960112899541855,
+ "step": 406
+ },
+ {
+ "epoch": 2.0556962025316454,
+ "grad_norm": 0.07398641109466553,
+ "learning_rate": 8.8327721661055e-05,
+ "loss": 0.02206597849726677,
+ "step": 407
+ },
+ {
+ "epoch": 2.060759493670886,
+ "grad_norm": 0.07659231871366501,
+ "learning_rate": 8.827160493827162e-05,
+ "loss": 0.019660351797938347,
+ "step": 408
+ },
+ {
+ "epoch": 2.0658227848101265,
+ "grad_norm": 0.05986466258764267,
+ "learning_rate": 8.821548821548821e-05,
+ "loss": 0.027121691033244133,
+ "step": 409
+ },
+ {
+ "epoch": 2.070886075949367,
+ "grad_norm": 0.03376661241054535,
+ "learning_rate": 8.815937149270484e-05,
+ "loss": 0.021059338003396988,
+ "step": 410
+ },
+ {
+ "epoch": 2.0759493670886076,
+ "grad_norm": 0.081104576587677,
+ "learning_rate": 8.810325476992143e-05,
+ "loss": 0.031228341162204742,
+ "step": 411
+ },
+ {
+ "epoch": 2.081012658227848,
+ "grad_norm": 0.04295242205262184,
+ "learning_rate": 8.804713804713806e-05,
+ "loss": 0.020738180726766586,
+ "step": 412
+ },
+ {
+ "epoch": 2.0860759493670886,
+ "grad_norm": 0.03715268895030022,
+ "learning_rate": 8.799102132435467e-05,
+ "loss": 0.018579209223389626,
+ "step": 413
+ },
+ {
+ "epoch": 2.091139240506329,
+ "grad_norm": 0.06769359856843948,
+ "learning_rate": 8.793490460157128e-05,
+ "loss": 0.026761794462800026,
+ "step": 414
+ },
+ {
+ "epoch": 2.0962025316455697,
+ "grad_norm": 0.03715744614601135,
+ "learning_rate": 8.787878787878789e-05,
+ "loss": 0.022879980504512787,
+ "step": 415
+ },
+ {
+ "epoch": 2.1012658227848102,
+ "grad_norm": 0.04305677488446236,
+ "learning_rate": 8.78226711560045e-05,
+ "loss": 0.022773049771785736,
+ "step": 416
+ },
+ {
+ "epoch": 2.1063291139240508,
+ "grad_norm": 0.0449112169444561,
+ "learning_rate": 8.776655443322111e-05,
+ "loss": 0.022499293088912964,
+ "step": 417
+ },
+ {
+ "epoch": 2.1113924050632913,
+ "grad_norm": 0.0457427054643631,
+ "learning_rate": 8.77104377104377e-05,
+ "loss": 0.024978693574666977,
+ "step": 418
+ },
+ {
+ "epoch": 2.116455696202532,
+ "grad_norm": 0.04705161228775978,
+ "learning_rate": 8.765432098765433e-05,
+ "loss": 0.024807877838611603,
+ "step": 419
+ },
+ {
+ "epoch": 2.1215189873417724,
+ "grad_norm": 0.04377812147140503,
+ "learning_rate": 8.759820426487092e-05,
+ "loss": 0.025857431814074516,
+ "step": 420
+ },
+ {
+ "epoch": 2.1265822784810124,
+ "grad_norm": 0.08598720282316208,
+ "learning_rate": 8.754208754208755e-05,
+ "loss": 0.021972455084323883,
+ "step": 421
+ },
+ {
+ "epoch": 2.131645569620253,
+ "grad_norm": 0.4669632017612457,
+ "learning_rate": 8.748597081930416e-05,
+ "loss": 0.02055199444293976,
+ "step": 422
+ },
+ {
+ "epoch": 2.1367088607594935,
+ "grad_norm": 0.05292733013629913,
+ "learning_rate": 8.742985409652077e-05,
+ "loss": 0.020852137356996536,
+ "step": 423
+ },
+ {
+ "epoch": 2.141772151898734,
+ "grad_norm": 0.05878116562962532,
+ "learning_rate": 8.737373737373738e-05,
+ "loss": 0.02444305270910263,
+ "step": 424
+ },
+ {
+ "epoch": 2.1468354430379746,
+ "grad_norm": 0.05234210565686226,
+ "learning_rate": 8.731762065095399e-05,
+ "loss": 0.02202335000038147,
+ "step": 425
+ },
+ {
+ "epoch": 2.151898734177215,
+ "grad_norm": 0.04706348851323128,
+ "learning_rate": 8.72615039281706e-05,
+ "loss": 0.019998187199234962,
+ "step": 426
+ },
+ {
+ "epoch": 2.1569620253164556,
+ "grad_norm": 0.05263376981019974,
+ "learning_rate": 8.720538720538721e-05,
+ "loss": 0.028126951307058334,
+ "step": 427
+ },
+ {
+ "epoch": 2.162025316455696,
+ "grad_norm": 0.062016960233449936,
+ "learning_rate": 8.714927048260382e-05,
+ "loss": 0.0286184661090374,
+ "step": 428
+ },
+ {
+ "epoch": 2.1670886075949367,
+ "grad_norm": 0.13798244297504425,
+ "learning_rate": 8.709315375982043e-05,
+ "loss": 0.026699248701334,
+ "step": 429
+ },
+ {
+ "epoch": 2.1721518987341772,
+ "grad_norm": 0.09159042686223984,
+ "learning_rate": 8.703703703703704e-05,
+ "loss": 0.025515643879771233,
+ "step": 430
+ },
+ {
+ "epoch": 2.1772151898734178,
+ "grad_norm": 0.0828855037689209,
+ "learning_rate": 8.698092031425365e-05,
+ "loss": 0.025481123477220535,
+ "step": 431
+ },
+ {
+ "epoch": 2.1822784810126583,
+ "grad_norm": 0.09840776771306992,
+ "learning_rate": 8.692480359147026e-05,
+ "loss": 0.020968927070498466,
+ "step": 432
+ },
+ {
+ "epoch": 2.187341772151899,
+ "grad_norm": 0.10999752581119537,
+ "learning_rate": 8.686868686868688e-05,
+ "loss": 0.028588412329554558,
+ "step": 433
+ },
+ {
+ "epoch": 2.1924050632911394,
+ "grad_norm": 0.06938561797142029,
+ "learning_rate": 8.681257014590348e-05,
+ "loss": 0.024119220674037933,
+ "step": 434
+ },
+ {
+ "epoch": 2.19746835443038,
+ "grad_norm": 0.054689887911081314,
+ "learning_rate": 8.67564534231201e-05,
+ "loss": 0.02173299714922905,
+ "step": 435
+ },
+ {
+ "epoch": 2.2025316455696204,
+ "grad_norm": 0.09605880081653595,
+ "learning_rate": 8.67003367003367e-05,
+ "loss": 0.02312455326318741,
+ "step": 436
+ },
+ {
+ "epoch": 2.207594936708861,
+ "grad_norm": 0.06863043457269669,
+ "learning_rate": 8.664421997755332e-05,
+ "loss": 0.020868321880698204,
+ "step": 437
+ },
+ {
+ "epoch": 2.212658227848101,
+ "grad_norm": 0.11743242293596268,
+ "learning_rate": 8.658810325476992e-05,
+ "loss": 0.029748965054750443,
+ "step": 438
+ },
+ {
+ "epoch": 2.2177215189873416,
+ "grad_norm": 0.08399086445569992,
+ "learning_rate": 8.653198653198653e-05,
+ "loss": 0.02379520982503891,
+ "step": 439
+ },
+ {
+ "epoch": 2.222784810126582,
+ "grad_norm": 0.052164461463689804,
+ "learning_rate": 8.647586980920315e-05,
+ "loss": 0.02010851353406906,
+ "step": 440
+ },
+ {
+ "epoch": 2.2278481012658227,
+ "grad_norm": 0.11834696680307388,
+ "learning_rate": 8.641975308641975e-05,
+ "loss": 0.02748255990445614,
+ "step": 441
+ },
+ {
+ "epoch": 2.232911392405063,
+ "grad_norm": 0.06718999892473221,
+ "learning_rate": 8.636363636363637e-05,
+ "loss": 0.026828233152627945,
+ "step": 442
+ },
+ {
+ "epoch": 2.2379746835443037,
+ "grad_norm": 0.042458854615688324,
+ "learning_rate": 8.630751964085297e-05,
+ "loss": 0.021280258893966675,
+ "step": 443
+ },
+ {
+ "epoch": 2.2430379746835443,
+ "grad_norm": 0.036516617983579636,
+ "learning_rate": 8.62514029180696e-05,
+ "loss": 0.021773381158709526,
+ "step": 444
+ },
+ {
+ "epoch": 2.248101265822785,
+ "grad_norm": 0.04317261651158333,
+ "learning_rate": 8.619528619528619e-05,
+ "loss": 0.022671079263091087,
+ "step": 445
+ },
+ {
+ "epoch": 2.2531645569620253,
+ "grad_norm": 0.08610037714242935,
+ "learning_rate": 8.613916947250281e-05,
+ "loss": 0.02425701916217804,
+ "step": 446
+ },
+ {
+ "epoch": 2.258227848101266,
+ "grad_norm": 0.03478290140628815,
+ "learning_rate": 8.608305274971942e-05,
+ "loss": 0.022291556000709534,
+ "step": 447
+ },
+ {
+ "epoch": 2.2632911392405064,
+ "grad_norm": 0.04682233929634094,
+ "learning_rate": 8.602693602693603e-05,
+ "loss": 0.02036888152360916,
+ "step": 448
+ },
+ {
+ "epoch": 2.268354430379747,
+ "grad_norm": 0.0808606892824173,
+ "learning_rate": 8.597081930415264e-05,
+ "loss": 0.025470012798905373,
+ "step": 449
+ },
+ {
+ "epoch": 2.2734177215189875,
+ "grad_norm": 0.042830612510442734,
+ "learning_rate": 8.591470258136925e-05,
+ "loss": 0.020565971732139587,
+ "step": 450
+ },
+ {
+ "epoch": 2.278481012658228,
+ "grad_norm": 0.06374406069517136,
+ "learning_rate": 8.585858585858586e-05,
+ "loss": 0.031990330666303635,
+ "step": 451
+ },
+ {
+ "epoch": 2.2835443037974685,
+ "grad_norm": 0.05716697871685028,
+ "learning_rate": 8.580246913580247e-05,
+ "loss": 0.024125374853610992,
+ "step": 452
+ },
+ {
+ "epoch": 2.2886075949367086,
+ "grad_norm": 0.04057484492659569,
+ "learning_rate": 8.574635241301908e-05,
+ "loss": 0.021739482879638672,
+ "step": 453
+ },
+ {
+ "epoch": 2.293670886075949,
+ "grad_norm": 0.07754945009946823,
+ "learning_rate": 8.56902356902357e-05,
+ "loss": 0.02694481424987316,
+ "step": 454
+ },
+ {
+ "epoch": 2.2987341772151897,
+ "grad_norm": 0.06022442877292633,
+ "learning_rate": 8.56341189674523e-05,
+ "loss": 0.021221034228801727,
+ "step": 455
+ },
+ {
+ "epoch": 2.3037974683544302,
+ "grad_norm": 0.06909896433353424,
+ "learning_rate": 8.557800224466891e-05,
+ "loss": 0.02247895672917366,
+ "step": 456
+ },
+ {
+ "epoch": 2.3088607594936708,
+ "grad_norm": 0.05362236499786377,
+ "learning_rate": 8.552188552188552e-05,
+ "loss": 0.020700538530945778,
+ "step": 457
+ },
+ {
+ "epoch": 2.3139240506329113,
+ "grad_norm": 0.09836408495903015,
+ "learning_rate": 8.546576879910215e-05,
+ "loss": 0.02611887827515602,
+ "step": 458
+ },
+ {
+ "epoch": 2.318987341772152,
+ "grad_norm": 0.036625102162361145,
+ "learning_rate": 8.540965207631874e-05,
+ "loss": 0.0196938905864954,
+ "step": 459
+ },
+ {
+ "epoch": 2.3240506329113924,
+ "grad_norm": 0.07372298091650009,
+ "learning_rate": 8.535353535353535e-05,
+ "loss": 0.020545657724142075,
+ "step": 460
+ },
+ {
+ "epoch": 2.329113924050633,
+ "grad_norm": 0.20502988994121552,
+ "learning_rate": 8.529741863075196e-05,
+ "loss": 0.02884715050458908,
+ "step": 461
+ },
+ {
+ "epoch": 2.3341772151898734,
+ "grad_norm": 0.04867224395275116,
+ "learning_rate": 8.524130190796857e-05,
+ "loss": 0.019854716956615448,
+ "step": 462
+ },
+ {
+ "epoch": 2.339240506329114,
+ "grad_norm": 0.029550092294812202,
+ "learning_rate": 8.518518518518518e-05,
+ "loss": 0.01884104311466217,
+ "step": 463
+ },
+ {
+ "epoch": 2.3443037974683545,
+ "grad_norm": 0.04299351945519447,
+ "learning_rate": 8.51290684624018e-05,
+ "loss": 0.01954217068850994,
+ "step": 464
+ },
+ {
+ "epoch": 2.349367088607595,
+ "grad_norm": 0.043467242270708084,
+ "learning_rate": 8.507295173961842e-05,
+ "loss": 0.024274462834000587,
+ "step": 465
+ },
+ {
+ "epoch": 2.3544303797468356,
+ "grad_norm": 0.05131510645151138,
+ "learning_rate": 8.501683501683501e-05,
+ "loss": 0.026246599853038788,
+ "step": 466
+ },
+ {
+ "epoch": 2.359493670886076,
+ "grad_norm": 0.06280570477247238,
+ "learning_rate": 8.496071829405164e-05,
+ "loss": 0.024986159056425095,
+ "step": 467
+ },
+ {
+ "epoch": 2.3645569620253166,
+ "grad_norm": 0.04968208447098732,
+ "learning_rate": 8.490460157126824e-05,
+ "loss": 0.02912936732172966,
+ "step": 468
+ },
+ {
+ "epoch": 2.369620253164557,
+ "grad_norm": 0.08504039794206619,
+ "learning_rate": 8.484848484848486e-05,
+ "loss": 0.027097277343273163,
+ "step": 469
+ },
+ {
+ "epoch": 2.3746835443037977,
+ "grad_norm": 0.18385924398899078,
+ "learning_rate": 8.479236812570146e-05,
+ "loss": 0.02459462732076645,
+ "step": 470
+ },
+ {
+ "epoch": 2.379746835443038,
+ "grad_norm": 0.0663745328783989,
+ "learning_rate": 8.473625140291808e-05,
+ "loss": 0.020224973559379578,
+ "step": 471
+ },
+ {
+ "epoch": 2.3848101265822783,
+ "grad_norm": 0.04759671539068222,
+ "learning_rate": 8.468013468013468e-05,
+ "loss": 0.02591642364859581,
+ "step": 472
+ },
+ {
+ "epoch": 2.389873417721519,
+ "grad_norm": 0.044010091572999954,
+ "learning_rate": 8.46240179573513e-05,
+ "loss": 0.025122515857219696,
+ "step": 473
+ },
+ {
+ "epoch": 2.3949367088607594,
+ "grad_norm": 0.035054467618465424,
+ "learning_rate": 8.456790123456791e-05,
+ "loss": 0.019854065030813217,
+ "step": 474
+ },
+ {
+ "epoch": 2.4,
+ "grad_norm": 0.03171153366565704,
+ "learning_rate": 8.451178451178452e-05,
+ "loss": 0.02009584940969944,
+ "step": 475
+ },
+ {
+ "epoch": 2.4050632911392404,
+ "grad_norm": 0.17388089001178741,
+ "learning_rate": 8.445566778900113e-05,
+ "loss": 0.02714207023382187,
+ "step": 476
+ },
+ {
+ "epoch": 2.410126582278481,
+ "grad_norm": 0.038392502814531326,
+ "learning_rate": 8.439955106621774e-05,
+ "loss": 0.020382478833198547,
+ "step": 477
+ },
+ {
+ "epoch": 2.4151898734177215,
+ "grad_norm": 0.04264051839709282,
+ "learning_rate": 8.434343434343435e-05,
+ "loss": 0.022726822644472122,
+ "step": 478
+ },
+ {
+ "epoch": 2.420253164556962,
+ "grad_norm": 0.046432014554739,
+ "learning_rate": 8.428731762065096e-05,
+ "loss": 0.021431483328342438,
+ "step": 479
+ },
+ {
+ "epoch": 2.4253164556962026,
+ "grad_norm": 0.07288242876529694,
+ "learning_rate": 8.423120089786757e-05,
+ "loss": 0.026229504495859146,
+ "step": 480
+ },
+ {
+ "epoch": 2.430379746835443,
+ "grad_norm": 0.04801097884774208,
+ "learning_rate": 8.417508417508418e-05,
+ "loss": 0.020924456417560577,
+ "step": 481
+ },
+ {
+ "epoch": 2.4354430379746836,
+ "grad_norm": 0.11201190203428268,
+ "learning_rate": 8.411896745230079e-05,
+ "loss": 0.022652529180049896,
+ "step": 482
+ },
+ {
+ "epoch": 2.440506329113924,
+ "grad_norm": 0.06151285395026207,
+ "learning_rate": 8.40628507295174e-05,
+ "loss": 0.02416859194636345,
+ "step": 483
+ },
+ {
+ "epoch": 2.4455696202531647,
+ "grad_norm": 0.04006446525454521,
+ "learning_rate": 8.400673400673401e-05,
+ "loss": 0.02390255406498909,
+ "step": 484
+ },
+ {
+ "epoch": 2.4506329113924052,
+ "grad_norm": 0.027193108573555946,
+ "learning_rate": 8.395061728395062e-05,
+ "loss": 0.015282701700925827,
+ "step": 485
+ },
+ {
+ "epoch": 2.4556962025316453,
+ "grad_norm": 0.05453994497656822,
+ "learning_rate": 8.389450056116723e-05,
+ "loss": 0.025738034397363663,
+ "step": 486
+ },
+ {
+ "epoch": 2.460759493670886,
+ "grad_norm": 0.03226681798696518,
+ "learning_rate": 8.383838383838384e-05,
+ "loss": 0.02111941948533058,
+ "step": 487
+ },
+ {
+ "epoch": 2.4658227848101264,
+ "grad_norm": 0.0451083667576313,
+ "learning_rate": 8.378226711560045e-05,
+ "loss": 0.020694585517048836,
+ "step": 488
+ },
+ {
+ "epoch": 2.470886075949367,
+ "grad_norm": 0.0390113927423954,
+ "learning_rate": 8.372615039281706e-05,
+ "loss": 0.022557765245437622,
+ "step": 489
+ },
+ {
+ "epoch": 2.4759493670886075,
+ "grad_norm": 0.05983779951930046,
+ "learning_rate": 8.367003367003367e-05,
+ "loss": 0.02489873766899109,
+ "step": 490
+ },
+ {
+ "epoch": 2.481012658227848,
+ "grad_norm": 0.03961458057165146,
+ "learning_rate": 8.361391694725028e-05,
+ "loss": 0.021655399352312088,
+ "step": 491
+ },
+ {
+ "epoch": 2.4860759493670885,
+ "grad_norm": 0.03814523667097092,
+ "learning_rate": 8.35578002244669e-05,
+ "loss": 0.02217719703912735,
+ "step": 492
+ },
+ {
+ "epoch": 2.491139240506329,
+ "grad_norm": 0.030563514679670334,
+ "learning_rate": 8.35016835016835e-05,
+ "loss": 0.01679009571671486,
+ "step": 493
+ },
+ {
+ "epoch": 2.4962025316455696,
+ "grad_norm": 0.04566824436187744,
+ "learning_rate": 8.344556677890012e-05,
+ "loss": 0.019699417054653168,
+ "step": 494
+ },
+ {
+ "epoch": 2.50126582278481,
+ "grad_norm": 0.06117499992251396,
+ "learning_rate": 8.338945005611672e-05,
+ "loss": 0.028571851551532745,
+ "step": 495
+ },
+ {
+ "epoch": 2.5063291139240507,
+ "grad_norm": 0.03510760888457298,
+ "learning_rate": 8.333333333333334e-05,
+ "loss": 0.023387223482131958,
+ "step": 496
+ },
+ {
+ "epoch": 2.511392405063291,
+ "grad_norm": 0.028878437355160713,
+ "learning_rate": 8.327721661054994e-05,
+ "loss": 0.023329850286245346,
+ "step": 497
+ },
+ {
+ "epoch": 2.5164556962025317,
+ "grad_norm": 0.02818676456809044,
+ "learning_rate": 8.322109988776656e-05,
+ "loss": 0.017786618322134018,
+ "step": 498
+ },
+ {
+ "epoch": 2.5215189873417723,
+ "grad_norm": 0.06660276651382446,
+ "learning_rate": 8.316498316498317e-05,
+ "loss": 0.023636367172002792,
+ "step": 499
+ },
+ {
+ "epoch": 2.526582278481013,
+ "grad_norm": 0.05663186311721802,
+ "learning_rate": 8.310886644219978e-05,
+ "loss": 0.02607567049562931,
+ "step": 500
+ },
+ {
+ "epoch": 2.5316455696202533,
+ "grad_norm": 0.04156090319156647,
+ "learning_rate": 8.30527497194164e-05,
+ "loss": 0.024936942383646965,
+ "step": 501
+ },
+ {
+ "epoch": 2.536708860759494,
+ "grad_norm": 0.036135219037532806,
+ "learning_rate": 8.2996632996633e-05,
+ "loss": 0.023583384230732918,
+ "step": 502
+ },
+ {
+ "epoch": 2.5417721518987344,
+ "grad_norm": 0.052026644349098206,
+ "learning_rate": 8.294051627384961e-05,
+ "loss": 0.02324807643890381,
+ "step": 503
+ },
+ {
+ "epoch": 2.546835443037975,
+ "grad_norm": 0.03599514439702034,
+ "learning_rate": 8.288439955106621e-05,
+ "loss": 0.01879853755235672,
+ "step": 504
+ },
+ {
+ "epoch": 2.5518987341772155,
+ "grad_norm": 0.03505280241370201,
+ "learning_rate": 8.282828282828283e-05,
+ "loss": 0.017342131584882736,
+ "step": 505
+ },
+ {
+ "epoch": 2.5569620253164556,
+ "grad_norm": 0.0403706431388855,
+ "learning_rate": 8.277216610549943e-05,
+ "loss": 0.02082991972565651,
+ "step": 506
+ },
+ {
+ "epoch": 2.562025316455696,
+ "grad_norm": 0.031072309240698814,
+ "learning_rate": 8.271604938271605e-05,
+ "loss": 0.01711331121623516,
+ "step": 507
+ },
+ {
+ "epoch": 2.5670886075949366,
+ "grad_norm": 0.04118587449193001,
+ "learning_rate": 8.265993265993266e-05,
+ "loss": 0.01940922439098358,
+ "step": 508
+ },
+ {
+ "epoch": 2.572151898734177,
+ "grad_norm": 0.039908040314912796,
+ "learning_rate": 8.260381593714927e-05,
+ "loss": 0.021229952573776245,
+ "step": 509
+ },
+ {
+ "epoch": 2.5772151898734177,
+ "grad_norm": 0.02886618860065937,
+ "learning_rate": 8.254769921436589e-05,
+ "loss": 0.02004890888929367,
+ "step": 510
+ },
+ {
+ "epoch": 2.5822784810126582,
+ "grad_norm": 0.04229263588786125,
+ "learning_rate": 8.24915824915825e-05,
+ "loss": 0.019512392580509186,
+ "step": 511
+ },
+ {
+ "epoch": 2.5873417721518988,
+ "grad_norm": 0.030951635912060738,
+ "learning_rate": 8.24354657687991e-05,
+ "loss": 0.01836536079645157,
+ "step": 512
+ },
+ {
+ "epoch": 2.5924050632911393,
+ "grad_norm": 0.057054903358221054,
+ "learning_rate": 8.237934904601572e-05,
+ "loss": 0.028897594660520554,
+ "step": 513
+ },
+ {
+ "epoch": 2.59746835443038,
+ "grad_norm": 0.10734204202890396,
+ "learning_rate": 8.232323232323233e-05,
+ "loss": 0.024986904114484787,
+ "step": 514
+ },
+ {
+ "epoch": 2.6025316455696204,
+ "grad_norm": 0.029653102159500122,
+ "learning_rate": 8.226711560044894e-05,
+ "loss": 0.02242947742342949,
+ "step": 515
+ },
+ {
+ "epoch": 2.607594936708861,
+ "grad_norm": 0.05601462349295616,
+ "learning_rate": 8.221099887766555e-05,
+ "loss": 0.020091768354177475,
+ "step": 516
+ },
+ {
+ "epoch": 2.6126582278481014,
+ "grad_norm": 0.04170191287994385,
+ "learning_rate": 8.215488215488217e-05,
+ "loss": 0.021796470507979393,
+ "step": 517
+ },
+ {
+ "epoch": 2.6177215189873415,
+ "grad_norm": 0.06347091495990753,
+ "learning_rate": 8.209876543209877e-05,
+ "loss": 0.024338826537132263,
+ "step": 518
+ },
+ {
+ "epoch": 2.622784810126582,
+ "grad_norm": 0.06084204465150833,
+ "learning_rate": 8.204264870931539e-05,
+ "loss": 0.02493124082684517,
+ "step": 519
+ },
+ {
+ "epoch": 2.6278481012658226,
+ "grad_norm": 0.03094005584716797,
+ "learning_rate": 8.198653198653199e-05,
+ "loss": 0.021345658227801323,
+ "step": 520
+ },
+ {
+ "epoch": 2.632911392405063,
+ "grad_norm": 0.04017730429768562,
+ "learning_rate": 8.193041526374861e-05,
+ "loss": 0.019823770970106125,
+ "step": 521
+ },
+ {
+ "epoch": 2.6379746835443036,
+ "grad_norm": 0.045351576060056686,
+ "learning_rate": 8.18742985409652e-05,
+ "loss": 0.02385132387280464,
+ "step": 522
+ },
+ {
+ "epoch": 2.643037974683544,
+ "grad_norm": 0.04823896288871765,
+ "learning_rate": 8.181818181818183e-05,
+ "loss": 0.021753432229161263,
+ "step": 523
+ },
+ {
+ "epoch": 2.6481012658227847,
+ "grad_norm": 0.0442446693778038,
+ "learning_rate": 8.176206509539843e-05,
+ "loss": 0.022134695202112198,
+ "step": 524
+ },
+ {
+ "epoch": 2.6531645569620252,
+ "grad_norm": 0.07998359203338623,
+ "learning_rate": 8.170594837261504e-05,
+ "loss": 0.021159570664167404,
+ "step": 525
+ },
+ {
+ "epoch": 2.6582278481012658,
+ "grad_norm": 0.07844395190477371,
+ "learning_rate": 8.164983164983166e-05,
+ "loss": 0.023695990443229675,
+ "step": 526
+ },
+ {
+ "epoch": 2.6632911392405063,
+ "grad_norm": 0.025296518579125404,
+ "learning_rate": 8.159371492704826e-05,
+ "loss": 0.020914766937494278,
+ "step": 527
+ },
+ {
+ "epoch": 2.668354430379747,
+ "grad_norm": 0.337454617023468,
+ "learning_rate": 8.153759820426488e-05,
+ "loss": 0.02948678657412529,
+ "step": 528
+ },
+ {
+ "epoch": 2.6734177215189874,
+ "grad_norm": 0.03531114012002945,
+ "learning_rate": 8.148148148148148e-05,
+ "loss": 0.020608587190508842,
+ "step": 529
+ },
+ {
+ "epoch": 2.678481012658228,
+ "grad_norm": 0.0496559739112854,
+ "learning_rate": 8.14253647586981e-05,
+ "loss": 0.023600757122039795,
+ "step": 530
+ },
+ {
+ "epoch": 2.6835443037974684,
+ "grad_norm": 0.04093128815293312,
+ "learning_rate": 8.13692480359147e-05,
+ "loss": 0.022392068058252335,
+ "step": 531
+ },
+ {
+ "epoch": 2.688607594936709,
+ "grad_norm": 0.05343819782137871,
+ "learning_rate": 8.131313131313132e-05,
+ "loss": 0.01882098615169525,
+ "step": 532
+ },
+ {
+ "epoch": 2.6936708860759495,
+ "grad_norm": 0.0334453359246254,
+ "learning_rate": 8.125701459034793e-05,
+ "loss": 0.020492104813456535,
+ "step": 533
+ },
+ {
+ "epoch": 2.69873417721519,
+ "grad_norm": 0.045540470629930496,
+ "learning_rate": 8.120089786756454e-05,
+ "loss": 0.021309707313776016,
+ "step": 534
+ },
+ {
+ "epoch": 2.7037974683544306,
+ "grad_norm": 0.03238926827907562,
+ "learning_rate": 8.114478114478115e-05,
+ "loss": 0.01929772086441517,
+ "step": 535
+ },
+ {
+ "epoch": 2.708860759493671,
+ "grad_norm": 0.10985280573368073,
+ "learning_rate": 8.108866442199776e-05,
+ "loss": 0.02431013062596321,
+ "step": 536
+ },
+ {
+ "epoch": 2.7139240506329116,
+ "grad_norm": 0.039785534143447876,
+ "learning_rate": 8.103254769921437e-05,
+ "loss": 0.022708022966980934,
+ "step": 537
+ },
+ {
+ "epoch": 2.7189873417721517,
+ "grad_norm": 0.06239910051226616,
+ "learning_rate": 8.097643097643098e-05,
+ "loss": 0.02715257555246353,
+ "step": 538
+ },
+ {
+ "epoch": 2.7240506329113923,
+ "grad_norm": 0.03662843257188797,
+ "learning_rate": 8.092031425364759e-05,
+ "loss": 0.024876421317458153,
+ "step": 539
+ },
+ {
+ "epoch": 2.729113924050633,
+ "grad_norm": 0.05869411304593086,
+ "learning_rate": 8.08641975308642e-05,
+ "loss": 0.022937750443816185,
+ "step": 540
+ },
+ {
+ "epoch": 2.7341772151898733,
+ "grad_norm": 0.07220412790775299,
+ "learning_rate": 8.080808080808081e-05,
+ "loss": 0.02227093279361725,
+ "step": 541
+ },
+ {
+ "epoch": 2.739240506329114,
+ "grad_norm": 0.03881363570690155,
+ "learning_rate": 8.075196408529742e-05,
+ "loss": 0.020784813910722733,
+ "step": 542
+ },
+ {
+ "epoch": 2.7443037974683544,
+ "grad_norm": 0.04756273329257965,
+ "learning_rate": 8.069584736251403e-05,
+ "loss": 0.02334344945847988,
+ "step": 543
+ },
+ {
+ "epoch": 2.749367088607595,
+ "grad_norm": 0.05327540263533592,
+ "learning_rate": 8.063973063973065e-05,
+ "loss": 0.026313351467251778,
+ "step": 544
+ },
+ {
+ "epoch": 2.7544303797468355,
+ "grad_norm": 0.1605764925479889,
+ "learning_rate": 8.058361391694725e-05,
+ "loss": 0.02474561519920826,
+ "step": 545
+ },
+ {
+ "epoch": 2.759493670886076,
+ "grad_norm": 0.044486165046691895,
+ "learning_rate": 8.052749719416387e-05,
+ "loss": 0.023557808250188828,
+ "step": 546
+ },
+ {
+ "epoch": 2.7645569620253165,
+ "grad_norm": 0.04645116999745369,
+ "learning_rate": 8.047138047138047e-05,
+ "loss": 0.017340417951345444,
+ "step": 547
+ },
+ {
+ "epoch": 2.769620253164557,
+ "grad_norm": 0.04009381681680679,
+ "learning_rate": 8.041526374859708e-05,
+ "loss": 0.018324140459299088,
+ "step": 548
+ },
+ {
+ "epoch": 2.7746835443037976,
+ "grad_norm": 0.12476589530706406,
+ "learning_rate": 8.035914702581369e-05,
+ "loss": 0.023337965831160545,
+ "step": 549
+ },
+ {
+ "epoch": 2.779746835443038,
+ "grad_norm": 0.04257349297404289,
+ "learning_rate": 8.03030303030303e-05,
+ "loss": 0.021878249943256378,
+ "step": 550
+ },
+ {
+ "epoch": 2.7848101265822782,
+ "grad_norm": 0.044377341866493225,
+ "learning_rate": 8.024691358024692e-05,
+ "loss": 0.019643619656562805,
+ "step": 551
+ },
+ {
+ "epoch": 2.7898734177215188,
+ "grad_norm": 0.0801771879196167,
+ "learning_rate": 8.019079685746352e-05,
+ "loss": 0.021452955901622772,
+ "step": 552
+ },
+ {
+ "epoch": 2.7949367088607593,
+ "grad_norm": 0.04462383687496185,
+ "learning_rate": 8.013468013468015e-05,
+ "loss": 0.02363801747560501,
+ "step": 553
+ },
+ {
+ "epoch": 2.8,
+ "grad_norm": 0.05768737941980362,
+ "learning_rate": 8.007856341189674e-05,
+ "loss": 0.03572218120098114,
+ "step": 554
+ },
+ {
+ "epoch": 2.8050632911392404,
+ "grad_norm": 0.03812364116311073,
+ "learning_rate": 8.002244668911337e-05,
+ "loss": 0.01964751072227955,
+ "step": 555
+ },
+ {
+ "epoch": 2.810126582278481,
+ "grad_norm": 0.03297588974237442,
+ "learning_rate": 7.996632996632996e-05,
+ "loss": 0.019139982759952545,
+ "step": 556
+ },
+ {
+ "epoch": 2.8151898734177214,
+ "grad_norm": 0.024627596139907837,
+ "learning_rate": 7.991021324354659e-05,
+ "loss": 0.021029513329267502,
+ "step": 557
+ },
+ {
+ "epoch": 2.820253164556962,
+ "grad_norm": 0.058927983045578,
+ "learning_rate": 7.985409652076318e-05,
+ "loss": 0.03308084234595299,
+ "step": 558
+ },
+ {
+ "epoch": 2.8253164556962025,
+ "grad_norm": 0.11811497062444687,
+ "learning_rate": 7.97979797979798e-05,
+ "loss": 0.028271127492189407,
+ "step": 559
+ },
+ {
+ "epoch": 2.830379746835443,
+ "grad_norm": 0.043665409088134766,
+ "learning_rate": 7.974186307519642e-05,
+ "loss": 0.02708129584789276,
+ "step": 560
+ },
+ {
+ "epoch": 2.8354430379746836,
+ "grad_norm": 0.034729309380054474,
+ "learning_rate": 7.968574635241303e-05,
+ "loss": 0.023845072835683823,
+ "step": 561
+ },
+ {
+ "epoch": 2.840506329113924,
+ "grad_norm": 0.028991155326366425,
+ "learning_rate": 7.962962962962964e-05,
+ "loss": 0.018426496535539627,
+ "step": 562
+ },
+ {
+ "epoch": 2.8455696202531646,
+ "grad_norm": 0.04660327732563019,
+ "learning_rate": 7.957351290684625e-05,
+ "loss": 0.02610144019126892,
+ "step": 563
+ },
+ {
+ "epoch": 2.850632911392405,
+ "grad_norm": 0.03947063535451889,
+ "learning_rate": 7.951739618406286e-05,
+ "loss": 0.025909483432769775,
+ "step": 564
+ },
+ {
+ "epoch": 2.8556962025316457,
+ "grad_norm": 0.06056501716375351,
+ "learning_rate": 7.946127946127947e-05,
+ "loss": 0.030405592173337936,
+ "step": 565
+ },
+ {
+ "epoch": 2.8607594936708862,
+ "grad_norm": 0.03398960456252098,
+ "learning_rate": 7.940516273849608e-05,
+ "loss": 0.02486085705459118,
+ "step": 566
+ },
+ {
+ "epoch": 2.8658227848101268,
+ "grad_norm": 0.03136906027793884,
+ "learning_rate": 7.934904601571269e-05,
+ "loss": 0.020573778077960014,
+ "step": 567
+ },
+ {
+ "epoch": 2.8708860759493673,
+ "grad_norm": 0.03404523804783821,
+ "learning_rate": 7.92929292929293e-05,
+ "loss": 0.021034879609942436,
+ "step": 568
+ },
+ {
+ "epoch": 2.875949367088608,
+ "grad_norm": 0.02937588468194008,
+ "learning_rate": 7.92368125701459e-05,
+ "loss": 0.02275373972952366,
+ "step": 569
+ },
+ {
+ "epoch": 2.8810126582278484,
+ "grad_norm": 0.03971172124147415,
+ "learning_rate": 7.918069584736252e-05,
+ "loss": 0.021558552980422974,
+ "step": 570
+ },
+ {
+ "epoch": 2.8860759493670884,
+ "grad_norm": 0.05636494606733322,
+ "learning_rate": 7.912457912457913e-05,
+ "loss": 0.025583568960428238,
+ "step": 571
+ },
+ {
+ "epoch": 2.891139240506329,
+ "grad_norm": 0.2013683319091797,
+ "learning_rate": 7.906846240179574e-05,
+ "loss": 0.025386696681380272,
+ "step": 572
+ },
+ {
+ "epoch": 2.8962025316455695,
+ "grad_norm": 0.05875328183174133,
+ "learning_rate": 7.901234567901235e-05,
+ "loss": 0.023778585717082024,
+ "step": 573
+ },
+ {
+ "epoch": 2.90126582278481,
+ "grad_norm": 0.031178263947367668,
+ "learning_rate": 7.895622895622896e-05,
+ "loss": 0.02130977436900139,
+ "step": 574
+ },
+ {
+ "epoch": 2.9063291139240506,
+ "grad_norm": 0.028125282377004623,
+ "learning_rate": 7.890011223344557e-05,
+ "loss": 0.023941578343510628,
+ "step": 575
+ },
+ {
+ "epoch": 2.911392405063291,
+ "grad_norm": 0.03701331466436386,
+ "learning_rate": 7.884399551066218e-05,
+ "loss": 0.01856887713074684,
+ "step": 576
+ },
+ {
+ "epoch": 2.9164556962025316,
+ "grad_norm": 0.05281993746757507,
+ "learning_rate": 7.878787878787879e-05,
+ "loss": 0.023393619805574417,
+ "step": 577
+ },
+ {
+ "epoch": 2.921518987341772,
+ "grad_norm": 0.03958812728524208,
+ "learning_rate": 7.873176206509541e-05,
+ "loss": 0.019871000200510025,
+ "step": 578
+ },
+ {
+ "epoch": 2.9265822784810127,
+ "grad_norm": 0.0439714752137661,
+ "learning_rate": 7.867564534231201e-05,
+ "loss": 0.025316016748547554,
+ "step": 579
+ },
+ {
+ "epoch": 2.9316455696202532,
+ "grad_norm": 0.03543296083807945,
+ "learning_rate": 7.861952861952863e-05,
+ "loss": 0.022549735382199287,
+ "step": 580
+ },
+ {
+ "epoch": 2.9367088607594938,
+ "grad_norm": 0.05503656715154648,
+ "learning_rate": 7.856341189674523e-05,
+ "loss": 0.02716357260942459,
+ "step": 581
+ },
+ {
+ "epoch": 2.9417721518987343,
+ "grad_norm": 0.03273561969399452,
+ "learning_rate": 7.850729517396185e-05,
+ "loss": 0.017606684938073158,
+ "step": 582
+ },
+ {
+ "epoch": 2.946835443037975,
+ "grad_norm": 0.04668378457427025,
+ "learning_rate": 7.845117845117845e-05,
+ "loss": 0.022529952228069305,
+ "step": 583
+ },
+ {
+ "epoch": 2.951898734177215,
+ "grad_norm": 0.034348756074905396,
+ "learning_rate": 7.839506172839507e-05,
+ "loss": 0.02549612522125244,
+ "step": 584
+ },
+ {
+ "epoch": 2.9569620253164555,
+ "grad_norm": 0.03485729172825813,
+ "learning_rate": 7.833894500561168e-05,
+ "loss": 0.019362375140190125,
+ "step": 585
+ },
+ {
+ "epoch": 2.962025316455696,
+ "grad_norm": 0.034695904701948166,
+ "learning_rate": 7.828282828282829e-05,
+ "loss": 0.023550841957330704,
+ "step": 586
+ },
+ {
+ "epoch": 2.9670886075949365,
+ "grad_norm": 0.02703205682337284,
+ "learning_rate": 7.82267115600449e-05,
+ "loss": 0.016860410571098328,
+ "step": 587
+ },
+ {
+ "epoch": 2.972151898734177,
+ "grad_norm": 0.0694100558757782,
+ "learning_rate": 7.817059483726151e-05,
+ "loss": 0.02669605240225792,
+ "step": 588
+ },
+ {
+ "epoch": 2.9772151898734176,
+ "grad_norm": 0.02641797810792923,
+ "learning_rate": 7.811447811447812e-05,
+ "loss": 0.019620027393102646,
+ "step": 589
+ },
+ {
+ "epoch": 2.982278481012658,
+ "grad_norm": 0.03643452376127243,
+ "learning_rate": 7.805836139169473e-05,
+ "loss": 0.018797604367136955,
+ "step": 590
+ },
+ {
+ "epoch": 2.9873417721518987,
+ "grad_norm": 0.04125158116221428,
+ "learning_rate": 7.800224466891134e-05,
+ "loss": 0.020387161523103714,
+ "step": 591
+ },
+ {
+ "epoch": 2.992405063291139,
+ "grad_norm": 0.037161167711019516,
+ "learning_rate": 7.794612794612795e-05,
+ "loss": 0.02484878897666931,
+ "step": 592
+ },
+ {
+ "epoch": 2.9974683544303797,
+ "grad_norm": 0.03352266550064087,
+ "learning_rate": 7.789001122334456e-05,
+ "loss": 0.022045889869332314,
+ "step": 593
+ },
+ {
+ "epoch": 3.0,
+ "grad_norm": 0.07333379238843918,
+ "learning_rate": 7.783389450056117e-05,
+ "loss": 0.025806350633502007,
+ "step": 594
+ },
+ {
+ "epoch": 3.0050632911392405,
+ "grad_norm": 0.05492037162184715,
+ "learning_rate": 7.777777777777778e-05,
+ "loss": 0.025387149304151535,
+ "step": 595
+ },
+ {
+ "epoch": 3.010126582278481,
+ "grad_norm": 0.03932039067149162,
+ "learning_rate": 7.772166105499439e-05,
+ "loss": 0.020961906760931015,
+ "step": 596
+ },
+ {
+ "epoch": 3.0151898734177216,
+ "grad_norm": 0.03346814960241318,
+ "learning_rate": 7.7665544332211e-05,
+ "loss": 0.018602946773171425,
+ "step": 597
+ },
+ {
+ "epoch": 3.020253164556962,
+ "grad_norm": 0.041588157415390015,
+ "learning_rate": 7.760942760942761e-05,
+ "loss": 0.02350936457514763,
+ "step": 598
+ },
+ {
+ "epoch": 3.0253164556962027,
+ "grad_norm": 0.0634593740105629,
+ "learning_rate": 7.755331088664422e-05,
+ "loss": 0.02807607129216194,
+ "step": 599
+ },
+ {
+ "epoch": 3.030379746835443,
+ "grad_norm": 0.037369582802057266,
+ "learning_rate": 7.749719416386083e-05,
+ "loss": 0.01987743005156517,
+ "step": 600
+ },
+ {
+ "epoch": 3.0354430379746837,
+ "grad_norm": 0.051795534789562225,
+ "learning_rate": 7.744107744107744e-05,
+ "loss": 0.02273828536272049,
+ "step": 601
+ },
+ {
+ "epoch": 3.0405063291139243,
+ "grad_norm": 0.06508016586303711,
+ "learning_rate": 7.738496071829405e-05,
+ "loss": 0.022526375949382782,
+ "step": 602
+ },
+ {
+ "epoch": 3.0455696202531644,
+ "grad_norm": 0.05076521635055542,
+ "learning_rate": 7.732884399551068e-05,
+ "loss": 0.030540699139237404,
+ "step": 603
+ },
+ {
+ "epoch": 3.050632911392405,
+ "grad_norm": 0.05223327502608299,
+ "learning_rate": 7.727272727272727e-05,
+ "loss": 0.025222979485988617,
+ "step": 604
+ },
+ {
+ "epoch": 3.0556962025316454,
+ "grad_norm": 0.040298622101545334,
+ "learning_rate": 7.72166105499439e-05,
+ "loss": 0.024349395185709,
+ "step": 605
+ },
+ {
+ "epoch": 3.060759493670886,
+ "grad_norm": 0.031546592712402344,
+ "learning_rate": 7.716049382716049e-05,
+ "loss": 0.022118842229247093,
+ "step": 606
+ },
+ {
+ "epoch": 3.0658227848101265,
+ "grad_norm": 0.03639276325702667,
+ "learning_rate": 7.710437710437712e-05,
+ "loss": 0.019809089601039886,
+ "step": 607
+ },
+ {
+ "epoch": 3.070886075949367,
+ "grad_norm": 0.03702636435627937,
+ "learning_rate": 7.704826038159371e-05,
+ "loss": 0.023927533999085426,
+ "step": 608
+ },
+ {
+ "epoch": 3.0759493670886076,
+ "grad_norm": 0.027585966512560844,
+ "learning_rate": 7.699214365881034e-05,
+ "loss": 0.017853228375315666,
+ "step": 609
+ },
+ {
+ "epoch": 3.081012658227848,
+ "grad_norm": 0.036372315138578415,
+ "learning_rate": 7.693602693602693e-05,
+ "loss": 0.027036674320697784,
+ "step": 610
+ },
+ {
+ "epoch": 3.0860759493670886,
+ "grad_norm": 0.03734718635678291,
+ "learning_rate": 7.687991021324356e-05,
+ "loss": 0.021930409595370293,
+ "step": 611
+ },
+ {
+ "epoch": 3.091139240506329,
+ "grad_norm": 0.04167135804891586,
+ "learning_rate": 7.682379349046017e-05,
+ "loss": 0.02211524173617363,
+ "step": 612
+ },
+ {
+ "epoch": 3.0962025316455697,
+ "grad_norm": 0.06541049480438232,
+ "learning_rate": 7.676767676767676e-05,
+ "loss": 0.02102654054760933,
+ "step": 613
+ },
+ {
+ "epoch": 3.1012658227848102,
+ "grad_norm": 0.03505360335111618,
+ "learning_rate": 7.671156004489339e-05,
+ "loss": 0.021799035370349884,
+ "step": 614
+ },
+ {
+ "epoch": 3.1063291139240508,
+ "grad_norm": 0.038781505078077316,
+ "learning_rate": 7.665544332210998e-05,
+ "loss": 0.020275672897696495,
+ "step": 615
+ },
+ {
+ "epoch": 3.1113924050632913,
+ "grad_norm": 0.05527551844716072,
+ "learning_rate": 7.65993265993266e-05,
+ "loss": 0.02752656675875187,
+ "step": 616
+ },
+ {
+ "epoch": 3.116455696202532,
+ "grad_norm": 0.092417873442173,
+ "learning_rate": 7.65432098765432e-05,
+ "loss": 0.034416262060403824,
+ "step": 617
+ },
+ {
+ "epoch": 3.1215189873417724,
+ "grad_norm": 0.04619184136390686,
+ "learning_rate": 7.648709315375983e-05,
+ "loss": 0.028675489127635956,
+ "step": 618
+ },
+ {
+ "epoch": 3.1265822784810124,
+ "grad_norm": 0.027103425934910774,
+ "learning_rate": 7.643097643097644e-05,
+ "loss": 0.01944906637072563,
+ "step": 619
+ },
+ {
+ "epoch": 3.131645569620253,
+ "grad_norm": 0.062025271356105804,
+ "learning_rate": 7.637485970819305e-05,
+ "loss": 0.030966270714998245,
+ "step": 620
+ },
+ {
+ "epoch": 3.1367088607594935,
+ "grad_norm": 0.029828928411006927,
+ "learning_rate": 7.631874298540966e-05,
+ "loss": 0.02199825644493103,
+ "step": 621
+ },
+ {
+ "epoch": 3.141772151898734,
+ "grad_norm": 0.029867300763726234,
+ "learning_rate": 7.626262626262627e-05,
+ "loss": 0.02649630233645439,
+ "step": 622
+ },
+ {
+ "epoch": 3.1468354430379746,
+ "grad_norm": 0.055938251316547394,
+ "learning_rate": 7.620650953984288e-05,
+ "loss": 0.03135379031300545,
+ "step": 623
+ },
+ {
+ "epoch": 3.151898734177215,
+ "grad_norm": 0.035160645842552185,
+ "learning_rate": 7.615039281705949e-05,
+ "loss": 0.025492198765277863,
+ "step": 624
+ },
+ {
+ "epoch": 3.1569620253164556,
+ "grad_norm": 0.0550227165222168,
+ "learning_rate": 7.60942760942761e-05,
+ "loss": 0.024527709931135178,
+ "step": 625
+ },
+ {
+ "epoch": 3.162025316455696,
+ "grad_norm": 0.045406773686409,
+ "learning_rate": 7.603815937149271e-05,
+ "loss": 0.021749500185251236,
+ "step": 626
+ },
+ {
+ "epoch": 3.1670886075949367,
+ "grad_norm": 0.03407207131385803,
+ "learning_rate": 7.598204264870932e-05,
+ "loss": 0.022218957543373108,
+ "step": 627
+ },
+ {
+ "epoch": 3.1721518987341772,
+ "grad_norm": 0.07292751222848892,
+ "learning_rate": 7.592592592592593e-05,
+ "loss": 0.027731608599424362,
+ "step": 628
+ },
+ {
+ "epoch": 3.1772151898734178,
+ "grad_norm": 0.05087915435433388,
+ "learning_rate": 7.586980920314254e-05,
+ "loss": 0.025174522772431374,
+ "step": 629
+ },
+ {
+ "epoch": 3.1822784810126583,
+ "grad_norm": 0.03146078437566757,
+ "learning_rate": 7.581369248035916e-05,
+ "loss": 0.023854102939367294,
+ "step": 630
+ },
+ {
+ "epoch": 3.187341772151899,
+ "grad_norm": 0.03517632558941841,
+ "learning_rate": 7.575757575757576e-05,
+ "loss": 0.021264635026454926,
+ "step": 631
+ },
+ {
+ "epoch": 3.1924050632911394,
+ "grad_norm": 0.0355447381734848,
+ "learning_rate": 7.570145903479238e-05,
+ "loss": 0.023219801485538483,
+ "step": 632
+ },
+ {
+ "epoch": 3.19746835443038,
+ "grad_norm": 0.03751067817211151,
+ "learning_rate": 7.564534231200898e-05,
+ "loss": 0.02329118922352791,
+ "step": 633
+ },
+ {
+ "epoch": 3.2025316455696204,
+ "grad_norm": 0.03923696279525757,
+ "learning_rate": 7.558922558922559e-05,
+ "loss": 0.025390561670064926,
+ "step": 634
+ },
+ {
+ "epoch": 3.207594936708861,
+ "grad_norm": 0.03601266071200371,
+ "learning_rate": 7.55331088664422e-05,
+ "loss": 0.02001899480819702,
+ "step": 635
+ },
+ {
+ "epoch": 3.212658227848101,
+ "grad_norm": 0.032203998416662216,
+ "learning_rate": 7.547699214365881e-05,
+ "loss": 0.022725094109773636,
+ "step": 636
+ },
+ {
+ "epoch": 3.2177215189873416,
+ "grad_norm": 0.040842000395059586,
+ "learning_rate": 7.542087542087543e-05,
+ "loss": 0.021683380007743835,
+ "step": 637
+ },
+ {
+ "epoch": 3.222784810126582,
+ "grad_norm": 0.03078434057533741,
+ "learning_rate": 7.536475869809203e-05,
+ "loss": 0.02051977440714836,
+ "step": 638
+ },
+ {
+ "epoch": 3.2278481012658227,
+ "grad_norm": 0.025937417522072792,
+ "learning_rate": 7.530864197530865e-05,
+ "loss": 0.01884596049785614,
+ "step": 639
+ },
+ {
+ "epoch": 3.232911392405063,
+ "grad_norm": 0.0464826263487339,
+ "learning_rate": 7.525252525252525e-05,
+ "loss": 0.018389636650681496,
+ "step": 640
+ },
+ {
+ "epoch": 3.2379746835443037,
+ "grad_norm": 0.04150732606649399,
+ "learning_rate": 7.519640852974187e-05,
+ "loss": 0.020952530205249786,
+ "step": 641
+ },
+ {
+ "epoch": 3.2430379746835443,
+ "grad_norm": 0.04317227005958557,
+ "learning_rate": 7.514029180695847e-05,
+ "loss": 0.024093877524137497,
+ "step": 642
+ },
+ {
+ "epoch": 3.248101265822785,
+ "grad_norm": 0.04621734470129013,
+ "learning_rate": 7.508417508417509e-05,
+ "loss": 0.029940858483314514,
+ "step": 643
+ },
+ {
+ "epoch": 3.2531645569620253,
+ "grad_norm": 0.03514556586742401,
+ "learning_rate": 7.50280583613917e-05,
+ "loss": 0.022350966930389404,
+ "step": 644
+ },
+ {
+ "epoch": 3.258227848101266,
+ "grad_norm": 0.025245223194360733,
+ "learning_rate": 7.497194163860831e-05,
+ "loss": 0.018291346728801727,
+ "step": 645
+ },
+ {
+ "epoch": 3.2632911392405064,
+ "grad_norm": 0.02498617395758629,
+ "learning_rate": 7.491582491582492e-05,
+ "loss": 0.01909235306084156,
+ "step": 646
+ },
+ {
+ "epoch": 3.268354430379747,
+ "grad_norm": 0.022831663489341736,
+ "learning_rate": 7.485970819304153e-05,
+ "loss": 0.01462332159280777,
+ "step": 647
+ },
+ {
+ "epoch": 3.2734177215189875,
+ "grad_norm": 0.03779070824384689,
+ "learning_rate": 7.480359147025814e-05,
+ "loss": 0.019472766667604446,
+ "step": 648
+ },
+ {
+ "epoch": 3.278481012658228,
+ "grad_norm": 0.030341917648911476,
+ "learning_rate": 7.474747474747475e-05,
+ "loss": 0.018727967515587807,
+ "step": 649
+ },
+ {
+ "epoch": 3.2835443037974685,
+ "grad_norm": 0.045589644461870193,
+ "learning_rate": 7.469135802469136e-05,
+ "loss": 0.023640938103199005,
+ "step": 650
+ },
+ {
+ "epoch": 3.2886075949367086,
+ "grad_norm": 0.023883633315563202,
+ "learning_rate": 7.463524130190797e-05,
+ "loss": 0.019227800890803337,
+ "step": 651
+ },
+ {
+ "epoch": 3.293670886075949,
+ "grad_norm": 0.03794898837804794,
+ "learning_rate": 7.457912457912458e-05,
+ "loss": 0.02445095032453537,
+ "step": 652
+ },
+ {
+ "epoch": 3.2987341772151897,
+ "grad_norm": 0.1442285180091858,
+ "learning_rate": 7.452300785634119e-05,
+ "loss": 0.023129010573029518,
+ "step": 653
+ },
+ {
+ "epoch": 3.3037974683544302,
+ "grad_norm": 0.03197013959288597,
+ "learning_rate": 7.44668911335578e-05,
+ "loss": 0.02768155373632908,
+ "step": 654
+ },
+ {
+ "epoch": 3.3088607594936708,
+ "grad_norm": 0.0434270016849041,
+ "learning_rate": 7.441077441077443e-05,
+ "loss": 0.02330004796385765,
+ "step": 655
+ },
+ {
+ "epoch": 3.3139240506329113,
+ "grad_norm": 0.03878983482718468,
+ "learning_rate": 7.435465768799102e-05,
+ "loss": 0.028383342549204826,
+ "step": 656
+ },
+ {
+ "epoch": 3.318987341772152,
+ "grad_norm": 0.035334642976522446,
+ "learning_rate": 7.429854096520763e-05,
+ "loss": 0.02583262138068676,
+ "step": 657
+ },
+ {
+ "epoch": 3.3240506329113924,
+ "grad_norm": 0.0473608672618866,
+ "learning_rate": 7.424242424242424e-05,
+ "loss": 0.030471306294202805,
+ "step": 658
+ },
+ {
+ "epoch": 3.329113924050633,
+ "grad_norm": 0.04193368926644325,
+ "learning_rate": 7.418630751964085e-05,
+ "loss": 0.016215423122048378,
+ "step": 659
+ },
+ {
+ "epoch": 3.3341772151898734,
+ "grad_norm": 0.023891586810350418,
+ "learning_rate": 7.413019079685746e-05,
+ "loss": 0.021040987223386765,
+ "step": 660
+ },
+ {
+ "epoch": 3.339240506329114,
+ "grad_norm": 0.029971614480018616,
+ "learning_rate": 7.407407407407407e-05,
+ "loss": 0.022258542478084564,
+ "step": 661
+ },
+ {
+ "epoch": 3.3443037974683545,
+ "grad_norm": 0.035308364778757095,
+ "learning_rate": 7.401795735129068e-05,
+ "loss": 0.02215534821152687,
+ "step": 662
+ },
+ {
+ "epoch": 3.349367088607595,
+ "grad_norm": 0.036979664117097855,
+ "learning_rate": 7.39618406285073e-05,
+ "loss": 0.027577020227909088,
+ "step": 663
+ },
+ {
+ "epoch": 3.3544303797468356,
+ "grad_norm": 0.03403281047940254,
+ "learning_rate": 7.390572390572392e-05,
+ "loss": 0.024540117010474205,
+ "step": 664
+ },
+ {
+ "epoch": 3.359493670886076,
+ "grad_norm": 0.04739405959844589,
+ "learning_rate": 7.384960718294051e-05,
+ "loss": 0.01647120714187622,
+ "step": 665
+ },
+ {
+ "epoch": 3.3645569620253166,
+ "grad_norm": 0.036933764815330505,
+ "learning_rate": 7.379349046015714e-05,
+ "loss": 0.02817656472325325,
+ "step": 666
+ },
+ {
+ "epoch": 3.369620253164557,
+ "grad_norm": 0.05966564640402794,
+ "learning_rate": 7.373737373737373e-05,
+ "loss": 0.028103439137339592,
+ "step": 667
+ },
+ {
+ "epoch": 3.3746835443037977,
+ "grad_norm": 0.09403033554553986,
+ "learning_rate": 7.368125701459036e-05,
+ "loss": 0.024899154901504517,
+ "step": 668
+ },
+ {
+ "epoch": 3.379746835443038,
+ "grad_norm": 0.056374453008174896,
+ "learning_rate": 7.362514029180695e-05,
+ "loss": 0.025570789352059364,
+ "step": 669
+ },
+ {
+ "epoch": 3.3848101265822783,
+ "grad_norm": 0.056454673409461975,
+ "learning_rate": 7.356902356902358e-05,
+ "loss": 0.02471453696489334,
+ "step": 670
+ },
+ {
+ "epoch": 3.389873417721519,
+ "grad_norm": 0.04115903005003929,
+ "learning_rate": 7.351290684624019e-05,
+ "loss": 0.017306309193372726,
+ "step": 671
+ },
+ {
+ "epoch": 3.3949367088607594,
+ "grad_norm": 0.030604340136051178,
+ "learning_rate": 7.34567901234568e-05,
+ "loss": 0.019510511308908463,
+ "step": 672
+ },
+ {
+ "epoch": 3.4,
+ "grad_norm": 0.059018854051828384,
+ "learning_rate": 7.340067340067341e-05,
+ "loss": 0.02810611203312874,
+ "step": 673
+ },
+ {
+ "epoch": 3.4050632911392404,
+ "grad_norm": 0.026413513347506523,
+ "learning_rate": 7.334455667789002e-05,
+ "loss": 0.018966296687722206,
+ "step": 674
+ },
+ {
+ "epoch": 3.410126582278481,
+ "grad_norm": 0.03285476937890053,
+ "learning_rate": 7.328843995510663e-05,
+ "loss": 0.026708189398050308,
+ "step": 675
+ },
+ {
+ "epoch": 3.4151898734177215,
+ "grad_norm": 0.0392388291656971,
+ "learning_rate": 7.323232323232324e-05,
+ "loss": 0.022320115938782692,
+ "step": 676
+ },
+ {
+ "epoch": 3.420253164556962,
+ "grad_norm": 0.0305775236338377,
+ "learning_rate": 7.317620650953985e-05,
+ "loss": 0.018710114061832428,
+ "step": 677
+ },
+ {
+ "epoch": 3.4253164556962026,
+ "grad_norm": 0.033393554389476776,
+ "learning_rate": 7.312008978675646e-05,
+ "loss": 0.018753021955490112,
+ "step": 678
+ },
+ {
+ "epoch": 3.430379746835443,
+ "grad_norm": 0.02704286389052868,
+ "learning_rate": 7.306397306397307e-05,
+ "loss": 0.01539788581430912,
+ "step": 679
+ },
+ {
+ "epoch": 3.4354430379746836,
+ "grad_norm": 0.038779884576797485,
+ "learning_rate": 7.300785634118968e-05,
+ "loss": 0.024458929896354675,
+ "step": 680
+ },
+ {
+ "epoch": 3.440506329113924,
+ "grad_norm": 0.061135295778512955,
+ "learning_rate": 7.295173961840629e-05,
+ "loss": 0.021106259897351265,
+ "step": 681
+ },
+ {
+ "epoch": 3.4455696202531647,
+ "grad_norm": 0.02436748333275318,
+ "learning_rate": 7.28956228956229e-05,
+ "loss": 0.019037332385778427,
+ "step": 682
+ },
+ {
+ "epoch": 3.4506329113924052,
+ "grad_norm": 0.037567682564258575,
+ "learning_rate": 7.283950617283951e-05,
+ "loss": 0.02065495029091835,
+ "step": 683
+ },
+ {
+ "epoch": 3.4556962025316453,
+ "grad_norm": 0.03743781894445419,
+ "learning_rate": 7.278338945005612e-05,
+ "loss": 0.02559451386332512,
+ "step": 684
+ },
+ {
+ "epoch": 3.460759493670886,
+ "grad_norm": 0.04715351387858391,
+ "learning_rate": 7.272727272727273e-05,
+ "loss": 0.021420618519186974,
+ "step": 685
+ },
+ {
+ "epoch": 3.4658227848101264,
+ "grad_norm": 0.02502383477985859,
+ "learning_rate": 7.267115600448934e-05,
+ "loss": 0.019398193806409836,
+ "step": 686
+ },
+ {
+ "epoch": 3.470886075949367,
+ "grad_norm": 0.02199714072048664,
+ "learning_rate": 7.261503928170595e-05,
+ "loss": 0.019068796187639236,
+ "step": 687
+ },
+ {
+ "epoch": 3.4759493670886075,
+ "grad_norm": 0.034711211919784546,
+ "learning_rate": 7.255892255892256e-05,
+ "loss": 0.021794648841023445,
+ "step": 688
+ },
+ {
+ "epoch": 3.481012658227848,
+ "grad_norm": 0.040784433484077454,
+ "learning_rate": 7.250280583613918e-05,
+ "loss": 0.022812314331531525,
+ "step": 689
+ },
+ {
+ "epoch": 3.4860759493670885,
+ "grad_norm": 0.035993628203868866,
+ "learning_rate": 7.244668911335578e-05,
+ "loss": 0.026385463774204254,
+ "step": 690
+ },
+ {
+ "epoch": 3.491139240506329,
+ "grad_norm": 0.031834330409765244,
+ "learning_rate": 7.23905723905724e-05,
+ "loss": 0.022114556282758713,
+ "step": 691
+ },
+ {
+ "epoch": 3.4962025316455696,
+ "grad_norm": 0.025820165872573853,
+ "learning_rate": 7.2334455667789e-05,
+ "loss": 0.01813361421227455,
+ "step": 692
+ },
+ {
+ "epoch": 3.50126582278481,
+ "grad_norm": 0.04998617246747017,
+ "learning_rate": 7.227833894500562e-05,
+ "loss": 0.022573690861463547,
+ "step": 693
+ },
+ {
+ "epoch": 3.5063291139240507,
+ "grad_norm": 0.04184528812766075,
+ "learning_rate": 7.222222222222222e-05,
+ "loss": 0.026092834770679474,
+ "step": 694
+ },
+ {
+ "epoch": 3.511392405063291,
+ "grad_norm": 0.050683457404375076,
+ "learning_rate": 7.216610549943884e-05,
+ "loss": 0.021743692457675934,
+ "step": 695
+ },
+ {
+ "epoch": 3.5164556962025317,
+ "grad_norm": 0.07393304258584976,
+ "learning_rate": 7.210998877665545e-05,
+ "loss": 0.024253465235233307,
+ "step": 696
+ },
+ {
+ "epoch": 3.5215189873417723,
+ "grad_norm": 0.02564188838005066,
+ "learning_rate": 7.205387205387206e-05,
+ "loss": 0.019201550632715225,
+ "step": 697
+ },
+ {
+ "epoch": 3.526582278481013,
+ "grad_norm": 0.035527680069208145,
+ "learning_rate": 7.199775533108867e-05,
+ "loss": 0.02153913676738739,
+ "step": 698
+ },
+ {
+ "epoch": 3.5316455696202533,
+ "grad_norm": 0.036737874150276184,
+ "learning_rate": 7.194163860830527e-05,
+ "loss": 0.025572702288627625,
+ "step": 699
+ },
+ {
+ "epoch": 3.536708860759494,
+ "grad_norm": 0.03383871540427208,
+ "learning_rate": 7.188552188552189e-05,
+ "loss": 0.017153475433588028,
+ "step": 700
+ },
+ {
+ "epoch": 3.5417721518987344,
+ "grad_norm": 0.0350637212395668,
+ "learning_rate": 7.182940516273849e-05,
+ "loss": 0.018297579139471054,
+ "step": 701
+ },
+ {
+ "epoch": 3.546835443037975,
+ "grad_norm": 0.029637211933732033,
+ "learning_rate": 7.177328843995511e-05,
+ "loss": 0.017981912940740585,
+ "step": 702
+ },
+ {
+ "epoch": 3.5518987341772155,
+ "grad_norm": 0.03611799329519272,
+ "learning_rate": 7.171717171717171e-05,
+ "loss": 0.02710491605103016,
+ "step": 703
+ },
+ {
+ "epoch": 3.5569620253164556,
+ "grad_norm": 0.02008277364075184,
+ "learning_rate": 7.166105499438833e-05,
+ "loss": 0.02035117708146572,
+ "step": 704
+ },
+ {
+ "epoch": 3.562025316455696,
+ "grad_norm": 0.026698170229792595,
+ "learning_rate": 7.160493827160494e-05,
+ "loss": 0.017481079325079918,
+ "step": 705
+ },
+ {
+ "epoch": 3.5670886075949366,
+ "grad_norm": 0.036382947117090225,
+ "learning_rate": 7.154882154882155e-05,
+ "loss": 0.019109399989247322,
+ "step": 706
+ },
+ {
+ "epoch": 3.572151898734177,
+ "grad_norm": 0.04591331630945206,
+ "learning_rate": 7.149270482603816e-05,
+ "loss": 0.023143479600548744,
+ "step": 707
+ },
+ {
+ "epoch": 3.5772151898734177,
+ "grad_norm": 0.04864713177084923,
+ "learning_rate": 7.143658810325477e-05,
+ "loss": 0.022374317049980164,
+ "step": 708
+ },
+ {
+ "epoch": 3.5822784810126582,
+ "grad_norm": 0.03528938442468643,
+ "learning_rate": 7.138047138047138e-05,
+ "loss": 0.021928273141384125,
+ "step": 709
+ },
+ {
+ "epoch": 3.5873417721518988,
+ "grad_norm": 0.03548784181475639,
+ "learning_rate": 7.1324354657688e-05,
+ "loss": 0.02179766446352005,
+ "step": 710
+ },
+ {
+ "epoch": 3.5924050632911393,
+ "grad_norm": 0.041786350309848785,
+ "learning_rate": 7.12682379349046e-05,
+ "loss": 0.028576329350471497,
+ "step": 711
+ },
+ {
+ "epoch": 3.59746835443038,
+ "grad_norm": 0.03197047486901283,
+ "learning_rate": 7.121212121212121e-05,
+ "loss": 0.018731534481048584,
+ "step": 712
+ },
+ {
+ "epoch": 3.6025316455696204,
+ "grad_norm": 0.04037933051586151,
+ "learning_rate": 7.115600448933782e-05,
+ "loss": 0.024375513195991516,
+ "step": 713
+ },
+ {
+ "epoch": 3.607594936708861,
+ "grad_norm": 0.032266534864902496,
+ "learning_rate": 7.109988776655443e-05,
+ "loss": 0.016232451424002647,
+ "step": 714
+ },
+ {
+ "epoch": 3.6126582278481014,
+ "grad_norm": 0.02890392392873764,
+ "learning_rate": 7.104377104377104e-05,
+ "loss": 0.018303632736206055,
+ "step": 715
+ },
+ {
+ "epoch": 3.6177215189873415,
+ "grad_norm": 0.032750677317380905,
+ "learning_rate": 7.098765432098767e-05,
+ "loss": 0.021466076374053955,
+ "step": 716
+ },
+ {
+ "epoch": 3.622784810126582,
+ "grad_norm": 0.05076618492603302,
+ "learning_rate": 7.093153759820426e-05,
+ "loss": 0.022349126636981964,
+ "step": 717
+ },
+ {
+ "epoch": 3.6278481012658226,
+ "grad_norm": 0.034143563359975815,
+ "learning_rate": 7.087542087542089e-05,
+ "loss": 0.02274998091161251,
+ "step": 718
+ },
+ {
+ "epoch": 3.632911392405063,
+ "grad_norm": 0.025406064465641975,
+ "learning_rate": 7.081930415263748e-05,
+ "loss": 0.016980832442641258,
+ "step": 719
+ },
+ {
+ "epoch": 3.6379746835443036,
+ "grad_norm": 0.031938597559928894,
+ "learning_rate": 7.076318742985411e-05,
+ "loss": 0.023153938353061676,
+ "step": 720
+ },
+ {
+ "epoch": 3.643037974683544,
+ "grad_norm": 0.03354712948203087,
+ "learning_rate": 7.07070707070707e-05,
+ "loss": 0.018384695053100586,
+ "step": 721
+ },
+ {
+ "epoch": 3.6481012658227847,
+ "grad_norm": 0.028671689331531525,
+ "learning_rate": 7.065095398428731e-05,
+ "loss": 0.021795600652694702,
+ "step": 722
+ },
+ {
+ "epoch": 3.6531645569620252,
+ "grad_norm": 0.057982735335826874,
+ "learning_rate": 7.059483726150394e-05,
+ "loss": 0.026870068162679672,
+ "step": 723
+ },
+ {
+ "epoch": 3.6582278481012658,
+ "grad_norm": 0.036460306495428085,
+ "learning_rate": 7.053872053872053e-05,
+ "loss": 0.019742611795663834,
+ "step": 724
+ },
+ {
+ "epoch": 3.6632911392405063,
+ "grad_norm": 0.06633497029542923,
+ "learning_rate": 7.048260381593716e-05,
+ "loss": 0.01737678050994873,
+ "step": 725
+ },
+ {
+ "epoch": 3.668354430379747,
+ "grad_norm": 0.0410747192800045,
+ "learning_rate": 7.042648709315375e-05,
+ "loss": 0.023570548743009567,
+ "step": 726
+ },
+ {
+ "epoch": 3.6734177215189874,
+ "grad_norm": 0.04499414190649986,
+ "learning_rate": 7.037037037037038e-05,
+ "loss": 0.024305228143930435,
+ "step": 727
+ },
+ {
+ "epoch": 3.678481012658228,
+ "grad_norm": 0.024429699406027794,
+ "learning_rate": 7.031425364758697e-05,
+ "loss": 0.018056385219097137,
+ "step": 728
+ },
+ {
+ "epoch": 3.6835443037974684,
+ "grad_norm": 0.03042393922805786,
+ "learning_rate": 7.02581369248036e-05,
+ "loss": 0.019678741693496704,
+ "step": 729
+ },
+ {
+ "epoch": 3.688607594936709,
+ "grad_norm": 0.04088849946856499,
+ "learning_rate": 7.020202020202021e-05,
+ "loss": 0.026466136798262596,
+ "step": 730
+ },
+ {
+ "epoch": 3.6936708860759495,
+ "grad_norm": 0.03353559225797653,
+ "learning_rate": 7.014590347923682e-05,
+ "loss": 0.021056771278381348,
+ "step": 731
+ },
+ {
+ "epoch": 3.69873417721519,
+ "grad_norm": 0.03120904415845871,
+ "learning_rate": 7.008978675645343e-05,
+ "loss": 0.020675398409366608,
+ "step": 732
+ },
+ {
+ "epoch": 3.7037974683544306,
+ "grad_norm": 0.05723356828093529,
+ "learning_rate": 7.003367003367004e-05,
+ "loss": 0.033802516758441925,
+ "step": 733
+ },
+ {
+ "epoch": 3.708860759493671,
+ "grad_norm": 0.03580084443092346,
+ "learning_rate": 6.997755331088665e-05,
+ "loss": 0.026392754167318344,
+ "step": 734
+ },
+ {
+ "epoch": 3.7139240506329116,
+ "grad_norm": 0.05164967477321625,
+ "learning_rate": 6.992143658810326e-05,
+ "loss": 0.0241309255361557,
+ "step": 735
+ },
+ {
+ "epoch": 3.7189873417721517,
+ "grad_norm": 0.02190530300140381,
+ "learning_rate": 6.986531986531987e-05,
+ "loss": 0.018209822475910187,
+ "step": 736
+ },
+ {
+ "epoch": 3.7240506329113923,
+ "grad_norm": 0.027256503701210022,
+ "learning_rate": 6.980920314253648e-05,
+ "loss": 0.022063471376895905,
+ "step": 737
+ },
+ {
+ "epoch": 3.729113924050633,
+ "grad_norm": 0.03337831795215607,
+ "learning_rate": 6.975308641975309e-05,
+ "loss": 0.018506363034248352,
+ "step": 738
+ },
+ {
+ "epoch": 3.7341772151898733,
+ "grad_norm": 0.025730784982442856,
+ "learning_rate": 6.96969696969697e-05,
+ "loss": 0.016883976757526398,
+ "step": 739
+ },
+ {
+ "epoch": 3.739240506329114,
+ "grad_norm": 0.026203135028481483,
+ "learning_rate": 6.964085297418631e-05,
+ "loss": 0.023329125717282295,
+ "step": 740
+ },
+ {
+ "epoch": 3.7443037974683544,
+ "grad_norm": 0.02676830254495144,
+ "learning_rate": 6.958473625140293e-05,
+ "loss": 0.020962664857506752,
+ "step": 741
+ },
+ {
+ "epoch": 3.749367088607595,
+ "grad_norm": 0.019974667578935623,
+ "learning_rate": 6.952861952861953e-05,
+ "loss": 0.018353454768657684,
+ "step": 742
+ },
+ {
+ "epoch": 3.7544303797468355,
+ "grad_norm": 0.02399631030857563,
+ "learning_rate": 6.947250280583614e-05,
+ "loss": 0.01820143684744835,
+ "step": 743
+ },
+ {
+ "epoch": 3.759493670886076,
+ "grad_norm": 0.02083951234817505,
+ "learning_rate": 6.941638608305275e-05,
+ "loss": 0.02312408946454525,
+ "step": 744
+ },
+ {
+ "epoch": 3.7645569620253165,
+ "grad_norm": 0.025636207312345505,
+ "learning_rate": 6.936026936026936e-05,
+ "loss": 0.01757936365902424,
+ "step": 745
+ },
+ {
+ "epoch": 3.769620253164557,
+ "grad_norm": 0.036856744438409805,
+ "learning_rate": 6.930415263748597e-05,
+ "loss": 0.028933756053447723,
+ "step": 746
+ },
+ {
+ "epoch": 3.7746835443037976,
+ "grad_norm": 0.037415456026792526,
+ "learning_rate": 6.924803591470258e-05,
+ "loss": 0.022136090323328972,
+ "step": 747
+ },
+ {
+ "epoch": 3.779746835443038,
+ "grad_norm": 0.027949288487434387,
+ "learning_rate": 6.91919191919192e-05,
+ "loss": 0.022943630814552307,
+ "step": 748
+ },
+ {
+ "epoch": 3.7848101265822782,
+ "grad_norm": 0.037508148699998856,
+ "learning_rate": 6.91358024691358e-05,
+ "loss": 0.020460065454244614,
+ "step": 749
+ },
+ {
+ "epoch": 3.7898734177215188,
+ "grad_norm": 0.037965189665555954,
+ "learning_rate": 6.907968574635242e-05,
+ "loss": 0.024793215095996857,
+ "step": 750
+ },
+ {
+ "epoch": 3.7949367088607593,
+ "grad_norm": 0.027956753969192505,
+ "learning_rate": 6.902356902356902e-05,
+ "loss": 0.02188705839216709,
+ "step": 751
+ },
+ {
+ "epoch": 3.8,
+ "grad_norm": 0.027417965233325958,
+ "learning_rate": 6.896745230078564e-05,
+ "loss": 0.01465995516628027,
+ "step": 752
+ },
+ {
+ "epoch": 3.8050632911392404,
+ "grad_norm": 0.036644525825977325,
+ "learning_rate": 6.891133557800224e-05,
+ "loss": 0.020246809348464012,
+ "step": 753
+ },
+ {
+ "epoch": 3.810126582278481,
+ "grad_norm": 0.027043674141168594,
+ "learning_rate": 6.885521885521886e-05,
+ "loss": 0.02293788641691208,
+ "step": 754
+ },
+ {
+ "epoch": 3.8151898734177214,
+ "grad_norm": 0.033968694508075714,
+ "learning_rate": 6.879910213243546e-05,
+ "loss": 0.024979766458272934,
+ "step": 755
+ },
+ {
+ "epoch": 3.820253164556962,
+ "grad_norm": 0.022790739312767982,
+ "learning_rate": 6.874298540965208e-05,
+ "loss": 0.019254112616181374,
+ "step": 756
+ },
+ {
+ "epoch": 3.8253164556962025,
+ "grad_norm": 0.028349611908197403,
+ "learning_rate": 6.86868686868687e-05,
+ "loss": 0.018624842166900635,
+ "step": 757
+ },
+ {
+ "epoch": 3.830379746835443,
+ "grad_norm": 0.034140367060899734,
+ "learning_rate": 6.86307519640853e-05,
+ "loss": 0.01691599376499653,
+ "step": 758
+ },
+ {
+ "epoch": 3.8354430379746836,
+ "grad_norm": 0.03422265127301216,
+ "learning_rate": 6.857463524130191e-05,
+ "loss": 0.01864086464047432,
+ "step": 759
+ },
+ {
+ "epoch": 3.840506329113924,
+ "grad_norm": 0.037322208285331726,
+ "learning_rate": 6.851851851851852e-05,
+ "loss": 0.024382904171943665,
+ "step": 760
+ },
+ {
+ "epoch": 3.8455696202531646,
+ "grad_norm": 0.022540392354130745,
+ "learning_rate": 6.846240179573513e-05,
+ "loss": 0.017390096560120583,
+ "step": 761
+ },
+ {
+ "epoch": 3.850632911392405,
+ "grad_norm": 0.035701289772987366,
+ "learning_rate": 6.840628507295174e-05,
+ "loss": 0.01928594335913658,
+ "step": 762
+ },
+ {
+ "epoch": 3.8556962025316457,
+ "grad_norm": 0.047425150871276855,
+ "learning_rate": 6.835016835016835e-05,
+ "loss": 0.026818927377462387,
+ "step": 763
+ },
+ {
+ "epoch": 3.8607594936708862,
+ "grad_norm": 0.0244912076741457,
+ "learning_rate": 6.829405162738496e-05,
+ "loss": 0.01811584085226059,
+ "step": 764
+ },
+ {
+ "epoch": 3.8658227848101268,
+ "grad_norm": 0.03282126039266586,
+ "learning_rate": 6.823793490460157e-05,
+ "loss": 0.01521163061261177,
+ "step": 765
+ },
+ {
+ "epoch": 3.8708860759493673,
+ "grad_norm": 0.030519530177116394,
+ "learning_rate": 6.818181818181818e-05,
+ "loss": 0.023735523223876953,
+ "step": 766
+ },
+ {
+ "epoch": 3.875949367088608,
+ "grad_norm": 0.03829387575387955,
+ "learning_rate": 6.81257014590348e-05,
+ "loss": 0.02391430363059044,
+ "step": 767
+ },
+ {
+ "epoch": 3.8810126582278484,
+ "grad_norm": 0.03133988752961159,
+ "learning_rate": 6.80695847362514e-05,
+ "loss": 0.022026970982551575,
+ "step": 768
+ },
+ {
+ "epoch": 3.8860759493670884,
+ "grad_norm": 0.036327920854091644,
+ "learning_rate": 6.801346801346801e-05,
+ "loss": 0.01740797609090805,
+ "step": 769
+ },
+ {
+ "epoch": 3.891139240506329,
+ "grad_norm": 0.06766671687364578,
+ "learning_rate": 6.795735129068462e-05,
+ "loss": 0.02804078534245491,
+ "step": 770
+ },
+ {
+ "epoch": 3.8962025316455695,
+ "grad_norm": 0.06390757858753204,
+ "learning_rate": 6.790123456790123e-05,
+ "loss": 0.032084181904792786,
+ "step": 771
+ },
+ {
+ "epoch": 3.90126582278481,
+ "grad_norm": 0.03238178789615631,
+ "learning_rate": 6.784511784511784e-05,
+ "loss": 0.02189403772354126,
+ "step": 772
+ },
+ {
+ "epoch": 3.9063291139240506,
+ "grad_norm": 0.03206197917461395,
+ "learning_rate": 6.778900112233445e-05,
+ "loss": 0.022829271852970123,
+ "step": 773
+ },
+ {
+ "epoch": 3.911392405063291,
+ "grad_norm": 0.030897945165634155,
+ "learning_rate": 6.773288439955107e-05,
+ "loss": 0.021807631477713585,
+ "step": 774
+ },
+ {
+ "epoch": 3.9164556962025316,
+ "grad_norm": 0.04285162314772606,
+ "learning_rate": 6.767676767676769e-05,
+ "loss": 0.023028545081615448,
+ "step": 775
+ },
+ {
+ "epoch": 3.921518987341772,
+ "grad_norm": 0.02819208987057209,
+ "learning_rate": 6.762065095398429e-05,
+ "loss": 0.02110828459262848,
+ "step": 776
+ },
+ {
+ "epoch": 3.9265822784810127,
+ "grad_norm": 0.03159799054265022,
+ "learning_rate": 6.756453423120091e-05,
+ "loss": 0.02116553671658039,
+ "step": 777
+ },
+ {
+ "epoch": 3.9316455696202532,
+ "grad_norm": 0.028514137491583824,
+ "learning_rate": 6.75084175084175e-05,
+ "loss": 0.020262988284230232,
+ "step": 778
+ },
+ {
+ "epoch": 3.9367088607594938,
+ "grad_norm": 0.03610249608755112,
+ "learning_rate": 6.745230078563413e-05,
+ "loss": 0.016928158700466156,
+ "step": 779
+ },
+ {
+ "epoch": 3.9417721518987343,
+ "grad_norm": 0.02753387950360775,
+ "learning_rate": 6.739618406285073e-05,
+ "loss": 0.022629719227552414,
+ "step": 780
+ },
+ {
+ "epoch": 3.946835443037975,
+ "grad_norm": 0.026071136817336082,
+ "learning_rate": 6.734006734006735e-05,
+ "loss": 0.020297978073358536,
+ "step": 781
+ },
+ {
+ "epoch": 3.951898734177215,
+ "grad_norm": 0.04774617776274681,
+ "learning_rate": 6.728395061728396e-05,
+ "loss": 0.01858438178896904,
+ "step": 782
+ },
+ {
+ "epoch": 3.9569620253164555,
+ "grad_norm": 0.03666248545050621,
+ "learning_rate": 6.722783389450057e-05,
+ "loss": 0.024037979543209076,
+ "step": 783
+ },
+ {
+ "epoch": 3.962025316455696,
+ "grad_norm": 0.04990983009338379,
+ "learning_rate": 6.717171717171718e-05,
+ "loss": 0.027675451710820198,
+ "step": 784
+ },
+ {
+ "epoch": 3.9670886075949365,
+ "grad_norm": 0.04734862968325615,
+ "learning_rate": 6.711560044893379e-05,
+ "loss": 0.02003151923418045,
+ "step": 785
+ },
+ {
+ "epoch": 3.972151898734177,
+ "grad_norm": 0.031911976635456085,
+ "learning_rate": 6.70594837261504e-05,
+ "loss": 0.02302616462111473,
+ "step": 786
+ },
+ {
+ "epoch": 3.9772151898734176,
+ "grad_norm": 0.03199504688382149,
+ "learning_rate": 6.7003367003367e-05,
+ "loss": 0.020066704601049423,
+ "step": 787
+ },
+ {
+ "epoch": 3.982278481012658,
+ "grad_norm": 0.02664150856435299,
+ "learning_rate": 6.694725028058362e-05,
+ "loss": 0.01888475939631462,
+ "step": 788
+ },
+ {
+ "epoch": 3.9873417721518987,
+ "grad_norm": 0.03886157646775246,
+ "learning_rate": 6.689113355780023e-05,
+ "loss": 0.016029106453061104,
+ "step": 789
+ },
+ {
+ "epoch": 3.992405063291139,
+ "grad_norm": 0.025033561512827873,
+ "learning_rate": 6.683501683501684e-05,
+ "loss": 0.01627909578382969,
+ "step": 790
+ },
+ {
+ "epoch": 3.9974683544303797,
+ "grad_norm": 0.04991500452160835,
+ "learning_rate": 6.677890011223345e-05,
+ "loss": 0.02633330039680004,
+ "step": 791
+ },
+ {
+ "epoch": 4.0,
+ "grad_norm": 0.0552835538983345,
+ "learning_rate": 6.672278338945006e-05,
+ "loss": 0.025268658995628357,
+ "step": 792
+ },
+ {
+ "epoch": 4.0050632911392405,
+ "grad_norm": 0.04223925992846489,
+ "learning_rate": 6.666666666666667e-05,
+ "loss": 0.023410093039274216,
+ "step": 793
+ },
+ {
+ "epoch": 4.010126582278481,
+ "grad_norm": 0.03191488981246948,
+ "learning_rate": 6.661054994388328e-05,
+ "loss": 0.01913982629776001,
+ "step": 794
+ },
+ {
+ "epoch": 4.015189873417722,
+ "grad_norm": 0.03535325452685356,
+ "learning_rate": 6.655443322109989e-05,
+ "loss": 0.020550835877656937,
+ "step": 795
+ },
+ {
+ "epoch": 4.020253164556962,
+ "grad_norm": 0.027277838438749313,
+ "learning_rate": 6.64983164983165e-05,
+ "loss": 0.02178161032497883,
+ "step": 796
+ },
+ {
+ "epoch": 4.025316455696203,
+ "grad_norm": 0.03889140114188194,
+ "learning_rate": 6.644219977553311e-05,
+ "loss": 0.02359630912542343,
+ "step": 797
+ },
+ {
+ "epoch": 4.030379746835443,
+ "grad_norm": 0.03794289380311966,
+ "learning_rate": 6.638608305274972e-05,
+ "loss": 0.02135687693953514,
+ "step": 798
+ },
+ {
+ "epoch": 4.035443037974684,
+ "grad_norm": 0.030842013657093048,
+ "learning_rate": 6.632996632996633e-05,
+ "loss": 0.026881888508796692,
+ "step": 799
+ },
+ {
+ "epoch": 4.040506329113924,
+ "grad_norm": 0.036720771342515945,
+ "learning_rate": 6.627384960718295e-05,
+ "loss": 0.017526758834719658,
+ "step": 800
+ },
+ {
+ "epoch": 4.045569620253165,
+ "grad_norm": 0.04940621554851532,
+ "learning_rate": 6.621773288439955e-05,
+ "loss": 0.023458952084183693,
+ "step": 801
+ },
+ {
+ "epoch": 4.050632911392405,
+ "grad_norm": 0.0228698942810297,
+ "learning_rate": 6.616161616161617e-05,
+ "loss": 0.017165549099445343,
+ "step": 802
+ },
+ {
+ "epoch": 4.055696202531646,
+ "grad_norm": 0.0323697030544281,
+ "learning_rate": 6.610549943883277e-05,
+ "loss": 0.020573658868670464,
+ "step": 803
+ },
+ {
+ "epoch": 4.060759493670886,
+ "grad_norm": 0.03041171282529831,
+ "learning_rate": 6.60493827160494e-05,
+ "loss": 0.022557582706212997,
+ "step": 804
+ },
+ {
+ "epoch": 4.065822784810127,
+ "grad_norm": 0.030996058136224747,
+ "learning_rate": 6.599326599326599e-05,
+ "loss": 0.024344075471162796,
+ "step": 805
+ },
+ {
+ "epoch": 4.0708860759493675,
+ "grad_norm": 0.02448248863220215,
+ "learning_rate": 6.593714927048261e-05,
+ "loss": 0.018718231469392776,
+ "step": 806
+ },
+ {
+ "epoch": 4.075949367088608,
+ "grad_norm": 0.03839370980858803,
+ "learning_rate": 6.588103254769921e-05,
+ "loss": 0.02680569887161255,
+ "step": 807
+ },
+ {
+ "epoch": 4.0810126582278485,
+ "grad_norm": 0.029364196583628654,
+ "learning_rate": 6.582491582491582e-05,
+ "loss": 0.01946680247783661,
+ "step": 808
+ },
+ {
+ "epoch": 4.086075949367088,
+ "grad_norm": 0.02478131465613842,
+ "learning_rate": 6.576879910213244e-05,
+ "loss": 0.021097835153341293,
+ "step": 809
+ },
+ {
+ "epoch": 4.091139240506329,
+ "grad_norm": 0.030616244301199913,
+ "learning_rate": 6.571268237934904e-05,
+ "loss": 0.021518010646104813,
+ "step": 810
+ },
+ {
+ "epoch": 4.096202531645569,
+ "grad_norm": 0.02732054330408573,
+ "learning_rate": 6.565656565656566e-05,
+ "loss": 0.02008533477783203,
+ "step": 811
+ },
+ {
+ "epoch": 4.10126582278481,
+ "grad_norm": 0.0323524996638298,
+ "learning_rate": 6.560044893378226e-05,
+ "loss": 0.025486933067440987,
+ "step": 812
+ },
+ {
+ "epoch": 4.10632911392405,
+ "grad_norm": 0.026200806722044945,
+ "learning_rate": 6.554433221099888e-05,
+ "loss": 0.019320383667945862,
+ "step": 813
+ },
+ {
+ "epoch": 4.111392405063291,
+ "grad_norm": 0.03883595019578934,
+ "learning_rate": 6.548821548821548e-05,
+ "loss": 0.021837443113327026,
+ "step": 814
+ },
+ {
+ "epoch": 4.116455696202531,
+ "grad_norm": 0.037654533982276917,
+ "learning_rate": 6.54320987654321e-05,
+ "loss": 0.024574559181928635,
+ "step": 815
+ },
+ {
+ "epoch": 4.121518987341772,
+ "grad_norm": 0.04923658072948456,
+ "learning_rate": 6.537598204264871e-05,
+ "loss": 0.01940765418112278,
+ "step": 816
+ },
+ {
+ "epoch": 4.1265822784810124,
+ "grad_norm": 0.02900642342865467,
+ "learning_rate": 6.531986531986533e-05,
+ "loss": 0.019193468615412712,
+ "step": 817
+ },
+ {
+ "epoch": 4.131645569620253,
+ "grad_norm": 0.03798971325159073,
+ "learning_rate": 6.526374859708194e-05,
+ "loss": 0.022473281249403954,
+ "step": 818
+ },
+ {
+ "epoch": 4.1367088607594935,
+ "grad_norm": 0.05821327865123749,
+ "learning_rate": 6.520763187429855e-05,
+ "loss": 0.025292381644248962,
+ "step": 819
+ },
+ {
+ "epoch": 4.141772151898734,
+ "grad_norm": 0.02774794027209282,
+ "learning_rate": 6.515151515151516e-05,
+ "loss": 0.021283335983753204,
+ "step": 820
+ },
+ {
+ "epoch": 4.146835443037975,
+ "grad_norm": 0.03002094104886055,
+ "learning_rate": 6.509539842873177e-05,
+ "loss": 0.020336506888270378,
+ "step": 821
+ },
+ {
+ "epoch": 4.151898734177215,
+ "grad_norm": 0.02205439656972885,
+ "learning_rate": 6.503928170594838e-05,
+ "loss": 0.01669773831963539,
+ "step": 822
+ },
+ {
+ "epoch": 4.156962025316456,
+ "grad_norm": 0.023610664531588554,
+ "learning_rate": 6.498316498316499e-05,
+ "loss": 0.016195815056562424,
+ "step": 823
+ },
+ {
+ "epoch": 4.162025316455696,
+ "grad_norm": 0.02679222822189331,
+ "learning_rate": 6.49270482603816e-05,
+ "loss": 0.020671207457780838,
+ "step": 824
+ },
+ {
+ "epoch": 4.167088607594937,
+ "grad_norm": 0.043805427849292755,
+ "learning_rate": 6.48709315375982e-05,
+ "loss": 0.029262011870741844,
+ "step": 825
+ },
+ {
+ "epoch": 4.172151898734177,
+ "grad_norm": 0.024075932800769806,
+ "learning_rate": 6.481481481481482e-05,
+ "loss": 0.0180169977247715,
+ "step": 826
+ },
+ {
+ "epoch": 4.177215189873418,
+ "grad_norm": 0.027496427297592163,
+ "learning_rate": 6.475869809203144e-05,
+ "loss": 0.01985255442559719,
+ "step": 827
+ },
+ {
+ "epoch": 4.182278481012658,
+ "grad_norm": 0.028868619352579117,
+ "learning_rate": 6.470258136924804e-05,
+ "loss": 0.02416200190782547,
+ "step": 828
+ },
+ {
+ "epoch": 4.187341772151899,
+ "grad_norm": 0.026004688814282417,
+ "learning_rate": 6.464646464646466e-05,
+ "loss": 0.01904168725013733,
+ "step": 829
+ },
+ {
+ "epoch": 4.192405063291139,
+ "grad_norm": 0.04274019971489906,
+ "learning_rate": 6.459034792368126e-05,
+ "loss": 0.02680842950940132,
+ "step": 830
+ },
+ {
+ "epoch": 4.19746835443038,
+ "grad_norm": 0.024735039100050926,
+ "learning_rate": 6.453423120089787e-05,
+ "loss": 0.016491729766130447,
+ "step": 831
+ },
+ {
+ "epoch": 4.2025316455696204,
+ "grad_norm": 0.04336397722363472,
+ "learning_rate": 6.447811447811448e-05,
+ "loss": 0.02140970341861248,
+ "step": 832
+ },
+ {
+ "epoch": 4.207594936708861,
+ "grad_norm": 0.025922754779458046,
+ "learning_rate": 6.442199775533109e-05,
+ "loss": 0.017252741381525993,
+ "step": 833
+ },
+ {
+ "epoch": 4.2126582278481015,
+ "grad_norm": 0.0322343185544014,
+ "learning_rate": 6.436588103254771e-05,
+ "loss": 0.015862349420785904,
+ "step": 834
+ },
+ {
+ "epoch": 4.217721518987342,
+ "grad_norm": 0.033133670687675476,
+ "learning_rate": 6.43097643097643e-05,
+ "loss": 0.02029406651854515,
+ "step": 835
+ },
+ {
+ "epoch": 4.222784810126583,
+ "grad_norm": 0.044879183173179626,
+ "learning_rate": 6.425364758698093e-05,
+ "loss": 0.021223746240139008,
+ "step": 836
+ },
+ {
+ "epoch": 4.227848101265823,
+ "grad_norm": 0.031861864030361176,
+ "learning_rate": 6.419753086419753e-05,
+ "loss": 0.023331837728619576,
+ "step": 837
+ },
+ {
+ "epoch": 4.232911392405064,
+ "grad_norm": 0.03642997145652771,
+ "learning_rate": 6.414141414141415e-05,
+ "loss": 0.025932632386684418,
+ "step": 838
+ },
+ {
+ "epoch": 4.237974683544304,
+ "grad_norm": 0.025531062856316566,
+ "learning_rate": 6.408529741863075e-05,
+ "loss": 0.019921796396374702,
+ "step": 839
+ },
+ {
+ "epoch": 4.243037974683545,
+ "grad_norm": 0.025292333215475082,
+ "learning_rate": 6.402918069584737e-05,
+ "loss": 0.017363781109452248,
+ "step": 840
+ },
+ {
+ "epoch": 4.248101265822784,
+ "grad_norm": 0.03679105266928673,
+ "learning_rate": 6.397306397306398e-05,
+ "loss": 0.026451613754034042,
+ "step": 841
+ },
+ {
+ "epoch": 4.253164556962025,
+ "grad_norm": 0.029125263914465904,
+ "learning_rate": 6.391694725028059e-05,
+ "loss": 0.018277600407600403,
+ "step": 842
+ },
+ {
+ "epoch": 4.258227848101265,
+ "grad_norm": 0.03969479724764824,
+ "learning_rate": 6.38608305274972e-05,
+ "loss": 0.026814289391040802,
+ "step": 843
+ },
+ {
+ "epoch": 4.263291139240506,
+ "grad_norm": 0.03083009086549282,
+ "learning_rate": 6.380471380471381e-05,
+ "loss": 0.01898398995399475,
+ "step": 844
+ },
+ {
+ "epoch": 4.2683544303797465,
+ "grad_norm": 0.04128425940871239,
+ "learning_rate": 6.374859708193042e-05,
+ "loss": 0.02890118584036827,
+ "step": 845
+ },
+ {
+ "epoch": 4.273417721518987,
+ "grad_norm": 0.03675759211182594,
+ "learning_rate": 6.369248035914703e-05,
+ "loss": 0.0232902429997921,
+ "step": 846
+ },
+ {
+ "epoch": 4.2784810126582276,
+ "grad_norm": 0.035842880606651306,
+ "learning_rate": 6.363636363636364e-05,
+ "loss": 0.018688444048166275,
+ "step": 847
+ },
+ {
+ "epoch": 4.283544303797468,
+ "grad_norm": 0.041631679981946945,
+ "learning_rate": 6.358024691358025e-05,
+ "loss": 0.028953872621059418,
+ "step": 848
+ },
+ {
+ "epoch": 4.288607594936709,
+ "grad_norm": 0.02474270947277546,
+ "learning_rate": 6.352413019079686e-05,
+ "loss": 0.02291303500533104,
+ "step": 849
+ },
+ {
+ "epoch": 4.293670886075949,
+ "grad_norm": 0.0414784699678421,
+ "learning_rate": 6.346801346801347e-05,
+ "loss": 0.0197298601269722,
+ "step": 850
+ },
+ {
+ "epoch": 4.29873417721519,
+ "grad_norm": 0.022596480324864388,
+ "learning_rate": 6.341189674523008e-05,
+ "loss": 0.022477108985185623,
+ "step": 851
+ },
+ {
+ "epoch": 4.30379746835443,
+ "grad_norm": 0.03707405552268028,
+ "learning_rate": 6.335578002244669e-05,
+ "loss": 0.02374342642724514,
+ "step": 852
+ },
+ {
+ "epoch": 4.308860759493671,
+ "grad_norm": 0.036069657653570175,
+ "learning_rate": 6.32996632996633e-05,
+ "loss": 0.025015011429786682,
+ "step": 853
+ },
+ {
+ "epoch": 4.313924050632911,
+ "grad_norm": 0.025126038119196892,
+ "learning_rate": 6.324354657687991e-05,
+ "loss": 0.022152241319417953,
+ "step": 854
+ },
+ {
+ "epoch": 4.318987341772152,
+ "grad_norm": 0.03695147857069969,
+ "learning_rate": 6.318742985409652e-05,
+ "loss": 0.019978618249297142,
+ "step": 855
+ },
+ {
+ "epoch": 4.324050632911392,
+ "grad_norm": 0.034860849380493164,
+ "learning_rate": 6.313131313131313e-05,
+ "loss": 0.01976930722594261,
+ "step": 856
+ },
+ {
+ "epoch": 4.329113924050633,
+ "grad_norm": 0.029625017195940018,
+ "learning_rate": 6.307519640852974e-05,
+ "loss": 0.024136420339345932,
+ "step": 857
+ },
+ {
+ "epoch": 4.334177215189873,
+ "grad_norm": 0.03501079976558685,
+ "learning_rate": 6.301907968574635e-05,
+ "loss": 0.020777776837348938,
+ "step": 858
+ },
+ {
+ "epoch": 4.339240506329114,
+ "grad_norm": 0.037415534257888794,
+ "learning_rate": 6.296296296296296e-05,
+ "loss": 0.016332093626260757,
+ "step": 859
+ },
+ {
+ "epoch": 4.3443037974683545,
+ "grad_norm": 0.032555654644966125,
+ "learning_rate": 6.290684624017957e-05,
+ "loss": 0.02344547212123871,
+ "step": 860
+ },
+ {
+ "epoch": 4.349367088607595,
+ "grad_norm": 0.04069099947810173,
+ "learning_rate": 6.28507295173962e-05,
+ "loss": 0.019369281828403473,
+ "step": 861
+ },
+ {
+ "epoch": 4.3544303797468356,
+ "grad_norm": 0.05188984051346779,
+ "learning_rate": 6.279461279461279e-05,
+ "loss": 0.02291448414325714,
+ "step": 862
+ },
+ {
+ "epoch": 4.359493670886076,
+ "grad_norm": 0.0357513502240181,
+ "learning_rate": 6.273849607182942e-05,
+ "loss": 0.02141542360186577,
+ "step": 863
+ },
+ {
+ "epoch": 4.364556962025317,
+ "grad_norm": 0.026472769677639008,
+ "learning_rate": 6.268237934904601e-05,
+ "loss": 0.01893937960267067,
+ "step": 864
+ },
+ {
+ "epoch": 4.369620253164557,
+ "grad_norm": 0.0498812235891819,
+ "learning_rate": 6.262626262626264e-05,
+ "loss": 0.021839456632733345,
+ "step": 865
+ },
+ {
+ "epoch": 4.374683544303798,
+ "grad_norm": 0.05202518403530121,
+ "learning_rate": 6.257014590347923e-05,
+ "loss": 0.023422567173838615,
+ "step": 866
+ },
+ {
+ "epoch": 4.379746835443038,
+ "grad_norm": 0.024116024374961853,
+ "learning_rate": 6.251402918069586e-05,
+ "loss": 0.018288200721144676,
+ "step": 867
+ },
+ {
+ "epoch": 4.384810126582279,
+ "grad_norm": 0.02667090855538845,
+ "learning_rate": 6.245791245791247e-05,
+ "loss": 0.022375311702489853,
+ "step": 868
+ },
+ {
+ "epoch": 4.389873417721519,
+ "grad_norm": 0.02306467480957508,
+ "learning_rate": 6.240179573512908e-05,
+ "loss": 0.017447657883167267,
+ "step": 869
+ },
+ {
+ "epoch": 4.39493670886076,
+ "grad_norm": 0.031131602823734283,
+ "learning_rate": 6.234567901234569e-05,
+ "loss": 0.021768944337964058,
+ "step": 870
+ },
+ {
+ "epoch": 4.4,
+ "grad_norm": 0.05789825692772865,
+ "learning_rate": 6.22895622895623e-05,
+ "loss": 0.02762719616293907,
+ "step": 871
+ },
+ {
+ "epoch": 4.405063291139241,
+ "grad_norm": 0.03830523043870926,
+ "learning_rate": 6.22334455667789e-05,
+ "loss": 0.023558061569929123,
+ "step": 872
+ },
+ {
+ "epoch": 4.410126582278481,
+ "grad_norm": 0.025961998850107193,
+ "learning_rate": 6.21773288439955e-05,
+ "loss": 0.022518256679177284,
+ "step": 873
+ },
+ {
+ "epoch": 4.415189873417722,
+ "grad_norm": 0.025299636647105217,
+ "learning_rate": 6.212121212121213e-05,
+ "loss": 0.018432877957820892,
+ "step": 874
+ },
+ {
+ "epoch": 4.4202531645569625,
+ "grad_norm": 0.027106614783406258,
+ "learning_rate": 6.206509539842874e-05,
+ "loss": 0.01614236831665039,
+ "step": 875
+ },
+ {
+ "epoch": 4.425316455696202,
+ "grad_norm": 0.04538397118449211,
+ "learning_rate": 6.200897867564535e-05,
+ "loss": 0.027474530041217804,
+ "step": 876
+ },
+ {
+ "epoch": 4.430379746835443,
+ "grad_norm": 0.041059643030166626,
+ "learning_rate": 6.195286195286196e-05,
+ "loss": 0.030840855091810226,
+ "step": 877
+ },
+ {
+ "epoch": 4.435443037974683,
+ "grad_norm": 0.055599089711904526,
+ "learning_rate": 6.189674523007857e-05,
+ "loss": 0.02877015620470047,
+ "step": 878
+ },
+ {
+ "epoch": 4.440506329113924,
+ "grad_norm": 0.023808903992176056,
+ "learning_rate": 6.184062850729518e-05,
+ "loss": 0.018071971833705902,
+ "step": 879
+ },
+ {
+ "epoch": 4.445569620253164,
+ "grad_norm": 0.04098769649863243,
+ "learning_rate": 6.178451178451179e-05,
+ "loss": 0.019321631640195847,
+ "step": 880
+ },
+ {
+ "epoch": 4.450632911392405,
+ "grad_norm": 0.0329279750585556,
+ "learning_rate": 6.17283950617284e-05,
+ "loss": 0.023013390600681305,
+ "step": 881
+ },
+ {
+ "epoch": 4.455696202531645,
+ "grad_norm": 0.030751917511224747,
+ "learning_rate": 6.1672278338945e-05,
+ "loss": 0.018062159419059753,
+ "step": 882
+ },
+ {
+ "epoch": 4.460759493670886,
+ "grad_norm": 0.025446373969316483,
+ "learning_rate": 6.161616161616162e-05,
+ "loss": 0.020532462745904922,
+ "step": 883
+ },
+ {
+ "epoch": 4.465822784810126,
+ "grad_norm": 0.037997085601091385,
+ "learning_rate": 6.156004489337823e-05,
+ "loss": 0.024340521544218063,
+ "step": 884
+ },
+ {
+ "epoch": 4.470886075949367,
+ "grad_norm": 0.021509790793061256,
+ "learning_rate": 6.150392817059484e-05,
+ "loss": 0.018887734040617943,
+ "step": 885
+ },
+ {
+ "epoch": 4.4759493670886075,
+ "grad_norm": 0.027931779623031616,
+ "learning_rate": 6.144781144781146e-05,
+ "loss": 0.02148054540157318,
+ "step": 886
+ },
+ {
+ "epoch": 4.481012658227848,
+ "grad_norm": 0.035554565489292145,
+ "learning_rate": 6.139169472502806e-05,
+ "loss": 0.019528254866600037,
+ "step": 887
+ },
+ {
+ "epoch": 4.4860759493670885,
+ "grad_norm": 0.02668517455458641,
+ "learning_rate": 6.133557800224468e-05,
+ "loss": 0.022182706743478775,
+ "step": 888
+ },
+ {
+ "epoch": 4.491139240506329,
+ "grad_norm": 0.0376712940633297,
+ "learning_rate": 6.127946127946128e-05,
+ "loss": 0.026006314903497696,
+ "step": 889
+ },
+ {
+ "epoch": 4.49620253164557,
+ "grad_norm": 0.02952289767563343,
+ "learning_rate": 6.12233445566779e-05,
+ "loss": 0.022582251578569412,
+ "step": 890
+ },
+ {
+ "epoch": 4.50126582278481,
+ "grad_norm": 0.05064458027482033,
+ "learning_rate": 6.11672278338945e-05,
+ "loss": 0.021709535270929337,
+ "step": 891
+ },
+ {
+ "epoch": 4.506329113924051,
+ "grad_norm": 0.021470079198479652,
+ "learning_rate": 6.111111111111112e-05,
+ "loss": 0.015116477385163307,
+ "step": 892
+ },
+ {
+ "epoch": 4.511392405063291,
+ "grad_norm": 0.04210078716278076,
+ "learning_rate": 6.105499438832773e-05,
+ "loss": 0.030057771131396294,
+ "step": 893
+ },
+ {
+ "epoch": 4.516455696202532,
+ "grad_norm": 0.20027652382850647,
+ "learning_rate": 6.099887766554434e-05,
+ "loss": 0.02081073820590973,
+ "step": 894
+ },
+ {
+ "epoch": 4.521518987341772,
+ "grad_norm": 0.03083370067179203,
+ "learning_rate": 6.0942760942760944e-05,
+ "loss": 0.020705904811620712,
+ "step": 895
+ },
+ {
+ "epoch": 4.526582278481013,
+ "grad_norm": 0.05921618640422821,
+ "learning_rate": 6.0886644219977554e-05,
+ "loss": 0.020449915900826454,
+ "step": 896
+ },
+ {
+ "epoch": 4.531645569620253,
+ "grad_norm": 0.02304214984178543,
+ "learning_rate": 6.0830527497194164e-05,
+ "loss": 0.01927848532795906,
+ "step": 897
+ },
+ {
+ "epoch": 4.536708860759494,
+ "grad_norm": 0.03946949169039726,
+ "learning_rate": 6.0774410774410774e-05,
+ "loss": 0.026231423020362854,
+ "step": 898
+ },
+ {
+ "epoch": 4.541772151898734,
+ "grad_norm": 0.027822930365800858,
+ "learning_rate": 6.071829405162739e-05,
+ "loss": 0.022259924560785294,
+ "step": 899
+ },
+ {
+ "epoch": 4.546835443037975,
+ "grad_norm": 0.029135817661881447,
+ "learning_rate": 6.0662177328843995e-05,
+ "loss": 0.019272884353995323,
+ "step": 900
+ },
+ {
+ "epoch": 4.5518987341772155,
+ "grad_norm": 0.03746713697910309,
+ "learning_rate": 6.060606060606061e-05,
+ "loss": 0.022191740572452545,
+ "step": 901
+ },
+ {
+ "epoch": 4.556962025316456,
+ "grad_norm": 0.027378680184483528,
+ "learning_rate": 6.0549943883277215e-05,
+ "loss": 0.023043492808938026,
+ "step": 902
+ },
+ {
+ "epoch": 4.5620253164556965,
+ "grad_norm": 0.047497715801000595,
+ "learning_rate": 6.049382716049383e-05,
+ "loss": 0.023993097245693207,
+ "step": 903
+ },
+ {
+ "epoch": 4.567088607594937,
+ "grad_norm": 0.02557055652141571,
+ "learning_rate": 6.0437710437710435e-05,
+ "loss": 0.020033126696944237,
+ "step": 904
+ },
+ {
+ "epoch": 4.572151898734178,
+ "grad_norm": 0.08165695518255234,
+ "learning_rate": 6.038159371492705e-05,
+ "loss": 0.02415328472852707,
+ "step": 905
+ },
+ {
+ "epoch": 4.577215189873417,
+ "grad_norm": 0.03633309155702591,
+ "learning_rate": 6.032547699214366e-05,
+ "loss": 0.02082585170865059,
+ "step": 906
+ },
+ {
+ "epoch": 4.582278481012658,
+ "grad_norm": 0.03273358196020126,
+ "learning_rate": 6.026936026936028e-05,
+ "loss": 0.020049303770065308,
+ "step": 907
+ },
+ {
+ "epoch": 4.587341772151898,
+ "grad_norm": 0.040032029151916504,
+ "learning_rate": 6.021324354657688e-05,
+ "loss": 0.02167242392897606,
+ "step": 908
+ },
+ {
+ "epoch": 4.592405063291139,
+ "grad_norm": 0.02789166197180748,
+ "learning_rate": 6.01571268237935e-05,
+ "loss": 0.01964012160897255,
+ "step": 909
+ },
+ {
+ "epoch": 4.597468354430379,
+ "grad_norm": 0.03285825625061989,
+ "learning_rate": 6.01010101010101e-05,
+ "loss": 0.024942882359027863,
+ "step": 910
+ },
+ {
+ "epoch": 4.60253164556962,
+ "grad_norm": 0.02894079126417637,
+ "learning_rate": 6.004489337822672e-05,
+ "loss": 0.022012561559677124,
+ "step": 911
+ },
+ {
+ "epoch": 4.6075949367088604,
+ "grad_norm": 0.03291299566626549,
+ "learning_rate": 5.998877665544332e-05,
+ "loss": 0.02291432023048401,
+ "step": 912
+ },
+ {
+ "epoch": 4.612658227848101,
+ "grad_norm": 0.05124634876847267,
+ "learning_rate": 5.993265993265994e-05,
+ "loss": 0.017874885350465775,
+ "step": 913
+ },
+ {
+ "epoch": 4.6177215189873415,
+ "grad_norm": 0.042412169277668,
+ "learning_rate": 5.987654320987654e-05,
+ "loss": 0.0233401320874691,
+ "step": 914
+ },
+ {
+ "epoch": 4.622784810126582,
+ "grad_norm": 0.03447306156158447,
+ "learning_rate": 5.982042648709316e-05,
+ "loss": 0.022503826767206192,
+ "step": 915
+ },
+ {
+ "epoch": 4.627848101265823,
+ "grad_norm": 0.022415662184357643,
+ "learning_rate": 5.976430976430977e-05,
+ "loss": 0.01659448817372322,
+ "step": 916
+ },
+ {
+ "epoch": 4.632911392405063,
+ "grad_norm": 0.04882103577256203,
+ "learning_rate": 5.970819304152637e-05,
+ "loss": 0.02342696487903595,
+ "step": 917
+ },
+ {
+ "epoch": 4.637974683544304,
+ "grad_norm": 0.0341666042804718,
+ "learning_rate": 5.965207631874299e-05,
+ "loss": 0.026119260117411613,
+ "step": 918
+ },
+ {
+ "epoch": 4.643037974683544,
+ "grad_norm": 0.03507097065448761,
+ "learning_rate": 5.959595959595959e-05,
+ "loss": 0.022042831405997276,
+ "step": 919
+ },
+ {
+ "epoch": 4.648101265822785,
+ "grad_norm": 0.04078570008277893,
+ "learning_rate": 5.953984287317621e-05,
+ "loss": 0.01978793554008007,
+ "step": 920
+ },
+ {
+ "epoch": 4.653164556962025,
+ "grad_norm": 0.03481799736618996,
+ "learning_rate": 5.948372615039281e-05,
+ "loss": 0.02518302947282791,
+ "step": 921
+ },
+ {
+ "epoch": 4.658227848101266,
+ "grad_norm": 0.0456753633916378,
+ "learning_rate": 5.942760942760943e-05,
+ "loss": 0.027814291417598724,
+ "step": 922
+ },
+ {
+ "epoch": 4.663291139240506,
+ "grad_norm": 0.026144322007894516,
+ "learning_rate": 5.937149270482604e-05,
+ "loss": 0.020842768251895905,
+ "step": 923
+ },
+ {
+ "epoch": 4.668354430379747,
+ "grad_norm": 0.027078162878751755,
+ "learning_rate": 5.9315375982042657e-05,
+ "loss": 0.026818346232175827,
+ "step": 924
+ },
+ {
+ "epoch": 4.673417721518987,
+ "grad_norm": 0.04505958408117294,
+ "learning_rate": 5.925925925925926e-05,
+ "loss": 0.01925778016448021,
+ "step": 925
+ },
+ {
+ "epoch": 4.678481012658228,
+ "grad_norm": 0.028921643272042274,
+ "learning_rate": 5.920314253647588e-05,
+ "loss": 0.017857741564512253,
+ "step": 926
+ },
+ {
+ "epoch": 4.6835443037974684,
+ "grad_norm": 0.021489476785063744,
+ "learning_rate": 5.914702581369248e-05,
+ "loss": 0.018585946410894394,
+ "step": 927
+ },
+ {
+ "epoch": 4.688607594936709,
+ "grad_norm": 0.02885374240577221,
+ "learning_rate": 5.90909090909091e-05,
+ "loss": 0.023486338555812836,
+ "step": 928
+ },
+ {
+ "epoch": 4.6936708860759495,
+ "grad_norm": 0.037063464522361755,
+ "learning_rate": 5.90347923681257e-05,
+ "loss": 0.02569335326552391,
+ "step": 929
+ },
+ {
+ "epoch": 4.69873417721519,
+ "grad_norm": 0.02460661344230175,
+ "learning_rate": 5.897867564534232e-05,
+ "loss": 0.01580418087542057,
+ "step": 930
+ },
+ {
+ "epoch": 4.703797468354431,
+ "grad_norm": 0.030016187578439713,
+ "learning_rate": 5.892255892255892e-05,
+ "loss": 0.01811431720852852,
+ "step": 931
+ },
+ {
+ "epoch": 4.708860759493671,
+ "grad_norm": 0.030638013035058975,
+ "learning_rate": 5.886644219977554e-05,
+ "loss": 0.02380264922976494,
+ "step": 932
+ },
+ {
+ "epoch": 4.713924050632912,
+ "grad_norm": 0.022593742236495018,
+ "learning_rate": 5.881032547699215e-05,
+ "loss": 0.017498169094324112,
+ "step": 933
+ },
+ {
+ "epoch": 4.718987341772152,
+ "grad_norm": 0.026072485372424126,
+ "learning_rate": 5.8754208754208764e-05,
+ "loss": 0.020261723548173904,
+ "step": 934
+ },
+ {
+ "epoch": 4.724050632911393,
+ "grad_norm": 0.020842554047703743,
+ "learning_rate": 5.869809203142537e-05,
+ "loss": 0.018765904009342194,
+ "step": 935
+ },
+ {
+ "epoch": 4.729113924050633,
+ "grad_norm": 0.02724885568022728,
+ "learning_rate": 5.8641975308641984e-05,
+ "loss": 0.01877676695585251,
+ "step": 936
+ },
+ {
+ "epoch": 4.734177215189874,
+ "grad_norm": 0.037401214241981506,
+ "learning_rate": 5.858585858585859e-05,
+ "loss": 0.026435203850269318,
+ "step": 937
+ },
+ {
+ "epoch": 4.739240506329114,
+ "grad_norm": 0.06131114065647125,
+ "learning_rate": 5.852974186307519e-05,
+ "loss": 0.023247163742780685,
+ "step": 938
+ },
+ {
+ "epoch": 4.744303797468355,
+ "grad_norm": 0.04543917998671532,
+ "learning_rate": 5.847362514029181e-05,
+ "loss": 0.024184830486774445,
+ "step": 939
+ },
+ {
+ "epoch": 4.749367088607595,
+ "grad_norm": 0.03184051439166069,
+ "learning_rate": 5.841750841750842e-05,
+ "loss": 0.02176564559340477,
+ "step": 940
+ },
+ {
+ "epoch": 4.754430379746836,
+ "grad_norm": 0.0309689249843359,
+ "learning_rate": 5.8361391694725034e-05,
+ "loss": 0.023136526346206665,
+ "step": 941
+ },
+ {
+ "epoch": 4.759493670886076,
+ "grad_norm": 0.024972833693027496,
+ "learning_rate": 5.830527497194164e-05,
+ "loss": 0.017270661890506744,
+ "step": 942
+ },
+ {
+ "epoch": 4.764556962025316,
+ "grad_norm": 0.03733127936720848,
+ "learning_rate": 5.8249158249158255e-05,
+ "loss": 0.022722383961081505,
+ "step": 943
+ },
+ {
+ "epoch": 4.769620253164557,
+ "grad_norm": 0.04425952583551407,
+ "learning_rate": 5.819304152637486e-05,
+ "loss": 0.02506185881793499,
+ "step": 944
+ },
+ {
+ "epoch": 4.774683544303797,
+ "grad_norm": 0.022625036537647247,
+ "learning_rate": 5.8136924803591475e-05,
+ "loss": 0.017418090254068375,
+ "step": 945
+ },
+ {
+ "epoch": 4.779746835443038,
+ "grad_norm": 0.02716260775923729,
+ "learning_rate": 5.808080808080808e-05,
+ "loss": 0.022329077124595642,
+ "step": 946
+ },
+ {
+ "epoch": 4.784810126582278,
+ "grad_norm": 0.03288663551211357,
+ "learning_rate": 5.8024691358024695e-05,
+ "loss": 0.02051950991153717,
+ "step": 947
+ },
+ {
+ "epoch": 4.789873417721519,
+ "grad_norm": 0.03347448632121086,
+ "learning_rate": 5.7968574635241305e-05,
+ "loss": 0.01883091777563095,
+ "step": 948
+ },
+ {
+ "epoch": 4.794936708860759,
+ "grad_norm": 0.036814238876104355,
+ "learning_rate": 5.7912457912457915e-05,
+ "loss": 0.02320999652147293,
+ "step": 949
+ },
+ {
+ "epoch": 4.8,
+ "grad_norm": 0.030795598402619362,
+ "learning_rate": 5.7856341189674525e-05,
+ "loss": 0.01819070428609848,
+ "step": 950
+ },
+ {
+ "epoch": 4.80506329113924,
+ "grad_norm": 0.03846567124128342,
+ "learning_rate": 5.780022446689114e-05,
+ "loss": 0.01933719590306282,
+ "step": 951
+ },
+ {
+ "epoch": 4.810126582278481,
+ "grad_norm": 0.029248127713799477,
+ "learning_rate": 5.7744107744107745e-05,
+ "loss": 0.01642131432890892,
+ "step": 952
+ },
+ {
+ "epoch": 4.815189873417721,
+ "grad_norm": 0.025749213993549347,
+ "learning_rate": 5.768799102132436e-05,
+ "loss": 0.017750587314367294,
+ "step": 953
+ },
+ {
+ "epoch": 4.820253164556962,
+ "grad_norm": 0.043794333934783936,
+ "learning_rate": 5.7631874298540965e-05,
+ "loss": 0.02561376616358757,
+ "step": 954
+ },
+ {
+ "epoch": 4.8253164556962025,
+ "grad_norm": 0.04074554517865181,
+ "learning_rate": 5.757575757575758e-05,
+ "loss": 0.023251589387655258,
+ "step": 955
+ },
+ {
+ "epoch": 4.830379746835443,
+ "grad_norm": 0.043594326823949814,
+ "learning_rate": 5.7519640852974186e-05,
+ "loss": 0.025138206779956818,
+ "step": 956
+ },
+ {
+ "epoch": 4.8354430379746836,
+ "grad_norm": 0.05410498008131981,
+ "learning_rate": 5.74635241301908e-05,
+ "loss": 0.023706410080194473,
+ "step": 957
+ },
+ {
+ "epoch": 4.840506329113924,
+ "grad_norm": 0.0299235749989748,
+ "learning_rate": 5.740740740740741e-05,
+ "loss": 0.01801147311925888,
+ "step": 958
+ },
+ {
+ "epoch": 4.845569620253165,
+ "grad_norm": 0.02982177399098873,
+ "learning_rate": 5.735129068462403e-05,
+ "loss": 0.021112898364663124,
+ "step": 959
+ },
+ {
+ "epoch": 4.850632911392405,
+ "grad_norm": 0.04181864112615585,
+ "learning_rate": 5.729517396184063e-05,
+ "loss": 0.02110268548130989,
+ "step": 960
+ },
+ {
+ "epoch": 4.855696202531646,
+ "grad_norm": 0.040301334112882614,
+ "learning_rate": 5.7239057239057236e-05,
+ "loss": 0.020649928599596024,
+ "step": 961
+ },
+ {
+ "epoch": 4.860759493670886,
+ "grad_norm": 0.03669300675392151,
+ "learning_rate": 5.718294051627385e-05,
+ "loss": 0.023078542202711105,
+ "step": 962
+ },
+ {
+ "epoch": 4.865822784810127,
+ "grad_norm": 0.023378873243927956,
+ "learning_rate": 5.7126823793490456e-05,
+ "loss": 0.01759505085647106,
+ "step": 963
+ },
+ {
+ "epoch": 4.870886075949367,
+ "grad_norm": 0.044835980981588364,
+ "learning_rate": 5.707070707070707e-05,
+ "loss": 0.023342810571193695,
+ "step": 964
+ },
+ {
+ "epoch": 4.875949367088608,
+ "grad_norm": 0.03264521807432175,
+ "learning_rate": 5.701459034792368e-05,
+ "loss": 0.021122846752405167,
+ "step": 965
+ },
+ {
+ "epoch": 4.881012658227848,
+ "grad_norm": 0.036651868373155594,
+ "learning_rate": 5.695847362514029e-05,
+ "loss": 0.026279672980308533,
+ "step": 966
+ },
+ {
+ "epoch": 4.886075949367089,
+ "grad_norm": 0.023810314014554024,
+ "learning_rate": 5.69023569023569e-05,
+ "loss": 0.020299838855862617,
+ "step": 967
+ },
+ {
+ "epoch": 4.891139240506329,
+ "grad_norm": 0.028432384133338928,
+ "learning_rate": 5.684624017957352e-05,
+ "loss": 0.019828233867883682,
+ "step": 968
+ },
+ {
+ "epoch": 4.89620253164557,
+ "grad_norm": 0.02499561943113804,
+ "learning_rate": 5.679012345679012e-05,
+ "loss": 0.023105870932340622,
+ "step": 969
+ },
+ {
+ "epoch": 4.9012658227848105,
+ "grad_norm": 0.0340624563395977,
+ "learning_rate": 5.673400673400674e-05,
+ "loss": 0.023707572370767593,
+ "step": 970
+ },
+ {
+ "epoch": 4.90632911392405,
+ "grad_norm": 0.02945004589855671,
+ "learning_rate": 5.667789001122334e-05,
+ "loss": 0.019038598984479904,
+ "step": 971
+ },
+ {
+ "epoch": 4.911392405063291,
+ "grad_norm": 0.034173011779785156,
+ "learning_rate": 5.662177328843996e-05,
+ "loss": 0.02678484097123146,
+ "step": 972
+ },
+ {
+ "epoch": 4.916455696202531,
+ "grad_norm": 0.0515705943107605,
+ "learning_rate": 5.6565656565656563e-05,
+ "loss": 0.02983126789331436,
+ "step": 973
+ },
+ {
+ "epoch": 4.921518987341772,
+ "grad_norm": 0.024027375504374504,
+ "learning_rate": 5.650953984287318e-05,
+ "loss": 0.021375803276896477,
+ "step": 974
+ },
+ {
+ "epoch": 4.926582278481012,
+ "grad_norm": 0.03331667557358742,
+ "learning_rate": 5.645342312008979e-05,
+ "loss": 0.021600808948278427,
+ "step": 975
+ },
+ {
+ "epoch": 4.931645569620253,
+ "grad_norm": 0.029174596071243286,
+ "learning_rate": 5.639730639730641e-05,
+ "loss": 0.022452034056186676,
+ "step": 976
+ },
+ {
+ "epoch": 4.936708860759493,
+ "grad_norm": 0.03323808312416077,
+ "learning_rate": 5.634118967452301e-05,
+ "loss": 0.02531963586807251,
+ "step": 977
+ },
+ {
+ "epoch": 4.941772151898734,
+ "grad_norm": 0.02238641493022442,
+ "learning_rate": 5.628507295173963e-05,
+ "loss": 0.01655597612261772,
+ "step": 978
+ },
+ {
+ "epoch": 4.946835443037974,
+ "grad_norm": 0.03279856964945793,
+ "learning_rate": 5.622895622895623e-05,
+ "loss": 0.02232341095805168,
+ "step": 979
+ },
+ {
+ "epoch": 4.951898734177215,
+ "grad_norm": 0.03852152079343796,
+ "learning_rate": 5.617283950617285e-05,
+ "loss": 0.025721147656440735,
+ "step": 980
+ },
+ {
+ "epoch": 4.9569620253164555,
+ "grad_norm": 0.039974186569452286,
+ "learning_rate": 5.611672278338945e-05,
+ "loss": 0.015438543632626534,
+ "step": 981
+ },
+ {
+ "epoch": 4.962025316455696,
+ "grad_norm": 0.0348355695605278,
+ "learning_rate": 5.606060606060606e-05,
+ "loss": 0.021361682564020157,
+ "step": 982
+ },
+ {
+ "epoch": 4.9670886075949365,
+ "grad_norm": 0.02576221525669098,
+ "learning_rate": 5.600448933782267e-05,
+ "loss": 0.02103075385093689,
+ "step": 983
+ },
+ {
+ "epoch": 4.972151898734177,
+ "grad_norm": 0.039421118795871735,
+ "learning_rate": 5.594837261503928e-05,
+ "loss": 0.026340002194046974,
+ "step": 984
+ },
+ {
+ "epoch": 4.977215189873418,
+ "grad_norm": 0.02953593246638775,
+ "learning_rate": 5.58922558922559e-05,
+ "loss": 0.020818116143345833,
+ "step": 985
+ },
+ {
+ "epoch": 4.982278481012658,
+ "grad_norm": 0.033213913440704346,
+ "learning_rate": 5.58361391694725e-05,
+ "loss": 0.020878788083791733,
+ "step": 986
+ },
+ {
+ "epoch": 4.987341772151899,
+ "grad_norm": 0.04450162872672081,
+ "learning_rate": 5.578002244668912e-05,
+ "loss": 0.02208695001900196,
+ "step": 987
+ },
+ {
+ "epoch": 4.992405063291139,
+ "grad_norm": 0.04752403125166893,
+ "learning_rate": 5.572390572390572e-05,
+ "loss": 0.021128743886947632,
+ "step": 988
+ },
+ {
+ "epoch": 4.99746835443038,
+ "grad_norm": 0.03401600942015648,
+ "learning_rate": 5.566778900112234e-05,
+ "loss": 0.020553182810544968,
+ "step": 989
+ },
+ {
+ "epoch": 5.0,
+ "grad_norm": 0.031174728646874428,
+ "learning_rate": 5.561167227833894e-05,
+ "loss": 0.01929999701678753,
+ "step": 990
+ }
+ ],
+ "logging_steps": 1,
+ "max_steps": 1980,
+ "num_input_tokens_seen": 0,
+ "num_train_epochs": 10,
+ "save_steps": 500,
+ "stateful_callbacks": {
+ "TrainerControl": {
+ "args": {
+ "should_epoch_stop": false,
+ "should_evaluate": false,
+ "should_log": false,
+ "should_save": true,
+ "should_training_stop": false
+ },
+ "attributes": {}
+ }
+ },
+ "total_flos": 6.30412778992128e+16,
+ "train_batch_size": 2,
+ "trial_name": null,
+ "trial_params": null
+}
diff --git a/checkpoint-990/training_args.bin b/checkpoint-990/training_args.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ce6b9228ad6cf155da5af64a370f864d5fe04e56
--- /dev/null
+++ b/checkpoint-990/training_args.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3a4d7936dc7001e3baf6e9cead308b6188ace221538f9d436668bdf0b1d43a1
+size 5777
diff --git a/final/README.md b/final/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..9be0791f81b2b47661989d40ff352e2c143824ae
--- /dev/null
+++ b/final/README.md
@@ -0,0 +1,210 @@
+---
+base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/Qwen3-4B-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+---
+
+# Model Card for Model ID
+
+
+
+
+
+## Model Details
+
+### Model Description
+
+
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+
+
+### Direct Use
+
+
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+
+
+[More Information Needed]
+
+### Recommendations
+
+
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+
+
+[More Information Needed]
+
+### Training Procedure
+
+
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed]
+
+#### Speeds, Sizes, Times [optional]
+
+
+
+[More Information Needed]
+
+## Evaluation
+
+
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+[More Information Needed]
+
+#### Factors
+
+
+
+[More Information Needed]
+
+#### Metrics
+
+
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+
+
+[More Information Needed]
+
+## Environmental Impact
+
+
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1
\ No newline at end of file
diff --git a/final/adapter_config.json b/final/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..bbcc7740fbc3841db465c9aa396dca7834e891f0
--- /dev/null
+++ b/final/adapter_config.json
@@ -0,0 +1,52 @@
+{
+ "alora_invocation_tokens": null,
+ "alpha_pattern": {},
+ "arrow_config": null,
+ "auto_mapping": {
+ "base_model_class": "Qwen3ForCausalLM",
+ "parent_library": "transformers.models.qwen3.modeling_qwen3",
+ "unsloth_fixed": true
+ },
+ "base_model_name_or_path": "unsloth/Qwen3-4B-unsloth-bnb-4bit",
+ "bias": "none",
+ "corda_config": null,
+ "ensure_weight_tying": false,
+ "eva_config": null,
+ "exclude_modules": null,
+ "fan_in_fan_out": false,
+ "inference_mode": true,
+ "init_lora_weights": true,
+ "layer_replication": null,
+ "layers_pattern": null,
+ "layers_to_transform": null,
+ "loftq_config": {},
+ "lora_alpha": 16,
+ "lora_bias": false,
+ "lora_dropout": 0.0,
+ "lora_ga_config": null,
+ "megatron_config": null,
+ "megatron_core": "megatron.core",
+ "modules_to_save": null,
+ "peft_type": "LORA",
+ "peft_version": "0.19.1",
+ "qalora_group_size": 16,
+ "r": 16,
+ "rank_pattern": {},
+ "revision": null,
+ "target_modules": [
+ "v_proj",
+ "q_proj",
+ "up_proj",
+ "o_proj",
+ "k_proj",
+ "down_proj",
+ "gate_proj"
+ ],
+ "target_parameters": null,
+ "task_type": "CAUSAL_LM",
+ "trainable_token_indices": null,
+ "use_bdlora": null,
+ "use_dora": false,
+ "use_qalora": false,
+ "use_rslora": false
+}
\ No newline at end of file
diff --git a/final/adapter_model.safetensors b/final/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..dcb60eee965e9ed70e0d9e959e025f75c82f9337
--- /dev/null
+++ b/final/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8636ea19f80e695bcfe6bc0b5a7db4ecdacd046c264199b3e8273f1635c4e078
+size 132187888
diff --git a/final/chat_template.jinja b/final/chat_template.jinja
new file mode 100644
index 0000000000000000000000000000000000000000..ba899982bb3df102af1c0e6979230dd568ae8b5e
--- /dev/null
+++ b/final/chat_template.jinja
@@ -0,0 +1,97 @@
+{%- if tools %}
+ {{- '<|im_start|>system\n' }}
+ {%- if messages[0].role == 'system' %}
+ {{- messages[0].content + '\n\n' }}
+ {%- endif %}
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
+ {%- for tool in tools %}
+ {{- "\n" }}
+ {{- tool | tojson }}
+ {%- endfor %}
+ {{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
+{%- else %}
+ {%- if messages[0].role == 'system' %}
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+ {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+ {%- set index = (messages|length - 1) - loop.index0 %}
+ {%- set message = messages[index] %}
+ {%- set tool_start = '' %}
+ {%- set tool_start_length = tool_start|length %}
+ {%- set start_of_message = message.content[:tool_start_length] %}
+ {%- set tool_end = '' %}
+ {%- set tool_end_length = tool_end|length %}
+ {%- set start_pos = (message.content|length) - tool_end_length %}
+ {%- if start_pos < 0 %}
+ {%- set start_pos = 0 %}
+ {%- endif %}
+ {%- set end_of_message = message.content[start_pos:] %}
+ {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+ {%- set ns.multi_step_tool = false %}
+ {%- set ns.last_query_index = index %}
+ {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+ {%- elif message.role == "assistant" %}
+ {%- set content = message.content %}
+ {%- set reasoning_content = '' %}
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+ {%- set reasoning_content = message.reasoning_content %}
+ {%- else %}
+ {%- if '' in message.content %}
+ {%- set content = (message.content.split('')|last).lstrip('\n') %}
+ {%- set reasoning_content = (message.content.split('')|first).rstrip('\n') %}
+ {%- set reasoning_content = (reasoning_content.split('')|last).lstrip('\n') %}
+ {%- endif %}
+ {%- endif %}
+ {%- if loop.index0 > ns.last_query_index %}
+ {%- if loop.last or (not loop.last and reasoning_content) %}
+ {{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- else %}
+ {{- '<|im_start|>' + message.role + '\n' + content }}
+ {%- endif %}
+ {%- if message.tool_calls %}
+ {%- for tool_call in message.tool_calls %}
+ {%- if (loop.first and content) or (not loop.first) %}
+ {{- '\n' }}
+ {%- endif %}
+ {%- if tool_call.function %}
+ {%- set tool_call = tool_call.function %}
+ {%- endif %}
+ {{- '\n{"name": "' }}
+ {{- tool_call.name }}
+ {{- '", "arguments": ' }}
+ {%- if tool_call.arguments is string %}
+ {{- tool_call.arguments }}
+ {%- else %}
+ {{- tool_call.arguments | tojson }}
+ {%- endif %}
+ {{- '}\n' }}
+ {%- endfor %}
+ {%- endif %}
+ {{- '<|im_end|>\n' }}
+ {%- elif message.role == "tool" %}
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+ {{- '<|im_start|>user' }}
+ {%- endif %}
+ {{- '\n\n' }}
+ {{- message.content }}
+ {{- '\n' }}
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+ {{- '<|im_end|>\n' }}
+ {%- endif %}
+ {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+ {{- '<|im_start|>assistant\n' }}
+ {%- if enable_thinking is defined and enable_thinking is false %}
+ {{- '\n\n\n\n' }}
+ {%- endif %}
+{%- endif %}
\ No newline at end of file
diff --git a/final/tokenizer.json b/final/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..7edcf722addb6c9290899bdb0555a96b2017c7cc
--- /dev/null
+++ b/final/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7430e9138b76e93fb6f93462394d236b411111aef53cb421ba97d2691040cca
+size 11423114
diff --git a/final/tokenizer_config.json b/final/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b3ccb6806694f11c256d6c55a7eb370ff3594a61
--- /dev/null
+++ b/final/tokenizer_config.json
@@ -0,0 +1,234 @@
+{
+ "add_prefix_space": false,
+ "backend": "tokenizers",
+ "bos_token": null,
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|im_end|>",
+ "errors": "replace",
+ "is_local": false,
+ "local_files_only": false,
+ "model_max_length": 40960,
+ "pad_token": "<|PAD_TOKEN|>",
+ "padding_side": "left",
+ "split_special_tokens": false,
+ "tokenizer_class": "Qwen2Tokenizer",
+ "unk_token": null,
+ "added_tokens_decoder": {
+ "151643": {
+ "content": "<|endoftext|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151644": {
+ "content": "<|im_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151645": {
+ "content": "<|im_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151646": {
+ "content": "<|object_ref_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151647": {
+ "content": "<|object_ref_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151648": {
+ "content": "<|box_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151649": {
+ "content": "<|box_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151650": {
+ "content": "<|quad_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151651": {
+ "content": "<|quad_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151652": {
+ "content": "<|vision_start|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151653": {
+ "content": "<|vision_end|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151654": {
+ "content": "<|vision_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151655": {
+ "content": "<|image_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151656": {
+ "content": "<|video_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ },
+ "151657": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151658": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151659": {
+ "content": "<|fim_prefix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151660": {
+ "content": "<|fim_middle|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151661": {
+ "content": "<|fim_suffix|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151662": {
+ "content": "<|fim_pad|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151663": {
+ "content": "<|repo_name|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151664": {
+ "content": "<|file_sep|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151665": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151666": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151667": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151668": {
+ "content": "",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": false
+ },
+ "151669": {
+ "content": "<|PAD_TOKEN|>",
+ "single_word": false,
+ "lstrip": false,
+ "rstrip": false,
+ "normalized": false,
+ "special": true
+ }
+ }
+}