diff --git a/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/README.md b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..38bfcaaee3459afd86547f19cbe6eba476e01969
--- /dev/null
+++ b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/README.md
@@ -0,0 +1,202 @@
+---
+base_model: llava-hf/llava-1.5-7b-hf
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.10.0
\ No newline at end of file
diff --git a/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/adapter_config.json b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..31abc72aecd047c340013ccf760e435ec0d16815
--- /dev/null
+++ b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/adapter_config.json
@@ -0,0 +1,34 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "../checkpoints/llava-1.5-7b-hf",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "o_proj",
+    "down_proj",
+    "up_proj",
+    "v_proj",
+    "k_proj",
+    "gate_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}
\ No newline at end of file
diff --git a/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/adapter_model.safetensors b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..dcd7db91e4f809cb39dbd08e7e7e851fed2c4a3a
--- /dev/null
+++ b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8299af17de2be888694b8fa94ac7ed7638349fb5fe9583a213376c06401bbdbd
+size 639692320
diff --git a/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/config.json b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..50a35d42ec2425acc72e5be7eaa8ea2e099092f4
--- /dev/null
+++ b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/config.json
@@ -0,0 +1,73 @@
+{
+  "_name_or_path": "../checkpoints/llava-1.5-7b-hf",
+  "architectures": [
+    "LlavaForConditionalGeneration"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "freeze_mm_mlp_adapter": false,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "ignore_index": -100,
+  "image_aspect_ratio": "pad",
+  "image_processor_path": "/home/r11kaijun/LLaVA-Med/checkpoints/vision_tower-epoch-1-lr-0.0001",
+  "image_token_index": 32000,
+  "initializer_range": 0.02,
+  "intermediate_size": 11008,
+  "max_position_embeddings": 2048,
+  "mm_hidden_size": 1024,
+  "mm_patch_merge_type": "flat",
+  "mm_projector_lr": 2e-05,
+  "mm_projector_type": "mlp2x_gelu",
+  "mm_use_im_patch_token": false,
+  "mm_use_im_start_end": false,
+  "mm_vision_select_feature": "patch",
+  "mm_vision_select_layer": -2,
+  "mm_vision_tower": "../checkpoints/llava-1.5-7b-hf",
+  "model_type": "llava_llama",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 32,
+  "pad_token_id": 32001,
+  "pretraining_tp": 1,
+  "projector_hidden_act": "gelu",
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 10000.0,
+  "text_config": {
+    "_name_or_path": "lmsys/vicuna-7b-v1.5",
+    "architectures": [
+      "LlamaForCausalLM"
+    ],
+    "max_position_embeddings": 4096,
+    "model_type": "llama",
+    "rms_norm_eps": 1e-05,
+    "torch_dtype": "float16",
+    "vocab_size": 32064
+  },
+  "tie_word_embeddings": false,
+  "tokenizer_model_max_length": 2048,
+  "tokenizer_padding_side": "right",
+  "torch_dtype": "float16",
+  "transformers_version": "4.37.2",
+  "tune_mm_mlp_adapter": false,
+  "use_cache": true,
+  "use_mm_proj": true,
+  "vision_config": {
+    "hidden_size": 1024,
+    "image_size": 336,
+    "intermediate_size": 4096,
+    "model_type": "clip_vision_model",
+    "num_attention_heads": 16,
+    "num_hidden_layers": 24,
+    "patch_size": 14,
+    "projection_dim": 768,
+    "vocab_size": 32000
+  },
+  "vision_feature_layer": -2,
+  "vision_feature_select_strategy": "default",
+  "vision_tower_path": "/home/r11kaijun/LLaVA-Med/checkpoints/vision_tower-epoch-1-lr-0.0001",
+  "vocab_size": 32064
+}
diff --git a/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/non_lora_trainables.bin b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/non_lora_trainables.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d656a697b17d7a8e669937733d38350de02e101f
--- /dev/null
+++ b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/non_lora_trainables.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:86d6cb17206b12a489c5b0818ecad5c5f0556922774613a5717d9fb995c87ee7
+size 41961648
diff --git a/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/trainer_state.json b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..f6ac92a36cba09f1365fbcf25716ff56dfbb4c4e
--- /dev/null
+++ b/lora-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-1-lr-2e-4/trainer_state.json
@@ -0,0 +1,10530 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.0,
+  "eval_steps": 500,
+  "global_step": 1750,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.0,
+      "learning_rate": 3.7735849056603773e-06,
+      "loss": 11.1516,
+      "step": 1
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 7.547169811320755e-06,
+      "loss": 11.1001,
+      "step": 2
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 1.1320754716981132e-05,
+      "loss": 11.0533,
+      "step": 3
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 1.509433962264151e-05,
+      "loss": 10.788,
+      "step": 4
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 1.8867924528301888e-05,
+      "loss": 10.592,
+      "step": 5
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 2.2641509433962265e-05,
+      "loss": 10.2507,
+      "step": 6
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 2.641509433962264e-05,
+      "loss": 9.9469,
+      "step": 7
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 3.018867924528302e-05,
+      "loss": 9.814,
+      "step": 8
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 3.39622641509434e-05,
+      "loss": 9.5728,
+      "step": 9
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 3.7735849056603776e-05,
+      "loss": 9.3391,
+      "step": 10
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 4.150943396226415e-05,
+      "loss": 9.0996,
+      "step": 11
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 4.528301886792453e-05,
+      "loss": 8.8303,
+      "step": 12
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 4.9056603773584906e-05,
+      "loss": 8.5624,
+      "step": 13
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 5.283018867924528e-05,
+      "loss": 8.6362,
+      "step": 14
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 5.660377358490566e-05,
+      "loss": 8.1031,
+      "step": 15
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 6.037735849056604e-05,
+      "loss": 7.9924,
+      "step": 16
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 6.415094339622641e-05,
+      "loss": 7.8833,
+      "step": 17
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 6.79245283018868e-05,
+      "loss": 7.7174,
+      "step": 18
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 7.169811320754717e-05,
+      "loss": 7.5573,
+      "step": 19
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 7.547169811320755e-05,
+      "loss": 7.4214,
+      "step": 20
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 7.924528301886794e-05,
+      "loss": 7.2181,
+      "step": 21
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 8.30188679245283e-05,
+      "loss": 7.2996,
+      "step": 22
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 8.679245283018869e-05,
+      "loss": 7.0584,
+      "step": 23
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 9.056603773584906e-05,
+      "loss": 7.2005,
+      "step": 24
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 9.433962264150944e-05,
+      "loss": 6.8055,
+      "step": 25
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 9.811320754716981e-05,
+      "loss": 6.6885,
+      "step": 26
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.0001018867924528302,
+      "loss": 6.8155,
+      "step": 27
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00010566037735849057,
+      "loss": 6.8168,
+      "step": 28
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00010943396226415095,
+      "loss": 6.7501,
+      "step": 29
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00011320754716981132,
+      "loss": 6.7967,
+      "step": 30
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.0001169811320754717,
+      "loss": 6.4707,
+      "step": 31
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00012075471698113207,
+      "loss": 6.4339,
+      "step": 32
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00012452830188679244,
+      "loss": 6.1615,
+      "step": 33
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00012830188679245283,
+      "loss": 7.0322,
+      "step": 34
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.0001320754716981132,
+      "loss": 6.5169,
+      "step": 35
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.0001358490566037736,
+      "loss": 6.9967,
+      "step": 36
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00013962264150943395,
+      "loss": 7.0238,
+      "step": 37
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00014339622641509434,
+      "loss": 6.758,
+      "step": 38
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00014716981132075472,
+      "loss": 6.6073,
+      "step": 39
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.0001509433962264151,
+      "loss": 6.2644,
+      "step": 40
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.0001547169811320755,
+      "loss": 6.7375,
+      "step": 41
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00015849056603773587,
+      "loss": 6.1794,
+      "step": 42
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 0.00016226415094339625,
+      "loss": 6.3443,
+      "step": 43
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.0001660377358490566,
+      "loss": 6.6697,
+      "step": 44
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.000169811320754717,
+      "loss": 6.6005,
+      "step": 45
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00017358490566037738,
+      "loss": 6.3549,
+      "step": 46
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00017735849056603776,
+      "loss": 6.0068,
+      "step": 47
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00018113207547169812,
+      "loss": 5.3664,
+      "step": 48
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.0001849056603773585,
+      "loss": 5.7696,
+      "step": 49
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00018867924528301889,
+      "loss": 5.8372,
+      "step": 50
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00019245283018867927,
+      "loss": 6.2557,
+      "step": 51
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00019622641509433963,
+      "loss": 5.9391,
+      "step": 52
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.0002,
+      "loss": 6.18,
+      "step": 53
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00019999982864138592,
+      "loss": 5.8357,
+      "step": 54
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00019999931456613087,
+      "loss": 5.7905,
+      "step": 55
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00019999845777599675,
+      "loss": 5.348,
+      "step": 56
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00019999725827391987,
+      "loss": 5.1987,
+      "step": 57
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00019999571606401119,
+      "loss": 5.1754,
+      "step": 58
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00019999383115155606,
+      "loss": 5.127,
+      "step": 59
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.00019999160354301442,
+      "loss": 5.1608,
+      "step": 60
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 0.0001999890332460207,
+      "loss": 4.9803,
+      "step": 61
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019998612026938376,
+      "loss": 4.6403,
+      "step": 62
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.0001999828646230868,
+      "loss": 4.6301,
+      "step": 63
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019997926631828755,
+      "loss": 5.0944,
+      "step": 64
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.000199975325367318,
+      "loss": 4.6612,
+      "step": 65
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019997104178368444,
+      "loss": 4.7172,
+      "step": 66
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019996641558206747,
+      "loss": 4.4929,
+      "step": 67
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.0001999614467783219,
+      "loss": 4.4256,
+      "step": 68
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.0001999561353894767,
+      "loss": 4.55,
+      "step": 69
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019995048143373482,
+      "loss": 4.8045,
+      "step": 70
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.0001999444849304734,
+      "loss": 4.7291,
+      "step": 71
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.0001999381459002435,
+      "loss": 4.1021,
+      "step": 72
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019993146436477003,
+      "loss": 4.0845,
+      "step": 73
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019992444034695178,
+      "loss": 4.3397,
+      "step": 74
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019991707387086134,
+      "loss": 4.2493,
+      "step": 75
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019990936496174479,
+      "loss": 3.8216,
+      "step": 76
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019990131364602188,
+      "loss": 4.0772,
+      "step": 77
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 0.00019989291995128596,
+      "loss": 3.7481,
+      "step": 78
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.0001998841839063036,
+      "loss": 3.6638,
+      "step": 79
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019987510554101472,
+      "loss": 3.6578,
+      "step": 80
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.0001998656848865325,
+      "loss": 4.0104,
+      "step": 81
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.0001998559219751431,
+      "loss": 3.6268,
+      "step": 82
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.0001998458168403057,
+      "loss": 3.9657,
+      "step": 83
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019983536951665234,
+      "loss": 3.2847,
+      "step": 84
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019982458003998783,
+      "loss": 3.3277,
+      "step": 85
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.0001998134484472895,
+      "loss": 3.8647,
+      "step": 86
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019980197477670732,
+      "loss": 3.743,
+      "step": 87
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.0001997901590675635,
+      "loss": 3.5542,
+      "step": 88
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019977800136035246,
+      "loss": 3.4194,
+      "step": 89
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019976550169674084,
+      "loss": 3.7425,
+      "step": 90
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.0001997526601195671,
+      "loss": 3.5173,
+      "step": 91
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.0001997394766728415,
+      "loss": 3.4379,
+      "step": 92
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019972595140174603,
+      "loss": 3.3112,
+      "step": 93
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019971208435263415,
+      "loss": 3.6013,
+      "step": 94
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019969787557303056,
+      "loss": 3.5222,
+      "step": 95
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 0.00019968332511163125,
+      "loss": 3.0503,
+      "step": 96
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019966843301830314,
+      "loss": 3.5132,
+      "step": 97
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019965319934408399,
+      "loss": 3.4347,
+      "step": 98
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019963762414118225,
+      "loss": 3.8351,
+      "step": 99
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019962170746297674,
+      "loss": 3.4224,
+      "step": 100
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.0001996054493640168,
+      "loss": 3.4203,
+      "step": 101
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019958884990002162,
+      "loss": 3.2861,
+      "step": 102
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019957190912788046,
+      "loss": 3.3349,
+      "step": 103
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019955462710565227,
+      "loss": 3.0552,
+      "step": 104
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019953700389256553,
+      "loss": 3.5212,
+      "step": 105
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.000199519039549018,
+      "loss": 3.3598,
+      "step": 106
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019950073413657661,
+      "loss": 3.4891,
+      "step": 107
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019948208771797713,
+      "loss": 3.1753,
+      "step": 108
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019946310035712407,
+      "loss": 3.1832,
+      "step": 109
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019944377211909037,
+      "loss": 3.2215,
+      "step": 110
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019942410307011724,
+      "loss": 3.4807,
+      "step": 111
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.00019940409327761394,
+      "loss": 3.4181,
+      "step": 112
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 0.0001993837428101574,
+      "loss": 2.8862,
+      "step": 113
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.00019936305173749223,
+      "loss": 2.9026,
+      "step": 114
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.0001993420201305303,
+      "loss": 3.1049,
+      "step": 115
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.00019932064806135052,
+      "loss": 3.0855,
+      "step": 116
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.0001992989356031987,
+      "loss": 2.8666,
+      "step": 117
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.0001992768828304871,
+      "loss": 3.1208,
+      "step": 118
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.0001992544898187944,
+      "loss": 3.2984,
+      "step": 119
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.00019923175664486538,
+      "loss": 2.8715,
+      "step": 120
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.00019920868338661046,
+      "loss": 3.5602,
+      "step": 121
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.0001991852701231057,
+      "loss": 3.2682,
+      "step": 122
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.0001991615169345924,
+      "loss": 2.9842,
+      "step": 123
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.00019913742390247682,
+      "loss": 3.0912,
+      "step": 124
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.00019911299110932996,
+      "loss": 3.2519,
+      "step": 125
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.00019908821863888712,
+      "loss": 3.4274,
+      "step": 126
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.0001990631065760479,
+      "loss": 3.0152,
+      "step": 127
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.00019903765500687567,
+      "loss": 3.1532,
+      "step": 128
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.0001990118640185973,
+      "loss": 3.1664,
+      "step": 129
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.000198985733699603,
+      "loss": 2.9954,
+      "step": 130
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 0.00019895926413944582,
+      "loss": 3.2371,
+      "step": 131
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019893245542884156,
+      "loss": 3.3999,
+      "step": 132
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019890530765966823,
+      "loss": 3.2906,
+      "step": 133
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019887782092496597,
+      "loss": 3.3508,
+      "step": 134
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.0001988499953189365,
+      "loss": 3.137,
+      "step": 135
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019882183093694302,
+      "loss": 3.263,
+      "step": 136
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019879332787550968,
+      "loss": 3.067,
+      "step": 137
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.0001987644862323214,
+      "loss": 3.4127,
+      "step": 138
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019873530610622347,
+      "loss": 2.9921,
+      "step": 139
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019870578759722117,
+      "loss": 3.22,
+      "step": 140
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019867593080647952,
+      "loss": 2.7924,
+      "step": 141
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019864573583632295,
+      "loss": 2.8433,
+      "step": 142
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019861520279023477,
+      "loss": 3.25,
+      "step": 143
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.000198584331772857,
+      "loss": 2.8412,
+      "step": 144
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019855312288998993,
+      "loss": 3.2488,
+      "step": 145
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.0001985215762485918,
+      "loss": 2.9692,
+      "step": 146
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019848969195677832,
+      "loss": 3.129,
+      "step": 147
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 0.00019845747012382255,
+      "loss": 2.9353,
+      "step": 148
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019842491086015417,
+      "loss": 2.9263,
+      "step": 149
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019839201427735947,
+      "loss": 2.7454,
+      "step": 150
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019835878048818066,
+      "loss": 2.6813,
+      "step": 151
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019832520960651564,
+      "loss": 3.2257,
+      "step": 152
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019829130174741762,
+      "loss": 2.803,
+      "step": 153
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019825705702709474,
+      "loss": 2.8344,
+      "step": 154
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019822247556290946,
+      "loss": 3.0551,
+      "step": 155
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019818755747337847,
+      "loss": 2.6836,
+      "step": 156
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019815230287817208,
+      "loss": 2.6149,
+      "step": 157
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019811671189811386,
+      "loss": 2.7574,
+      "step": 158
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019808078465518016,
+      "loss": 2.7014,
+      "step": 159
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019804452127249994,
+      "loss": 2.7006,
+      "step": 160
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.000198007921874354,
+      "loss": 2.7681,
+      "step": 161
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.0001979709865861748,
+      "loss": 2.499,
+      "step": 162
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019793371553454588,
+      "loss": 2.6372,
+      "step": 163
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019789610884720166,
+      "loss": 2.9513,
+      "step": 164
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019785816665302667,
+      "loss": 2.3745,
+      "step": 165
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 0.00019781988908205533,
+      "loss": 2.6894,
+      "step": 166
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019778127626547153,
+      "loss": 2.973,
+      "step": 167
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019774232833560796,
+      "loss": 3.0194,
+      "step": 168
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.000197703045425946,
+      "loss": 2.5732,
+      "step": 169
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019766342767111483,
+      "loss": 2.4344,
+      "step": 170
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019762347520689143,
+      "loss": 3.1938,
+      "step": 171
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019758318817019967,
+      "loss": 2.4041,
+      "step": 172
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019754256669911023,
+      "loss": 2.5791,
+      "step": 173
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019750161093283993,
+      "loss": 2.8989,
+      "step": 174
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019746032101175117,
+      "loss": 2.9055,
+      "step": 175
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019741869707735158,
+      "loss": 2.4665,
+      "step": 176
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019737673927229367,
+      "loss": 2.9517,
+      "step": 177
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.000197334447740374,
+      "loss": 2.9555,
+      "step": 178
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019729182262653297,
+      "loss": 2.5813,
+      "step": 179
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019724886407685411,
+      "loss": 2.2617,
+      "step": 180
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019720557223856387,
+      "loss": 2.8019,
+      "step": 181
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019716194726003078,
+      "loss": 2.5631,
+      "step": 182
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 0.00019711798929076518,
+      "loss": 2.8676,
+      "step": 183
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019707369848141862,
+      "loss": 2.8506,
+      "step": 184
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019702907498378328,
+      "loss": 2.4993,
+      "step": 185
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019698411895079158,
+      "loss": 2.5712,
+      "step": 186
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019693883053651566,
+      "loss": 2.7435,
+      "step": 187
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019689320989616665,
+      "loss": 2.5876,
+      "step": 188
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019684725718609438,
+      "loss": 2.626,
+      "step": 189
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019680097256378668,
+      "loss": 3.1402,
+      "step": 190
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019675435618786893,
+      "loss": 2.6178,
+      "step": 191
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019670740821810348,
+      "loss": 2.7436,
+      "step": 192
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019666012881538913,
+      "loss": 2.9183,
+      "step": 193
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019661251814176054,
+      "loss": 2.4663,
+      "step": 194
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019656457636038765,
+      "loss": 2.7965,
+      "step": 195
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019651630363557527,
+      "loss": 2.1567,
+      "step": 196
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019646770013276226,
+      "loss": 2.7182,
+      "step": 197
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.00019641876601852128,
+      "loss": 2.9626,
+      "step": 198
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.0001963695014605579,
+      "loss": 3.0941,
+      "step": 199
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.0001963199066277103,
+      "loss": 2.8599,
+      "step": 200
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 0.0001962699816899485,
+      "loss": 2.7466,
+      "step": 201
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019621972681837385,
+      "loss": 2.6624,
+      "step": 202
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019616914218521849,
+      "loss": 2.5388,
+      "step": 203
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019611822796384461,
+      "loss": 2.5389,
+      "step": 204
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019606698432874406,
+      "loss": 2.5231,
+      "step": 205
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019601541145553762,
+      "loss": 2.3653,
+      "step": 206
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019596350952097438,
+      "loss": 2.6823,
+      "step": 207
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019591127870293123,
+      "loss": 2.5414,
+      "step": 208
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019585871918041217,
+      "loss": 2.6983,
+      "step": 209
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019580583113354774,
+      "loss": 2.7229,
+      "step": 210
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.0001957526147435944,
+      "loss": 2.9091,
+      "step": 211
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019569907019293385,
+      "loss": 2.5197,
+      "step": 212
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019564519766507256,
+      "loss": 2.8052,
+      "step": 213
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.0001955909973446409,
+      "loss": 2.6833,
+      "step": 214
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.0001955364694173927,
+      "loss": 2.4054,
+      "step": 215
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019548161407020466,
+      "loss": 2.7406,
+      "step": 216
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019542643149107538,
+      "loss": 2.6569,
+      "step": 217
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 0.00019537092186912514,
+      "loss": 2.5562,
+      "step": 218
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019531508539459496,
+      "loss": 2.393,
+      "step": 219
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019525892225884605,
+      "loss": 2.5721,
+      "step": 220
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019520243265435915,
+      "loss": 2.3187,
+      "step": 221
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019514561677473388,
+      "loss": 2.9717,
+      "step": 222
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019508847481468806,
+      "loss": 2.7771,
+      "step": 223
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.000195031006970057,
+      "loss": 2.5152,
+      "step": 224
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019497321343779292,
+      "loss": 2.3614,
+      "step": 225
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.0001949150944159642,
+      "loss": 2.5835,
+      "step": 226
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019485665010375474,
+      "loss": 2.5347,
+      "step": 227
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.0001947978807014633,
+      "loss": 2.3691,
+      "step": 228
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019473878641050274,
+      "loss": 2.5052,
+      "step": 229
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019467936743339934,
+      "loss": 2.6198,
+      "step": 230
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019461962397379222,
+      "loss": 2.4241,
+      "step": 231
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019455955623643242,
+      "loss": 2.3211,
+      "step": 232
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019449916442718253,
+      "loss": 2.3206,
+      "step": 233
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019443844875301563,
+      "loss": 2.3988,
+      "step": 234
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019437740942201482,
+      "loss": 2.9787,
+      "step": 235
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 0.00019431604664337234,
+      "loss": 2.6592,
+      "step": 236
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019425436062738908,
+      "loss": 2.1848,
+      "step": 237
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019419235158547364,
+      "loss": 2.4102,
+      "step": 238
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019413001973014166,
+      "loss": 2.6875,
+      "step": 239
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019406736527501512,
+      "loss": 2.2944,
+      "step": 240
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019400438843482172,
+      "loss": 2.445,
+      "step": 241
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019394108942539384,
+      "loss": 2.1311,
+      "step": 242
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019387746846366815,
+      "loss": 2.3819,
+      "step": 243
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019381352576768463,
+      "loss": 2.2519,
+      "step": 244
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019374926155658594,
+      "loss": 2.289,
+      "step": 245
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019368467605061657,
+      "loss": 2.2024,
+      "step": 246
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019361976947112217,
+      "loss": 2.3603,
+      "step": 247
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.0001935545420405488,
+      "loss": 2.3351,
+      "step": 248
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.0001934889939824421,
+      "loss": 2.0922,
+      "step": 249
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019342312552144656,
+      "loss": 2.5393,
+      "step": 250
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019335693688330468,
+      "loss": 2.4631,
+      "step": 251
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.00019329042829485644,
+      "loss": 2.0325,
+      "step": 252
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 0.0001932235999840381,
+      "loss": 2.2927,
+      "step": 253
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.0001931564521798819,
+      "loss": 2.4118,
+      "step": 254
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019308898511251492,
+      "loss": 3.0812,
+      "step": 255
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.0001930211990131584,
+      "loss": 2.6356,
+      "step": 256
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019295309411412697,
+      "loss": 2.5943,
+      "step": 257
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019288467064882783,
+      "loss": 2.4095,
+      "step": 258
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019281592885176006,
+      "loss": 2.5081,
+      "step": 259
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019274686895851356,
+      "loss": 2.3581,
+      "step": 260
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019267749120576854,
+      "loss": 2.267,
+      "step": 261
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.0001926077958312945,
+      "loss": 2.2912,
+      "step": 262
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019253778307394946,
+      "loss": 2.2738,
+      "step": 263
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019246745317367926,
+      "loss": 2.0266,
+      "step": 264
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019239680637151652,
+      "loss": 2.359,
+      "step": 265
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019232584290958005,
+      "loss": 2.4635,
+      "step": 266
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019225456303107385,
+      "loss": 2.258,
+      "step": 267
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019218296698028634,
+      "loss": 2.2323,
+      "step": 268
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.0001921110550025895,
+      "loss": 2.1911,
+      "step": 269
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.0001920388273444381,
+      "loss": 2.454,
+      "step": 270
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 0.00019196628425336877,
+      "loss": 2.5697,
+      "step": 271
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019189342597799916,
+      "loss": 2.3349,
+      "step": 272
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019182025276802712,
+      "loss": 2.0058,
+      "step": 273
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019174676487422983,
+      "loss": 2.3031,
+      "step": 274
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019167296254846304,
+      "loss": 2.365,
+      "step": 275
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019159884604366,
+      "loss": 2.5012,
+      "step": 276
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019152441561383072,
+      "loss": 2.3732,
+      "step": 277
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019144967151406116,
+      "loss": 2.3486,
+      "step": 278
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.0001913746140005121,
+      "loss": 2.5776,
+      "step": 279
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019129924333041872,
+      "loss": 2.5373,
+      "step": 280
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019122355976208924,
+      "loss": 2.4349,
+      "step": 281
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019114756355490423,
+      "loss": 2.4321,
+      "step": 282
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019107125496931583,
+      "loss": 2.6042,
+      "step": 283
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019099463426684672,
+      "loss": 2.167,
+      "step": 284
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019091770171008926,
+      "loss": 2.3064,
+      "step": 285
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019084045756270453,
+      "loss": 2.5465,
+      "step": 286
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019076290208942155,
+      "loss": 2.0073,
+      "step": 287
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 0.00019068503555603629,
+      "loss": 2.2504,
+      "step": 288
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.0001906068582294108,
+      "loss": 2.2322,
+      "step": 289
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.0001905283703774722,
+      "loss": 2.4445,
+      "step": 290
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00019044957226921195,
+      "loss": 2.5596,
+      "step": 291
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00019037046417468462,
+      "loss": 2.3947,
+      "step": 292
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00019029104636500744,
+      "loss": 2.2694,
+      "step": 293
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00019021131911235877,
+      "loss": 2.2506,
+      "step": 294
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00019013128268997775,
+      "loss": 2.4782,
+      "step": 295
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00019005093737216292,
+      "loss": 2.5962,
+      "step": 296
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.0001899702834342716,
+      "loss": 2.1973,
+      "step": 297
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00018988932115271867,
+      "loss": 2.4118,
+      "step": 298
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00018980805080497584,
+      "loss": 2.3004,
+      "step": 299
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00018972647266957056,
+      "loss": 2.6015,
+      "step": 300
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.0001896445870260852,
+      "loss": 2.2191,
+      "step": 301
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00018956239415515594,
+      "loss": 2.125,
+      "step": 302
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00018947989433847195,
+      "loss": 2.021,
+      "step": 303
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00018939708785877427,
+      "loss": 2.2727,
+      "step": 304
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00018931397499985498,
+      "loss": 2.4502,
+      "step": 305
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 0.00018923055604655616,
+      "loss": 2.4235,
+      "step": 306
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018914683128476897,
+      "loss": 2.3096,
+      "step": 307
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018906280100143257,
+      "loss": 2.2697,
+      "step": 308
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.0001889784654845332,
+      "loss": 2.3037,
+      "step": 309
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018889382502310326,
+      "loss": 2.2377,
+      "step": 310
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018880887990722008,
+      "loss": 2.2691,
+      "step": 311
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018872363042800533,
+      "loss": 2.1425,
+      "step": 312
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018863807687762363,
+      "loss": 2.3374,
+      "step": 313
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.0001885522195492817,
+      "loss": 2.3965,
+      "step": 314
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018846605873722744,
+      "loss": 2.3981,
+      "step": 315
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018837959473674875,
+      "loss": 2.3996,
+      "step": 316
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.0001882928278441727,
+      "loss": 2.3242,
+      "step": 317
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018820575835686433,
+      "loss": 2.354,
+      "step": 318
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018811838657322585,
+      "loss": 2.1406,
+      "step": 319
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018803071279269534,
+      "loss": 2.0716,
+      "step": 320
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.000187942737315746,
+      "loss": 2.3447,
+      "step": 321
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018785446044388492,
+      "loss": 2.3101,
+      "step": 322
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 0.00018776588247965213,
+      "loss": 2.294,
+      "step": 323
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.0001876770037266196,
+      "loss": 2.3523,
+      "step": 324
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018758782448939014,
+      "loss": 2.3055,
+      "step": 325
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018749834507359632,
+      "loss": 2.6953,
+      "step": 326
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018740856578589957,
+      "loss": 2.5611,
+      "step": 327
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018731848693398894,
+      "loss": 2.1672,
+      "step": 328
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018722810882658018,
+      "loss": 1.9474,
+      "step": 329
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018713743177341466,
+      "loss": 2.1925,
+      "step": 330
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.0001870464560852582,
+      "loss": 2.3115,
+      "step": 331
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.0001869551820739002,
+      "loss": 2.2371,
+      "step": 332
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.0001868636100521524,
+      "loss": 2.1244,
+      "step": 333
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018677174033384796,
+      "loss": 2.3845,
+      "step": 334
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018667957323384015,
+      "loss": 2.4104,
+      "step": 335
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018658710906800153,
+      "loss": 2.3439,
+      "step": 336
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018649434815322277,
+      "loss": 2.36,
+      "step": 337
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018640129080741146,
+      "loss": 2.3242,
+      "step": 338
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018630793734949113,
+      "loss": 2.2643,
+      "step": 339
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018621428809940022,
+      "loss": 2.5654,
+      "step": 340
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 0.00018612034337809079,
+      "loss": 2.6275,
+      "step": 341
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018602610350752766,
+      "loss": 2.2065,
+      "step": 342
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018593156881068702,
+      "loss": 2.0575,
+      "step": 343
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018583673961155564,
+      "loss": 2.2512,
+      "step": 344
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018574161623512945,
+      "loss": 2.2092,
+      "step": 345
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018564619900741266,
+      "loss": 2.1601,
+      "step": 346
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.0001855504882554166,
+      "loss": 2.1867,
+      "step": 347
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.0001854544843071585,
+      "loss": 1.9798,
+      "step": 348
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018535818749166038,
+      "loss": 2.0916,
+      "step": 349
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018526159813894805,
+      "loss": 2.1335,
+      "step": 350
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018516471658004986,
+      "loss": 2.0547,
+      "step": 351
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018506754314699558,
+      "loss": 2.4789,
+      "step": 352
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018497007817281535,
+      "loss": 2.6466,
+      "step": 353
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.0001848723219915384,
+      "loss": 2.4612,
+      "step": 354
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.000184774274938192,
+      "loss": 2.4226,
+      "step": 355
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018467593734880028,
+      "loss": 2.2052,
+      "step": 356
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018457730956038316,
+      "loss": 2.393,
+      "step": 357
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 0.00018447839191095504,
+      "loss": 2.2205,
+      "step": 358
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.0001843791847395237,
+      "loss": 2.1361,
+      "step": 359
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018427968838608924,
+      "loss": 2.0848,
+      "step": 360
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018417990319164279,
+      "loss": 1.9937,
+      "step": 361
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018407982949816547,
+      "loss": 2.8084,
+      "step": 362
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018397946764862696,
+      "loss": 2.457,
+      "step": 363
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.0001838788179869847,
+      "loss": 2.2054,
+      "step": 364
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018377788085818236,
+      "loss": 2.5446,
+      "step": 365
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018367665660814892,
+      "loss": 2.0705,
+      "step": 366
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.0001835751455837973,
+      "loss": 2.2234,
+      "step": 367
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018347334813302325,
+      "loss": 2.2688,
+      "step": 368
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018337126460470419,
+      "loss": 2.28,
+      "step": 369
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018326889534869795,
+      "loss": 1.9819,
+      "step": 370
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018316624071584164,
+      "loss": 2.5736,
+      "step": 371
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018306330105795034,
+      "loss": 1.8844,
+      "step": 372
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.000182960076727816,
+      "loss": 2.1309,
+      "step": 373
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018285656807920617,
+      "loss": 1.7771,
+      "step": 374
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018275277546686284,
+      "loss": 2.0835,
+      "step": 375
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 0.00018264869924650119,
+      "loss": 2.4184,
+      "step": 376
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.0001825443397748083,
+      "loss": 2.09,
+      "step": 377
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018243969740944213,
+      "loss": 2.1374,
+      "step": 378
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018233477250903003,
+      "loss": 2.5695,
+      "step": 379
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018222956543316777,
+      "loss": 2.1977,
+      "step": 380
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018212407654241805,
+      "loss": 2.2248,
+      "step": 381
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018201830619830956,
+      "loss": 2.4674,
+      "step": 382
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018191225476333543,
+      "loss": 2.28,
+      "step": 383
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.0001818059226009522,
+      "loss": 1.911,
+      "step": 384
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018169931007557856,
+      "loss": 2.1439,
+      "step": 385
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018159241755259396,
+      "loss": 2.4142,
+      "step": 386
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018148524539833748,
+      "loss": 1.8965,
+      "step": 387
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.0001813777939801066,
+      "loss": 2.2893,
+      "step": 388
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018127006366615577,
+      "loss": 2.3093,
+      "step": 389
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018116205482569543,
+      "loss": 1.9409,
+      "step": 390
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018105376782889042,
+      "loss": 2.0133,
+      "step": 391
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018094520304685899,
+      "loss": 2.5783,
+      "step": 392
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 0.00018083636085167127,
+      "loss": 2.2316,
+      "step": 393
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00018072724161634826,
+      "loss": 2.5768,
+      "step": 394
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.0001806178457148604,
+      "loss": 1.9601,
+      "step": 395
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00018050817352212626,
+      "loss": 2.108,
+      "step": 396
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00018039822541401134,
+      "loss": 1.9058,
+      "step": 397
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00018028800176732676,
+      "loss": 1.9026,
+      "step": 398
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00018017750295982795,
+      "loss": 2.0288,
+      "step": 399
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00018006672937021336,
+      "loss": 2.3826,
+      "step": 400
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00017995568137812312,
+      "loss": 2.4956,
+      "step": 401
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00017984435936413792,
+      "loss": 2.0199,
+      "step": 402
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.0001797327637097774,
+      "loss": 2.0405,
+      "step": 403
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00017962089479749916,
+      "loss": 1.7553,
+      "step": 404
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00017950875301069713,
+      "loss": 2.0065,
+      "step": 405
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00017939633873370066,
+      "loss": 2.2475,
+      "step": 406
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00017928365235177278,
+      "loss": 2.4158,
+      "step": 407
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00017917069425110914,
+      "loss": 2.1398,
+      "step": 408
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.0001790574648188366,
+      "loss": 2.218,
+      "step": 409
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00017894396444301193,
+      "loss": 2.2982,
+      "step": 410
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 0.00017883019351262053,
+      "loss": 2.4536,
+      "step": 411
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017871615241757491,
+      "loss": 2.1546,
+      "step": 412
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017860184154871357,
+      "loss": 2.03,
+      "step": 413
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017848726129779955,
+      "loss": 2.3459,
+      "step": 414
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017837241205751915,
+      "loss": 1.955,
+      "step": 415
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017825729422148046,
+      "loss": 2.2059,
+      "step": 416
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017814190818421212,
+      "loss": 2.1836,
+      "step": 417
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017802625434116203,
+      "loss": 2.2005,
+      "step": 418
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017791033308869577,
+      "loss": 2.3204,
+      "step": 419
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017779414482409548,
+      "loss": 1.9079,
+      "step": 420
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.0001776776899455583,
+      "loss": 1.8369,
+      "step": 421
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017756096885219525,
+      "loss": 2.1036,
+      "step": 422
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017744398194402956,
+      "loss": 1.7783,
+      "step": 423
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017732672962199555,
+      "loss": 2.4767,
+      "step": 424
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.0001772092122879371,
+      "loss": 2.1763,
+      "step": 425
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.0001770914303446064,
+      "loss": 1.8721,
+      "step": 426
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017697338419566245,
+      "loss": 1.9256,
+      "step": 427
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 0.00017685507424566968,
+      "loss": 2.4181,
+      "step": 428
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.0001767365009000968,
+      "loss": 2.1372,
+      "step": 429
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017661766456531498,
+      "loss": 2.522,
+      "step": 430
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.0001764985656485968,
+      "loss": 1.986,
+      "step": 431
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017637920455811489,
+      "loss": 2.2933,
+      "step": 432
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017625958170294014,
+      "loss": 2.2244,
+      "step": 433
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017613969749304074,
+      "loss": 2.1162,
+      "step": 434
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017601955233928056,
+      "loss": 1.7318,
+      "step": 435
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.0001758991466534177,
+      "loss": 1.9831,
+      "step": 436
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.0001757784808481032,
+      "loss": 2.2918,
+      "step": 437
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017565755533687955,
+      "loss": 2.1271,
+      "step": 438
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017553637053417936,
+      "loss": 2.1554,
+      "step": 439
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017541492685532376,
+      "loss": 1.9027,
+      "step": 440
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017529322471652117,
+      "loss": 1.9628,
+      "step": 441
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.0001751712645348658,
+      "loss": 2.0448,
+      "step": 442
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017504904672833627,
+      "loss": 2.0662,
+      "step": 443
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017492657171579395,
+      "loss": 1.8612,
+      "step": 444
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017480383991698187,
+      "loss": 2.0109,
+      "step": 445
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 0.00017468085175252303,
+      "loss": 2.1546,
+      "step": 446
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.0001745576076439191,
+      "loss": 1.8819,
+      "step": 447
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017443410801354882,
+      "loss": 2.1897,
+      "step": 448
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017431035328466672,
+      "loss": 2.4183,
+      "step": 449
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017418634388140155,
+      "loss": 1.5322,
+      "step": 450
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017406208022875496,
+      "loss": 1.8965,
+      "step": 451
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017393756275259982,
+      "loss": 2.5062,
+      "step": 452
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017381279187967904,
+      "loss": 2.0735,
+      "step": 453
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017368776803760387,
+      "loss": 1.8848,
+      "step": 454
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017356249165485256,
+      "loss": 2.1948,
+      "step": 455
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017343696316076884,
+      "loss": 2.2882,
+      "step": 456
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.0001733111829855605,
+      "loss": 1.6359,
+      "step": 457
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017318515156029788,
+      "loss": 2.064,
+      "step": 458
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017305886931691234,
+      "loss": 1.9348,
+      "step": 459
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017293233668819497,
+      "loss": 2.017,
+      "step": 460
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017280555410779483,
+      "loss": 2.1276,
+      "step": 461
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017267852201021766,
+      "loss": 1.8849,
+      "step": 462
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 0.00017255124083082434,
+      "loss": 2.1077,
+      "step": 463
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017242371100582946,
+      "loss": 1.9061,
+      "step": 464
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.0001722959329722996,
+      "loss": 2.0388,
+      "step": 465
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.0001721679071681522,
+      "loss": 1.7763,
+      "step": 466
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017203963403215368,
+      "loss": 2.0734,
+      "step": 467
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017191111400391825,
+      "loss": 2.113,
+      "step": 468
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017178234752390607,
+      "loss": 1.8952,
+      "step": 469
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017165333503342214,
+      "loss": 2.3585,
+      "step": 470
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017152407697461447,
+      "loss": 2.0016,
+      "step": 471
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.0001713945737904727,
+      "loss": 2.3375,
+      "step": 472
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017126482592482654,
+      "loss": 1.6838,
+      "step": 473
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017113483382234426,
+      "loss": 1.8145,
+      "step": 474
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017100459792853125,
+      "loss": 2.081,
+      "step": 475
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017087411868972832,
+      "loss": 1.808,
+      "step": 476
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017074339655311028,
+      "loss": 2.1745,
+      "step": 477
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017061243196668445,
+      "loss": 1.9697,
+      "step": 478
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017048122537928904,
+      "loss": 2.128,
+      "step": 479
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.00017034977724059158,
+      "loss": 2.2673,
+      "step": 480
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 0.0001702180880010875,
+      "loss": 2.1307,
+      "step": 481
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.0001700861581120986,
+      "loss": 2.3287,
+      "step": 482
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.00016995398802577117,
+      "loss": 1.7666,
+      "step": 483
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.000169821578195075,
+      "loss": 2.1334,
+      "step": 484
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.00016968892907380135,
+      "loss": 1.9782,
+      "step": 485
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.0001695560411165616,
+      "loss": 2.313,
+      "step": 486
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.00016942291477878573,
+      "loss": 2.1062,
+      "step": 487
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.00016928955051672055,
+      "loss": 2.0696,
+      "step": 488
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.00016915594878742844,
+      "loss": 1.8445,
+      "step": 489
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.00016902211004878547,
+      "loss": 1.9491,
+      "step": 490
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.0001688880347594801,
+      "loss": 2.0359,
+      "step": 491
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.00016875372337901148,
+      "loss": 2.3316,
+      "step": 492
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.0001686191763676878,
+      "loss": 2.0779,
+      "step": 493
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.0001684843941866248,
+      "loss": 1.7657,
+      "step": 494
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.00016834937729774433,
+      "loss": 1.8241,
+      "step": 495
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.0001682141261637725,
+      "loss": 2.1056,
+      "step": 496
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.0001680786412482382,
+      "loss": 1.7187,
+      "step": 497
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 0.00016794292301547164,
+      "loss": 1.9173,
+      "step": 498
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016780697193060257,
+      "loss": 1.9274,
+      "step": 499
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016767078845955876,
+      "loss": 2.0432,
+      "step": 500
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016753437306906444,
+      "loss": 2.2669,
+      "step": 501
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016739772622663868,
+      "loss": 1.7062,
+      "step": 502
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016726084840059367,
+      "loss": 2.2194,
+      "step": 503
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.0001671237400600334,
+      "loss": 1.7685,
+      "step": 504
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016698640167485168,
+      "loss": 1.9341,
+      "step": 505
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016684883371573093,
+      "loss": 2.1971,
+      "step": 506
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016671103665414014,
+      "loss": 1.9888,
+      "step": 507
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016657301096233365,
+      "loss": 2.0831,
+      "step": 508
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016643475711334923,
+      "loss": 1.9168,
+      "step": 509
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016629627558100669,
+      "loss": 2.2276,
+      "step": 510
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016615756683990607,
+      "loss": 1.9629,
+      "step": 511
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016601863136542612,
+      "loss": 1.7659,
+      "step": 512
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016587946963372266,
+      "loss": 2.2037,
+      "step": 513
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016574008212172695,
+      "loss": 2.076,
+      "step": 514
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016560046930714391,
+      "loss": 2.0851,
+      "step": 515
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 0.00016546063166845084,
+      "loss": 2.0291,
+      "step": 516
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.0001653205696848953,
+      "loss": 1.8578,
+      "step": 517
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.0001651802838364939,
+      "loss": 1.8395,
+      "step": 518
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016503977460403043,
+      "loss": 1.9448,
+      "step": 519
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016489904246905416,
+      "loss": 2.2317,
+      "step": 520
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016475808791387844,
+      "loss": 2.1088,
+      "step": 521
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.0001646169114215788,
+      "loss": 1.644,
+      "step": 522
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016447551347599135,
+      "loss": 1.9976,
+      "step": 523
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016433389456171126,
+      "loss": 2.1709,
+      "step": 524
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016419205516409092,
+      "loss": 1.8659,
+      "step": 525
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016404999576923843,
+      "loss": 1.8242,
+      "step": 526
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016390771686401574,
+      "loss": 1.8075,
+      "step": 527
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.0001637652189360372,
+      "loss": 1.9656,
+      "step": 528
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.0001636225024736678,
+      "loss": 1.8924,
+      "step": 529
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.0001634795679660214,
+      "loss": 2.0009,
+      "step": 530
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016333641590295916,
+      "loss": 2.0376,
+      "step": 531
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.0001631930467750879,
+      "loss": 2.1311,
+      "step": 532
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 0.00016304946107375835,
+      "loss": 2.2283,
+      "step": 533
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.0001629056592910634,
+      "loss": 1.7574,
+      "step": 534
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016276164191983655,
+      "loss": 2.0175,
+      "step": 535
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016261740945365012,
+      "loss": 1.9322,
+      "step": 536
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016247296238681362,
+      "loss": 1.9672,
+      "step": 537
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016232830121437207,
+      "loss": 2.0282,
+      "step": 538
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016218342643210422,
+      "loss": 1.7126,
+      "step": 539
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.0001620383385365209,
+      "loss": 1.9792,
+      "step": 540
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016189303802486332,
+      "loss": 2.0057,
+      "step": 541
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016174752539510138,
+      "loss": 2.0233,
+      "step": 542
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.0001616018011459319,
+      "loss": 2.2166,
+      "step": 543
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016145586577677703,
+      "loss": 1.8409,
+      "step": 544
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016130971978778238,
+      "loss": 1.9757,
+      "step": 545
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016116336367981546,
+      "loss": 1.8926,
+      "step": 546
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016101679795446386,
+      "loss": 1.9958,
+      "step": 547
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016087002311403358,
+      "loss": 1.8794,
+      "step": 548
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.00016072303966154728,
+      "loss": 2.0984,
+      "step": 549
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.0001605758481007426,
+      "loss": 2.0672,
+      "step": 550
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 0.0001604284489360703,
+      "loss": 1.7366,
+      "step": 551
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.00016028084267269278,
+      "loss": 1.8981,
+      "step": 552
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.0001601330298164821,
+      "loss": 1.8403,
+      "step": 553
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.0001599850108740184,
+      "loss": 1.7631,
+      "step": 554
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.0001598367863525881,
+      "loss": 1.9823,
+      "step": 555
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.00015968835676018217,
+      "loss": 2.1072,
+      "step": 556
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.0001595397226054944,
+      "loss": 1.9577,
+      "step": 557
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.00015939088439791962,
+      "loss": 1.9442,
+      "step": 558
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.000159241842647552,
+      "loss": 2.0637,
+      "step": 559
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.0001590925978651834,
+      "loss": 1.8048,
+      "step": 560
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.00015894315056230125,
+      "loss": 2.0282,
+      "step": 561
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.0001587935012510873,
+      "loss": 1.9144,
+      "step": 562
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.0001586436504444155,
+      "loss": 2.0448,
+      "step": 563
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.0001584935986558504,
+      "loss": 1.8861,
+      "step": 564
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.00015834334639964527,
+      "loss": 2.1208,
+      "step": 565
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.00015819289419074056,
+      "loss": 1.7364,
+      "step": 566
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.00015804224254476187,
+      "loss": 2.3847,
+      "step": 567
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 0.0001578913919780183,
+      "loss": 1.8673,
+      "step": 568
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.0001577403430075008,
+      "loss": 1.7514,
+      "step": 569
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015758909615088017,
+      "loss": 1.9282,
+      "step": 570
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.0001574376519265055,
+      "loss": 2.0082,
+      "step": 571
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.0001572860108534022,
+      "loss": 1.9625,
+      "step": 572
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015713417345127032,
+      "loss": 1.851,
+      "step": 573
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015698214024048284,
+      "loss": 2.19,
+      "step": 574
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015682991174208378,
+      "loss": 2.0263,
+      "step": 575
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015667748847778638,
+      "loss": 1.661,
+      "step": 576
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015652487096997147,
+      "loss": 1.7109,
+      "step": 577
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015637205974168553,
+      "loss": 1.9312,
+      "step": 578
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015621905531663894,
+      "loss": 2.3136,
+      "step": 579
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015606585821920427,
+      "loss": 2.2294,
+      "step": 580
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015591246897441434,
+      "loss": 1.8774,
+      "step": 581
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.0001557588881079605,
+      "loss": 2.1094,
+      "step": 582
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015560511614619088,
+      "loss": 1.7745,
+      "step": 583
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015545115361610844,
+      "loss": 1.8127,
+      "step": 584
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.00015529700104536934,
+      "loss": 1.6497,
+      "step": 585
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 0.000155142658962281,
+      "loss": 1.5258,
+      "step": 586
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015498812789580026,
+      "loss": 1.5939,
+      "step": 587
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.0001548334083755318,
+      "loss": 1.6784,
+      "step": 588
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.000154678500931726,
+      "loss": 2.224,
+      "step": 589
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015452340609527738,
+      "loss": 1.8378,
+      "step": 590
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015436812439772267,
+      "loss": 2.185,
+      "step": 591
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.000154212656371239,
+      "loss": 1.8557,
+      "step": 592
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015405700254864208,
+      "loss": 2.2428,
+      "step": 593
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.0001539011634633844,
+      "loss": 1.9981,
+      "step": 594
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.0001537451396495533,
+      "loss": 1.7303,
+      "step": 595
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.0001535889316418693,
+      "loss": 1.8878,
+      "step": 596
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015343253997568415,
+      "loss": 1.8323,
+      "step": 597
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015327596518697903,
+      "loss": 2.0031,
+      "step": 598
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015311920781236276,
+      "loss": 2.0264,
+      "step": 599
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015296226838906982,
+      "loss": 1.6932,
+      "step": 600
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015280514745495864,
+      "loss": 2.2233,
+      "step": 601
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015264784554850977,
+      "loss": 1.9123,
+      "step": 602
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 0.00015249036320882394,
+      "loss": 1.8975,
+      "step": 603
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015233270097562022,
+      "loss": 1.8707,
+      "step": 604
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015217485938923427,
+      "loss": 1.5623,
+      "step": 605
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015201683899061642,
+      "loss": 2.1551,
+      "step": 606
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015185864032132978,
+      "loss": 1.8222,
+      "step": 607
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015170026392354844,
+      "loss": 2.1646,
+      "step": 608
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.0001515417103400556,
+      "loss": 1.8139,
+      "step": 609
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015138298011424176,
+      "loss": 1.8997,
+      "step": 610
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015122407379010265,
+      "loss": 2.1676,
+      "step": 611
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.0001510649919122377,
+      "loss": 2.2729,
+      "step": 612
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015090573502584786,
+      "loss": 1.4452,
+      "step": 613
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015074630367673398,
+      "loss": 1.7328,
+      "step": 614
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.0001505866984112947,
+      "loss": 1.8294,
+      "step": 615
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.0001504269197765248,
+      "loss": 2.0048,
+      "step": 616
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00015026696832001318,
+      "loss": 1.8241,
+      "step": 617
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.000150106844589941,
+      "loss": 1.7372,
+      "step": 618
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00014994654913507991,
+      "loss": 2.1094,
+      "step": 619
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.00014978608250479006,
+      "loss": 1.6446,
+      "step": 620
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 0.0001496254452490182,
+      "loss": 2.0786,
+      "step": 621
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.00014946463791829594,
+      "loss": 1.49,
+      "step": 622
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.0001493036610637376,
+      "loss": 2.01,
+      "step": 623
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.0001491425152370387,
+      "loss": 1.7596,
+      "step": 624
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.0001489812009904737,
+      "loss": 1.7722,
+      "step": 625
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.00014881971887689433,
+      "loss": 1.9145,
+      "step": 626
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.0001486580694497276,
+      "loss": 2.206,
+      "step": 627
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.00014849625326297393,
+      "loss": 1.7536,
+      "step": 628
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.00014833427087120531,
+      "loss": 1.9184,
+      "step": 629
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.00014817212282956335,
+      "loss": 1.9279,
+      "step": 630
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.00014800980969375716,
+      "loss": 2.0908,
+      "step": 631
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.000147847332020062,
+      "loss": 1.7797,
+      "step": 632
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.00014768469036531673,
+      "loss": 2.1805,
+      "step": 633
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.00014752188528692242,
+      "loss": 1.7696,
+      "step": 634
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.00014735891734284003,
+      "loss": 1.7893,
+      "step": 635
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.0001471957870915888,
+      "loss": 1.8147,
+      "step": 636
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.0001470324950922442,
+      "loss": 1.826,
+      "step": 637
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 0.0001468690419044361,
+      "loss": 1.8333,
+      "step": 638
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.0001467054280883467,
+      "loss": 1.6139,
+      "step": 639
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014654165420470875,
+      "loss": 2.0623,
+      "step": 640
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014637772081480351,
+      "loss": 1.81,
+      "step": 641
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014621362848045902,
+      "loss": 1.4343,
+      "step": 642
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014604937776404795,
+      "loss": 1.9273,
+      "step": 643
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.0001458849692284858,
+      "loss": 1.8857,
+      "step": 644
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014572040343722892,
+      "loss": 1.5608,
+      "step": 645
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.0001455556809542727,
+      "loss": 2.1799,
+      "step": 646
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014539080234414936,
+      "loss": 1.76,
+      "step": 647
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014522576817192642,
+      "loss": 1.9232,
+      "step": 648
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014506057900320435,
+      "loss": 1.9581,
+      "step": 649
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.0001448952354041149,
+      "loss": 1.9889,
+      "step": 650
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.0001447297379413191,
+      "loss": 1.3651,
+      "step": 651
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014456408718200523,
+      "loss": 2.1264,
+      "step": 652
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014439828369388702,
+      "loss": 1.7391,
+      "step": 653
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014423232804520151,
+      "loss": 1.8965,
+      "step": 654
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014406622080470743,
+      "loss": 1.9429,
+      "step": 655
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 0.00014389996254168276,
+      "loss": 2.4773,
+      "step": 656
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014373355382592333,
+      "loss": 1.92,
+      "step": 657
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014356699522774042,
+      "loss": 1.7896,
+      "step": 658
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014340028731795905,
+      "loss": 2.063,
+      "step": 659
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014323343066791598,
+      "loss": 1.8979,
+      "step": 660
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014306642584945765,
+      "loss": 1.7006,
+      "step": 661
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.0001428992734349383,
+      "loss": 1.797,
+      "step": 662
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.0001427319739972182,
+      "loss": 1.9911,
+      "step": 663
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014256452810966123,
+      "loss": 1.6982,
+      "step": 664
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014239693634613334,
+      "loss": 2.1087,
+      "step": 665
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014222919928100032,
+      "loss": 1.6313,
+      "step": 666
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014206131748912605,
+      "loss": 1.8278,
+      "step": 667
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014189329154587035,
+      "loss": 1.8432,
+      "step": 668
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014172512202708705,
+      "loss": 1.7691,
+      "step": 669
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.0001415568095091221,
+      "loss": 1.9347,
+      "step": 670
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014138835456881145,
+      "loss": 1.8702,
+      "step": 671
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.0001412197577834792,
+      "loss": 2.0455,
+      "step": 672
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 0.00014105101973093564,
+      "loss": 2.1592,
+      "step": 673
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00014088214098947508,
+      "loss": 1.7173,
+      "step": 674
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.0001407131221378741,
+      "loss": 1.528,
+      "step": 675
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00014054396375538943,
+      "loss": 1.6825,
+      "step": 676
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00014037466642175596,
+      "loss": 1.7331,
+      "step": 677
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00014020523071718482,
+      "loss": 1.9024,
+      "step": 678
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00014003565722236144,
+      "loss": 1.748,
+      "step": 679
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00013986594651844324,
+      "loss": 1.994,
+      "step": 680
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.0001396960991870582,
+      "loss": 1.5633,
+      "step": 681
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00013952611581030227,
+      "loss": 1.8282,
+      "step": 682
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00013935599697073787,
+      "loss": 1.7731,
+      "step": 683
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00013918574325139148,
+      "loss": 2.0317,
+      "step": 684
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.000139015355235752,
+      "loss": 1.6068,
+      "step": 685
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00013884483350776845,
+      "loss": 1.9422,
+      "step": 686
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.0001386741786518482,
+      "loss": 2.0406,
+      "step": 687
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00013850339125285487,
+      "loss": 1.8313,
+      "step": 688
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00013833247189610627,
+      "loss": 1.7055,
+      "step": 689
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00013816142116737247,
+      "loss": 1.8879,
+      "step": 690
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 0.00013799023965287382,
+      "loss": 1.8148,
+      "step": 691
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013781892793927883,
+      "loss": 2.3363,
+      "step": 692
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013764748661370231,
+      "loss": 1.7569,
+      "step": 693
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013747591626370314,
+      "loss": 1.6488,
+      "step": 694
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.0001373042174772825,
+      "loss": 2.0028,
+      "step": 695
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013713239084288176,
+      "loss": 2.0828,
+      "step": 696
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013696043694938034,
+      "loss": 1.9758,
+      "step": 697
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013678835638609386,
+      "loss": 2.0855,
+      "step": 698
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013661614974277208,
+      "loss": 1.5752,
+      "step": 699
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013644381760959681,
+      "loss": 1.5253,
+      "step": 700
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013627136057718002,
+      "loss": 1.8603,
+      "step": 701
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013609877923656159,
+      "loss": 2.0014,
+      "step": 702
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013592607417920756,
+      "loss": 1.7674,
+      "step": 703
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013575324599700788,
+      "loss": 1.8705,
+      "step": 704
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013558029528227454,
+      "loss": 1.6516,
+      "step": 705
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013540722262773942,
+      "loss": 2.0314,
+      "step": 706
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013523402862655235,
+      "loss": 1.639,
+      "step": 707
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 0.00013506071387227894,
+      "loss": 1.6488,
+      "step": 708
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.0001348872789588988,
+      "loss": 1.7552,
+      "step": 709
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013471372448080319,
+      "loss": 2.1326,
+      "step": 710
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013454005103279325,
+      "loss": 1.7469,
+      "step": 711
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013436625921007782,
+      "loss": 1.7786,
+      "step": 712
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013419234960827133,
+      "loss": 1.9115,
+      "step": 713
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013401832282339203,
+      "loss": 1.7447,
+      "step": 714
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.0001338441794518597,
+      "loss": 1.7431,
+      "step": 715
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.0001336699200904936,
+      "loss": 1.9201,
+      "step": 716
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013349554533651062,
+      "loss": 1.4894,
+      "step": 717
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.0001333210557875231,
+      "loss": 2.0804,
+      "step": 718
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013314645204153683,
+      "loss": 1.698,
+      "step": 719
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013297173469694883,
+      "loss": 1.6166,
+      "step": 720
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013279690435254556,
+      "loss": 1.9637,
+      "step": 721
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.0001326219616075008,
+      "loss": 1.6147,
+      "step": 722
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013244690706137343,
+      "loss": 1.7795,
+      "step": 723
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.0001322717413141055,
+      "loss": 1.8161,
+      "step": 724
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.0001320964649660203,
+      "loss": 2.057,
+      "step": 725
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 0.00013192107861781998,
+      "loss": 1.6305,
+      "step": 726
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00013174558287058384,
+      "loss": 1.5459,
+      "step": 727
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00013156997832576597,
+      "loss": 1.9521,
+      "step": 728
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00013139426558519344,
+      "loss": 1.735,
+      "step": 729
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00013121844525106413,
+      "loss": 1.5848,
+      "step": 730
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00013104251792594453,
+      "loss": 1.8728,
+      "step": 731
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00013086648421276793,
+      "loss": 1.6472,
+      "step": 732
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.0001306903447148322,
+      "loss": 1.9745,
+      "step": 733
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00013051410003579774,
+      "loss": 1.9314,
+      "step": 734
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00013033775077968545,
+      "loss": 1.5791,
+      "step": 735
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00013016129755087454,
+      "loss": 1.7365,
+      "step": 736
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00012998474095410068,
+      "loss": 1.9042,
+      "step": 737
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.0001298080815944538,
+      "loss": 1.8264,
+      "step": 738
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00012963132007737582,
+      "loss": 1.7089,
+      "step": 739
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.000129454457008659,
+      "loss": 2.3104,
+      "step": 740
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00012927749299444357,
+      "loss": 1.6208,
+      "step": 741
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.00012910042864121564,
+      "loss": 1.8952,
+      "step": 742
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 0.0001289232645558053,
+      "loss": 2.1815,
+      "step": 743
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012874600134538434,
+      "loss": 1.6929,
+      "step": 744
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012856863961746437,
+      "loss": 1.5836,
+      "step": 745
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012839117997989457,
+      "loss": 1.6706,
+      "step": 746
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.0001282136230408597,
+      "loss": 2.055,
+      "step": 747
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012803596940887794,
+      "loss": 1.7701,
+      "step": 748
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012785821969279893,
+      "loss": 1.992,
+      "step": 749
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012768037450180156,
+      "loss": 2.0082,
+      "step": 750
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012750243444539195,
+      "loss": 1.8106,
+      "step": 751
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.0001273244001334013,
+      "loss": 1.6976,
+      "step": 752
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012714627217598392,
+      "loss": 1.5776,
+      "step": 753
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012696805118361497,
+      "loss": 1.8228,
+      "step": 754
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012678973776708848,
+      "loss": 1.864,
+      "step": 755
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012661133253751532,
+      "loss": 1.7352,
+      "step": 756
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012643283610632084,
+      "loss": 1.9886,
+      "step": 757
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012625424908524314,
+      "loss": 1.87,
+      "step": 758
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.0001260755720863307,
+      "loss": 1.6641,
+      "step": 759
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012589680572194038,
+      "loss": 1.7451,
+      "step": 760
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 0.00012571795060473527,
+      "loss": 1.6198,
+      "step": 761
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.0001255390073476827,
+      "loss": 1.8114,
+      "step": 762
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012535997656405205,
+      "loss": 2.0006,
+      "step": 763
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012518085886741262,
+      "loss": 1.8692,
+      "step": 764
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012500165487163169,
+      "loss": 1.8301,
+      "step": 765
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012482236519087216,
+      "loss": 1.6984,
+      "step": 766
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012464299043959064,
+      "loss": 1.8206,
+      "step": 767
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012446353123253537,
+      "loss": 1.4812,
+      "step": 768
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012428398818474396,
+      "loss": 1.9697,
+      "step": 769
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.0001241043619115413,
+      "loss": 1.7389,
+      "step": 770
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012392465302853766,
+      "loss": 1.4502,
+      "step": 771
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012374486215162625,
+      "loss": 1.7309,
+      "step": 772
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.0001235649898969815,
+      "loss": 1.6507,
+      "step": 773
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.0001233850368810565,
+      "loss": 1.8252,
+      "step": 774
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.0001232050037205813,
+      "loss": 1.6956,
+      "step": 775
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012302489103256057,
+      "loss": 1.9173,
+      "step": 776
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012284469943427145,
+      "loss": 1.6154,
+      "step": 777
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 0.00012266442954326167,
+      "loss": 1.7757,
+      "step": 778
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012248408197734715,
+      "loss": 1.8531,
+      "step": 779
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.0001223036573546101,
+      "loss": 1.7032,
+      "step": 780
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012212315629339679,
+      "loss": 1.9935,
+      "step": 781
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012194257941231541,
+      "loss": 1.8056,
+      "step": 782
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.0001217619273302341,
+      "loss": 1.6726,
+      "step": 783
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012158120066627865,
+      "loss": 1.7936,
+      "step": 784
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012140040003983041,
+      "loss": 1.8058,
+      "step": 785
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.0001212195260705244,
+      "loss": 1.5579,
+      "step": 786
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012103857937824677,
+      "loss": 1.8106,
+      "step": 787
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012085756058313303,
+      "loss": 1.6624,
+      "step": 788
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.0001206764703055658,
+      "loss": 1.5364,
+      "step": 789
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012049530916617265,
+      "loss": 1.5879,
+      "step": 790
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012031407778582399,
+      "loss": 1.73,
+      "step": 791
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00012013277678563104,
+      "loss": 1.6884,
+      "step": 792
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00011995140678694352,
+      "loss": 1.8078,
+      "step": 793
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00011976996841134767,
+      "loss": 1.8837,
+      "step": 794
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00011958846228066405,
+      "loss": 1.7585,
+      "step": 795
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 0.00011940688901694548,
+      "loss": 1.9004,
+      "step": 796
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011922524924247476,
+      "loss": 1.8945,
+      "step": 797
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011904354357976275,
+      "loss": 1.913,
+      "step": 798
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011886177265154601,
+      "loss": 1.7512,
+      "step": 799
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011867993708078484,
+      "loss": 1.9082,
+      "step": 800
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.0001184980374906611,
+      "loss": 1.581,
+      "step": 801
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011831607450457602,
+      "loss": 2.0034,
+      "step": 802
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011813404874614805,
+      "loss": 1.7625,
+      "step": 803
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011795196083921087,
+      "loss": 1.8712,
+      "step": 804
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011776981140781109,
+      "loss": 1.8361,
+      "step": 805
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.0001175876010762062,
+      "loss": 1.7215,
+      "step": 806
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011740533046886238,
+      "loss": 1.642,
+      "step": 807
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011722300021045241,
+      "loss": 1.8313,
+      "step": 808
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011704061092585352,
+      "loss": 1.7128,
+      "step": 809
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011685816324014522,
+      "loss": 1.8761,
+      "step": 810
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.0001166756577786071,
+      "loss": 1.9232,
+      "step": 811
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011649309516671687,
+      "loss": 1.6746,
+      "step": 812
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 0.00011631047603014804,
+      "loss": 1.9347,
+      "step": 813
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011612780099476785,
+      "loss": 1.7775,
+      "step": 814
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011594507068663514,
+      "loss": 1.9845,
+      "step": 815
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011576228573199813,
+      "loss": 1.7177,
+      "step": 816
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.0001155794467572923,
+      "loss": 1.6216,
+      "step": 817
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011539655438913846,
+      "loss": 1.8238,
+      "step": 818
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.0001152136092543401,
+      "loss": 1.8493,
+      "step": 819
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011503061197988185,
+      "loss": 2.0944,
+      "step": 820
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011484756319292682,
+      "loss": 1.6536,
+      "step": 821
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011466446352081477,
+      "loss": 1.5265,
+      "step": 822
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011448131359105982,
+      "loss": 1.6297,
+      "step": 823
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.0001142981140313483,
+      "loss": 1.7124,
+      "step": 824
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011411486546953671,
+      "loss": 1.6685,
+      "step": 825
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011393156853364939,
+      "loss": 1.9609,
+      "step": 826
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011374822385187655,
+      "loss": 1.5484,
+      "step": 827
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011356483205257205,
+      "loss": 1.6222,
+      "step": 828
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011338139376425105,
+      "loss": 1.8165,
+      "step": 829
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011319790961558829,
+      "loss": 1.9273,
+      "step": 830
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 0.00011301438023541551,
+      "loss": 1.6748,
+      "step": 831
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011283080625271951,
+      "loss": 1.5569,
+      "step": 832
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011264718829663998,
+      "loss": 1.5414,
+      "step": 833
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011246352699646727,
+      "loss": 1.7134,
+      "step": 834
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011227982298164029,
+      "loss": 1.7669,
+      "step": 835
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011209607688174437,
+      "loss": 1.6682,
+      "step": 836
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011191228932650901,
+      "loss": 1.893,
+      "step": 837
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.0001117284609458059,
+      "loss": 1.7192,
+      "step": 838
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.0001115445923696465,
+      "loss": 1.5846,
+      "step": 839
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011136068422818014,
+      "loss": 1.5965,
+      "step": 840
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011117673715169168,
+      "loss": 1.8478,
+      "step": 841
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011099275177059942,
+      "loss": 1.6086,
+      "step": 842
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011080872871545302,
+      "loss": 1.7364,
+      "step": 843
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011062466861693115,
+      "loss": 1.6835,
+      "step": 844
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011044057210583952,
+      "loss": 1.8639,
+      "step": 845
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011025643981310854,
+      "loss": 2.0591,
+      "step": 846
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00011007227236979131,
+      "loss": 1.8685,
+      "step": 847
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 0.00010988807040706142,
+      "loss": 1.6642,
+      "step": 848
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010970383455621067,
+      "loss": 1.7456,
+      "step": 849
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010951956544864714,
+      "loss": 1.8187,
+      "step": 850
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010933526371589276,
+      "loss": 1.9228,
+      "step": 851
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.0001091509299895813,
+      "loss": 1.6111,
+      "step": 852
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010896656490145627,
+      "loss": 1.7107,
+      "step": 853
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010878216908336848,
+      "loss": 1.9996,
+      "step": 854
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010859774316727427,
+      "loss": 1.5554,
+      "step": 855
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.000108413287785233,
+      "loss": 2.0388,
+      "step": 856
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010822880356940501,
+      "loss": 2.0211,
+      "step": 857
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010804429115204953,
+      "loss": 1.5811,
+      "step": 858
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010785975116552239,
+      "loss": 1.7072,
+      "step": 859
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010767518424227388,
+      "loss": 1.8995,
+      "step": 860
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010749059101484671,
+      "loss": 1.4005,
+      "step": 861
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010730597211587361,
+      "loss": 1.6285,
+      "step": 862
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.0001071213281780754,
+      "loss": 1.6689,
+      "step": 863
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010693665983425865,
+      "loss": 1.7543,
+      "step": 864
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010675196771731357,
+      "loss": 1.9577,
+      "step": 865
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 0.00010656725246021189,
+      "loss": 1.7236,
+      "step": 866
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010638251469600459,
+      "loss": 1.631,
+      "step": 867
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010619775505781986,
+      "loss": 1.4982,
+      "step": 868
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010601297417886078,
+      "loss": 1.9629,
+      "step": 869
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010582817269240326,
+      "loss": 1.7575,
+      "step": 870
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010564335123179383,
+      "loss": 1.8665,
+      "step": 871
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010545851043044748,
+      "loss": 1.6138,
+      "step": 872
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010527365092184548,
+      "loss": 1.8974,
+      "step": 873
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010508877333953322,
+      "loss": 1.9944,
+      "step": 874
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010490387831711799,
+      "loss": 1.9629,
+      "step": 875
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010471896648826695,
+      "loss": 1.7652,
+      "step": 876
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010453403848670478,
+      "loss": 1.7028,
+      "step": 877
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010434909494621155,
+      "loss": 1.7814,
+      "step": 878
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010416413650062069,
+      "loss": 1.7265,
+      "step": 879
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.0001039791637838166,
+      "loss": 1.9072,
+      "step": 880
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010379417742973275,
+      "loss": 1.7312,
+      "step": 881
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010360917807234913,
+      "loss": 1.5401,
+      "step": 882
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 0.00010342416634569045,
+      "loss": 1.6348,
+      "step": 883
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010323914288382381,
+      "loss": 1.7033,
+      "step": 884
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010305410832085644,
+      "loss": 1.6501,
+      "step": 885
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010286906329093371,
+      "loss": 1.8168,
+      "step": 886
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.0001026840084282368,
+      "loss": 1.9983,
+      "step": 887
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010249894436698058,
+      "loss": 1.7268,
+      "step": 888
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.0001023138717414115,
+      "loss": 1.6317,
+      "step": 889
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010212879118580529,
+      "loss": 1.5017,
+      "step": 890
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010194370333446497,
+      "loss": 1.7859,
+      "step": 891
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010175860882171843,
+      "loss": 1.731,
+      "step": 892
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010157350828191651,
+      "loss": 2.1111,
+      "step": 893
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010138840234943061,
+      "loss": 1.7297,
+      "step": 894
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010120329165865065,
+      "loss": 1.8033,
+      "step": 895
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.0001010181768439829,
+      "loss": 1.6117,
+      "step": 896
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010083305853984765,
+      "loss": 1.7502,
+      "step": 897
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010064793738067728,
+      "loss": 1.8027,
+      "step": 898
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.0001004628140009139,
+      "loss": 1.4829,
+      "step": 899
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010027768903500721,
+      "loss": 1.7622,
+      "step": 900
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 0.00010009256311741231,
+      "loss": 1.6086,
+      "step": 901
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.99074368825877e-05,
+      "loss": 1.8871,
+      "step": 902
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.972231096499284e-05,
+      "loss": 1.7197,
+      "step": 903
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.953718599908613e-05,
+      "loss": 1.7996,
+      "step": 904
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.935206261932271e-05,
+      "loss": 1.979,
+      "step": 905
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.916694146015236e-05,
+      "loss": 1.691,
+      "step": 906
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.898182315601714e-05,
+      "loss": 1.379,
+      "step": 907
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.879670834134937e-05,
+      "loss": 1.5691,
+      "step": 908
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.861159765056942e-05,
+      "loss": 1.5572,
+      "step": 909
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.84264917180835e-05,
+      "loss": 1.6121,
+      "step": 910
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.824139117828158e-05,
+      "loss": 1.4393,
+      "step": 911
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.805629666553506e-05,
+      "loss": 1.6531,
+      "step": 912
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.787120881419472e-05,
+      "loss": 1.697,
+      "step": 913
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.768612825858856e-05,
+      "loss": 1.6407,
+      "step": 914
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.750105563301943e-05,
+      "loss": 1.8867,
+      "step": 915
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.731599157176321e-05,
+      "loss": 1.8828,
+      "step": 916
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.713093670906631e-05,
+      "loss": 1.6448,
+      "step": 917
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 9.694589167914357e-05,
+      "loss": 1.8575,
+      "step": 918
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.676085711617623e-05,
+      "loss": 1.5661,
+      "step": 919
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.657583365430954e-05,
+      "loss": 1.7556,
+      "step": 920
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.639082192765089e-05,
+      "loss": 1.9102,
+      "step": 921
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.620582257026729e-05,
+      "loss": 1.8699,
+      "step": 922
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.602083621618341e-05,
+      "loss": 1.5184,
+      "step": 923
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.583586349937935e-05,
+      "loss": 1.8665,
+      "step": 924
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.565090505378846e-05,
+      "loss": 1.9638,
+      "step": 925
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.546596151329525e-05,
+      "loss": 1.5569,
+      "step": 926
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.528103351173306e-05,
+      "loss": 1.666,
+      "step": 927
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.509612168288202e-05,
+      "loss": 1.3964,
+      "step": 928
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.491122666046682e-05,
+      "loss": 1.8253,
+      "step": 929
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.472634907815454e-05,
+      "loss": 2.1806,
+      "step": 930
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.454148956955254e-05,
+      "loss": 1.4033,
+      "step": 931
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.435664876820619e-05,
+      "loss": 1.7509,
+      "step": 932
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.417182730759677e-05,
+      "loss": 1.7489,
+      "step": 933
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.398702582113925e-05,
+      "loss": 1.6536,
+      "step": 934
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.380224494218013e-05,
+      "loss": 1.6154,
+      "step": 935
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 9.36174853039954e-05,
+      "loss": 1.887,
+      "step": 936
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.343274753978812e-05,
+      "loss": 1.823,
+      "step": 937
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.324803228268646e-05,
+      "loss": 1.5333,
+      "step": 938
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.30633401657414e-05,
+      "loss": 2.1047,
+      "step": 939
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.287867182192464e-05,
+      "loss": 1.51,
+      "step": 940
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.26940278841264e-05,
+      "loss": 1.6146,
+      "step": 941
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.250940898515331e-05,
+      "loss": 2.0019,
+      "step": 942
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.232481575772613e-05,
+      "loss": 1.4497,
+      "step": 943
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.214024883447766e-05,
+      "loss": 1.9049,
+      "step": 944
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.19557088479505e-05,
+      "loss": 1.6454,
+      "step": 945
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.1771196430595e-05,
+      "loss": 1.5611,
+      "step": 946
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.158671221476702e-05,
+      "loss": 1.471,
+      "step": 947
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.140225683272576e-05,
+      "loss": 1.9359,
+      "step": 948
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.121783091663152e-05,
+      "loss": 1.8417,
+      "step": 949
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.103343509854379e-05,
+      "loss": 1.3804,
+      "step": 950
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.084907001041871e-05,
+      "loss": 1.5237,
+      "step": 951
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.066473628410725e-05,
+      "loss": 1.5802,
+      "step": 952
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 9.048043455135288e-05,
+      "loss": 1.7699,
+      "step": 953
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 9.029616544378934e-05,
+      "loss": 1.8141,
+      "step": 954
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 9.011192959293863e-05,
+      "loss": 1.7469,
+      "step": 955
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.99277276302087e-05,
+      "loss": 1.3691,
+      "step": 956
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.974356018689147e-05,
+      "loss": 1.6466,
+      "step": 957
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.955942789416051e-05,
+      "loss": 1.7209,
+      "step": 958
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.937533138306886e-05,
+      "loss": 1.6043,
+      "step": 959
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.919127128454701e-05,
+      "loss": 1.7126,
+      "step": 960
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.900724822940057e-05,
+      "loss": 1.2784,
+      "step": 961
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.882326284830836e-05,
+      "loss": 1.7911,
+      "step": 962
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.86393157718199e-05,
+      "loss": 1.405,
+      "step": 963
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.845540763035354e-05,
+      "loss": 1.462,
+      "step": 964
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.827153905419413e-05,
+      "loss": 1.774,
+      "step": 965
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.808771067349099e-05,
+      "loss": 1.5846,
+      "step": 966
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.790392311825567e-05,
+      "loss": 1.3666,
+      "step": 967
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.772017701835974e-05,
+      "loss": 1.7865,
+      "step": 968
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.753647300353275e-05,
+      "loss": 1.4822,
+      "step": 969
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.735281170336004e-05,
+      "loss": 1.635,
+      "step": 970
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 8.71691937472805e-05,
+      "loss": 1.5485,
+      "step": 971
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.69856197645845e-05,
+      "loss": 1.8332,
+      "step": 972
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.680209038441172e-05,
+      "loss": 1.3538,
+      "step": 973
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.661860623574897e-05,
+      "loss": 1.6809,
+      "step": 974
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.643516794742801e-05,
+      "loss": 1.6464,
+      "step": 975
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.625177614812347e-05,
+      "loss": 1.3873,
+      "step": 976
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.606843146635062e-05,
+      "loss": 1.7089,
+      "step": 977
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.588513453046332e-05,
+      "loss": 1.6996,
+      "step": 978
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.570188596865171e-05,
+      "loss": 1.4423,
+      "step": 979
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.551868640894022e-05,
+      "loss": 1.7998,
+      "step": 980
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.533553647918526e-05,
+      "loss": 1.4903,
+      "step": 981
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.515243680707318e-05,
+      "loss": 1.8166,
+      "step": 982
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.496938802011816e-05,
+      "loss": 1.5929,
+      "step": 983
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.47863907456599e-05,
+      "loss": 1.4335,
+      "step": 984
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.460344561086158e-05,
+      "loss": 1.44,
+      "step": 985
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.44205532427077e-05,
+      "loss": 1.6771,
+      "step": 986
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.423771426800191e-05,
+      "loss": 1.7489,
+      "step": 987
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 8.405492931336489e-05,
+      "loss": 1.3223,
+      "step": 988
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.387219900523216e-05,
+      "loss": 1.6147,
+      "step": 989
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.3689523969852e-05,
+      "loss": 1.6545,
+      "step": 990
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.350690483328317e-05,
+      "loss": 1.4051,
+      "step": 991
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.33243422213929e-05,
+      "loss": 1.6058,
+      "step": 992
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.31418367598548e-05,
+      "loss": 1.9849,
+      "step": 993
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.29593890741465e-05,
+      "loss": 1.5149,
+      "step": 994
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.27769997895476e-05,
+      "loss": 1.7069,
+      "step": 995
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.259466953113766e-05,
+      "loss": 1.5325,
+      "step": 996
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.241239892379382e-05,
+      "loss": 1.6261,
+      "step": 997
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.223018859218893e-05,
+      "loss": 1.2901,
+      "step": 998
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.204803916078915e-05,
+      "loss": 1.3032,
+      "step": 999
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.186595125385198e-05,
+      "loss": 1.5565,
+      "step": 1000
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.168392549542403e-05,
+      "loss": 1.8205,
+      "step": 1001
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.150196250933889e-05,
+      "loss": 1.6517,
+      "step": 1002
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.132006291921515e-05,
+      "loss": 1.6817,
+      "step": 1003
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.113822734845401e-05,
+      "loss": 1.6176,
+      "step": 1004
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.095645642023727e-05,
+      "loss": 2.0013,
+      "step": 1005
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 8.077475075752525e-05,
+      "loss": 1.8899,
+      "step": 1006
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 8.059311098305454e-05,
+      "loss": 1.9102,
+      "step": 1007
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 8.041153771933595e-05,
+      "loss": 1.6835,
+      "step": 1008
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 8.023003158865236e-05,
+      "loss": 1.7227,
+      "step": 1009
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 8.00485932130565e-05,
+      "loss": 1.7661,
+      "step": 1010
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.986722321436899e-05,
+      "loss": 1.7143,
+      "step": 1011
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.968592221417604e-05,
+      "loss": 1.4745,
+      "step": 1012
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.950469083382736e-05,
+      "loss": 1.5555,
+      "step": 1013
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.932352969443422e-05,
+      "loss": 1.6048,
+      "step": 1014
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.9142439416867e-05,
+      "loss": 1.2895,
+      "step": 1015
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.896142062175328e-05,
+      "loss": 1.5053,
+      "step": 1016
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.878047392947565e-05,
+      "loss": 1.5165,
+      "step": 1017
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.859959996016957e-05,
+      "loss": 1.7149,
+      "step": 1018
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.841879933372139e-05,
+      "loss": 1.7818,
+      "step": 1019
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.823807266976592e-05,
+      "loss": 1.9185,
+      "step": 1020
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.805742058768461e-05,
+      "loss": 1.5728,
+      "step": 1021
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.787684370660324e-05,
+      "loss": 1.5916,
+      "step": 1022
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 7.76963426453899e-05,
+      "loss": 1.6795,
+      "step": 1023
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.751591802265286e-05,
+      "loss": 1.7184,
+      "step": 1024
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.733557045673834e-05,
+      "loss": 1.5221,
+      "step": 1025
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.715530056572856e-05,
+      "loss": 1.5669,
+      "step": 1026
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.697510896743948e-05,
+      "loss": 1.8018,
+      "step": 1027
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.679499627941869e-05,
+      "loss": 1.6047,
+      "step": 1028
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.661496311894351e-05,
+      "loss": 1.9697,
+      "step": 1029
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.643501010301853e-05,
+      "loss": 1.7658,
+      "step": 1030
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.625513784837374e-05,
+      "loss": 1.5094,
+      "step": 1031
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.607534697146239e-05,
+      "loss": 1.7245,
+      "step": 1032
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.58956380884587e-05,
+      "loss": 1.673,
+      "step": 1033
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.571601181525607e-05,
+      "loss": 1.6934,
+      "step": 1034
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.553646876746464e-05,
+      "loss": 1.4576,
+      "step": 1035
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.535700956040938e-05,
+      "loss": 1.514,
+      "step": 1036
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.51776348091279e-05,
+      "loss": 1.4255,
+      "step": 1037
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.499834512836832e-05,
+      "loss": 1.768,
+      "step": 1038
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.481914113258736e-05,
+      "loss": 1.8764,
+      "step": 1039
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.464002343594798e-05,
+      "loss": 1.2762,
+      "step": 1040
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 7.446099265231733e-05,
+      "loss": 1.4136,
+      "step": 1041
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.428204939526475e-05,
+      "loss": 1.6005,
+      "step": 1042
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.410319427805966e-05,
+      "loss": 1.6663,
+      "step": 1043
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.392442791366931e-05,
+      "loss": 1.4911,
+      "step": 1044
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.374575091475687e-05,
+      "loss": 1.6979,
+      "step": 1045
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.356716389367918e-05,
+      "loss": 1.362,
+      "step": 1046
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.338866746248473e-05,
+      "loss": 1.4376,
+      "step": 1047
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.321026223291156e-05,
+      "loss": 1.821,
+      "step": 1048
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.303194881638504e-05,
+      "loss": 1.6002,
+      "step": 1049
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.285372782401609e-05,
+      "loss": 1.5631,
+      "step": 1050
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.267559986659871e-05,
+      "loss": 1.645,
+      "step": 1051
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.249756555460809e-05,
+      "loss": 1.6378,
+      "step": 1052
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.231962549819848e-05,
+      "loss": 1.6258,
+      "step": 1053
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.214178030720108e-05,
+      "loss": 1.8166,
+      "step": 1054
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.196403059112209e-05,
+      "loss": 1.6189,
+      "step": 1055
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.178637695914034e-05,
+      "loss": 1.5998,
+      "step": 1056
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.160882002010546e-05,
+      "loss": 1.6064,
+      "step": 1057
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 7.143136038253566e-05,
+      "loss": 1.5693,
+      "step": 1058
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 7.125399865461566e-05,
+      "loss": 1.8171,
+      "step": 1059
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 7.107673544419472e-05,
+      "loss": 1.4349,
+      "step": 1060
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 7.089957135878438e-05,
+      "loss": 1.5197,
+      "step": 1061
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 7.072250700555645e-05,
+      "loss": 1.9559,
+      "step": 1062
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 7.054554299134101e-05,
+      "loss": 1.7002,
+      "step": 1063
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 7.03686799226242e-05,
+      "loss": 1.8539,
+      "step": 1064
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 7.019191840554624e-05,
+      "loss": 1.3098,
+      "step": 1065
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 7.001525904589931e-05,
+      "loss": 1.5757,
+      "step": 1066
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.98387024491255e-05,
+      "loss": 1.5044,
+      "step": 1067
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.966224922031462e-05,
+      "loss": 1.5505,
+      "step": 1068
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.948589996420224e-05,
+      "loss": 1.5759,
+      "step": 1069
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.93096552851678e-05,
+      "loss": 1.4592,
+      "step": 1070
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.913351578723209e-05,
+      "loss": 1.6666,
+      "step": 1071
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.89574820740555e-05,
+      "loss": 1.771,
+      "step": 1072
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.87815547489359e-05,
+      "loss": 1.6493,
+      "step": 1073
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.860573441480653e-05,
+      "loss": 1.578,
+      "step": 1074
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.843002167423403e-05,
+      "loss": 1.5866,
+      "step": 1075
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 6.82544171294162e-05,
+      "loss": 1.385,
+      "step": 1076
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.807892138218005e-05,
+      "loss": 1.6944,
+      "step": 1077
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.790353503397974e-05,
+      "loss": 1.5871,
+      "step": 1078
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.77282586858945e-05,
+      "loss": 1.3789,
+      "step": 1079
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.75530929386266e-05,
+      "loss": 1.2771,
+      "step": 1080
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.737803839249923e-05,
+      "loss": 1.385,
+      "step": 1081
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.720309564745443e-05,
+      "loss": 1.7627,
+      "step": 1082
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.702826530305123e-05,
+      "loss": 1.6009,
+      "step": 1083
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.685354795846322e-05,
+      "loss": 1.4812,
+      "step": 1084
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.667894421247688e-05,
+      "loss": 1.4849,
+      "step": 1085
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.650445466348938e-05,
+      "loss": 1.638,
+      "step": 1086
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.633007990950643e-05,
+      "loss": 1.2712,
+      "step": 1087
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.615582054814036e-05,
+      "loss": 1.5819,
+      "step": 1088
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.598167717660799e-05,
+      "loss": 1.5676,
+      "step": 1089
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.580765039172868e-05,
+      "loss": 1.7863,
+      "step": 1090
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.563374078992222e-05,
+      "loss": 1.4422,
+      "step": 1091
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.545994896720675e-05,
+      "loss": 1.377,
+      "step": 1092
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 6.528627551919681e-05,
+      "loss": 1.5641,
+      "step": 1093
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.511272104110124e-05,
+      "loss": 1.6919,
+      "step": 1094
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.493928612772104e-05,
+      "loss": 1.5635,
+      "step": 1095
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.476597137344768e-05,
+      "loss": 1.7403,
+      "step": 1096
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.459277737226059e-05,
+      "loss": 1.635,
+      "step": 1097
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.441970471772547e-05,
+      "loss": 1.6002,
+      "step": 1098
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.424675400299214e-05,
+      "loss": 1.5271,
+      "step": 1099
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.407392582079247e-05,
+      "loss": 1.688,
+      "step": 1100
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.390122076343844e-05,
+      "loss": 1.6129,
+      "step": 1101
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.372863942282001e-05,
+      "loss": 1.6714,
+      "step": 1102
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.35561823904032e-05,
+      "loss": 1.5349,
+      "step": 1103
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.338385025722795e-05,
+      "loss": 1.2853,
+      "step": 1104
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.321164361390615e-05,
+      "loss": 1.6001,
+      "step": 1105
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.303956305061968e-05,
+      "loss": 1.5516,
+      "step": 1106
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.286760915711827e-05,
+      "loss": 1.5695,
+      "step": 1107
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.26957825227175e-05,
+      "loss": 1.6224,
+      "step": 1108
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.25240837362969e-05,
+      "loss": 1.8384,
+      "step": 1109
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.23525133862977e-05,
+      "loss": 1.6847,
+      "step": 1110
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 6.218107206072115e-05,
+      "loss": 1.4729,
+      "step": 1111
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.200976034712617e-05,
+      "loss": 1.5154,
+      "step": 1112
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.183857883262754e-05,
+      "loss": 1.3924,
+      "step": 1113
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.166752810389376e-05,
+      "loss": 1.261,
+      "step": 1114
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.149660874714511e-05,
+      "loss": 1.7967,
+      "step": 1115
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.132582134815179e-05,
+      "loss": 1.5118,
+      "step": 1116
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.115516649223156e-05,
+      "loss": 1.6509,
+      "step": 1117
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.098464476424803e-05,
+      "loss": 1.6616,
+      "step": 1118
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.081425674860854e-05,
+      "loss": 1.7101,
+      "step": 1119
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.0644003029262175e-05,
+      "loss": 1.9115,
+      "step": 1120
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.0473884189697725e-05,
+      "loss": 1.7181,
+      "step": 1121
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.0303900812941827e-05,
+      "loss": 1.4707,
+      "step": 1122
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 6.013405348155677e-05,
+      "loss": 1.6362,
+      "step": 1123
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 5.996434277763863e-05,
+      "loss": 1.4056,
+      "step": 1124
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 5.97947692828152e-05,
+      "loss": 1.8028,
+      "step": 1125
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 5.9625333578244047e-05,
+      "loss": 1.5899,
+      "step": 1126
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 5.945603624461058e-05,
+      "loss": 1.4921,
+      "step": 1127
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 5.928687786212591e-05,
+      "loss": 1.3494,
+      "step": 1128
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.911785901052493e-05,
+      "loss": 2.1388,
+      "step": 1129
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.89489802690644e-05,
+      "loss": 1.3666,
+      "step": 1130
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.8780242216520796e-05,
+      "loss": 1.4615,
+      "step": 1131
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.8611645431188576e-05,
+      "loss": 1.5653,
+      "step": 1132
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.8443190490877943e-05,
+      "loss": 1.5046,
+      "step": 1133
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.827487797291296e-05,
+      "loss": 1.4568,
+      "step": 1134
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.8106708454129666e-05,
+      "loss": 1.5381,
+      "step": 1135
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.7938682510873935e-05,
+      "loss": 1.6541,
+      "step": 1136
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.7770800718999675e-05,
+      "loss": 1.5309,
+      "step": 1137
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.7603063653866694e-05,
+      "loss": 1.7324,
+      "step": 1138
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.74354718903388e-05,
+      "loss": 1.514,
+      "step": 1139
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.7268026002781825e-05,
+      "loss": 1.4976,
+      "step": 1140
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.710072656506167e-05,
+      "loss": 1.4829,
+      "step": 1141
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.693357415054239e-05,
+      "loss": 1.3913,
+      "step": 1142
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.6766569332084066e-05,
+      "loss": 1.5022,
+      "step": 1143
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.659971268204097e-05,
+      "loss": 1.7231,
+      "step": 1144
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.6433004772259614e-05,
+      "loss": 1.5993,
+      "step": 1145
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 5.626644617407667e-05,
+      "loss": 1.9843,
+      "step": 1146
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.6100037458317245e-05,
+      "loss": 1.8785,
+      "step": 1147
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.593377919529261e-05,
+      "loss": 1.597,
+      "step": 1148
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.5767671954798495e-05,
+      "loss": 1.4269,
+      "step": 1149
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.560171630611303e-05,
+      "loss": 1.5057,
+      "step": 1150
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.543591281799476e-05,
+      "loss": 1.8848,
+      "step": 1151
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.527026205868091e-05,
+      "loss": 1.6648,
+      "step": 1152
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.510476459588512e-05,
+      "loss": 1.3488,
+      "step": 1153
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.4939420996795676e-05,
+      "loss": 1.4698,
+      "step": 1154
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.477423182807362e-05,
+      "loss": 1.4993,
+      "step": 1155
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.460919765585068e-05,
+      "loss": 1.5806,
+      "step": 1156
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.444431904572735e-05,
+      "loss": 1.6902,
+      "step": 1157
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.4279596562771106e-05,
+      "loss": 1.4159,
+      "step": 1158
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.411503077151425e-05,
+      "loss": 1.5906,
+      "step": 1159
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.395062223595211e-05,
+      "loss": 1.5186,
+      "step": 1160
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.378637151954103e-05,
+      "loss": 1.4688,
+      "step": 1161
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.362227918519651e-05,
+      "loss": 1.7446,
+      "step": 1162
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 5.3458345795291295e-05,
+      "loss": 1.4552,
+      "step": 1163
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.3294571911653325e-05,
+      "loss": 1.7382,
+      "step": 1164
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.31309580955639e-05,
+      "loss": 1.6533,
+      "step": 1165
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.296750490775579e-05,
+      "loss": 1.5931,
+      "step": 1166
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.280421290841124e-05,
+      "loss": 1.7046,
+      "step": 1167
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.264108265715999e-05,
+      "loss": 1.3373,
+      "step": 1168
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.24781147130776e-05,
+      "loss": 1.825,
+      "step": 1169
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.231530963468325e-05,
+      "loss": 1.531,
+      "step": 1170
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.215266797993801e-05,
+      "loss": 1.4511,
+      "step": 1171
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.199019030624279e-05,
+      "loss": 1.4785,
+      "step": 1172
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.1827877170436666e-05,
+      "loss": 1.6164,
+      "step": 1173
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.166572912879467e-05,
+      "loss": 1.6292,
+      "step": 1174
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.150374673702607e-05,
+      "loss": 1.6762,
+      "step": 1175
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.134193055027243e-05,
+      "loss": 1.4888,
+      "step": 1176
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.118028112310569e-05,
+      "loss": 1.6559,
+      "step": 1177
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.101879900952632e-05,
+      "loss": 1.7112,
+      "step": 1178
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.0857484762961324e-05,
+      "loss": 1.1489,
+      "step": 1179
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.069633893626242e-05,
+      "loss": 1.6613,
+      "step": 1180
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 5.053536208170413e-05,
+      "loss": 1.2714,
+      "step": 1181
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 5.037455475098181e-05,
+      "loss": 1.5855,
+      "step": 1182
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 5.021391749520996e-05,
+      "loss": 1.5872,
+      "step": 1183
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 5.00534508649201e-05,
+      "loss": 1.4821,
+      "step": 1184
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.989315541005903e-05,
+      "loss": 1.4434,
+      "step": 1185
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.9733031679986874e-05,
+      "loss": 1.4363,
+      "step": 1186
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.957308022347521e-05,
+      "loss": 1.4829,
+      "step": 1187
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.9413301588705306e-05,
+      "loss": 1.4609,
+      "step": 1188
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.925369632326604e-05,
+      "loss": 1.5508,
+      "step": 1189
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.909426497415216e-05,
+      "loss": 1.7743,
+      "step": 1190
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.8935008087762344e-05,
+      "loss": 1.4651,
+      "step": 1191
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.877592620989739e-05,
+      "loss": 1.3678,
+      "step": 1192
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.8617019885758275e-05,
+      "loss": 1.8084,
+      "step": 1193
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.845828965994441e-05,
+      "loss": 1.5259,
+      "step": 1194
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.829973607645159e-05,
+      "loss": 1.2637,
+      "step": 1195
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.814135967867026e-05,
+      "loss": 1.2339,
+      "step": 1196
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.7983161009383626e-05,
+      "loss": 1.5256,
+      "step": 1197
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.782514061076574e-05,
+      "loss": 1.7238,
+      "step": 1198
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.766729902437982e-05,
+      "loss": 1.6077,
+      "step": 1199
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.7509636791176114e-05,
+      "loss": 1.4635,
+      "step": 1200
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.7352154451490283e-05,
+      "loss": 1.611,
+      "step": 1201
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.719485254504138e-05,
+      "loss": 1.4279,
+      "step": 1202
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.7037731610930215e-05,
+      "loss": 1.5654,
+      "step": 1203
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.688079218763728e-05,
+      "loss": 1.7005,
+      "step": 1204
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.672403481302096e-05,
+      "loss": 1.4512,
+      "step": 1205
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.656746002431586e-05,
+      "loss": 1.2077,
+      "step": 1206
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.641106835813073e-05,
+      "loss": 1.5321,
+      "step": 1207
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.62548603504467e-05,
+      "loss": 1.6799,
+      "step": 1208
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.609883653661562e-05,
+      "loss": 1.6249,
+      "step": 1209
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.5942997451357914e-05,
+      "loss": 1.3911,
+      "step": 1210
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.578734362876101e-05,
+      "loss": 1.2522,
+      "step": 1211
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.5631875602277354e-05,
+      "loss": 1.5985,
+      "step": 1212
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.547659390472262e-05,
+      "loss": 1.4064,
+      "step": 1213
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.532149906827401e-05,
+      "loss": 1.7128,
+      "step": 1214
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.516659162446822e-05,
+      "loss": 1.7731,
+      "step": 1215
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.501187210419975e-05,
+      "loss": 1.4555,
+      "step": 1216
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.485734103771905e-05,
+      "loss": 1.5535,
+      "step": 1217
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.470299895463065e-05,
+      "loss": 1.8557,
+      "step": 1218
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.454884638389155e-05,
+      "loss": 1.5999,
+      "step": 1219
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.439488385380914e-05,
+      "loss": 1.6452,
+      "step": 1220
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.4241111892039524e-05,
+      "loss": 1.3178,
+      "step": 1221
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.408753102558571e-05,
+      "loss": 1.6366,
+      "step": 1222
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.3934141780795746e-05,
+      "loss": 1.7496,
+      "step": 1223
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.378094468336107e-05,
+      "loss": 1.4534,
+      "step": 1224
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.36279402583145e-05,
+      "loss": 1.4879,
+      "step": 1225
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.3475129030028564e-05,
+      "loss": 1.797,
+      "step": 1226
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.332251152221366e-05,
+      "loss": 1.755,
+      "step": 1227
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.3170088257916277e-05,
+      "loss": 1.5334,
+      "step": 1228
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.301785975951718e-05,
+      "loss": 1.3509,
+      "step": 1229
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.286582654872971e-05,
+      "loss": 1.4803,
+      "step": 1230
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.271398914659786e-05,
+      "loss": 1.4174,
+      "step": 1231
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.256234807349455e-05,
+      "loss": 1.6836,
+      "step": 1232
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.2410903849119866e-05,
+      "loss": 1.6581,
+      "step": 1233
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.225965699249923e-05,
+      "loss": 1.4545,
+      "step": 1234
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.210860802198173e-05,
+      "loss": 1.4561,
+      "step": 1235
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.195775745523819e-05,
+      "loss": 1.6646,
+      "step": 1236
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.180710580925948e-05,
+      "loss": 1.8593,
+      "step": 1237
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.1656653600354736e-05,
+      "loss": 1.3432,
+      "step": 1238
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.1506401344149624e-05,
+      "loss": 1.7428,
+      "step": 1239
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.135634955558452e-05,
+      "loss": 1.5265,
+      "step": 1240
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.120649874891269e-05,
+      "loss": 1.6038,
+      "step": 1241
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.105684943769875e-05,
+      "loss": 1.62,
+      "step": 1242
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.090740213481664e-05,
+      "loss": 1.524,
+      "step": 1243
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.0758157352448e-05,
+      "loss": 1.5984,
+      "step": 1244
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.060911560208038e-05,
+      "loss": 1.602,
+      "step": 1245
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.046027739450562e-05,
+      "loss": 1.8375,
+      "step": 1246
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.0311643239817856e-05,
+      "loss": 1.722,
+      "step": 1247
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.0163213647411924e-05,
+      "loss": 1.7349,
+      "step": 1248
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.0014989125981594e-05,
+      "loss": 1.4009,
+      "step": 1249
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 3.9866970183517915e-05,
+      "loss": 1.5651,
+      "step": 1250
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 3.971915732730725e-05,
+      "loss": 1.4639,
+      "step": 1251
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.9571551063929735e-05,
+      "loss": 1.5082,
+      "step": 1252
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.9424151899257455e-05,
+      "loss": 2.0192,
+      "step": 1253
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.9276960338452716e-05,
+      "loss": 1.2115,
+      "step": 1254
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.912997688596641e-05,
+      "loss": 1.3201,
+      "step": 1255
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.898320204553614e-05,
+      "loss": 1.9871,
+      "step": 1256
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.883663632018456e-05,
+      "loss": 1.5665,
+      "step": 1257
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.8690280212217644e-05,
+      "loss": 1.5102,
+      "step": 1258
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.8544134223222986e-05,
+      "loss": 1.266,
+      "step": 1259
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.8398198854068114e-05,
+      "loss": 1.4204,
+      "step": 1260
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.825247460489865e-05,
+      "loss": 1.7609,
+      "step": 1261
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.81069619751367e-05,
+      "loss": 1.3592,
+      "step": 1262
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.7961661463479135e-05,
+      "loss": 1.4126,
+      "step": 1263
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.781657356789582e-05,
+      "loss": 1.4194,
+      "step": 1264
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.767169878562793e-05,
+      "loss": 1.5337,
+      "step": 1265
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.752703761318639e-05,
+      "loss": 1.4329,
+      "step": 1266
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.738259054634993e-05,
+      "loss": 1.5659,
+      "step": 1267
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 3.723835808016351e-05,
+      "loss": 1.2736,
+      "step": 1268
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.709434070893665e-05,
+      "loss": 2.04,
+      "step": 1269
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.695053892624166e-05,
+      "loss": 1.7854,
+      "step": 1270
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.68069532249121e-05,
+      "loss": 1.6785,
+      "step": 1271
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.666358409704086e-05,
+      "loss": 1.6782,
+      "step": 1272
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.6520432033978657e-05,
+      "loss": 1.6329,
+      "step": 1273
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.637749752633225e-05,
+      "loss": 1.5026,
+      "step": 1274
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.623478106396281e-05,
+      "loss": 1.5664,
+      "step": 1275
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.6092283135984296e-05,
+      "loss": 1.7229,
+      "step": 1276
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.595000423076162e-05,
+      "loss": 1.8079,
+      "step": 1277
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.580794483590908e-05,
+      "loss": 1.4605,
+      "step": 1278
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.566610543828876e-05,
+      "loss": 1.9116,
+      "step": 1279
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.552448652400868e-05,
+      "loss": 1.5441,
+      "step": 1280
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.538308857842122e-05,
+      "loss": 1.3942,
+      "step": 1281
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.5241912086121565e-05,
+      "loss": 1.6973,
+      "step": 1282
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.510095753094584e-05,
+      "loss": 1.601,
+      "step": 1283
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.4960225395969606e-05,
+      "loss": 1.5545,
+      "step": 1284
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.481971616350609e-05,
+      "loss": 1.2497,
+      "step": 1285
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 3.46794303151047e-05,
+      "loss": 1.5741,
+      "step": 1286
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.453936833154918e-05,
+      "loss": 1.4521,
+      "step": 1287
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.439953069285609e-05,
+      "loss": 1.7868,
+      "step": 1288
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.4259917878273095e-05,
+      "loss": 1.8244,
+      "step": 1289
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.412053036627732e-05,
+      "loss": 1.4066,
+      "step": 1290
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.398136863457389e-05,
+      "loss": 1.2967,
+      "step": 1291
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.384243316009395e-05,
+      "loss": 1.4826,
+      "step": 1292
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.370372441899333e-05,
+      "loss": 1.5515,
+      "step": 1293
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.3565242886650796e-05,
+      "loss": 1.3215,
+      "step": 1294
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.3426989037666356e-05,
+      "loss": 1.4563,
+      "step": 1295
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.328896334585986e-05,
+      "loss": 1.5442,
+      "step": 1296
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.3151166284269084e-05,
+      "loss": 1.6434,
+      "step": 1297
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.301359832514832e-05,
+      "loss": 1.4986,
+      "step": 1298
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.2876259939966634e-05,
+      "loss": 1.6104,
+      "step": 1299
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.273915159940636e-05,
+      "loss": 1.481,
+      "step": 1300
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.2602273773361346e-05,
+      "loss": 1.8361,
+      "step": 1301
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.2465626930935566e-05,
+      "loss": 1.3536,
+      "step": 1302
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 3.232921154044126e-05,
+      "loss": 1.3815,
+      "step": 1303
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.2193028069397455e-05,
+      "loss": 1.5579,
+      "step": 1304
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.2057076984528386e-05,
+      "loss": 1.7999,
+      "step": 1305
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.192135875176181e-05,
+      "loss": 1.5119,
+      "step": 1306
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.178587383622754e-05,
+      "loss": 1.4965,
+      "step": 1307
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.16506227022557e-05,
+      "loss": 1.7027,
+      "step": 1308
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.151560581337524e-05,
+      "loss": 1.2099,
+      "step": 1309
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.1380823632312276e-05,
+      "loss": 1.448,
+      "step": 1310
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.1246276620988545e-05,
+      "loss": 1.4255,
+      "step": 1311
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.1111965240519905e-05,
+      "loss": 1.4258,
+      "step": 1312
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.0977889951214554e-05,
+      "loss": 1.6441,
+      "step": 1313
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.084405121257161e-05,
+      "loss": 1.5759,
+      "step": 1314
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.071044948327945e-05,
+      "loss": 1.5413,
+      "step": 1315
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.05770852212143e-05,
+      "loss": 1.1413,
+      "step": 1316
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.0443958883438407e-05,
+      "loss": 1.3801,
+      "step": 1317
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.031107092619865e-05,
+      "loss": 1.5511,
+      "step": 1318
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.0178421804925005e-05,
+      "loss": 1.5642,
+      "step": 1319
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.004601197422884e-05,
+      "loss": 1.7629,
+      "step": 1320
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 2.9913841887901427e-05,
+      "loss": 1.1748,
+      "step": 1321
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.978191199891248e-05,
+      "loss": 1.5807,
+      "step": 1322
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.965022275940843e-05,
+      "loss": 1.3764,
+      "step": 1323
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.9518774620710977e-05,
+      "loss": 1.5585,
+      "step": 1324
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.938756803331556e-05,
+      "loss": 1.6272,
+      "step": 1325
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.9256603446889706e-05,
+      "loss": 1.6165,
+      "step": 1326
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.9125881310271685e-05,
+      "loss": 1.5237,
+      "step": 1327
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.8995402071468756e-05,
+      "loss": 1.5154,
+      "step": 1328
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.8865166177655745e-05,
+      "loss": 1.6596,
+      "step": 1329
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.8735174075173498e-05,
+      "loss": 1.5429,
+      "step": 1330
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.8605426209527318e-05,
+      "loss": 1.7465,
+      "step": 1331
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.8475923025385543e-05,
+      "loss": 1.6631,
+      "step": 1332
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.8346664966577874e-05,
+      "loss": 1.4025,
+      "step": 1333
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.8217652476093948e-05,
+      "loss": 1.2727,
+      "step": 1334
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.8088885996081805e-05,
+      "loss": 1.3416,
+      "step": 1335
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.7960365967846336e-05,
+      "loss": 1.4648,
+      "step": 1336
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.78320928318478e-05,
+      "loss": 1.6235,
+      "step": 1337
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 2.7704067027700398e-05,
+      "loss": 1.3916,
+      "step": 1338
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.7576288994170572e-05,
+      "loss": 1.3144,
+      "step": 1339
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.7448759169175676e-05,
+      "loss": 1.475,
+      "step": 1340
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.7321477989782386e-05,
+      "loss": 1.4861,
+      "step": 1341
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.719444589220519e-05,
+      "loss": 1.4116,
+      "step": 1342
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.7067663311805046e-05,
+      "loss": 1.7539,
+      "step": 1343
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.6941130683087658e-05,
+      "loss": 1.415,
+      "step": 1344
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.6814848439702156e-05,
+      "loss": 1.5414,
+      "step": 1345
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.6688817014439538e-05,
+      "loss": 1.6462,
+      "step": 1346
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.656303683923117e-05,
+      "loss": 1.6338,
+      "step": 1347
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.6437508345147465e-05,
+      "loss": 1.5767,
+      "step": 1348
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.631223196239615e-05,
+      "loss": 1.424,
+      "step": 1349
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.6187208120320984e-05,
+      "loss": 1.2644,
+      "step": 1350
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.6062437247400185e-05,
+      "loss": 1.1588,
+      "step": 1351
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.5937919771245067e-05,
+      "loss": 1.2925,
+      "step": 1352
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.5813656118598463e-05,
+      "loss": 1.5352,
+      "step": 1353
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.5689646715333315e-05,
+      "loss": 1.3947,
+      "step": 1354
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.5565891986451196e-05,
+      "loss": 1.507,
+      "step": 1355
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 2.544239235608091e-05,
+      "loss": 1.9416,
+      "step": 1356
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.5319148247476963e-05,
+      "loss": 1.407,
+      "step": 1357
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.5196160083018118e-05,
+      "loss": 1.4915,
+      "step": 1358
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.5073428284206045e-05,
+      "loss": 1.5079,
+      "step": 1359
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.4950953271663748e-05,
+      "loss": 1.3803,
+      "step": 1360
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.4828735465134188e-05,
+      "loss": 1.3984,
+      "step": 1361
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.4706775283478834e-05,
+      "loss": 1.586,
+      "step": 1362
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.4585073144676262e-05,
+      "loss": 1.7575,
+      "step": 1363
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.446362946582067e-05,
+      "loss": 1.4367,
+      "step": 1364
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.4342444663120457e-05,
+      "loss": 1.4826,
+      "step": 1365
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.422151915189682e-05,
+      "loss": 1.5902,
+      "step": 1366
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.4100853346582297e-05,
+      "loss": 1.6512,
+      "step": 1367
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.398044766071944e-05,
+      "loss": 1.3162,
+      "step": 1368
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.3860302506959253e-05,
+      "loss": 1.3959,
+      "step": 1369
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.3740418297059875e-05,
+      "loss": 1.7186,
+      "step": 1370
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.3620795441885148e-05,
+      "loss": 1.5878,
+      "step": 1371
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.3501434351403207e-05,
+      "loss": 1.2037,
+      "step": 1372
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 2.3382335434685044e-05,
+      "loss": 1.5493,
+      "step": 1373
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.326349909990323e-05,
+      "loss": 1.6555,
+      "step": 1374
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.3144925754330315e-05,
+      "loss": 1.4211,
+      "step": 1375
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.3026615804337582e-05,
+      "loss": 1.627,
+      "step": 1376
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.290856965539363e-05,
+      "loss": 1.5237,
+      "step": 1377
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.27907877120629e-05,
+      "loss": 1.5749,
+      "step": 1378
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.2673270378004475e-05,
+      "loss": 1.4566,
+      "step": 1379
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.255601805597046e-05,
+      "loss": 1.4767,
+      "step": 1380
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.243903114780479e-05,
+      "loss": 1.538,
+      "step": 1381
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.232231005444173e-05,
+      "loss": 1.5785,
+      "step": 1382
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.2205855175904556e-05,
+      "loss": 1.5375,
+      "step": 1383
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.2089666911304252e-05,
+      "loss": 1.2052,
+      "step": 1384
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.1973745658837997e-05,
+      "loss": 1.4827,
+      "step": 1385
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.1858091815787886e-05,
+      "loss": 1.4998,
+      "step": 1386
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.1742705778519577e-05,
+      "loss": 1.5547,
+      "step": 1387
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.1627587942480866e-05,
+      "loss": 1.3002,
+      "step": 1388
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.1512738702200453e-05,
+      "loss": 1.3861,
+      "step": 1389
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.1398158451286455e-05,
+      "loss": 1.6058,
+      "step": 1390
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 2.128384758242511e-05,
+      "loss": 1.6462,
+      "step": 1391
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.1169806487379497e-05,
+      "loss": 1.3529,
+      "step": 1392
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.1056035556988075e-05,
+      "loss": 1.5342,
+      "step": 1393
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.0942535181163404e-05,
+      "loss": 1.6098,
+      "step": 1394
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.0829305748890883e-05,
+      "loss": 1.3862,
+      "step": 1395
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.0716347648227242e-05,
+      "loss": 1.5603,
+      "step": 1396
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.0603661266299356e-05,
+      "loss": 1.5869,
+      "step": 1397
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.0491246989302848e-05,
+      "loss": 1.6428,
+      "step": 1398
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.0379105202500858e-05,
+      "loss": 1.4214,
+      "step": 1399
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.0267236290222602e-05,
+      "loss": 1.726,
+      "step": 1400
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.0155640635862094e-05,
+      "loss": 1.3779,
+      "step": 1401
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 2.004431862187688e-05,
+      "loss": 1.3435,
+      "step": 1402
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 1.9933270629786647e-05,
+      "loss": 1.5685,
+      "step": 1403
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 1.982249704017205e-05,
+      "loss": 1.6866,
+      "step": 1404
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 1.9711998232673247e-05,
+      "loss": 1.2784,
+      "step": 1405
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 1.9601774585988673e-05,
+      "loss": 1.6733,
+      "step": 1406
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 1.9491826477873766e-05,
+      "loss": 1.4765,
+      "step": 1407
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 1.938215428513963e-05,
+      "loss": 1.4472,
+      "step": 1408
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.9272758383651733e-05,
+      "loss": 1.2351,
+      "step": 1409
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.9163639148328748e-05,
+      "loss": 1.8237,
+      "step": 1410
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.905479695314104e-05,
+      "loss": 1.7798,
+      "step": 1411
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.894623217110959e-05,
+      "loss": 1.5971,
+      "step": 1412
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.8837945174304596e-05,
+      "loss": 1.518,
+      "step": 1413
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.8729936333844223e-05,
+      "loss": 1.6701,
+      "step": 1414
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.862220601989343e-05,
+      "loss": 1.4903,
+      "step": 1415
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.8514754601662544e-05,
+      "loss": 1.4217,
+      "step": 1416
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.840758244740608e-05,
+      "loss": 1.5594,
+      "step": 1417
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.8300689924421478e-05,
+      "loss": 1.4617,
+      "step": 1418
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.8194077399047792e-05,
+      "loss": 1.4645,
+      "step": 1419
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.808774523666459e-05,
+      "loss": 1.4996,
+      "step": 1420
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.798169380169046e-05,
+      "loss": 1.4993,
+      "step": 1421
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.7875923457581966e-05,
+      "loss": 1.5082,
+      "step": 1422
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.777043456683227e-05,
+      "loss": 1.3071,
+      "step": 1423
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.7665227490969982e-05,
+      "loss": 1.5606,
+      "step": 1424
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.7560302590557897e-05,
+      "loss": 1.2752,
+      "step": 1425
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 1.7455660225191715e-05,
+      "loss": 1.3328,
+      "step": 1426
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.7351300753498857e-05,
+      "loss": 1.4168,
+      "step": 1427
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.7247224533137162e-05,
+      "loss": 1.7445,
+      "step": 1428
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.714343192079385e-05,
+      "loss": 1.7909,
+      "step": 1429
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.703992327218403e-05,
+      "loss": 1.652,
+      "step": 1430
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.6936698942049666e-05,
+      "loss": 1.4826,
+      "step": 1431
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.6833759284158367e-05,
+      "loss": 1.5082,
+      "step": 1432
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.6731104651302055e-05,
+      "loss": 1.9254,
+      "step": 1433
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.6628735395295814e-05,
+      "loss": 1.6316,
+      "step": 1434
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.652665186697676e-05,
+      "loss": 1.3889,
+      "step": 1435
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.6424854416202727e-05,
+      "loss": 1.4924,
+      "step": 1436
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.6323343391851097e-05,
+      "loss": 1.2403,
+      "step": 1437
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.622211914181765e-05,
+      "loss": 1.4673,
+      "step": 1438
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.61211820130153e-05,
+      "loss": 1.675,
+      "step": 1439
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.6020532351373042e-05,
+      "loss": 1.3811,
+      "step": 1440
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.592017050183455e-05,
+      "loss": 1.4779,
+      "step": 1441
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.582009680835721e-05,
+      "loss": 1.631,
+      "step": 1442
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 1.5720311613910787e-05,
+      "loss": 1.6856,
+      "step": 1443
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.562081526047634e-05,
+      "loss": 1.498,
+      "step": 1444
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.552160808904498e-05,
+      "loss": 1.5739,
+      "step": 1445
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.542269043961684e-05,
+      "loss": 1.2108,
+      "step": 1446
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.532406265119971e-05,
+      "loss": 1.5062,
+      "step": 1447
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.5225725061808027e-05,
+      "loss": 1.5386,
+      "step": 1448
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.5127678008461633e-05,
+      "loss": 1.4687,
+      "step": 1449
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.5029921827184657e-05,
+      "loss": 1.3327,
+      "step": 1450
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.4932456853004429e-05,
+      "loss": 1.531,
+      "step": 1451
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.4835283419950164e-05,
+      "loss": 1.3574,
+      "step": 1452
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.4738401861051977e-05,
+      "loss": 1.5991,
+      "step": 1453
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.4641812508339648e-05,
+      "loss": 1.4434,
+      "step": 1454
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.4545515692841517e-05,
+      "loss": 1.2876,
+      "step": 1455
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.4449511744583399e-05,
+      "loss": 1.4832,
+      "step": 1456
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.4353800992587341e-05,
+      "loss": 1.3495,
+      "step": 1457
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.4258383764870586e-05,
+      "loss": 1.2479,
+      "step": 1458
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.416326038844441e-05,
+      "loss": 1.4204,
+      "step": 1459
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.4068431189312992e-05,
+      "loss": 1.3884,
+      "step": 1460
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 1.3973896492472371e-05,
+      "loss": 1.3545,
+      "step": 1461
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.387965662190922e-05,
+      "loss": 1.4263,
+      "step": 1462
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.3785711900599818e-05,
+      "loss": 1.3738,
+      "step": 1463
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.3692062650508908e-05,
+      "loss": 1.5192,
+      "step": 1464
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.3598709192588577e-05,
+      "loss": 1.5528,
+      "step": 1465
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.3505651846777256e-05,
+      "loss": 1.5884,
+      "step": 1466
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.3412890931998467e-05,
+      "loss": 1.6593,
+      "step": 1467
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.3320426766159854e-05,
+      "loss": 1.3007,
+      "step": 1468
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.3228259666152054e-05,
+      "loss": 1.6549,
+      "step": 1469
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.3136389947847593e-05,
+      "loss": 1.3378,
+      "step": 1470
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.3044817926099806e-05,
+      "loss": 1.4622,
+      "step": 1471
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.2953543914741817e-05,
+      "loss": 1.4228,
+      "step": 1472
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.2862568226585381e-05,
+      "loss": 1.6234,
+      "step": 1473
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.2771891173419836e-05,
+      "loss": 1.4518,
+      "step": 1474
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.2681513066011064e-05,
+      "loss": 1.5831,
+      "step": 1475
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.2591434214100428e-05,
+      "loss": 1.7618,
+      "step": 1476
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.2501654926403683e-05,
+      "loss": 1.5157,
+      "step": 1477
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 1.241217551060988e-05,
+      "loss": 1.2114,
+      "step": 1478
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.2322996273380427e-05,
+      "loss": 1.5176,
+      "step": 1479
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.223411752034791e-05,
+      "loss": 1.4507,
+      "step": 1480
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.2145539556115115e-05,
+      "loss": 1.5029,
+      "step": 1481
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.2057262684254033e-05,
+      "loss": 1.2238,
+      "step": 1482
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.196928720730468e-05,
+      "loss": 1.723,
+      "step": 1483
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1881613426774175e-05,
+      "loss": 1.3434,
+      "step": 1484
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1794241643135673e-05,
+      "loss": 1.5053,
+      "step": 1485
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1707172155827307e-05,
+      "loss": 1.3872,
+      "step": 1486
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1620405263251255e-05,
+      "loss": 1.6737,
+      "step": 1487
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1533941262772585e-05,
+      "loss": 1.3839,
+      "step": 1488
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1447780450718314e-05,
+      "loss": 1.3774,
+      "step": 1489
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1361923122376395e-05,
+      "loss": 1.619,
+      "step": 1490
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.127636957199467e-05,
+      "loss": 1.4088,
+      "step": 1491
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1191120092779917e-05,
+      "loss": 1.8829,
+      "step": 1492
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1106174976896789e-05,
+      "loss": 1.4611,
+      "step": 1493
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.1021534515466825e-05,
+      "loss": 1.6585,
+      "step": 1494
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.0937198998567466e-05,
+      "loss": 1.5309,
+      "step": 1495
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 1.0853168715231043e-05,
+      "loss": 1.7554,
+      "step": 1496
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.0769443953443848e-05,
+      "loss": 1.6353,
+      "step": 1497
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.068602500014504e-05,
+      "loss": 1.4047,
+      "step": 1498
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.0602912141225752e-05,
+      "loss": 1.4872,
+      "step": 1499
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.052010566152808e-05,
+      "loss": 1.4415,
+      "step": 1500
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.0437605844844045e-05,
+      "loss": 1.3304,
+      "step": 1501
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.0355412973914802e-05,
+      "loss": 1.6305,
+      "step": 1502
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.0273527330429455e-05,
+      "loss": 1.5313,
+      "step": 1503
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.0191949195024175e-05,
+      "loss": 1.4468,
+      "step": 1504
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.011067884728134e-05,
+      "loss": 1.6513,
+      "step": 1505
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 1.0029716565728408e-05,
+      "loss": 1.309,
+      "step": 1506
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 9.949062627837059e-06,
+      "loss": 1.601,
+      "step": 1507
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 9.868717310022257e-06,
+      "loss": 1.3033,
+      "step": 1508
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 9.788680887641233e-06,
+      "loss": 1.561,
+      "step": 1509
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 9.708953634992602e-06,
+      "loss": 1.7296,
+      "step": 1510
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 9.629535825315362e-06,
+      "loss": 1.4834,
+      "step": 1511
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 9.55042773078808e-06,
+      "loss": 1.5171,
+      "step": 1512
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 9.4716296225278e-06,
+      "loss": 1.4468,
+      "step": 1513
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 9.393141770589208e-06,
+      "loss": 1.4755,
+      "step": 1514
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 9.314964443963715e-06,
+      "loss": 1.5009,
+      "step": 1515
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 9.237097910578462e-06,
+      "loss": 1.4373,
+      "step": 1516
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 9.159542437295476e-06,
+      "loss": 1.4056,
+      "step": 1517
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 9.082298289910762e-06,
+      "loss": 1.406,
+      "step": 1518
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 9.005365733153282e-06,
+      "loss": 1.6005,
+      "step": 1519
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.928745030684183e-06,
+      "loss": 1.5233,
+      "step": 1520
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.852436445095802e-06,
+      "loss": 1.547,
+      "step": 1521
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.776440237910788e-06,
+      "loss": 1.548,
+      "step": 1522
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.700756669581279e-06,
+      "loss": 1.285,
+      "step": 1523
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.62538599948789e-06,
+      "loss": 1.4989,
+      "step": 1524
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.550328485938885e-06,
+      "loss": 1.46,
+      "step": 1525
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.475584386169289e-06,
+      "loss": 1.247,
+      "step": 1526
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.401153956339991e-06,
+      "loss": 1.41,
+      "step": 1527
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.327037451536945e-06,
+      "loss": 1.5541,
+      "step": 1528
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.253235125770164e-06,
+      "loss": 1.5876,
+      "step": 1529
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.179747231972911e-06,
+      "loss": 1.5603,
+      "step": 1530
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 8.10657402200089e-06,
+      "loss": 1.2205,
+      "step": 1531
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 8.033715746631254e-06,
+      "loss": 1.1944,
+      "step": 1532
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.961172655561911e-06,
+      "loss": 1.531,
+      "step": 1533
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.888944997410508e-06,
+      "loss": 1.3763,
+      "step": 1534
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.817033019713692e-06,
+      "loss": 1.5526,
+      "step": 1535
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.745436968926178e-06,
+      "loss": 1.5448,
+      "step": 1536
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.674157090419965e-06,
+      "loss": 2.0339,
+      "step": 1537
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.603193628483496e-06,
+      "loss": 1.4803,
+      "step": 1538
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.5325468263207745e-06,
+      "loss": 1.3438,
+      "step": 1539
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.462216926050558e-06,
+      "loss": 1.537,
+      "step": 1540
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.39220416870553e-06,
+      "loss": 1.4498,
+      "step": 1541
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.322508794231476e-06,
+      "loss": 1.6221,
+      "step": 1542
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.253131041486461e-06,
+      "loss": 1.4852,
+      "step": 1543
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.184071148239957e-06,
+      "loss": 1.3665,
+      "step": 1544
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.115329351172173e-06,
+      "loss": 1.278,
+      "step": 1545
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 7.046905885873057e-06,
+      "loss": 1.4046,
+      "step": 1546
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 6.978800986841605e-06,
+      "loss": 1.974,
+      "step": 1547
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 6.911014887485068e-06,
+      "loss": 1.2305,
+      "step": 1548
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.843547820118079e-06,
+      "loss": 1.7394,
+      "step": 1549
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.776400015961881e-06,
+      "loss": 1.4169,
+      "step": 1550
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.709571705143591e-06,
+      "loss": 1.6973,
+      "step": 1551
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.643063116695325e-06,
+      "loss": 1.6746,
+      "step": 1552
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.576874478553463e-06,
+      "loss": 1.8666,
+      "step": 1553
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.511006017557908e-06,
+      "loss": 1.5443,
+      "step": 1554
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.445457959451207e-06,
+      "loss": 1.3081,
+      "step": 1555
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.38023052887784e-06,
+      "loss": 1.4181,
+      "step": 1556
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.315323949383456e-06,
+      "loss": 1.4969,
+      "step": 1557
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.250738443414073e-06,
+      "loss": 1.6408,
+      "step": 1558
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.1864742323153755e-06,
+      "loss": 1.2451,
+      "step": 1559
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.122531536331866e-06,
+      "loss": 1.4875,
+      "step": 1560
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 6.05891057460618e-06,
+      "loss": 1.6222,
+      "step": 1561
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 5.995611565178316e-06,
+      "loss": 1.8785,
+      "step": 1562
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 5.932634724984876e-06,
+      "loss": 1.36,
+      "step": 1563
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 5.869980269858355e-06,
+      "loss": 1.6873,
+      "step": 1564
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 5.807648414526368e-06,
+      "loss": 1.4992,
+      "step": 1565
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 5.745639372610922e-06,
+      "loss": 1.1869,
+      "step": 1566
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.683953356627669e-06,
+      "loss": 1.4862,
+      "step": 1567
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.62259057798521e-06,
+      "loss": 1.4815,
+      "step": 1568
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.561551246984387e-06,
+      "loss": 1.3613,
+      "step": 1569
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.5008355728174865e-06,
+      "loss": 1.4065,
+      "step": 1570
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.4404437635675935e-06,
+      "loss": 1.6057,
+      "step": 1571
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.380376026207823e-06,
+      "loss": 1.4346,
+      "step": 1572
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.320632566600669e-06,
+      "loss": 1.444,
+      "step": 1573
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.261213589497272e-06,
+      "loss": 1.0771,
+      "step": 1574
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.2021192985367004e-06,
+      "loss": 1.5763,
+      "step": 1575
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.1433498962452644e-06,
+      "loss": 1.6011,
+      "step": 1576
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.084905584035826e-06,
+      "loss": 1.4757,
+      "step": 1577
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 5.026786562207098e-06,
+      "loss": 1.2637,
+      "step": 1578
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 4.968993029943026e-06,
+      "loss": 1.3055,
+      "step": 1579
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 4.91152518531196e-06,
+      "loss": 1.3369,
+      "step": 1580
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 4.8543832252661124e-06,
+      "loss": 1.4293,
+      "step": 1581
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 4.7975673456408525e-06,
+      "loss": 1.352,
+      "step": 1582
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 4.741077741153965e-06,
+      "loss": 1.5699,
+      "step": 1583
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.684914605405044e-06,
+      "loss": 1.1004,
+      "step": 1584
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.629078130874864e-06,
+      "loss": 1.696,
+      "step": 1585
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.57356850892462e-06,
+      "loss": 1.5497,
+      "step": 1586
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.5183859297953545e-06,
+      "loss": 1.346,
+      "step": 1587
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.4635305826072785e-06,
+      "loss": 1.3519,
+      "step": 1588
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.409002655359107e-06,
+      "loss": 1.6072,
+      "step": 1589
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.354802334927455e-06,
+      "loss": 1.5083,
+      "step": 1590
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.300929807066146e-06,
+      "loss": 1.4011,
+      "step": 1591
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.247385256405623e-06,
+      "loss": 1.2403,
+      "step": 1592
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.194168866452275e-06,
+      "loss": 1.5103,
+      "step": 1593
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.141280819587834e-06,
+      "loss": 1.5773,
+      "step": 1594
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.088721297068776e-06,
+      "loss": 1.6227,
+      "step": 1595
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 4.036490479025623e-06,
+      "loss": 1.2225,
+      "step": 1596
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.984588544462387e-06,
+      "loss": 1.3142,
+      "step": 1597
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.933015671255946e-06,
+      "loss": 1.5455,
+      "step": 1598
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.8817720361553954e-06,
+      "loss": 1.5688,
+      "step": 1599
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.83085781478153e-06,
+      "loss": 1.4537,
+      "step": 1600
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.7802731816261484e-06,
+      "loss": 1.4018,
+      "step": 1601
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.7300183100515085e-06,
+      "loss": 1.2993,
+      "step": 1602
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.680093372289706e-06,
+      "loss": 1.344,
+      "step": 1603
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.6304985394420954e-06,
+      "loss": 1.2135,
+      "step": 1604
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.5812339814787376e-06,
+      "loss": 1.2205,
+      "step": 1605
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.5322998672377428e-06,
+      "loss": 1.4413,
+      "step": 1606
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.48369636442476e-06,
+      "loss": 1.4536,
+      "step": 1607
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.435423639612356e-06,
+      "loss": 1.5577,
+      "step": 1608
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.3874818582394717e-06,
+      "loss": 1.6891,
+      "step": 1609
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.3398711846108764e-06,
+      "loss": 1.4165,
+      "step": 1610
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.2925917818965257e-06,
+      "loss": 1.152,
+      "step": 1611
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.245643812131094e-06,
+      "loss": 1.4184,
+      "step": 1612
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.1990274362133534e-06,
+      "loss": 1.3022,
+      "step": 1613
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.15274281390564e-06,
+      "loss": 1.4716,
+      "step": 1614
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.106790103833368e-06,
+      "loss": 1.4401,
+      "step": 1615
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.061169463484359e-06,
+      "loss": 1.5769,
+      "step": 1616
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.0158810492084133e-06,
+      "loss": 1.3831,
+      "step": 1617
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 2.9709250162167412e-06,
+      "loss": 1.3578,
+      "step": 1618
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.926301518581409e-06,
+      "loss": 1.2642,
+      "step": 1619
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.882010709234817e-06,
+      "loss": 1.2626,
+      "step": 1620
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.8380527399692104e-06,
+      "loss": 1.4741,
+      "step": 1621
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.7944277614361247e-06,
+      "loss": 1.4785,
+      "step": 1622
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.7511359231458754e-06,
+      "loss": 1.3648,
+      "step": 1623
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.708177373467058e-06,
+      "loss": 1.443,
+      "step": 1624
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.6655522596259917e-06,
+      "loss": 1.6715,
+      "step": 1625
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.623260727706334e-06,
+      "loss": 1.6782,
+      "step": 1626
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.5813029226484096e-06,
+      "loss": 1.6295,
+      "step": 1627
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.5396789882488727e-06,
+      "loss": 1.5176,
+      "step": 1628
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.4983890671601006e-06,
+      "loss": 1.5017,
+      "step": 1629
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.4574333008897552e-06,
+      "loss": 1.4898,
+      "step": 1630
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.4168118298003364e-06,
+      "loss": 1.0972,
+      "step": 1631
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.3765247931086033e-06,
+      "loss": 1.5642,
+      "step": 1632
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.336572328885178e-06,
+      "loss": 1.628,
+      "step": 1633
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.2969545740540335e-06,
+      "loss": 1.4371,
+      "step": 1634
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.2576716643920358e-06,
+      "loss": 1.6451,
+      "step": 1635
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 2.218723734528494e-06,
+      "loss": 1.3833,
+      "step": 1636
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 2.180110917944678e-06,
+      "loss": 1.4701,
+      "step": 1637
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 2.1418333469733544e-06,
+      "loss": 1.4513,
+      "step": 1638
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 2.103891152798354e-06,
+      "loss": 1.1869,
+      "step": 1639
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 2.066284465454105e-06,
+      "loss": 1.2976,
+      "step": 1640
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 2.0290134138252314e-06,
+      "loss": 1.6223,
+      "step": 1641
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.992078125646013e-06,
+      "loss": 1.6844,
+      "step": 1642
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.9554787275000706e-06,
+      "loss": 1.3767,
+      "step": 1643
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.919215344819836e-06,
+      "loss": 1.5658,
+      "step": 1644
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.8832881018861713e-06,
+      "loss": 1.4048,
+      "step": 1645
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.8476971218279293e-06,
+      "loss": 1.2985,
+      "step": 1646
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.8124425266215273e-06,
+      "loss": 1.545,
+      "step": 1647
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.7775244370905387e-06,
+      "loss": 1.5249,
+      "step": 1648
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.7429429729052816e-06,
+      "loss": 1.5716,
+      "step": 1649
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.7086982525823636e-06,
+      "loss": 1.1574,
+      "step": 1650
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.6747903934843712e-06,
+      "loss": 1.4907,
+      "step": 1651
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.6412195118193697e-06,
+      "loss": 1.4049,
+      "step": 1652
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 1.6079857226405481e-06,
+      "loss": 1.58,
+      "step": 1653
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.57508913984582e-06,
+      "loss": 1.3537,
+      "step": 1654
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.5425298761774676e-06,
+      "loss": 1.586,
+      "step": 1655
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.5103080432216753e-06,
+      "loss": 1.5154,
+      "step": 1656
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.478423751408231e-06,
+      "loss": 1.6983,
+      "step": 1657
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.4468771100100808e-06,
+      "loss": 1.6261,
+      "step": 1658
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.4156682271430189e-06,
+      "loss": 1.4149,
+      "step": 1659
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.3847972097652428e-06,
+      "loss": 1.3621,
+      "step": 1660
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.3542641636770548e-06,
+      "loss": 1.4859,
+      "step": 1661
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.3240691935204608e-06,
+      "loss": 1.3434,
+      "step": 1662
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.2942124027788495e-06,
+      "loss": 1.4377,
+      "step": 1663
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.2646938937765584e-06,
+      "loss": 1.4133,
+      "step": 1664
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.2355137676786088e-06,
+      "loss": 1.5554,
+      "step": 1665
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.2066721244903157e-06,
+      "loss": 1.6052,
+      "step": 1666
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.1781690630569885e-06,
+      "loss": 1.2897,
+      "step": 1667
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.150004681063499e-06,
+      "loss": 1.0486,
+      "step": 1668
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.1221790750340465e-06,
+      "loss": 1.2673,
+      "step": 1669
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.094692340331771e-06,
+      "loss": 1.5204,
+      "step": 1670
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 1.067544571158452e-06,
+      "loss": 1.169,
+      "step": 1671
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 1.040735860554176e-06,
+      "loss": 1.1303,
+      "step": 1672
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 1.0142663003970155e-06,
+      "loss": 1.5095,
+      "step": 1673
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 9.881359814027048e-07,
+      "loss": 1.3887,
+      "step": 1674
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 9.623449931243422e-07,
+      "loss": 1.3595,
+      "step": 1675
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 9.36893423952101e-07,
+      "loss": 1.2681,
+      "step": 1676
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 9.117813611128844e-07,
+      "loss": 1.3787,
+      "step": 1677
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 8.870088906700713e-07,
+      "loss": 1.4271,
+      "step": 1678
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 8.625760975231822e-07,
+      "loss": 1.4526,
+      "step": 1679
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 8.384830654076026e-07,
+      "loss": 1.2458,
+      "step": 1680
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 8.147298768942934e-07,
+      "loss": 1.6105,
+      "step": 1681
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 7.913166133895478e-07,
+      "loss": 1.4861,
+      "step": 1682
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 7.682433551346347e-07,
+      "loss": 1.5687,
+      "step": 1683
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 7.455101812055998e-07,
+      "loss": 1.2883,
+      "step": 1684
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 7.231171695129324e-07,
+      "loss": 1.4969,
+      "step": 1685
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 7.010643968013431e-07,
+      "loss": 1.3642,
+      "step": 1686
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 6.793519386494973e-07,
+      "loss": 1.2697,
+      "step": 1687
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 6.57979869469727e-07,
+      "loss": 1.4437,
+      "step": 1688
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 6.369482625077749e-07,
+      "loss": 1.411,
+      "step": 1689
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 6.162571898426062e-07,
+      "loss": 1.6748,
+      "step": 1690
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 5.959067223860748e-07,
+      "loss": 1.1569,
+      "step": 1691
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 5.758969298827465e-07,
+      "loss": 1.521,
+      "step": 1692
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 5.562278809096322e-07,
+      "loss": 1.3578,
+      "step": 1693
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 5.368996428759432e-07,
+      "loss": 1.3112,
+      "step": 1694
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 5.17912282022881e-07,
+      "loss": 1.4656,
+      "step": 1695
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 4.992658634234038e-07,
+      "loss": 1.425,
+      "step": 1696
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 4.809604509820043e-07,
+      "loss": 1.3737,
+      "step": 1697
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 4.6299610743447683e-07,
+      "loss": 1.4331,
+      "step": 1698
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 4.4537289434772866e-07,
+      "loss": 2.0453,
+      "step": 1699
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 4.280908721195465e-07,
+      "loss": 1.4324,
+      "step": 1700
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 4.1115009997840793e-07,
+      "loss": 1.5224,
+      "step": 1701
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.945506359832263e-07,
+      "loss": 1.5118,
+      "step": 1702
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.782925370232615e-07,
+      "loss": 1.64,
+      "step": 1703
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.6237585881778723e-07,
+      "loss": 1.3675,
+      "step": 1704
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.4680065591602415e-07,
+      "loss": 1.5857,
+      "step": 1705
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.315669816968736e-07,
+      "loss": 1.5998,
+      "step": 1706
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.166748883687509e-07,
+      "loss": 1.5191,
+      "step": 1707
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.021244269694412e-07,
+      "loss": 1.2976,
+      "step": 1708
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 2.879156473658662e-07,
+      "loss": 1.3454,
+      "step": 1709
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 2.7404859825397313e-07,
+      "loss": 1.4047,
+      "step": 1710
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 2.605233271585128e-07,
+      "loss": 1.4968,
+      "step": 1711
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 2.4733988043293964e-07,
+      "loss": 1.9007,
+      "step": 1712
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 2.3449830325917853e-07,
+      "loss": 1.3605,
+      "step": 1713
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 2.2199863964754707e-07,
+      "loss": 1.5131,
+      "step": 1714
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 2.0984093243653357e-07,
+      "loss": 1.6281,
+      "step": 1715
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 1.9802522329268603e-07,
+      "loss": 1.275,
+      "step": 1716
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 1.8655155271048997e-07,
+      "loss": 1.6893,
+      "step": 1717
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 1.7541996001219085e-07,
+      "loss": 1.4978,
+      "step": 1718
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 1.6463048334767194e-07,
+      "loss": 1.6123,
+      "step": 1719
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 1.5418315969432108e-07,
+      "loss": 1.5833,
+      "step": 1720
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 1.4407802485691958e-07,
+      "loss": 1.3204,
+      "step": 1721
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 1.3431511346750912e-07,
+      "loss": 1.5477,
+      "step": 1722
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 1.2489445898528074e-07,
+      "loss": 1.4579,
+      "step": 1723
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 1.1581609369641922e-07,
+      "loss": 1.6216,
+      "step": 1724
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 1.0708004871404775e-07,
+      "loss": 1.6038,
+      "step": 1725
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 9.868635397811688e-08,
+      "loss": 1.2921,
+      "step": 1726
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 9.0635038255249e-08,
+      "loss": 1.2408,
+      "step": 1727
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 8.292612913869402e-08,
+      "loss": 1.9021,
+      "step": 1728
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 7.555965304820722e-08,
+      "loss": 1.2717,
+      "step": 1729
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 6.853563522997153e-08,
+      "loss": 1.6079,
+      "step": 1730
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 6.18540997565198e-08,
+      "loss": 1.347,
+      "step": 1731
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 5.5515069526612675e-08,
+      "loss": 1.3493,
+      "step": 1732
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 4.9518566265194246e-08,
+      "loss": 1.2432,
+      "step": 1733
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 4.3864610523325354e-08,
+      "loss": 1.3954,
+      "step": 1734
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.855322167808373e-08,
+      "loss": 1.5528,
+      "step": 1735
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.358441793251954e-08,
+      "loss": 1.3617,
+      "step": 1736
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 2.895821631556661e-08,
+      "loss": 1.2754,
+      "step": 1737
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 2.4674632682020195e-08,
+      "loss": 1.2537,
+      "step": 1738
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 2.0733681712459264e-08,
+      "loss": 1.4961,
+      "step": 1739
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 1.7135376913202107e-08,
+      "loss": 1.5801,
+      "step": 1740
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 1.387973061626191e-08,
+      "loss": 1.7043,
+      "step": 1741
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 1.0966753979302357e-08,
+      "loss": 1.4956,
+      "step": 1742
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 8.396456985582113e-09,
+      "loss": 1.4971,
+      "step": 1743
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 6.168848443954822e-09,
+      "loss": 1.4801,
+      "step": 1744
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 4.283935988835808e-09,
+      "loss": 1.4517,
+      "step": 1745
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 2.741726080135454e-09,
+      "loss": 1.4444,
+      "step": 1746
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 1.5422240032592073e-09,
+      "loss": 1.8116,
+      "step": 1747
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 6.854338691297812e-10,
+      "loss": 1.5837,
+      "step": 1748
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 1.7135861409833808e-10,
+      "loss": 1.6544,
+      "step": 1749
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 0.0,
+      "loss": 1.2849,
+      "step": 1750
+    },
+    {
+      "epoch": 1.0,
+      "step": 1750,
+      "total_flos": 2.0402858751741133e+17,
+      "train_loss": 2.0639551182474407,
+      "train_runtime": 10466.3396,
+      "train_samples_per_second": 2.675,
+      "train_steps_per_second": 0.167
+    }
+  ],
+  "logging_steps": 1.0,
+  "max_steps": 1750,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 50000,
+  "total_flos": 2.0402858751741133e+17,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}