diff --git a/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/README.md b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..857411c3c4bf6826c3bb3b2bbbb6c44b8462a8a4
--- /dev/null
+++ b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/README.md
@@ -0,0 +1,202 @@
+---
+base_model: liuhaotian/llava-v1.5-7b
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.10.0
\ No newline at end of file
diff --git a/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/adapter_config.json b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/adapter_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..791f54d059ab212b92ef1860dae29ed0ced550f6
--- /dev/null
+++ b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/adapter_config.json
@@ -0,0 +1,34 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "/home/r11kaijun/LLaVA/checkpoints/liuhaotian-llava-v1.5-7b",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "up_proj",
+    "k_proj",
+    "v_proj",
+    "o_proj",
+    "gate_proj",
+    "down_proj",
+    "q_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}
\ No newline at end of file
diff --git a/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/adapter_model.safetensors b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/adapter_model.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..1d41dd9cb5d146e1ed50a88d39faa4bc4d885d4b
--- /dev/null
+++ b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/adapter_model.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95c88bffddf6b2793a34665636ed25aeb50b4a8a4a417c481532ca9a68dea5d1
+size 639692320
diff --git a/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/config.json b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..3af476df32bee9bc5a858936a326449312b00d94
--- /dev/null
+++ b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/config.json
@@ -0,0 +1,51 @@
+{
+  "_name_or_path": "/home/r11kaijun/LLaVA/checkpoints/liuhaotian-llava-v1.5-7b",
+  "architectures": [
+    "LlavaLlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "freeze_mm_mlp_adapter": false,
+  "freeze_mm_vision_resampler": false,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "image_aspect_ratio": "pad",
+  "image_processor_path": "/home/r11kaijun/LLaVA/checkpoints/vision_tower-epoch-1-lr-0.0001",
+  "initializer_range": 0.02,
+  "intermediate_size": 11008,
+  "max_length": 4096,
+  "max_position_embeddings": 4096,
+  "mm_hidden_size": 1024,
+  "mm_patch_merge_type": "flat",
+  "mm_projector_lr": 2e-05,
+  "mm_projector_type": "mlp2x_gelu",
+  "mm_resampler_type": null,
+  "mm_use_im_patch_token": false,
+  "mm_use_im_start_end": false,
+  "mm_vision_select_feature": "patch",
+  "mm_vision_select_layer": -2,
+  "mm_vision_tower": "/home/r11kaijun/LLaVA/checkpoints/liuhaotian-llava-v1.5-7b",
+  "model_type": "llava_llama",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 32,
+  "pad_token_id": 0,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": null,
+  "rope_theta": 10000.0,
+  "tie_word_embeddings": false,
+  "tokenizer_model_max_length": 2048,
+  "tokenizer_padding_side": "right",
+  "torch_dtype": "float16",
+  "transformers_version": "4.37.2",
+  "tune_mm_mlp_adapter": false,
+  "tune_mm_vision_resampler": false,
+  "unfreeze_mm_vision_tower": false,
+  "use_cache": true,
+  "use_mm_proj": true,
+  "vision_tower_path": "/home/r11kaijun/LLaVA/checkpoints/vision_tower-epoch-1-lr-0.0001",
+  "vocab_size": 32000
+}
diff --git a/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/non_lora_trainables.bin b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/non_lora_trainables.bin
new file mode 100644
index 0000000000000000000000000000000000000000..b8224518cb2e069089ebd66eaa920ed96b0932d8
--- /dev/null
+++ b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/non_lora_trainables.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df948f9900b7bf9ccf29b8853f5dc9c680ac3a017477a7a799422d8f20408cc9
+size 41961648
diff --git a/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/trainer_state.json b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/trainer_state.json
new file mode 100644
index 0000000000000000000000000000000000000000..ced946384097b072ef95ca52f21f586b2053b56b
--- /dev/null
+++ b/lora-liuhaotian-llava-v1.5-7b-vision_tower-epoch-1-lr-0.0001-train_28k_custom-train-mlp-and-llm-unquantized-epoch-2-lr-6e-5/trainer_state.json
@@ -0,0 +1,21030 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 2.0,
+  "eval_steps": 500,
+  "global_step": 3500,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.0,
+      "learning_rate": 5.714285714285715e-07,
+      "loss": 2.5131,
+      "step": 1
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 1.142857142857143e-06,
+      "loss": 2.5635,
+      "step": 2
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 1.7142857142857143e-06,
+      "loss": 2.6506,
+      "step": 3
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 2.285714285714286e-06,
+      "loss": 2.7476,
+      "step": 4
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 2.8571428571428573e-06,
+      "loss": 2.6204,
+      "step": 5
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 3.4285714285714285e-06,
+      "loss": 2.7344,
+      "step": 6
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 4e-06,
+      "loss": 2.6053,
+      "step": 7
+    },
+    {
+      "epoch": 0.0,
+      "learning_rate": 4.571428571428572e-06,
+      "loss": 2.4524,
+      "step": 8
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 5.142857142857143e-06,
+      "loss": 2.4451,
+      "step": 9
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 5.7142857142857145e-06,
+      "loss": 2.4988,
+      "step": 10
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 6.285714285714286e-06,
+      "loss": 2.3463,
+      "step": 11
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 6.857142857142857e-06,
+      "loss": 2.3157,
+      "step": 12
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 7.428571428571429e-06,
+      "loss": 2.4401,
+      "step": 13
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 8e-06,
+      "loss": 2.4424,
+      "step": 14
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 8.571428571428571e-06,
+      "loss": 2.3891,
+      "step": 15
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 9.142857142857144e-06,
+      "loss": 2.3456,
+      "step": 16
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 9.714285714285715e-06,
+      "loss": 2.1623,
+      "step": 17
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 1.0285714285714286e-05,
+      "loss": 2.2015,
+      "step": 18
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 1.0857142857142858e-05,
+      "loss": 2.0723,
+      "step": 19
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 1.1428571428571429e-05,
+      "loss": 2.2245,
+      "step": 20
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 1.2e-05,
+      "loss": 2.0772,
+      "step": 21
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 1.2571428571428572e-05,
+      "loss": 2.1567,
+      "step": 22
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 1.3142857142857143e-05,
+      "loss": 1.8458,
+      "step": 23
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 1.3714285714285714e-05,
+      "loss": 2.0393,
+      "step": 24
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 1.4285714285714285e-05,
+      "loss": 1.8176,
+      "step": 25
+    },
+    {
+      "epoch": 0.01,
+      "learning_rate": 1.4857142857142858e-05,
+      "loss": 1.8693,
+      "step": 26
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 1.5428571428571428e-05,
+      "loss": 1.9138,
+      "step": 27
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 1.6e-05,
+      "loss": 1.8914,
+      "step": 28
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 1.6571428571428574e-05,
+      "loss": 1.8815,
+      "step": 29
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 1.7142857142857142e-05,
+      "loss": 1.9903,
+      "step": 30
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 1.7714285714285717e-05,
+      "loss": 1.7925,
+      "step": 31
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 1.8285714285714288e-05,
+      "loss": 1.7906,
+      "step": 32
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 1.8857142857142856e-05,
+      "loss": 1.778,
+      "step": 33
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 1.942857142857143e-05,
+      "loss": 2.1203,
+      "step": 34
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 1.9999999999999998e-05,
+      "loss": 1.6773,
+      "step": 35
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 2.0571428571428573e-05,
+      "loss": 1.8191,
+      "step": 36
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 2.1142857142857144e-05,
+      "loss": 1.917,
+      "step": 37
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 2.1714285714285715e-05,
+      "loss": 1.6981,
+      "step": 38
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 2.2285714285714287e-05,
+      "loss": 1.7678,
+      "step": 39
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 2.2857142857142858e-05,
+      "loss": 1.8091,
+      "step": 40
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 2.342857142857143e-05,
+      "loss": 1.7311,
+      "step": 41
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 2.4e-05,
+      "loss": 1.8267,
+      "step": 42
+    },
+    {
+      "epoch": 0.02,
+      "learning_rate": 2.4571428571428572e-05,
+      "loss": 1.7456,
+      "step": 43
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 2.5142857142857143e-05,
+      "loss": 1.6801,
+      "step": 44
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 2.5714285714285714e-05,
+      "loss": 1.7205,
+      "step": 45
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 2.6285714285714286e-05,
+      "loss": 1.7272,
+      "step": 46
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 2.685714285714286e-05,
+      "loss": 1.7019,
+      "step": 47
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 2.7428571428571428e-05,
+      "loss": 1.5481,
+      "step": 48
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 2.8e-05,
+      "loss": 1.4077,
+      "step": 49
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 2.857142857142857e-05,
+      "loss": 1.5636,
+      "step": 50
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 2.9142857142857142e-05,
+      "loss": 1.6735,
+      "step": 51
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 2.9714285714285717e-05,
+      "loss": 1.4807,
+      "step": 52
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 3.0285714285714285e-05,
+      "loss": 1.6839,
+      "step": 53
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 3.0857142857142856e-05,
+      "loss": 1.578,
+      "step": 54
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 3.142857142857143e-05,
+      "loss": 1.7775,
+      "step": 55
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 3.2e-05,
+      "loss": 1.5789,
+      "step": 56
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 3.2571428571428566e-05,
+      "loss": 1.5733,
+      "step": 57
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 3.314285714285715e-05,
+      "loss": 1.5908,
+      "step": 58
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 3.3714285714285716e-05,
+      "loss": 1.6788,
+      "step": 59
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 3.4285714285714284e-05,
+      "loss": 1.6715,
+      "step": 60
+    },
+    {
+      "epoch": 0.03,
+      "learning_rate": 3.485714285714286e-05,
+      "loss": 1.651,
+      "step": 61
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 3.542857142857143e-05,
+      "loss": 1.527,
+      "step": 62
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 3.6e-05,
+      "loss": 1.4544,
+      "step": 63
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 3.6571428571428576e-05,
+      "loss": 1.7134,
+      "step": 64
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 3.7142857142857143e-05,
+      "loss": 1.5462,
+      "step": 65
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 3.771428571428571e-05,
+      "loss": 1.4882,
+      "step": 66
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 3.8285714285714286e-05,
+      "loss": 1.4759,
+      "step": 67
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 3.885714285714286e-05,
+      "loss": 1.5585,
+      "step": 68
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 3.942857142857143e-05,
+      "loss": 1.6374,
+      "step": 69
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 3.9999999999999996e-05,
+      "loss": 1.6904,
+      "step": 70
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 4.057142857142858e-05,
+      "loss": 1.6488,
+      "step": 71
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 4.1142857142857146e-05,
+      "loss": 1.593,
+      "step": 72
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 4.1714285714285714e-05,
+      "loss": 1.5516,
+      "step": 73
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 4.228571428571429e-05,
+      "loss": 1.5302,
+      "step": 74
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 4.2857142857142856e-05,
+      "loss": 1.6237,
+      "step": 75
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 4.342857142857143e-05,
+      "loss": 1.4187,
+      "step": 76
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 4.4e-05,
+      "loss": 1.5665,
+      "step": 77
+    },
+    {
+      "epoch": 0.04,
+      "learning_rate": 4.4571428571428574e-05,
+      "loss": 1.3691,
+      "step": 78
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.514285714285714e-05,
+      "loss": 1.4379,
+      "step": 79
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.5714285714285716e-05,
+      "loss": 1.3048,
+      "step": 80
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.628571428571429e-05,
+      "loss": 1.5741,
+      "step": 81
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.685714285714286e-05,
+      "loss": 1.4735,
+      "step": 82
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.7428571428571427e-05,
+      "loss": 1.5396,
+      "step": 83
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.8e-05,
+      "loss": 1.4128,
+      "step": 84
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.8571428571428576e-05,
+      "loss": 1.3273,
+      "step": 85
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.9142857142857144e-05,
+      "loss": 1.5592,
+      "step": 86
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 4.971428571428572e-05,
+      "loss": 1.5049,
+      "step": 87
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 5.0285714285714286e-05,
+      "loss": 1.4782,
+      "step": 88
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 5.0857142857142854e-05,
+      "loss": 1.3633,
+      "step": 89
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 5.142857142857143e-05,
+      "loss": 1.4669,
+      "step": 90
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 5.2000000000000004e-05,
+      "loss": 1.4861,
+      "step": 91
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 5.257142857142857e-05,
+      "loss": 1.4946,
+      "step": 92
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 5.314285714285714e-05,
+      "loss": 1.4229,
+      "step": 93
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 5.371428571428572e-05,
+      "loss": 1.4278,
+      "step": 94
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 5.428571428571429e-05,
+      "loss": 1.5075,
+      "step": 95
+    },
+    {
+      "epoch": 0.05,
+      "learning_rate": 5.4857142857142857e-05,
+      "loss": 1.3799,
+      "step": 96
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.542857142857143e-05,
+      "loss": 1.5081,
+      "step": 97
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.6e-05,
+      "loss": 1.5639,
+      "step": 98
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.6571428571428574e-05,
+      "loss": 1.5616,
+      "step": 99
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.714285714285714e-05,
+      "loss": 1.478,
+      "step": 100
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.7714285714285716e-05,
+      "loss": 1.476,
+      "step": 101
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.8285714285714284e-05,
+      "loss": 1.4472,
+      "step": 102
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.885714285714286e-05,
+      "loss": 1.4188,
+      "step": 103
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.9428571428571434e-05,
+      "loss": 1.4653,
+      "step": 104
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 6e-05,
+      "loss": 1.6261,
+      "step": 105
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.999998715567115e-05,
+      "loss": 1.442,
+      "step": 106
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.999994862269559e-05,
+      "loss": 1.5547,
+      "step": 107
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.999988440110633e-05,
+      "loss": 1.3502,
+      "step": 108
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.9999794490958346e-05,
+      "loss": 1.4946,
+      "step": 109
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.999967889232863e-05,
+      "loss": 1.4315,
+      "step": 110
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.999953760531618e-05,
+      "loss": 1.5798,
+      "step": 111
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.999937063004196e-05,
+      "loss": 1.4303,
+      "step": 112
+    },
+    {
+      "epoch": 0.06,
+      "learning_rate": 5.999917796664897e-05,
+      "loss": 1.3411,
+      "step": 113
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999895961530217e-05,
+      "loss": 1.2936,
+      "step": 114
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999871557618853e-05,
+      "loss": 1.4337,
+      "step": 115
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999844584951703e-05,
+      "loss": 1.3367,
+      "step": 116
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999815043551863e-05,
+      "loss": 1.3203,
+      "step": 117
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.9997829334446286e-05,
+      "loss": 1.3113,
+      "step": 118
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999748254657496e-05,
+      "loss": 1.5033,
+      "step": 119
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.9997110072201586e-05,
+      "loss": 1.2804,
+      "step": 120
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999671191164513e-05,
+      "loss": 1.5973,
+      "step": 121
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999628806524652e-05,
+      "loss": 1.4724,
+      "step": 122
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.9995838533368695e-05,
+      "loss": 1.3677,
+      "step": 123
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999536331639658e-05,
+      "loss": 1.3857,
+      "step": 124
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.9994862414737106e-05,
+      "loss": 1.5379,
+      "step": 125
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999433582881918e-05,
+      "loss": 1.5247,
+      "step": 126
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999378355909372e-05,
+      "loss": 1.4129,
+      "step": 127
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999320560603362e-05,
+      "loss": 1.4737,
+      "step": 128
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.9992601970133785e-05,
+      "loss": 1.4404,
+      "step": 129
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.999197265191109e-05,
+      "loss": 1.4058,
+      "step": 130
+    },
+    {
+      "epoch": 0.07,
+      "learning_rate": 5.9991317651904416e-05,
+      "loss": 1.3948,
+      "step": 131
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.999063697067464e-05,
+      "loss": 1.5521,
+      "step": 132
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.998993060880461e-05,
+      "loss": 1.5669,
+      "step": 133
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.998919856689919e-05,
+      "loss": 1.4679,
+      "step": 134
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.99884408455852e-05,
+      "loss": 1.4912,
+      "step": 135
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.9987657445511484e-05,
+      "loss": 1.3933,
+      "step": 136
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.9986848367348856e-05,
+      "loss": 1.3742,
+      "step": 137
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.998601361179011e-05,
+      "loss": 1.6056,
+      "step": 138
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.998515317955005e-05,
+      "loss": 1.3348,
+      "step": 139
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.998426707136545e-05,
+      "loss": 1.4705,
+      "step": 140
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.9983355287995074e-05,
+      "loss": 1.3836,
+      "step": 141
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.9982417830219665e-05,
+      "loss": 1.3376,
+      "step": 142
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.9981454698841974e-05,
+      "loss": 1.4828,
+      "step": 143
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.9980465894686706e-05,
+      "loss": 1.3,
+      "step": 144
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.997945141860056e-05,
+      "loss": 1.4716,
+      "step": 145
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.9978411271452245e-05,
+      "loss": 1.3351,
+      "step": 146
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.9977345454132394e-05,
+      "loss": 1.4754,
+      "step": 147
+    },
+    {
+      "epoch": 0.08,
+      "learning_rate": 5.997625396755367e-05,
+      "loss": 1.4244,
+      "step": 148
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.99751368126507e-05,
+      "loss": 1.3679,
+      "step": 149
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9973993990380087e-05,
+      "loss": 1.3707,
+      "step": 150
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.997282550172043e-05,
+      "loss": 1.2821,
+      "step": 151
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9971631347672275e-05,
+      "loss": 1.5299,
+      "step": 152
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.997041152925817e-05,
+      "loss": 1.3202,
+      "step": 153
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9969166047522637e-05,
+      "loss": 1.4032,
+      "step": 154
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9967894903532155e-05,
+      "loss": 1.485,
+      "step": 155
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.99665980983752e-05,
+      "loss": 1.3716,
+      "step": 156
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9965275633162215e-05,
+      "loss": 1.2311,
+      "step": 157
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.996392750902559e-05,
+      "loss": 1.2965,
+      "step": 158
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9962553727119745e-05,
+      "loss": 1.3187,
+      "step": 159
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9961154288621e-05,
+      "loss": 1.2862,
+      "step": 160
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.995972919472769e-05,
+      "loss": 1.3527,
+      "step": 161
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9958278446660115e-05,
+      "loss": 1.3132,
+      "step": 162
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9956802045660524e-05,
+      "loss": 1.2963,
+      "step": 163
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.9955299992993145e-05,
+      "loss": 1.4838,
+      "step": 164
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.995377228994417e-05,
+      "loss": 1.1187,
+      "step": 165
+    },
+    {
+      "epoch": 0.09,
+      "learning_rate": 5.995221893782175e-05,
+      "loss": 1.2702,
+      "step": 166
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.9950639937956007e-05,
+      "loss": 1.4016,
+      "step": 167
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.994903529169902e-05,
+      "loss": 1.4548,
+      "step": 168
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.9947405000424826e-05,
+      "loss": 1.1921,
+      "step": 169
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.994574906552942e-05,
+      "loss": 1.2285,
+      "step": 170
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.994406748843077e-05,
+      "loss": 1.4914,
+      "step": 171
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.99423602705688e-05,
+      "loss": 1.1629,
+      "step": 172
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.994062741340536e-05,
+      "loss": 1.2467,
+      "step": 173
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.993886891842428e-05,
+      "loss": 1.4114,
+      "step": 174
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.993708478713135e-05,
+      "loss": 1.4377,
+      "step": 175
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.99352750210543e-05,
+      "loss": 1.1744,
+      "step": 176
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.99334396217428e-05,
+      "loss": 1.3885,
+      "step": 177
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.993157859076849e-05,
+      "loss": 1.3346,
+      "step": 178
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.992969192972496e-05,
+      "loss": 1.2593,
+      "step": 179
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.9927779640227714e-05,
+      "loss": 1.1339,
+      "step": 180
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.9925841723914235e-05,
+      "loss": 1.306,
+      "step": 181
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.992387818244394e-05,
+      "loss": 1.2674,
+      "step": 182
+    },
+    {
+      "epoch": 0.1,
+      "learning_rate": 5.992188901749818e-05,
+      "loss": 1.3776,
+      "step": 183
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.991987423078027e-05,
+      "loss": 1.3937,
+      "step": 184
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.991783382401544e-05,
+      "loss": 1.1458,
+      "step": 185
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.9915767798950854e-05,
+      "loss": 1.3559,
+      "step": 186
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.9913676157355645e-05,
+      "loss": 1.4009,
+      "step": 187
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.991155890102086e-05,
+      "loss": 1.2611,
+      "step": 188
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.990941603175946e-05,
+      "loss": 1.3545,
+      "step": 189
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.9907247551406383e-05,
+      "loss": 1.344,
+      "step": 190
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.990505346181847e-05,
+      "loss": 1.3253,
+      "step": 191
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.990283376487449e-05,
+      "loss": 1.41,
+      "step": 192
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.990058846247514e-05,
+      "loss": 1.3793,
+      "step": 193
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.9898317556543054e-05,
+      "loss": 1.1646,
+      "step": 194
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.989602104902278e-05,
+      "loss": 1.3545,
+      "step": 195
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.989369894188079e-05,
+      "loss": 1.2301,
+      "step": 196
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.989135123710549e-05,
+      "loss": 1.2795,
+      "step": 197
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.988897793670717e-05,
+      "loss": 1.431,
+      "step": 198
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.988657904271808e-05,
+      "loss": 1.4231,
+      "step": 199
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.9884154557192367e-05,
+      "loss": 1.3822,
+      "step": 200
+    },
+    {
+      "epoch": 0.11,
+      "learning_rate": 5.988170448220607e-05,
+      "loss": 1.2795,
+      "step": 201
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.987922881985718e-05,
+      "loss": 1.3845,
+      "step": 202
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.987672757226556e-05,
+      "loss": 1.1886,
+      "step": 203
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.9874200741573005e-05,
+      "loss": 1.3167,
+      "step": 204
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.9871648329943235e-05,
+      "loss": 1.2675,
+      "step": 205
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.9869070339561824e-05,
+      "loss": 1.1449,
+      "step": 206
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.986646677263628e-05,
+      "loss": 1.2858,
+      "step": 207
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.986383763139601e-05,
+      "loss": 1.2835,
+      "step": 208
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.986118291809232e-05,
+      "loss": 1.2615,
+      "step": 209
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.985850263499842e-05,
+      "loss": 1.3239,
+      "step": 210
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.9855796784409395e-05,
+      "loss": 1.4486,
+      "step": 211
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.985306536864223e-05,
+      "loss": 1.2838,
+      "step": 212
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.98503083900358e-05,
+      "loss": 1.3174,
+      "step": 213
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.98475258509509e-05,
+      "loss": 1.2965,
+      "step": 214
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.984471775377016e-05,
+      "loss": 1.1386,
+      "step": 215
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.984188410089814e-05,
+      "loss": 1.3007,
+      "step": 216
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.983902489476126e-05,
+      "loss": 1.2164,
+      "step": 217
+    },
+    {
+      "epoch": 0.12,
+      "learning_rate": 5.983614013780782e-05,
+      "loss": 1.3184,
+      "step": 218
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.9833229832508e-05,
+      "loss": 1.1477,
+      "step": 219
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.983029398135387e-05,
+      "loss": 1.3399,
+      "step": 220
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.982733258685937e-05,
+      "loss": 1.117,
+      "step": 221
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.982434565156029e-05,
+      "loss": 1.4567,
+      "step": 222
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.982133317801434e-05,
+      "loss": 1.4819,
+      "step": 223
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.981829516880104e-05,
+      "loss": 1.299,
+      "step": 224
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.9815231626521805e-05,
+      "loss": 1.202,
+      "step": 225
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.981214255379992e-05,
+      "loss": 1.3211,
+      "step": 226
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.980902795328052e-05,
+      "loss": 1.2873,
+      "step": 227
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.98058878276306e-05,
+      "loss": 1.124,
+      "step": 228
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.980272217953901e-05,
+      "loss": 1.2164,
+      "step": 229
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.979953101171647e-05,
+      "loss": 1.3501,
+      "step": 230
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.9796314326895534e-05,
+      "loss": 1.1994,
+      "step": 231
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.979307212783062e-05,
+      "loss": 1.2097,
+      "step": 232
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.978980441729796e-05,
+      "loss": 1.1782,
+      "step": 233
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.9786511198095695e-05,
+      "loss": 1.2644,
+      "step": 234
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.978319247304374e-05,
+      "loss": 1.6451,
+      "step": 235
+    },
+    {
+      "epoch": 0.13,
+      "learning_rate": 5.97798482449839e-05,
+      "loss": 1.2588,
+      "step": 236
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.977647851677979e-05,
+      "loss": 1.137,
+      "step": 237
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.977308329131687e-05,
+      "loss": 1.2248,
+      "step": 238
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.9769662571502434e-05,
+      "loss": 1.3649,
+      "step": 239
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.976621636026561e-05,
+      "loss": 1.2627,
+      "step": 240
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.976274466055735e-05,
+      "loss": 1.243,
+      "step": 241
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.975924747535042e-05,
+      "loss": 1.139,
+      "step": 242
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.975572480763943e-05,
+      "loss": 1.2991,
+      "step": 243
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.97521766604408e-05,
+      "loss": 1.1573,
+      "step": 244
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.9748603036792754e-05,
+      "loss": 1.2305,
+      "step": 245
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.974500393975537e-05,
+      "loss": 1.1434,
+      "step": 246
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.974137937241048e-05,
+      "loss": 1.1891,
+      "step": 247
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.973772933786179e-05,
+      "loss": 1.2141,
+      "step": 248
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.973405383923478e-05,
+      "loss": 1.0875,
+      "step": 249
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.9730352879676725e-05,
+      "loss": 1.425,
+      "step": 250
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.972662646235671e-05,
+      "loss": 1.2941,
+      "step": 251
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.972287459046565e-05,
+      "loss": 1.092,
+      "step": 252
+    },
+    {
+      "epoch": 0.14,
+      "learning_rate": 5.97190972672162e-05,
+      "loss": 1.1271,
+      "step": 253
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.971529449584286e-05,
+      "loss": 1.2603,
+      "step": 254
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.9711466279601875e-05,
+      "loss": 1.5529,
+      "step": 255
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.970761262177134e-05,
+      "loss": 1.4092,
+      "step": 256
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.970373352565106e-05,
+      "loss": 1.2384,
+      "step": 257
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.969982899456269e-05,
+      "loss": 1.1861,
+      "step": 258
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.969589903184962e-05,
+      "loss": 1.2724,
+      "step": 259
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.969194364087704e-05,
+      "loss": 1.1864,
+      "step": 260
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.96879628250319e-05,
+      "loss": 1.1879,
+      "step": 261
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.968395658772293e-05,
+      "loss": 1.2308,
+      "step": 262
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.9679924932380614e-05,
+      "loss": 1.1376,
+      "step": 263
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.967586786245723e-05,
+      "loss": 1.1309,
+      "step": 264
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.96717853814268e-05,
+      "loss": 1.1743,
+      "step": 265
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.966767749278509e-05,
+      "loss": 1.3209,
+      "step": 266
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.9663544200049656e-05,
+      "loss": 1.2444,
+      "step": 267
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.965938550675978e-05,
+      "loss": 1.2724,
+      "step": 268
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.9655201416476505e-05,
+      "loss": 1.2337,
+      "step": 269
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.9650991932782616e-05,
+      "loss": 1.2944,
+      "step": 270
+    },
+    {
+      "epoch": 0.15,
+      "learning_rate": 5.964675705928265e-05,
+      "loss": 1.3527,
+      "step": 271
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.964249679960288e-05,
+      "loss": 1.2448,
+      "step": 272
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.963821115739132e-05,
+      "loss": 1.07,
+      "step": 273
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.963390013631772e-05,
+      "loss": 1.2245,
+      "step": 274
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.9629563740073545e-05,
+      "loss": 1.2514,
+      "step": 275
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.962520197237201e-05,
+      "loss": 1.2938,
+      "step": 276
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.962081483694805e-05,
+      "loss": 1.2613,
+      "step": 277
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.9616402337558316e-05,
+      "loss": 1.1746,
+      "step": 278
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.961196447798117e-05,
+      "loss": 1.3059,
+      "step": 279
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.960750126201672e-05,
+      "loss": 1.2515,
+      "step": 280
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.9603012693486756e-05,
+      "loss": 1.1792,
+      "step": 281
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.959849877623479e-05,
+      "loss": 1.2304,
+      "step": 282
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.959395951412604e-05,
+      "loss": 1.4572,
+      "step": 283
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.958939491104742e-05,
+      "loss": 1.1767,
+      "step": 284
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.958480497090755e-05,
+      "loss": 1.2458,
+      "step": 285
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.958018969763674e-05,
+      "loss": 1.3361,
+      "step": 286
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.9575549095187e-05,
+      "loss": 1.131,
+      "step": 287
+    },
+    {
+      "epoch": 0.16,
+      "learning_rate": 5.957088316753202e-05,
+      "loss": 1.2144,
+      "step": 288
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.9566191918667196e-05,
+      "loss": 1.2565,
+      "step": 289
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.9561475352609564e-05,
+      "loss": 1.2459,
+      "step": 290
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.955673347339789e-05,
+      "loss": 1.326,
+      "step": 291
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.9551966285092576e-05,
+      "loss": 1.3458,
+      "step": 292
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.954717379177572e-05,
+      "loss": 1.1893,
+      "step": 293
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.954235599755108e-05,
+      "loss": 1.1843,
+      "step": 294
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.953751290654407e-05,
+      "loss": 1.3191,
+      "step": 295
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.953264452290178e-05,
+      "loss": 1.3321,
+      "step": 296
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.9527750850792946e-05,
+      "loss": 1.219,
+      "step": 297
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.9522831894407964e-05,
+      "loss": 1.3073,
+      "step": 298
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.951788765795889e-05,
+      "loss": 1.2114,
+      "step": 299
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.951291814567941e-05,
+      "loss": 1.384,
+      "step": 300
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.9507923361824865e-05,
+      "loss": 1.2547,
+      "step": 301
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.9502903310672214e-05,
+      "loss": 1.1333,
+      "step": 302
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.9497857996520094e-05,
+      "loss": 1.1515,
+      "step": 303
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.949278742368874e-05,
+      "loss": 1.1842,
+      "step": 304
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.948769159652001e-05,
+      "loss": 1.235,
+      "step": 305
+    },
+    {
+      "epoch": 0.17,
+      "learning_rate": 5.9482570519377425e-05,
+      "loss": 1.283,
+      "step": 306
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.9477424196646105e-05,
+      "loss": 1.3065,
+      "step": 307
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.947225263273277e-05,
+      "loss": 1.2164,
+      "step": 308
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.946705583206578e-05,
+      "loss": 1.2446,
+      "step": 309
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.946183379909511e-05,
+      "loss": 1.2634,
+      "step": 310
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.94565865382923e-05,
+      "loss": 1.1852,
+      "step": 311
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.945131405415054e-05,
+      "loss": 1.2012,
+      "step": 312
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.944601635118459e-05,
+      "loss": 1.3116,
+      "step": 313
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.944069343393082e-05,
+      "loss": 1.3273,
+      "step": 314
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.9435345306947176e-05,
+      "loss": 1.2893,
+      "step": 315
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.942997197481319e-05,
+      "loss": 1.2902,
+      "step": 316
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.942457344213001e-05,
+      "loss": 1.2889,
+      "step": 317
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.941914971352031e-05,
+      "loss": 1.3585,
+      "step": 318
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.9413700793628384e-05,
+      "loss": 1.1963,
+      "step": 319
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.9408226687120075e-05,
+      "loss": 1.2033,
+      "step": 320
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.9402727398682796e-05,
+      "loss": 1.3298,
+      "step": 321
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.9397202933025534e-05,
+      "loss": 1.2837,
+      "step": 322
+    },
+    {
+      "epoch": 0.18,
+      "learning_rate": 5.9391653294878814e-05,
+      "loss": 1.2531,
+      "step": 323
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.938607848899473e-05,
+      "loss": 1.3248,
+      "step": 324
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.938047852014694e-05,
+      "loss": 1.2643,
+      "step": 325
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.937485339313061e-05,
+      "loss": 1.3921,
+      "step": 326
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.936920311276249e-05,
+      "loss": 1.3924,
+      "step": 327
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.936352768388084e-05,
+      "loss": 1.1679,
+      "step": 328
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.9357827111345466e-05,
+      "loss": 1.11,
+      "step": 329
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.93521014000377e-05,
+      "loss": 1.1462,
+      "step": 330
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.9346350554860426e-05,
+      "loss": 1.2304,
+      "step": 331
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.934057458073801e-05,
+      "loss": 1.2539,
+      "step": 332
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.933477348261635e-05,
+      "loss": 1.2417,
+      "step": 333
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.932894726546285e-05,
+      "loss": 1.373,
+      "step": 334
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.932309593426646e-05,
+      "loss": 1.2812,
+      "step": 335
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.931721949403759e-05,
+      "loss": 1.3008,
+      "step": 336
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.931131794980818e-05,
+      "loss": 1.2814,
+      "step": 337
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.9305391306631644e-05,
+      "loss": 1.2264,
+      "step": 338
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.92994395695829e-05,
+      "loss": 1.2004,
+      "step": 339
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.929346274375836e-05,
+      "loss": 1.3828,
+      "step": 340
+    },
+    {
+      "epoch": 0.19,
+      "learning_rate": 5.928746083427591e-05,
+      "loss": 1.4058,
+      "step": 341
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.928143384627491e-05,
+      "loss": 1.2506,
+      "step": 342
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.9275381784916206e-05,
+      "loss": 1.1275,
+      "step": 343
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.92693046553821e-05,
+      "loss": 1.2831,
+      "step": 344
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.926320246287639e-05,
+      "loss": 1.1668,
+      "step": 345
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.92570752126243e-05,
+      "loss": 1.1972,
+      "step": 346
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.9250922909872525e-05,
+      "loss": 1.212,
+      "step": 347
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.924474555988921e-05,
+      "loss": 1.1565,
+      "step": 348
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.9238543167963946e-05,
+      "loss": 1.1822,
+      "step": 349
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.923231573940778e-05,
+      "loss": 1.1988,
+      "step": 350
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.922606327955319e-05,
+      "loss": 1.1738,
+      "step": 351
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.921978579375407e-05,
+      "loss": 1.2813,
+      "step": 352
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.921348328738578e-05,
+      "loss": 1.4251,
+      "step": 353
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.9207155765845064e-05,
+      "loss": 1.2768,
+      "step": 354
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.9200803234550124e-05,
+      "loss": 1.3527,
+      "step": 355
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.919442569894055e-05,
+      "loss": 1.2717,
+      "step": 356
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.9188023164477345e-05,
+      "loss": 1.3046,
+      "step": 357
+    },
+    {
+      "epoch": 0.2,
+      "learning_rate": 5.918159563664295e-05,
+      "loss": 1.2561,
+      "step": 358
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.917514312094116e-05,
+      "loss": 1.1746,
+      "step": 359
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.916866562289721e-05,
+      "loss": 1.2482,
+      "step": 360
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.916216314805769e-05,
+      "loss": 1.162,
+      "step": 361
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.915563570199061e-05,
+      "loss": 1.5942,
+      "step": 362
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.914908329028534e-05,
+      "loss": 1.3784,
+      "step": 363
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.914250591855263e-05,
+      "loss": 1.2184,
+      "step": 364
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.913590359242462e-05,
+      "loss": 1.3547,
+      "step": 365
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.9129276317554804e-05,
+      "loss": 1.1729,
+      "step": 366
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.912262409961803e-05,
+      "loss": 1.3004,
+      "step": 367
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.9115946944310534e-05,
+      "loss": 1.2657,
+      "step": 368
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.9109244857349876e-05,
+      "loss": 1.2606,
+      "step": 369
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.910251784447498e-05,
+      "loss": 1.1663,
+      "step": 370
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.9095765911446105e-05,
+      "loss": 1.3921,
+      "step": 371
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.908898906404487e-05,
+      "loss": 1.1453,
+      "step": 372
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.90821873080742e-05,
+      "loss": 1.2709,
+      "step": 373
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.907536064935835e-05,
+      "loss": 1.0745,
+      "step": 374
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.906850909374294e-05,
+      "loss": 1.2114,
+      "step": 375
+    },
+    {
+      "epoch": 0.21,
+      "learning_rate": 5.906163264709485e-05,
+      "loss": 1.4142,
+      "step": 376
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.905473131530232e-05,
+      "loss": 1.1895,
+      "step": 377
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.904780510427487e-05,
+      "loss": 1.206,
+      "step": 378
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.904085401994335e-05,
+      "loss": 1.4215,
+      "step": 379
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.903387806825988e-05,
+      "loss": 1.2606,
+      "step": 380
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.90268772551979e-05,
+      "loss": 1.3489,
+      "step": 381
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.901985158675211e-05,
+      "loss": 1.3864,
+      "step": 382
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.901280106893853e-05,
+      "loss": 1.3262,
+      "step": 383
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.900572570779442e-05,
+      "loss": 1.0514,
+      "step": 384
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.8998625509378336e-05,
+      "loss": 1.2402,
+      "step": 385
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.8991500479770106e-05,
+      "loss": 1.3565,
+      "step": 386
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.8984350625070796e-05,
+      "loss": 1.1668,
+      "step": 387
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.897717595140277e-05,
+      "loss": 1.3031,
+      "step": 388
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.896997646490959e-05,
+      "loss": 1.3446,
+      "step": 389
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.8962752171756116e-05,
+      "loss": 1.1084,
+      "step": 390
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.895550307812841e-05,
+      "loss": 1.194,
+      "step": 391
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.89482291902338e-05,
+      "loss": 1.4762,
+      "step": 392
+    },
+    {
+      "epoch": 0.22,
+      "learning_rate": 5.894093051430084e-05,
+      "loss": 1.3113,
+      "step": 393
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.893360705657928e-05,
+      "loss": 1.3665,
+      "step": 394
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.892625882334013e-05,
+      "loss": 1.1545,
+      "step": 395
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.8918885820875596e-05,
+      "loss": 1.2631,
+      "step": 396
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.8911488055499104e-05,
+      "loss": 1.0901,
+      "step": 397
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.890406553354526e-05,
+      "loss": 1.1629,
+      "step": 398
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.889661826136989e-05,
+      "loss": 1.1903,
+      "step": 399
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.888914624535001e-05,
+      "loss": 1.3415,
+      "step": 400
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.888164949188382e-05,
+      "loss": 1.3495,
+      "step": 401
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.887412800739071e-05,
+      "loss": 1.1577,
+      "step": 402
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.8866581798311244e-05,
+      "loss": 1.1293,
+      "step": 403
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.8859010871107135e-05,
+      "loss": 1.0445,
+      "step": 404
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.885141523226131e-05,
+      "loss": 1.1414,
+      "step": 405
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.8843794888277805e-05,
+      "loss": 1.3114,
+      "step": 406
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.883614984568184e-05,
+      "loss": 1.3719,
+      "step": 407
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.8828480111019774e-05,
+      "loss": 1.2448,
+      "step": 408
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.882078569085913e-05,
+      "loss": 1.3037,
+      "step": 409
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.881306659178854e-05,
+      "loss": 1.3769,
+      "step": 410
+    },
+    {
+      "epoch": 0.23,
+      "learning_rate": 5.880532282041778e-05,
+      "loss": 1.4545,
+      "step": 411
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.879755438337775e-05,
+      "loss": 1.189,
+      "step": 412
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.8789761287320485e-05,
+      "loss": 1.2279,
+      "step": 413
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.8781943538919114e-05,
+      "loss": 1.3925,
+      "step": 414
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.877410114486789e-05,
+      "loss": 1.1647,
+      "step": 415
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.876623411188216e-05,
+      "loss": 1.3333,
+      "step": 416
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.875834244669839e-05,
+      "loss": 1.1912,
+      "step": 417
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.8750426156074105e-05,
+      "loss": 1.2005,
+      "step": 418
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.874248524678794e-05,
+      "loss": 1.2561,
+      "step": 419
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.873451972563961e-05,
+      "loss": 1.1758,
+      "step": 420
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.8726529599449906e-05,
+      "loss": 1.1035,
+      "step": 421
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.871851487506066e-05,
+      "loss": 1.2024,
+      "step": 422
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.87104755593348e-05,
+      "loss": 1.0316,
+      "step": 423
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.870241165915631e-05,
+      "loss": 1.3744,
+      "step": 424
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.86943231814302e-05,
+      "loss": 1.2191,
+      "step": 425
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.868621013308256e-05,
+      "loss": 1.1206,
+      "step": 426
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.867807252106048e-05,
+      "loss": 1.1668,
+      "step": 427
+    },
+    {
+      "epoch": 0.24,
+      "learning_rate": 5.8669910352332116e-05,
+      "loss": 1.3121,
+      "step": 428
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.8661723633886644e-05,
+      "loss": 1.214,
+      "step": 429
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.865351237273424e-05,
+      "loss": 1.3915,
+      "step": 430
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.864527657590614e-05,
+      "loss": 1.1381,
+      "step": 431
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.8637016250454535e-05,
+      "loss": 1.323,
+      "step": 432
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.862873140345266e-05,
+      "loss": 1.2819,
+      "step": 433
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.862042204199474e-05,
+      "loss": 1.2253,
+      "step": 434
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.861208817319598e-05,
+      "loss": 0.9674,
+      "step": 435
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.860372980419257e-05,
+      "loss": 1.1817,
+      "step": 436
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.8595346942141713e-05,
+      "loss": 1.3408,
+      "step": 437
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.8586939594221524e-05,
+      "loss": 1.266,
+      "step": 438
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.857850776763114e-05,
+      "loss": 1.2284,
+      "step": 439
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.857005146959063e-05,
+      "loss": 1.1404,
+      "step": 440
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.856157070734103e-05,
+      "loss": 1.24,
+      "step": 441
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.855306548814431e-05,
+      "loss": 1.1699,
+      "step": 442
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.854453581928341e-05,
+      "loss": 1.1864,
+      "step": 443
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.8535981708062174e-05,
+      "loss": 1.0678,
+      "step": 444
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.852740316180539e-05,
+      "loss": 1.1558,
+      "step": 445
+    },
+    {
+      "epoch": 0.25,
+      "learning_rate": 5.851880018785878e-05,
+      "loss": 1.1982,
+      "step": 446
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.851017279358896e-05,
+      "loss": 1.1722,
+      "step": 447
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.850152098638348e-05,
+      "loss": 1.2659,
+      "step": 448
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.8492844773650773e-05,
+      "loss": 1.3706,
+      "step": 449
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.848414416282019e-05,
+      "loss": 0.9967,
+      "step": 450
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.847541916134196e-05,
+      "loss": 1.1731,
+      "step": 451
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.84666697766872e-05,
+      "loss": 1.4015,
+      "step": 452
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.845789601634792e-05,
+      "loss": 1.1711,
+      "step": 453
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.844909788783698e-05,
+      "loss": 1.116,
+      "step": 454
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.844027539868812e-05,
+      "loss": 1.3371,
+      "step": 455
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.843142855645593e-05,
+      "loss": 1.3502,
+      "step": 456
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.842255736871587e-05,
+      "loss": 1.0215,
+      "step": 457
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.841366184306424e-05,
+      "loss": 1.2454,
+      "step": 458
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.840474198711816e-05,
+      "loss": 1.1846,
+      "step": 459
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.8395797808515614e-05,
+      "loss": 1.1576,
+      "step": 460
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.83868293149154e-05,
+      "loss": 1.2185,
+      "step": 461
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.837783651399714e-05,
+      "loss": 1.1948,
+      "step": 462
+    },
+    {
+      "epoch": 0.26,
+      "learning_rate": 5.836881941346125e-05,
+      "loss": 1.3099,
+      "step": 463
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.835977802102899e-05,
+      "loss": 1.2076,
+      "step": 464
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.835071234444239e-05,
+      "loss": 1.2153,
+      "step": 465
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.834162239146429e-05,
+      "loss": 1.1817,
+      "step": 466
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.833250816987831e-05,
+      "loss": 1.1871,
+      "step": 467
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.832336968748885e-05,
+      "loss": 1.2003,
+      "step": 468
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.8314206952121094e-05,
+      "loss": 1.0941,
+      "step": 469
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.8305019971620994e-05,
+      "loss": 1.3372,
+      "step": 470
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.8295808753855244e-05,
+      "loss": 1.1485,
+      "step": 471
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.8286573306711306e-05,
+      "loss": 1.3803,
+      "step": 472
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.82773136380974e-05,
+      "loss": 1.0419,
+      "step": 473
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.826802975594246e-05,
+      "loss": 1.06,
+      "step": 474
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.825872166819618e-05,
+      "loss": 1.2068,
+      "step": 475
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.824938938282897e-05,
+      "loss": 1.1193,
+      "step": 476
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.824003290783194e-05,
+      "loss": 1.2184,
+      "step": 477
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.8230652251216955e-05,
+      "loss": 1.1683,
+      "step": 478
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.822124742101656e-05,
+      "loss": 1.3124,
+      "step": 479
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.821181842528399e-05,
+      "loss": 1.3639,
+      "step": 480
+    },
+    {
+      "epoch": 0.27,
+      "learning_rate": 5.82023652720932e-05,
+      "loss": 1.3009,
+      "step": 481
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.819288796953882e-05,
+      "loss": 1.3618,
+      "step": 482
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.818338652573614e-05,
+      "loss": 1.0877,
+      "step": 483
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.8173860948821153e-05,
+      "loss": 1.3061,
+      "step": 484
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.816431124695049e-05,
+      "loss": 1.173,
+      "step": 485
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.8154737428301466e-05,
+      "loss": 1.3433,
+      "step": 486
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.8145139501072016e-05,
+      "loss": 1.2959,
+      "step": 487
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.8135517473480744e-05,
+      "loss": 1.1954,
+      "step": 488
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.8125871353766894e-05,
+      "loss": 1.1224,
+      "step": 489
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.811620115019031e-05,
+      "loss": 1.2467,
+      "step": 490
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.8106506871031484e-05,
+      "loss": 1.1959,
+      "step": 491
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.8096788524591516e-05,
+      "loss": 1.3152,
+      "step": 492
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.808704611919212e-05,
+      "loss": 1.2128,
+      "step": 493
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.80772796631756e-05,
+      "loss": 1.139,
+      "step": 494
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.8067489164904856e-05,
+      "loss": 1.1229,
+      "step": 495
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.8057674632763394e-05,
+      "loss": 1.273,
+      "step": 496
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.804783607515528e-05,
+      "loss": 1.1,
+      "step": 497
+    },
+    {
+      "epoch": 0.28,
+      "learning_rate": 5.803797350050515e-05,
+      "loss": 1.2187,
+      "step": 498
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.802808691725823e-05,
+      "loss": 1.1511,
+      "step": 499
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.8018176333880276e-05,
+      "loss": 1.2405,
+      "step": 500
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.8008241758857614e-05,
+      "loss": 1.1804,
+      "step": 501
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.79982832006971e-05,
+      "loss": 1.0633,
+      "step": 502
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.7988300667926145e-05,
+      "loss": 1.3326,
+      "step": 503
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.797829416909267e-05,
+      "loss": 1.1606,
+      "step": 504
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.796826371276513e-05,
+      "loss": 1.2099,
+      "step": 505
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.795820930753248e-05,
+      "loss": 1.2905,
+      "step": 506
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.79481309620042e-05,
+      "loss": 1.1492,
+      "step": 507
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.793802868481027e-05,
+      "loss": 1.2518,
+      "step": 508
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.792790248460114e-05,
+      "loss": 1.1904,
+      "step": 509
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.7917752370047775e-05,
+      "loss": 1.2821,
+      "step": 510
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.790757834984159e-05,
+      "loss": 1.1776,
+      "step": 511
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.789738043269448e-05,
+      "loss": 1.0763,
+      "step": 512
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.788715862733882e-05,
+      "loss": 1.2845,
+      "step": 513
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.787691294252741e-05,
+      "loss": 1.2606,
+      "step": 514
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.786664338703353e-05,
+      "loss": 1.1844,
+      "step": 515
+    },
+    {
+      "epoch": 0.29,
+      "learning_rate": 5.785634996965086e-05,
+      "loss": 1.2814,
+      "step": 516
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.784603269919356e-05,
+      "loss": 1.0812,
+      "step": 517
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.783569158449617e-05,
+      "loss": 1.1523,
+      "step": 518
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.7825326634413686e-05,
+      "loss": 1.2283,
+      "step": 519
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.7814937857821486e-05,
+      "loss": 1.3273,
+      "step": 520
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.780452526361537e-05,
+      "loss": 1.2444,
+      "step": 521
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.779408886071151e-05,
+      "loss": 1.0103,
+      "step": 522
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.778362865804648e-05,
+      "loss": 1.2379,
+      "step": 523
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.777314466457725e-05,
+      "loss": 1.2409,
+      "step": 524
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.776263688928113e-05,
+      "loss": 1.1251,
+      "step": 525
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.775210534115581e-05,
+      "loss": 1.0961,
+      "step": 526
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.774155002921933e-05,
+      "loss": 1.1199,
+      "step": 527
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.7730970962510085e-05,
+      "loss": 1.1518,
+      "step": 528
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.772036815008682e-05,
+      "loss": 1.1517,
+      "step": 529
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.770974160102859e-05,
+      "loss": 1.2283,
+      "step": 530
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.76990913244348e-05,
+      "loss": 1.2005,
+      "step": 531
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.7688417329425155e-05,
+      "loss": 1.3084,
+      "step": 532
+    },
+    {
+      "epoch": 0.3,
+      "learning_rate": 5.767771962513966e-05,
+      "loss": 1.2695,
+      "step": 533
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.766699822073865e-05,
+      "loss": 1.0749,
+      "step": 534
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.765625312540275e-05,
+      "loss": 1.289,
+      "step": 535
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.764548434833285e-05,
+      "loss": 1.2,
+      "step": 536
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.763469189875013e-05,
+      "loss": 1.1789,
+      "step": 537
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.7623875785896055e-05,
+      "loss": 1.2666,
+      "step": 538
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.761303601903232e-05,
+      "loss": 1.1105,
+      "step": 539
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.7602172607440915e-05,
+      "loss": 1.1871,
+      "step": 540
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.759128556042403e-05,
+      "loss": 1.1735,
+      "step": 541
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.758037488730415e-05,
+      "loss": 1.2334,
+      "step": 542
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.7569440597423926e-05,
+      "loss": 1.3132,
+      "step": 543
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.755848270014629e-05,
+      "loss": 1.1639,
+      "step": 544
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.7547501204854356e-05,
+      "loss": 1.1832,
+      "step": 545
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.753649612095146e-05,
+      "loss": 1.1999,
+      "step": 546
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.752546745786111e-05,
+      "loss": 1.194,
+      "step": 547
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.751441522502705e-05,
+      "loss": 1.1892,
+      "step": 548
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.7503339431913174e-05,
+      "loss": 1.2658,
+      "step": 549
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.749224008800354e-05,
+      "loss": 1.213,
+      "step": 550
+    },
+    {
+      "epoch": 0.31,
+      "learning_rate": 5.7481117202802416e-05,
+      "loss": 1.0823,
+      "step": 551
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.746997078583418e-05,
+      "loss": 1.1643,
+      "step": 552
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.7458800846643386e-05,
+      "loss": 1.128,
+      "step": 553
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.744760739479473e-05,
+      "loss": 1.1089,
+      "step": 554
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.7436390439873036e-05,
+      "loss": 1.2004,
+      "step": 555
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.742514999148326e-05,
+      "loss": 1.2835,
+      "step": 556
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.741388605925047e-05,
+      "loss": 1.1203,
+      "step": 557
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.740259865281982e-05,
+      "loss": 1.2189,
+      "step": 558
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.739128778185661e-05,
+      "loss": 1.2348,
+      "step": 559
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.7379953456046206e-05,
+      "loss": 1.0678,
+      "step": 560
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.736859568509406e-05,
+      "loss": 1.2194,
+      "step": 561
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.735721447872571e-05,
+      "loss": 1.1349,
+      "step": 562
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.7345809846686735e-05,
+      "loss": 1.2831,
+      "step": 563
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.73343817987428e-05,
+      "loss": 1.1358,
+      "step": 564
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.73229303446796e-05,
+      "loss": 1.2426,
+      "step": 565
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.731145549430293e-05,
+      "loss": 1.0438,
+      "step": 566
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.729995725743851e-05,
+      "loss": 1.4072,
+      "step": 567
+    },
+    {
+      "epoch": 0.32,
+      "learning_rate": 5.72884356439322e-05,
+      "loss": 1.1148,
+      "step": 568
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.72768906636498e-05,
+      "loss": 1.1324,
+      "step": 569
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.726532232647715e-05,
+      "loss": 1.2361,
+      "step": 570
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.7253730642320086e-05,
+      "loss": 1.2063,
+      "step": 571
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.724211562110444e-05,
+      "loss": 1.2382,
+      "step": 572
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.723047727277601e-05,
+      "loss": 1.1943,
+      "step": 573
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.721881560730059e-05,
+      "loss": 1.3094,
+      "step": 574
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.720713063466393e-05,
+      "loss": 1.2319,
+      "step": 575
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.719542236487174e-05,
+      "loss": 1.0889,
+      "step": 576
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.718369080794967e-05,
+      "loss": 1.0919,
+      "step": 577
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.717193597394333e-05,
+      "loss": 1.2125,
+      "step": 578
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.716015787291824e-05,
+      "loss": 1.3092,
+      "step": 579
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.714835651495986e-05,
+      "loss": 1.3682,
+      "step": 580
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.713653191017356e-05,
+      "loss": 1.1499,
+      "step": 581
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.71246840686846e-05,
+      "loss": 1.2228,
+      "step": 582
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.711281300063817e-05,
+      "loss": 1.1153,
+      "step": 583
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.710091871619932e-05,
+      "loss": 1.1307,
+      "step": 584
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.708900122555299e-05,
+      "loss": 1.0803,
+      "step": 585
+    },
+    {
+      "epoch": 0.33,
+      "learning_rate": 5.707706053890399e-05,
+      "loss": 0.9651,
+      "step": 586
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.7065096666477005e-05,
+      "loss": 1.051,
+      "step": 587
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.705310961851656e-05,
+      "loss": 1.0603,
+      "step": 588
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.704109940528701e-05,
+      "loss": 1.2083,
+      "step": 589
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.702906603707257e-05,
+      "loss": 1.1323,
+      "step": 590
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.701700952417729e-05,
+      "loss": 1.3855,
+      "step": 591
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.700492987692502e-05,
+      "loss": 1.1447,
+      "step": 592
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.699282710565941e-05,
+      "loss": 1.3726,
+      "step": 593
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.698070122074394e-05,
+      "loss": 1.1279,
+      "step": 594
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.696855223256186e-05,
+      "loss": 1.0668,
+      "step": 595
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.695638015151622e-05,
+      "loss": 1.0825,
+      "step": 596
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.694418498802981e-05,
+      "loss": 1.1542,
+      "step": 597
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.693196675254523e-05,
+      "loss": 1.2622,
+      "step": 598
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.691972545552482e-05,
+      "loss": 1.269,
+      "step": 599
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.690746110745064e-05,
+      "loss": 1.082,
+      "step": 600
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.689517371882453e-05,
+      "loss": 1.3134,
+      "step": 601
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.6882863300168035e-05,
+      "loss": 1.1834,
+      "step": 602
+    },
+    {
+      "epoch": 0.34,
+      "learning_rate": 5.687052986202243e-05,
+      "loss": 1.1231,
+      "step": 603
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.68581734149487e-05,
+      "loss": 1.1268,
+      "step": 604
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.684579396952751e-05,
+      "loss": 1.0181,
+      "step": 605
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.683339153635926e-05,
+      "loss": 1.2894,
+      "step": 606
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.6820966126064e-05,
+      "loss": 1.1949,
+      "step": 607
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.6808517749281466e-05,
+      "loss": 1.3071,
+      "step": 608
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.6796046416671074e-05,
+      "loss": 1.106,
+      "step": 609
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.678355213891188e-05,
+      "loss": 1.1361,
+      "step": 610
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.677103492670257e-05,
+      "loss": 1.2861,
+      "step": 611
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.675849479076152e-05,
+      "loss": 1.4244,
+      "step": 612
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.6745931741826684e-05,
+      "loss": 0.9825,
+      "step": 613
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.673334579065567e-05,
+      "loss": 1.1071,
+      "step": 614
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.672073694802568e-05,
+      "loss": 1.1388,
+      "step": 615
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.670810522473352e-05,
+      "loss": 1.2206,
+      "step": 616
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.6695450631595595e-05,
+      "loss": 1.1238,
+      "step": 617
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.6682773179447885e-05,
+      "loss": 1.1009,
+      "step": 618
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.667007287914595e-05,
+      "loss": 1.3218,
+      "step": 619
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.6657349741564915e-05,
+      "loss": 1.1074,
+      "step": 620
+    },
+    {
+      "epoch": 0.35,
+      "learning_rate": 5.6644603777599445e-05,
+      "loss": 1.3009,
+      "step": 621
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.663183499816378e-05,
+      "loss": 0.9704,
+      "step": 622
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.661904341419167e-05,
+      "loss": 1.2093,
+      "step": 623
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.6606229036636404e-05,
+      "loss": 1.0959,
+      "step": 624
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.659339187647079e-05,
+      "loss": 1.1171,
+      "step": 625
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.658053194468713e-05,
+      "loss": 1.219,
+      "step": 626
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.656764925229726e-05,
+      "loss": 1.2462,
+      "step": 627
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.655474381033246e-05,
+      "loss": 1.1237,
+      "step": 628
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.6541815629843524e-05,
+      "loss": 1.1017,
+      "step": 629
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.652886472190071e-05,
+      "loss": 1.1777,
+      "step": 630
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.651589109759372e-05,
+      "loss": 1.3108,
+      "step": 631
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.650289476803173e-05,
+      "loss": 1.1499,
+      "step": 632
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.648987574434334e-05,
+      "loss": 1.3421,
+      "step": 633
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.647683403767661e-05,
+      "loss": 1.2061,
+      "step": 634
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.6463769659198975e-05,
+      "loss": 1.238,
+      "step": 635
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.645068262009733e-05,
+      "loss": 1.1742,
+      "step": 636
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.643757293157797e-05,
+      "loss": 1.1933,
+      "step": 637
+    },
+    {
+      "epoch": 0.36,
+      "learning_rate": 5.642444060486655e-05,
+      "loss": 1.2513,
+      "step": 638
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.641128565120814e-05,
+      "loss": 1.096,
+      "step": 639
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.639810808186718e-05,
+      "loss": 1.2623,
+      "step": 640
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.6384907908127464e-05,
+      "loss": 1.1374,
+      "step": 641
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.6371685141292156e-05,
+      "loss": 0.9582,
+      "step": 642
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.635843979268376e-05,
+      "loss": 1.1934,
+      "step": 643
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.634517187364411e-05,
+      "loss": 1.2045,
+      "step": 644
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.63318813955344e-05,
+      "loss": 1.0274,
+      "step": 645
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.631856836973508e-05,
+      "loss": 1.3821,
+      "step": 646
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.6305232807645954e-05,
+      "loss": 1.0839,
+      "step": 647
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.629187472068613e-05,
+      "loss": 1.2481,
+      "step": 648
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.6278494120293956e-05,
+      "loss": 1.3164,
+      "step": 649
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.6265091017927107e-05,
+      "loss": 1.2434,
+      "step": 650
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.62516654250625e-05,
+      "loss": 0.8996,
+      "step": 651
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.623821735319631e-05,
+      "loss": 1.2739,
+      "step": 652
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.622474681384399e-05,
+      "loss": 1.093,
+      "step": 653
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.621125381854018e-05,
+      "loss": 1.1679,
+      "step": 654
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.61977383788388e-05,
+      "loss": 1.2337,
+      "step": 655
+    },
+    {
+      "epoch": 0.37,
+      "learning_rate": 5.618420050631297e-05,
+      "loss": 1.3999,
+      "step": 656
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.617064021255499e-05,
+      "loss": 1.1604,
+      "step": 657
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.6157057509176415e-05,
+      "loss": 1.1776,
+      "step": 658
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.6143452407807927e-05,
+      "loss": 1.2532,
+      "step": 659
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.612982492009945e-05,
+      "loss": 1.1977,
+      "step": 660
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.611617505772003e-05,
+      "loss": 1.1141,
+      "step": 661
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.6102502832357884e-05,
+      "loss": 1.0795,
+      "step": 662
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.608880825572039e-05,
+      "loss": 1.2937,
+      "step": 663
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.607509133953406e-05,
+      "loss": 1.0467,
+      "step": 664
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.606135209554454e-05,
+      "loss": 1.3079,
+      "step": 665
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.604759053551656e-05,
+      "loss": 1.0127,
+      "step": 666
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.603380667123402e-05,
+      "loss": 1.193,
+      "step": 667
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.6020000514499856e-05,
+      "loss": 1.141,
+      "step": 668
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.600617207713614e-05,
+      "loss": 1.1353,
+      "step": 669
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.5992321370984005e-05,
+      "loss": 1.2297,
+      "step": 670
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.5978448407903655e-05,
+      "loss": 1.2322,
+      "step": 671
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.596455319977434e-05,
+      "loss": 1.2483,
+      "step": 672
+    },
+    {
+      "epoch": 0.38,
+      "learning_rate": 5.595063575849437e-05,
+      "loss": 1.2819,
+      "step": 673
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.593669609598109e-05,
+      "loss": 1.1032,
+      "step": 674
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.592273422417089e-05,
+      "loss": 0.9736,
+      "step": 675
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.5908750155019144e-05,
+      "loss": 1.1137,
+      "step": 676
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.589474390050025e-05,
+      "loss": 1.0881,
+      "step": 677
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.588071547260761e-05,
+      "loss": 1.1516,
+      "step": 678
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.586666488335362e-05,
+      "loss": 1.1289,
+      "step": 679
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.5852592144769626e-05,
+      "loss": 1.2832,
+      "step": 680
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.583849726890594e-05,
+      "loss": 1.0188,
+      "step": 681
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.5824380267831864e-05,
+      "loss": 1.1108,
+      "step": 682
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.581024115363562e-05,
+      "loss": 1.1344,
+      "step": 683
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.579607993842436e-05,
+      "loss": 1.3017,
+      "step": 684
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.578189663432419e-05,
+      "loss": 1.0234,
+      "step": 685
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.576769125348009e-05,
+      "loss": 1.1707,
+      "step": 686
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.575346380805599e-05,
+      "loss": 1.2975,
+      "step": 687
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.573921431023466e-05,
+      "loss": 1.1545,
+      "step": 688
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.572494277221781e-05,
+      "loss": 1.152,
+      "step": 689
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.571064920622597e-05,
+      "loss": 1.1884,
+      "step": 690
+    },
+    {
+      "epoch": 0.39,
+      "learning_rate": 5.569633362449858e-05,
+      "loss": 1.1592,
+      "step": 691
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.56819960392939e-05,
+      "loss": 1.3585,
+      "step": 692
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.566763646288904e-05,
+      "loss": 1.1004,
+      "step": 693
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.565325490757994e-05,
+      "loss": 1.1258,
+      "step": 694
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.5638851385681354e-05,
+      "loss": 1.264,
+      "step": 695
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.562442590952688e-05,
+      "loss": 1.3104,
+      "step": 696
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.560997849146886e-05,
+      "loss": 1.2116,
+      "step": 697
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.559550914387847e-05,
+      "loss": 1.3143,
+      "step": 698
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.558101787914565e-05,
+      "loss": 0.9532,
+      "step": 699
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.556650470967908e-05,
+      "loss": 1.0093,
+      "step": 700
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.555196964790625e-05,
+      "loss": 1.187,
+      "step": 701
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.553741270627335e-05,
+      "loss": 1.24,
+      "step": 702
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.5522833897245325e-05,
+      "loss": 1.1332,
+      "step": 703
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.550823323330585e-05,
+      "loss": 1.2646,
+      "step": 704
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.549361072695731e-05,
+      "loss": 1.0934,
+      "step": 705
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.5478966390720776e-05,
+      "loss": 1.3061,
+      "step": 706
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.546430023713603e-05,
+      "loss": 1.1112,
+      "step": 707
+    },
+    {
+      "epoch": 0.4,
+      "learning_rate": 5.544961227876155e-05,
+      "loss": 1.1148,
+      "step": 708
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.543490252817445e-05,
+      "loss": 1.1558,
+      "step": 709
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.542017099797052e-05,
+      "loss": 1.3068,
+      "step": 710
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.54054177007642e-05,
+      "loss": 1.1182,
+      "step": 711
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.539064264918858e-05,
+      "loss": 1.154,
+      "step": 712
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.537584585589537e-05,
+      "loss": 1.3112,
+      "step": 713
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.536102733355488e-05,
+      "loss": 1.0923,
+      "step": 714
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.5346187094856055e-05,
+      "loss": 1.1076,
+      "step": 715
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.533132515250642e-05,
+      "loss": 1.1753,
+      "step": 716
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.531644151923208e-05,
+      "loss": 1.0177,
+      "step": 717
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.5301536207777735e-05,
+      "loss": 1.3035,
+      "step": 718
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.528660923090661e-05,
+      "loss": 1.1181,
+      "step": 719
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.5271660601400527e-05,
+      "loss": 1.0776,
+      "step": 720
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.5256690332059814e-05,
+      "loss": 1.2053,
+      "step": 721
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.524169843570334e-05,
+      "loss": 1.0938,
+      "step": 722
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.522668492516851e-05,
+      "loss": 1.1497,
+      "step": 723
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.521164981331121e-05,
+      "loss": 1.1451,
+      "step": 724
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.519659311300583e-05,
+      "loss": 1.2373,
+      "step": 725
+    },
+    {
+      "epoch": 0.41,
+      "learning_rate": 5.5181514837145266e-05,
+      "loss": 1.0725,
+      "step": 726
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.5166414998640866e-05,
+      "loss": 1.1046,
+      "step": 727
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.515129361042245e-05,
+      "loss": 1.2302,
+      "step": 728
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.513615068543828e-05,
+      "loss": 1.0883,
+      "step": 729
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.512098623665508e-05,
+      "loss": 1.0844,
+      "step": 730
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.5105800277057996e-05,
+      "loss": 1.1403,
+      "step": 731
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.509059281965059e-05,
+      "loss": 1.12,
+      "step": 732
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.507536387745484e-05,
+      "loss": 1.2461,
+      "step": 733
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.50601134635111e-05,
+      "loss": 1.2489,
+      "step": 734
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.504484159087813e-05,
+      "loss": 1.0261,
+      "step": 735
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.5029548272633075e-05,
+      "loss": 1.1625,
+      "step": 736
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.5014233521871415e-05,
+      "loss": 1.2227,
+      "step": 737
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.4998897351707004e-05,
+      "loss": 1.1839,
+      "step": 738
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.498353977527202e-05,
+      "loss": 1.1287,
+      "step": 739
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.4968160805716995e-05,
+      "loss": 1.3727,
+      "step": 740
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.495276045621074e-05,
+      "loss": 1.095,
+      "step": 741
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.493733873994042e-05,
+      "loss": 1.1681,
+      "step": 742
+    },
+    {
+      "epoch": 0.42,
+      "learning_rate": 5.4921895670111474e-05,
+      "loss": 1.2298,
+      "step": 743
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.490643125994762e-05,
+      "loss": 1.1233,
+      "step": 744
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.4890945522690855e-05,
+      "loss": 1.105,
+      "step": 745
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.487543847160145e-05,
+      "loss": 1.1042,
+      "step": 746
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.48599101199579e-05,
+      "loss": 1.2735,
+      "step": 747
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.4844360481056964e-05,
+      "loss": 1.2113,
+      "step": 748
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.4828789568213624e-05,
+      "loss": 1.1769,
+      "step": 749
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.4813197394761064e-05,
+      "loss": 1.3264,
+      "step": 750
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.47975839740507e-05,
+      "loss": 1.1479,
+      "step": 751
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.4781949319452105e-05,
+      "loss": 1.1558,
+      "step": 752
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.4766293444353076e-05,
+      "loss": 1.0229,
+      "step": 753
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.475061636215954e-05,
+      "loss": 1.1647,
+      "step": 754
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.473491808629562e-05,
+      "loss": 1.2486,
+      "step": 755
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.4719198630203576e-05,
+      "loss": 1.155,
+      "step": 756
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.4703458007343776e-05,
+      "loss": 1.3802,
+      "step": 757
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.468769623119476e-05,
+      "loss": 1.1966,
+      "step": 758
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.467191331525313e-05,
+      "loss": 1.1512,
+      "step": 759
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.465610927303364e-05,
+      "loss": 1.204,
+      "step": 760
+    },
+    {
+      "epoch": 0.43,
+      "learning_rate": 5.4640284118069104e-05,
+      "loss": 1.1046,
+      "step": 761
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.462443786391042e-05,
+      "loss": 1.195,
+      "step": 762
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.460857052412655e-05,
+      "loss": 1.206,
+      "step": 763
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.459268211230453e-05,
+      "loss": 1.1917,
+      "step": 764
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.4576772642049415e-05,
+      "loss": 1.1893,
+      "step": 765
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.45608421269843e-05,
+      "loss": 1.1464,
+      "step": 766
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.454489058075031e-05,
+      "loss": 1.167,
+      "step": 767
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.452891801700658e-05,
+      "loss": 1.0146,
+      "step": 768
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.451292444943021e-05,
+      "loss": 1.2238,
+      "step": 769
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.449690989171633e-05,
+      "loss": 1.1878,
+      "step": 770
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.448087435757802e-05,
+      "loss": 0.9969,
+      "step": 771
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.446481786074631e-05,
+      "loss": 1.1885,
+      "step": 772
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.444874041497022e-05,
+      "loss": 1.07,
+      "step": 773
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.443264203401666e-05,
+      "loss": 1.1814,
+      "step": 774
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.4416522731670506e-05,
+      "loss": 1.0692,
+      "step": 775
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.4400382521734524e-05,
+      "loss": 1.187,
+      "step": 776
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.43842214180294e-05,
+      "loss": 1.0558,
+      "step": 777
+    },
+    {
+      "epoch": 0.44,
+      "learning_rate": 5.436803943439369e-05,
+      "loss": 1.1391,
+      "step": 778
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.4351836584683854e-05,
+      "loss": 1.1901,
+      "step": 779
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.4335612882774195e-05,
+      "loss": 1.0358,
+      "step": 780
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.43193683425569e-05,
+      "loss": 1.3223,
+      "step": 781
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.430310297794197e-05,
+      "loss": 1.166,
+      "step": 782
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.428681680285725e-05,
+      "loss": 1.1736,
+      "step": 783
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.427050983124843e-05,
+      "loss": 1.1278,
+      "step": 784
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.425418207707895e-05,
+      "loss": 1.1681,
+      "step": 785
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.4237833554330095e-05,
+      "loss": 0.986,
+      "step": 786
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.422146427700092e-05,
+      "loss": 1.1428,
+      "step": 787
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.4205074259108255e-05,
+      "loss": 1.0928,
+      "step": 788
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.418866351468668e-05,
+      "loss": 1.0439,
+      "step": 789
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.4172232057788515e-05,
+      "loss": 1.0795,
+      "step": 790
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.415577990248385e-05,
+      "loss": 1.1073,
+      "step": 791
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.413930706286047e-05,
+      "loss": 1.0889,
+      "step": 792
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.412281355302388e-05,
+      "loss": 1.1951,
+      "step": 793
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.4106299387097274e-05,
+      "loss": 1.2114,
+      "step": 794
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.408976457922155e-05,
+      "loss": 1.1071,
+      "step": 795
+    },
+    {
+      "epoch": 0.45,
+      "learning_rate": 5.4073209143555294e-05,
+      "loss": 1.1702,
+      "step": 796
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.4056633094274717e-05,
+      "loss": 1.2357,
+      "step": 797
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.40400364455737e-05,
+      "loss": 1.1887,
+      "step": 798
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.4023419211663776e-05,
+      "loss": 1.1861,
+      "step": 799
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.400678140677408e-05,
+      "loss": 1.2858,
+      "step": 800
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.399012304515138e-05,
+      "loss": 1.1022,
+      "step": 801
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.397344414106004e-05,
+      "loss": 1.2595,
+      "step": 802
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.3956744708782024e-05,
+      "loss": 1.1816,
+      "step": 803
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.394002476261685e-05,
+      "loss": 1.1861,
+      "step": 804
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.392328431688162e-05,
+      "loss": 1.2506,
+      "step": 805
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.3906523385911e-05,
+      "loss": 1.1202,
+      "step": 806
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.388974198405718e-05,
+      "loss": 1.1255,
+      "step": 807
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.3872940125689864e-05,
+      "loss": 1.2497,
+      "step": 808
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.385611782519632e-05,
+      "loss": 1.1805,
+      "step": 809
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.383927509698127e-05,
+      "loss": 1.2313,
+      "step": 810
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.3822411955466966e-05,
+      "loss": 1.2464,
+      "step": 811
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.3805528415093105e-05,
+      "loss": 1.1607,
+      "step": 812
+    },
+    {
+      "epoch": 0.46,
+      "learning_rate": 5.378862449031689e-05,
+      "loss": 1.2657,
+      "step": 813
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.377170019561295e-05,
+      "loss": 1.1692,
+      "step": 814
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.3754755545473354e-05,
+      "loss": 1.1629,
+      "step": 815
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.3737790554407626e-05,
+      "loss": 1.1403,
+      "step": 816
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.37208052369427e-05,
+      "loss": 1.0951,
+      "step": 817
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.3703799607622896e-05,
+      "loss": 1.1678,
+      "step": 818
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.3686773681009945e-05,
+      "loss": 1.1886,
+      "step": 819
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.366972747168296e-05,
+      "loss": 1.3491,
+      "step": 820
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.36526609942384e-05,
+      "loss": 1.1324,
+      "step": 821
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.363557426329011e-05,
+      "loss": 1.0961,
+      "step": 822
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.361846729346927e-05,
+      "loss": 1.0828,
+      "step": 823
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.360134009942435e-05,
+      "loss": 1.0635,
+      "step": 824
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.35841926958212e-05,
+      "loss": 1.1159,
+      "step": 825
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.356702509734294e-05,
+      "loss": 1.1998,
+      "step": 826
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.354983731868999e-05,
+      "loss": 1.0367,
+      "step": 827
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.3532629374580035e-05,
+      "loss": 1.1435,
+      "step": 828
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.351540127974806e-05,
+      "loss": 1.2021,
+      "step": 829
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.3498153048946273e-05,
+      "loss": 1.2239,
+      "step": 830
+    },
+    {
+      "epoch": 0.47,
+      "learning_rate": 5.3480884696944145e-05,
+      "loss": 1.1311,
+      "step": 831
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.346359623852836e-05,
+      "loss": 1.07,
+      "step": 832
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.344628768850284e-05,
+      "loss": 1.0195,
+      "step": 833
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.3428959061688685e-05,
+      "loss": 1.1672,
+      "step": 834
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.34116103729242e-05,
+      "loss": 1.1443,
+      "step": 835
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.339424163706489e-05,
+      "loss": 1.1357,
+      "step": 836
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.337685286898339e-05,
+      "loss": 1.2997,
+      "step": 837
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.33594440835695e-05,
+      "loss": 1.1219,
+      "step": 838
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.3342015295730176e-05,
+      "loss": 1.0794,
+      "step": 839
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.3324566520389485e-05,
+      "loss": 1.1514,
+      "step": 840
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.330709777248861e-05,
+      "loss": 1.1933,
+      "step": 841
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.328960906698584e-05,
+      "loss": 1.0912,
+      "step": 842
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.327210041885656e-05,
+      "loss": 1.1811,
+      "step": 843
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.3254571843093225e-05,
+      "loss": 1.1088,
+      "step": 844
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.3237023354705355e-05,
+      "loss": 1.2118,
+      "step": 845
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.321945496871952e-05,
+      "loss": 1.284,
+      "step": 846
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.320186670017932e-05,
+      "loss": 1.2104,
+      "step": 847
+    },
+    {
+      "epoch": 0.48,
+      "learning_rate": 5.318425856414539e-05,
+      "loss": 1.1234,
+      "step": 848
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.31666305756954e-05,
+      "loss": 1.1973,
+      "step": 849
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.314898274992396e-05,
+      "loss": 1.3095,
+      "step": 850
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.313131510194273e-05,
+      "loss": 1.2368,
+      "step": 851
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.3113627646880295e-05,
+      "loss": 1.084,
+      "step": 852
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.309592039988224e-05,
+      "loss": 1.2267,
+      "step": 853
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.307819337611106e-05,
+      "loss": 1.2945,
+      "step": 854
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.306044659074622e-05,
+      "loss": 1.0821,
+      "step": 855
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.3042680058984066e-05,
+      "loss": 1.3488,
+      "step": 856
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.302489379603791e-05,
+      "loss": 1.34,
+      "step": 857
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.30070878171379e-05,
+      "loss": 1.0924,
+      "step": 858
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.2989262137531093e-05,
+      "loss": 1.1202,
+      "step": 859
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.2971416772481427e-05,
+      "loss": 1.2438,
+      "step": 860
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.295355173726968e-05,
+      "loss": 0.9599,
+      "step": 861
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.293566704719348e-05,
+      "loss": 1.0931,
+      "step": 862
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.291776271756729e-05,
+      "loss": 1.1084,
+      "step": 863
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.289983876372236e-05,
+      "loss": 1.1135,
+      "step": 864
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.288189520100679e-05,
+      "loss": 1.2668,
+      "step": 865
+    },
+    {
+      "epoch": 0.49,
+      "learning_rate": 5.286393204478544e-05,
+      "loss": 1.1772,
+      "step": 866
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.284594931043995e-05,
+      "loss": 1.1161,
+      "step": 867
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.282794701336873e-05,
+      "loss": 1.0898,
+      "step": 868
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.2809925168986955e-05,
+      "loss": 1.2888,
+      "step": 869
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.279188379272652e-05,
+      "loss": 1.1908,
+      "step": 870
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.277382290003604e-05,
+      "loss": 1.2014,
+      "step": 871
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.275574250638086e-05,
+      "loss": 1.1201,
+      "step": 872
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.2737642627243005e-05,
+      "loss": 1.2646,
+      "step": 873
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.2719523278121214e-05,
+      "loss": 1.3526,
+      "step": 874
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.2701384474530855e-05,
+      "loss": 1.3291,
+      "step": 875
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.2683226232004e-05,
+      "loss": 1.2105,
+      "step": 876
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.266504856608933e-05,
+      "loss": 1.1314,
+      "step": 877
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.264685149235218e-05,
+      "loss": 1.1163,
+      "step": 878
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.26286350263745e-05,
+      "loss": 1.1127,
+      "step": 879
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.261039918375483e-05,
+      "loss": 1.2368,
+      "step": 880
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.2592143980108334e-05,
+      "loss": 1.193,
+      "step": 881
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.2573869431066705e-05,
+      "loss": 1.0528,
+      "step": 882
+    },
+    {
+      "epoch": 0.5,
+      "learning_rate": 5.255557555227826e-05,
+      "loss": 1.0958,
+      "step": 883
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.2537262359407815e-05,
+      "loss": 1.1166,
+      "step": 884
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.251892986813677e-05,
+      "loss": 1.1238,
+      "step": 885
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.2500578094163016e-05,
+      "loss": 1.1888,
+      "step": 886
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.248220705320096e-05,
+      "loss": 1.249,
+      "step": 887
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.2463816760981536e-05,
+      "loss": 1.1435,
+      "step": 888
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.244540723325212e-05,
+      "loss": 1.1549,
+      "step": 889
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.242697848577659e-05,
+      "loss": 1.0175,
+      "step": 890
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.240853053433528e-05,
+      "loss": 1.1229,
+      "step": 891
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.239006339472495e-05,
+      "loss": 1.1723,
+      "step": 892
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.2371577082758794e-05,
+      "loss": 1.3707,
+      "step": 893
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.235307161426645e-05,
+      "loss": 1.1808,
+      "step": 894
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.233454700509392e-05,
+      "loss": 1.1593,
+      "step": 895
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.2316003271103635e-05,
+      "loss": 1.1151,
+      "step": 896
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.229744042817436e-05,
+      "loss": 1.1692,
+      "step": 897
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.227885849220127e-05,
+      "loss": 1.2318,
+      "step": 898
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.226025747909584e-05,
+      "loss": 1.0008,
+      "step": 899
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.224163740478593e-05,
+      "loss": 1.192,
+      "step": 900
+    },
+    {
+      "epoch": 0.51,
+      "learning_rate": 5.222299828521568e-05,
+      "loss": 1.0656,
+      "step": 901
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.220434013634556e-05,
+      "loss": 1.2429,
+      "step": 902
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.2185662974152325e-05,
+      "loss": 1.0459,
+      "step": 903
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.216696681462903e-05,
+      "loss": 1.1764,
+      "step": 904
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.2148251673784965e-05,
+      "loss": 1.3172,
+      "step": 905
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.212951756764571e-05,
+      "loss": 1.0529,
+      "step": 906
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.211076451225305e-05,
+      "loss": 0.9544,
+      "step": 907
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.209199252366502e-05,
+      "loss": 1.0628,
+      "step": 908
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.2073201617955866e-05,
+      "loss": 1.107,
+      "step": 909
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.205439181121601e-05,
+      "loss": 1.115,
+      "step": 910
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.203556311955209e-05,
+      "loss": 1.0058,
+      "step": 911
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.2016715559086896e-05,
+      "loss": 1.0834,
+      "step": 912
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.199784914595937e-05,
+      "loss": 1.2133,
+      "step": 913
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.1978963896324624e-05,
+      "loss": 1.0692,
+      "step": 914
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.196005982635386e-05,
+      "loss": 1.2157,
+      "step": 915
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.1941136952234434e-05,
+      "loss": 1.2785,
+      "step": 916
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.192219529016978e-05,
+      "loss": 1.1987,
+      "step": 917
+    },
+    {
+      "epoch": 0.52,
+      "learning_rate": 5.190323485637943e-05,
+      "loss": 1.2549,
+      "step": 918
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.188425566709899e-05,
+      "loss": 1.0654,
+      "step": 919
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.186525773858012e-05,
+      "loss": 1.2171,
+      "step": 920
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.184624108709052e-05,
+      "loss": 1.293,
+      "step": 921
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.182720572891395e-05,
+      "loss": 1.2619,
+      "step": 922
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.1808151680350154e-05,
+      "loss": 1.0671,
+      "step": 923
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.17890789577149e-05,
+      "loss": 1.2375,
+      "step": 924
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.1769987577339946e-05,
+      "loss": 1.301,
+      "step": 925
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.1750877555573027e-05,
+      "loss": 0.9778,
+      "step": 926
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.173174890877783e-05,
+      "loss": 1.1323,
+      "step": 927
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.1712601653334e-05,
+      "loss": 0.9951,
+      "step": 928
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.169343580563712e-05,
+      "loss": 1.2056,
+      "step": 929
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.167425138209867e-05,
+      "loss": 1.3612,
+      "step": 930
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.1655048399146066e-05,
+      "loss": 1.0079,
+      "step": 931
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.16358268732226e-05,
+      "loss": 1.1731,
+      "step": 932
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.161658682078744e-05,
+      "loss": 1.1845,
+      "step": 933
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.159732825831563e-05,
+      "loss": 1.1868,
+      "step": 934
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.157805120229806e-05,
+      "loss": 1.0952,
+      "step": 935
+    },
+    {
+      "epoch": 0.53,
+      "learning_rate": 5.1558755669241445e-05,
+      "loss": 1.1964,
+      "step": 936
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.153944167566833e-05,
+      "loss": 1.1765,
+      "step": 937
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.1520109238117075e-05,
+      "loss": 1.1232,
+      "step": 938
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.1500758373141823e-05,
+      "loss": 1.3371,
+      "step": 939
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.14813890973125e-05,
+      "loss": 1.038,
+      "step": 940
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.146200142721478e-05,
+      "loss": 1.06,
+      "step": 941
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.144259537945013e-05,
+      "loss": 1.3545,
+      "step": 942
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.142317097063571e-05,
+      "loss": 1.0696,
+      "step": 943
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.140372821740442e-05,
+      "loss": 1.2081,
+      "step": 944
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.138426713640488e-05,
+      "loss": 1.1612,
+      "step": 945
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.136478774430138e-05,
+      "loss": 1.1027,
+      "step": 946
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.13452900577739e-05,
+      "loss": 0.9885,
+      "step": 947
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.1325774093518094e-05,
+      "loss": 1.2874,
+      "step": 948
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.130623986824526e-05,
+      "loss": 1.2007,
+      "step": 949
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.1286687398682324e-05,
+      "loss": 0.9804,
+      "step": 950
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.126711670157185e-05,
+      "loss": 1.0673,
+      "step": 951
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.124752779367199e-05,
+      "loss": 0.9835,
+      "step": 952
+    },
+    {
+      "epoch": 0.54,
+      "learning_rate": 5.122792069175653e-05,
+      "loss": 1.1885,
+      "step": 953
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.120829541261478e-05,
+      "loss": 1.181,
+      "step": 954
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.118865197305165e-05,
+      "loss": 1.1163,
+      "step": 955
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.1168990389887595e-05,
+      "loss": 0.9656,
+      "step": 956
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.114931067995861e-05,
+      "loss": 1.1098,
+      "step": 957
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.11296128601162e-05,
+      "loss": 1.0812,
+      "step": 958
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.110989694722738e-05,
+      "loss": 1.1558,
+      "step": 959
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.1090162958174685e-05,
+      "loss": 1.1846,
+      "step": 960
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.1070410909856065e-05,
+      "loss": 0.9662,
+      "step": 961
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.1050640819184996e-05,
+      "loss": 1.2573,
+      "step": 962
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.1030852703090386e-05,
+      "loss": 1.0069,
+      "step": 963
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.101104657851656e-05,
+      "loss": 1.0552,
+      "step": 964
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.0991222462423286e-05,
+      "loss": 1.2189,
+      "step": 965
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.097138037178573e-05,
+      "loss": 1.1373,
+      "step": 966
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.095152032359443e-05,
+      "loss": 0.9596,
+      "step": 967
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.093164233485534e-05,
+      "loss": 1.2251,
+      "step": 968
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.091174642258975e-05,
+      "loss": 1.09,
+      "step": 969
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.089183260383429e-05,
+      "loss": 1.1201,
+      "step": 970
+    },
+    {
+      "epoch": 0.55,
+      "learning_rate": 5.0871900895640946e-05,
+      "loss": 1.0472,
+      "step": 971
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.085195131507701e-05,
+      "loss": 1.2901,
+      "step": 972
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.083198387922509e-05,
+      "loss": 0.9718,
+      "step": 973
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.081199860518306e-05,
+      "loss": 1.144,
+      "step": 974
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.079199551006409e-05,
+      "loss": 1.1247,
+      "step": 975
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.07719746109966e-05,
+      "loss": 0.97,
+      "step": 976
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.075193592512425e-05,
+      "loss": 1.1163,
+      "step": 977
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.0731879469605946e-05,
+      "loss": 1.1123,
+      "step": 978
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.07118052616158e-05,
+      "loss": 1.0078,
+      "step": 979
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.0691713318343134e-05,
+      "loss": 1.1793,
+      "step": 980
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.067160365699243e-05,
+      "loss": 1.072,
+      "step": 981
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.0651476294783385e-05,
+      "loss": 1.2336,
+      "step": 982
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.063133124895082e-05,
+      "loss": 1.0677,
+      "step": 983
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.061116853674471e-05,
+      "loss": 0.9936,
+      "step": 984
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.059098817543015e-05,
+      "loss": 0.9774,
+      "step": 985
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.057079018228736e-05,
+      "loss": 1.1176,
+      "step": 986
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.055057457461164e-05,
+      "loss": 1.1757,
+      "step": 987
+    },
+    {
+      "epoch": 0.56,
+      "learning_rate": 5.053034136971339e-05,
+      "loss": 0.9056,
+      "step": 988
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.051009058491809e-05,
+      "loss": 1.1343,
+      "step": 989
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.0489822237566225e-05,
+      "loss": 1.1063,
+      "step": 990
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.0469536345013366e-05,
+      "loss": 0.9864,
+      "step": 991
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.0449232924630095e-05,
+      "loss": 1.0303,
+      "step": 992
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.0428911993801996e-05,
+      "loss": 1.3047,
+      "step": 993
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.0408573569929646e-05,
+      "loss": 1.0817,
+      "step": 994
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.0388217670428603e-05,
+      "loss": 1.1845,
+      "step": 995
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.03678443127294e-05,
+      "loss": 1.0394,
+      "step": 996
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.034745351427751e-05,
+      "loss": 1.2014,
+      "step": 997
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.032704529253333e-05,
+      "loss": 0.9757,
+      "step": 998
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.03066196649722e-05,
+      "loss": 0.9013,
+      "step": 999
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.028617664908435e-05,
+      "loss": 1.1282,
+      "step": 1000
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.026571626237489e-05,
+      "loss": 1.1598,
+      "step": 1001
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.024523852236384e-05,
+      "loss": 1.1195,
+      "step": 1002
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.0224743446586024e-05,
+      "loss": 1.147,
+      "step": 1003
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.020423105259116e-05,
+      "loss": 1.1583,
+      "step": 1004
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.018370135794377e-05,
+      "loss": 1.3566,
+      "step": 1005
+    },
+    {
+      "epoch": 0.57,
+      "learning_rate": 5.016315438022321e-05,
+      "loss": 1.1799,
+      "step": 1006
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 5.0142590137023615e-05,
+      "loss": 1.2322,
+      "step": 1007
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 5.0122008645953906e-05,
+      "loss": 1.1739,
+      "step": 1008
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 5.010140992463778e-05,
+      "loss": 1.1922,
+      "step": 1009
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 5.0080793990713693e-05,
+      "loss": 1.1193,
+      "step": 1010
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 5.006016086183483e-05,
+      "loss": 1.1437,
+      "step": 1011
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 5.0039510555669106e-05,
+      "loss": 0.9838,
+      "step": 1012
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 5.0018843089899144e-05,
+      "loss": 0.9868,
+      "step": 1013
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.999815848222226e-05,
+      "loss": 1.0782,
+      "step": 1014
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.997745675035043e-05,
+      "loss": 0.9318,
+      "step": 1015
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.995673791201034e-05,
+      "loss": 1.0489,
+      "step": 1016
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.993600198494328e-05,
+      "loss": 1.0281,
+      "step": 1017
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.991524898690518e-05,
+      "loss": 1.1618,
+      "step": 1018
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.9894478935666605e-05,
+      "loss": 1.1993,
+      "step": 1019
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.987369184901271e-05,
+      "loss": 1.3238,
+      "step": 1020
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.985288774474325e-05,
+      "loss": 0.9779,
+      "step": 1021
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.983206664067253e-05,
+      "loss": 1.0781,
+      "step": 1022
+    },
+    {
+      "epoch": 0.58,
+      "learning_rate": 4.981122855462942e-05,
+      "loss": 1.1459,
+      "step": 1023
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.979037350445735e-05,
+      "loss": 1.1598,
+      "step": 1024
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.976950150801425e-05,
+      "loss": 1.0769,
+      "step": 1025
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.9748612583172575e-05,
+      "loss": 1.0775,
+      "step": 1026
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.972770674781928e-05,
+      "loss": 1.2145,
+      "step": 1027
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.970678401985579e-05,
+      "loss": 1.1081,
+      "step": 1028
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.968584441719799e-05,
+      "loss": 1.2515,
+      "step": 1029
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.966488795777623e-05,
+      "loss": 1.1828,
+      "step": 1030
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.9643914659535285e-05,
+      "loss": 1.0675,
+      "step": 1031
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.962292454043436e-05,
+      "loss": 1.1932,
+      "step": 1032
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.9601917618447036e-05,
+      "loss": 1.1887,
+      "step": 1033
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.958089391156131e-05,
+      "loss": 1.1691,
+      "step": 1034
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.9559853437779544e-05,
+      "loss": 1.0491,
+      "step": 1035
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.953879621511846e-05,
+      "loss": 1.0984,
+      "step": 1036
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.951772226160911e-05,
+      "loss": 1.0506,
+      "step": 1037
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.949663159529689e-05,
+      "loss": 1.2133,
+      "step": 1038
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.9475524234241476e-05,
+      "loss": 1.2828,
+      "step": 1039
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.945440019651688e-05,
+      "loss": 0.955,
+      "step": 1040
+    },
+    {
+      "epoch": 0.59,
+      "learning_rate": 4.943325950021137e-05,
+      "loss": 1.031,
+      "step": 1041
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.9412102163427485e-05,
+      "loss": 1.1472,
+      "step": 1042
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.9390928204282004e-05,
+      "loss": 1.1818,
+      "step": 1043
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.936973764090595e-05,
+      "loss": 0.9973,
+      "step": 1044
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.9348530491444564e-05,
+      "loss": 1.1426,
+      "step": 1045
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.932730677405727e-05,
+      "loss": 0.9807,
+      "step": 1046
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.930606650691772e-05,
+      "loss": 1.0164,
+      "step": 1047
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.92848097082137e-05,
+      "loss": 1.1949,
+      "step": 1048
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.926353639614716e-05,
+      "loss": 1.1365,
+      "step": 1049
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.92422465889342e-05,
+      "loss": 1.0948,
+      "step": 1050
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.9220940304805034e-05,
+      "loss": 1.1667,
+      "step": 1051
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.9199617562004e-05,
+      "loss": 1.1292,
+      "step": 1052
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.9178278378789505e-05,
+      "loss": 1.14,
+      "step": 1053
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.915692277343407e-05,
+      "loss": 1.1767,
+      "step": 1054
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.9135550764224236e-05,
+      "loss": 1.133,
+      "step": 1055
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.9114162369460614e-05,
+      "loss": 1.1295,
+      "step": 1056
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.9092757607457845e-05,
+      "loss": 1.1781,
+      "step": 1057
+    },
+    {
+      "epoch": 0.6,
+      "learning_rate": 4.907133649654459e-05,
+      "loss": 1.1185,
+      "step": 1058
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.904989905506349e-05,
+      "loss": 1.1673,
+      "step": 1059
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.902844530137119e-05,
+      "loss": 1.018,
+      "step": 1060
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.900697525383828e-05,
+      "loss": 1.0961,
+      "step": 1061
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.898548893084934e-05,
+      "loss": 1.3182,
+      "step": 1062
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.8963986350802845e-05,
+      "loss": 1.1127,
+      "step": 1063
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.894246753211122e-05,
+      "loss": 1.2125,
+      "step": 1064
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.892093249320077e-05,
+      "loss": 0.8882,
+      "step": 1065
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.889938125251171e-05,
+      "loss": 1.0994,
+      "step": 1066
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.8877813828498135e-05,
+      "loss": 1.0969,
+      "step": 1067
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.885623023962797e-05,
+      "loss": 1.0993,
+      "step": 1068
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.883463050438299e-05,
+      "loss": 1.1874,
+      "step": 1069
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.881301464125882e-05,
+      "loss": 1.0088,
+      "step": 1070
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.879138266876486e-05,
+      "loss": 1.144,
+      "step": 1071
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.8769734605424336e-05,
+      "loss": 1.2191,
+      "step": 1072
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.8748070469774216e-05,
+      "loss": 1.1346,
+      "step": 1073
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.8726390280365284e-05,
+      "loss": 1.0853,
+      "step": 1074
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.870469405576201e-05,
+      "loss": 1.0999,
+      "step": 1075
+    },
+    {
+      "epoch": 0.61,
+      "learning_rate": 4.8682981814542636e-05,
+      "loss": 1.002,
+      "step": 1076
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.866125357529911e-05,
+      "loss": 1.1354,
+      "step": 1077
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.863950935663706e-05,
+      "loss": 1.0856,
+      "step": 1078
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.8617749177175834e-05,
+      "loss": 0.9813,
+      "step": 1079
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.85959730555484e-05,
+      "loss": 0.9195,
+      "step": 1080
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.857418101040144e-05,
+      "loss": 1.0147,
+      "step": 1081
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.855237306039518e-05,
+      "loss": 1.1821,
+      "step": 1082
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.853054922420357e-05,
+      "loss": 1.1337,
+      "step": 1083
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.850870952051409e-05,
+      "loss": 1.011,
+      "step": 1084
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.848685396802782e-05,
+      "loss": 1.0679,
+      "step": 1085
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.846498258545944e-05,
+      "loss": 1.1226,
+      "step": 1086
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.844309539153714e-05,
+      "loss": 0.9152,
+      "step": 1087
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.8421192405002706e-05,
+      "loss": 1.1249,
+      "step": 1088
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.839927364461139e-05,
+      "loss": 1.1129,
+      "step": 1089
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.8377339129132e-05,
+      "loss": 1.2165,
+      "step": 1090
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.835538887734678e-05,
+      "loss": 1.0371,
+      "step": 1091
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.833342290805151e-05,
+      "loss": 0.9937,
+      "step": 1092
+    },
+    {
+      "epoch": 0.62,
+      "learning_rate": 4.831144124005538e-05,
+      "loss": 1.0425,
+      "step": 1093
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.8289443892181047e-05,
+      "loss": 1.1914,
+      "step": 1094
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.826743088326459e-05,
+      "loss": 1.0616,
+      "step": 1095
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.82454022321555e-05,
+      "loss": 1.173,
+      "step": 1096
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.822335795771665e-05,
+      "loss": 1.1726,
+      "step": 1097
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.8201298078824313e-05,
+      "loss": 1.006,
+      "step": 1098
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.81792226143681e-05,
+      "loss": 1.1035,
+      "step": 1099
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.8157131583250995e-05,
+      "loss": 1.1789,
+      "step": 1100
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.813502500438928e-05,
+      "loss": 1.1296,
+      "step": 1101
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.811290289671257e-05,
+      "loss": 1.2178,
+      "step": 1102
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.8090765279163785e-05,
+      "loss": 1.0842,
+      "step": 1103
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.80686121706991e-05,
+      "loss": 0.908,
+      "step": 1104
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.8046443590287976e-05,
+      "loss": 1.1556,
+      "step": 1105
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.802425955691311e-05,
+      "loss": 1.1183,
+      "step": 1106
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.8002060089570444e-05,
+      "loss": 1.1277,
+      "step": 1107
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.797984520726912e-05,
+      "loss": 1.0646,
+      "step": 1108
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.79576149290315e-05,
+      "loss": 1.2643,
+      "step": 1109
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.7935369273893095e-05,
+      "loss": 1.1383,
+      "step": 1110
+    },
+    {
+      "epoch": 0.63,
+      "learning_rate": 4.791310826090264e-05,
+      "loss": 0.9911,
+      "step": 1111
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.789083190912195e-05,
+      "loss": 1.033,
+      "step": 1112
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.786854023762605e-05,
+      "loss": 0.9537,
+      "step": 1113
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.7846233265503006e-05,
+      "loss": 0.9697,
+      "step": 1114
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.782391101185405e-05,
+      "loss": 1.3009,
+      "step": 1115
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.780157349579346e-05,
+      "loss": 1.0953,
+      "step": 1116
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.7779220736448594e-05,
+      "loss": 1.2084,
+      "step": 1117
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.7756852752959874e-05,
+      "loss": 1.1661,
+      "step": 1118
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.773446956448075e-05,
+      "loss": 1.156,
+      "step": 1119
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.771207119017768e-05,
+      "loss": 1.2632,
+      "step": 1120
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.768965764923015e-05,
+      "loss": 1.1487,
+      "step": 1121
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.766722896083061e-05,
+      "loss": 1.0718,
+      "step": 1122
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.764478514418448e-05,
+      "loss": 1.1605,
+      "step": 1123
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.762232621851017e-05,
+      "loss": 0.9674,
+      "step": 1124
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.759985220303899e-05,
+      "loss": 1.1446,
+      "step": 1125
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.7577363117015164e-05,
+      "loss": 1.1534,
+      "step": 1126
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.755485897969587e-05,
+      "loss": 1.0806,
+      "step": 1127
+    },
+    {
+      "epoch": 0.64,
+      "learning_rate": 4.753233981035113e-05,
+      "loss": 1.0072,
+      "step": 1128
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.750980562826384e-05,
+      "loss": 1.3223,
+      "step": 1129
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.7487256452729794e-05,
+      "loss": 0.995,
+      "step": 1130
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.746469230305757e-05,
+      "loss": 1.0536,
+      "step": 1131
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.744211319856859e-05,
+      "loss": 1.0503,
+      "step": 1132
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.7419519158597095e-05,
+      "loss": 1.0461,
+      "step": 1133
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.7396910202490105e-05,
+      "loss": 1.0597,
+      "step": 1134
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.7374286349607394e-05,
+      "loss": 1.1272,
+      "step": 1135
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.7351647619321534e-05,
+      "loss": 1.1585,
+      "step": 1136
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.732899403101778e-05,
+      "loss": 1.1158,
+      "step": 1137
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.730632560409417e-05,
+      "loss": 1.1609,
+      "step": 1138
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.7283642357961406e-05,
+      "loss": 1.0848,
+      "step": 1139
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.726094431204289e-05,
+      "loss": 1.023,
+      "step": 1140
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.723823148577472e-05,
+      "loss": 1.0647,
+      "step": 1141
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.72155038986056e-05,
+      "loss": 1.0355,
+      "step": 1142
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.719276156999693e-05,
+      "loss": 1.1048,
+      "step": 1143
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.717000451942269e-05,
+      "loss": 1.1541,
+      "step": 1144
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.714723276636949e-05,
+      "loss": 1.157,
+      "step": 1145
+    },
+    {
+      "epoch": 0.65,
+      "learning_rate": 4.7124446330336525e-05,
+      "loss": 1.3112,
+      "step": 1146
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.7101645230835546e-05,
+      "loss": 1.3171,
+      "step": 1147
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.707882948739088e-05,
+      "loss": 1.1016,
+      "step": 1148
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.7055999119539404e-05,
+      "loss": 1.0189,
+      "step": 1149
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.703315414683048e-05,
+      "loss": 1.0449,
+      "step": 1150
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.7010294588826015e-05,
+      "loss": 1.3306,
+      "step": 1151
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.698742046510037e-05,
+      "loss": 1.1277,
+      "step": 1152
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.696453179524041e-05,
+      "loss": 1.0096,
+      "step": 1153
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.694162859884544e-05,
+      "loss": 1.1219,
+      "step": 1154
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.691871089552719e-05,
+      "loss": 1.1208,
+      "step": 1155
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.689577870490986e-05,
+      "loss": 1.1781,
+      "step": 1156
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.687283204662999e-05,
+      "loss": 1.1166,
+      "step": 1157
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.684987094033656e-05,
+      "loss": 1.0589,
+      "step": 1158
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.68268954056909e-05,
+      "loss": 1.0929,
+      "step": 1159
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.680390546236669e-05,
+      "loss": 1.0948,
+      "step": 1160
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.678090113004998e-05,
+      "loss": 1.0545,
+      "step": 1161
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.675788242843909e-05,
+      "loss": 1.2297,
+      "step": 1162
+    },
+    {
+      "epoch": 0.66,
+      "learning_rate": 4.673484937724468e-05,
+      "loss": 1.032,
+      "step": 1163
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.6711801996189694e-05,
+      "loss": 1.1435,
+      "step": 1164
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.6688740305009336e-05,
+      "loss": 1.145,
+      "step": 1165
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.6665664323451075e-05,
+      "loss": 1.1088,
+      "step": 1166
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.6642574071274606e-05,
+      "loss": 1.1645,
+      "step": 1167
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.6619469568251844e-05,
+      "loss": 0.9161,
+      "step": 1168
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.659635083416692e-05,
+      "loss": 1.1333,
+      "step": 1169
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.6573217888816144e-05,
+      "loss": 1.0841,
+      "step": 1170
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.655007075200799e-05,
+      "loss": 1.018,
+      "step": 1171
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.6526909443563075e-05,
+      "loss": 1.0408,
+      "step": 1172
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.650373398331418e-05,
+      "loss": 1.1701,
+      "step": 1173
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.648054439110618e-05,
+      "loss": 1.1139,
+      "step": 1174
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.645734068679606e-05,
+      "loss": 1.1747,
+      "step": 1175
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.643412289025289e-05,
+      "loss": 1.0842,
+      "step": 1176
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.6410891021357795e-05,
+      "loss": 1.1608,
+      "step": 1177
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.638764510000397e-05,
+      "loss": 1.1792,
+      "step": 1178
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.636438514609663e-05,
+      "loss": 0.8511,
+      "step": 1179
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.6341111179553e-05,
+      "loss": 1.1756,
+      "step": 1180
+    },
+    {
+      "epoch": 0.67,
+      "learning_rate": 4.631782322030231e-05,
+      "loss": 0.9626,
+      "step": 1181
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.6294521288285786e-05,
+      "loss": 1.1276,
+      "step": 1182
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.6271205403456604e-05,
+      "loss": 1.0632,
+      "step": 1183
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.6247875585779885e-05,
+      "loss": 1.1151,
+      "step": 1184
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.6224531855232696e-05,
+      "loss": 1.061,
+      "step": 1185
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.620117423180399e-05,
+      "loss": 1.0445,
+      "step": 1186
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.617780273549465e-05,
+      "loss": 1.0643,
+      "step": 1187
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.615441738631741e-05,
+      "loss": 1.0922,
+      "step": 1188
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.613101820429688e-05,
+      "loss": 1.0277,
+      "step": 1189
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.610760520946952e-05,
+      "loss": 1.1587,
+      "step": 1190
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.6084178421883606e-05,
+      "loss": 1.0093,
+      "step": 1191
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.606073786159922e-05,
+      "loss": 1.0025,
+      "step": 1192
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.603728354868825e-05,
+      "loss": 1.2493,
+      "step": 1193
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.601381550323438e-05,
+      "loss": 1.079,
+      "step": 1194
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.5990333745333e-05,
+      "loss": 0.9842,
+      "step": 1195
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.5966838295091275e-05,
+      "loss": 0.9409,
+      "step": 1196
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.594332917262811e-05,
+      "loss": 1.0917,
+      "step": 1197
+    },
+    {
+      "epoch": 0.68,
+      "learning_rate": 4.591980639807408e-05,
+      "loss": 1.1776,
+      "step": 1198
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.589626999157148e-05,
+      "loss": 1.1797,
+      "step": 1199
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.5872719973274254e-05,
+      "loss": 1.0611,
+      "step": 1200
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.5849156363348025e-05,
+      "loss": 1.1353,
+      "step": 1201
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.582557918197003e-05,
+      "loss": 1.0617,
+      "step": 1202
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.580198844932917e-05,
+      "loss": 1.1034,
+      "step": 1203
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.577838418562588e-05,
+      "loss": 1.1759,
+      "step": 1204
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.575476641107226e-05,
+      "loss": 1.0857,
+      "step": 1205
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.573113514589191e-05,
+      "loss": 0.9387,
+      "step": 1206
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.570749041032002e-05,
+      "loss": 1.1054,
+      "step": 1207
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.5683832224603314e-05,
+      "loss": 1.1598,
+      "step": 1208
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.5660160609000044e-05,
+      "loss": 1.1387,
+      "step": 1209
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.56364755837799e-05,
+      "loss": 0.9858,
+      "step": 1210
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.5612777169224134e-05,
+      "loss": 0.9579,
+      "step": 1211
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.558906538562543e-05,
+      "loss": 1.1013,
+      "step": 1212
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.556534025328789e-05,
+      "loss": 0.9947,
+      "step": 1213
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.554160179252709e-05,
+      "loss": 1.1609,
+      "step": 1214
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.5517850023670014e-05,
+      "loss": 1.159,
+      "step": 1215
+    },
+    {
+      "epoch": 0.69,
+      "learning_rate": 4.549408496705502e-05,
+      "loss": 1.0611,
+      "step": 1216
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.547030664303184e-05,
+      "loss": 1.1204,
+      "step": 1217
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.544651507196161e-05,
+      "loss": 1.3476,
+      "step": 1218
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.5422710274216754e-05,
+      "loss": 1.0479,
+      "step": 1219
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.539889227018107e-05,
+      "loss": 1.2066,
+      "step": 1220
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.537506108024963e-05,
+      "loss": 1.0022,
+      "step": 1221
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.5351216724828825e-05,
+      "loss": 1.1257,
+      "step": 1222
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.532735922433628e-05,
+      "loss": 1.2447,
+      "step": 1223
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.5303488599200924e-05,
+      "loss": 1.0497,
+      "step": 1224
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.5279604869862894e-05,
+      "loss": 1.1275,
+      "step": 1225
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.5255708056773545e-05,
+      "loss": 1.2693,
+      "step": 1226
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.523179818039546e-05,
+      "loss": 1.2201,
+      "step": 1227
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.520787526120238e-05,
+      "loss": 1.0865,
+      "step": 1228
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.518393931967924e-05,
+      "loss": 0.9947,
+      "step": 1229
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.51599903763221e-05,
+      "loss": 1.0036,
+      "step": 1230
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.513602845163818e-05,
+      "loss": 1.0162,
+      "step": 1231
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.511205356614579e-05,
+      "loss": 1.17,
+      "step": 1232
+    },
+    {
+      "epoch": 0.7,
+      "learning_rate": 4.508806574037437e-05,
+      "loss": 1.1578,
+      "step": 1233
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.5064064994864404e-05,
+      "loss": 1.0529,
+      "step": 1234
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.504005135016746e-05,
+      "loss": 1.0434,
+      "step": 1235
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.501602482684615e-05,
+      "loss": 1.2318,
+      "step": 1236
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.499198544547413e-05,
+      "loss": 1.2697,
+      "step": 1237
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.4967933226636e-05,
+      "loss": 1.0175,
+      "step": 1238
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.494386819092745e-05,
+      "loss": 1.2165,
+      "step": 1239
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.491979035895507e-05,
+      "loss": 1.0665,
+      "step": 1240
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.489569975133644e-05,
+      "loss": 1.1102,
+      "step": 1241
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.487159638870007e-05,
+      "loss": 1.1409,
+      "step": 1242
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.4847480291685396e-05,
+      "loss": 1.0693,
+      "step": 1243
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.4823351480942754e-05,
+      "loss": 1.1834,
+      "step": 1244
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.479920997713338e-05,
+      "loss": 1.1124,
+      "step": 1245
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.477505580092935e-05,
+      "loss": 1.2738,
+      "step": 1246
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.475088897301362e-05,
+      "loss": 1.1818,
+      "step": 1247
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.4726709514079974e-05,
+      "loss": 1.1875,
+      "step": 1248
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.4702517444832994e-05,
+      "loss": 1.073,
+      "step": 1249
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.467831278598809e-05,
+      "loss": 1.163,
+      "step": 1250
+    },
+    {
+      "epoch": 0.71,
+      "learning_rate": 4.465409555827142e-05,
+      "loss": 1.0853,
+      "step": 1251
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.462986578241993e-05,
+      "loss": 1.0558,
+      "step": 1252
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.4605623479181285e-05,
+      "loss": 1.2658,
+      "step": 1253
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.458136866931392e-05,
+      "loss": 0.9223,
+      "step": 1254
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.455710137358692e-05,
+      "loss": 0.9562,
+      "step": 1255
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.4532821612780116e-05,
+      "loss": 1.382,
+      "step": 1256
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.450852940768398e-05,
+      "loss": 1.077,
+      "step": 1257
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.4484224779099654e-05,
+      "loss": 1.0911,
+      "step": 1258
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.445990774783891e-05,
+      "loss": 0.9736,
+      "step": 1259
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.4435578334724156e-05,
+      "loss": 1.0182,
+      "step": 1260
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.441123656058838e-05,
+      "loss": 1.1736,
+      "step": 1261
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.4386882446275156e-05,
+      "loss": 0.977,
+      "step": 1262
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.436251601263866e-05,
+      "loss": 1.0637,
+      "step": 1263
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.433813728054357e-05,
+      "loss": 1.0483,
+      "step": 1264
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.431374627086512e-05,
+      "loss": 1.1417,
+      "step": 1265
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.428934300448906e-05,
+      "loss": 1.0477,
+      "step": 1266
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.426492750231163e-05,
+      "loss": 1.1491,
+      "step": 1267
+    },
+    {
+      "epoch": 0.72,
+      "learning_rate": 4.424049978523953e-05,
+      "loss": 0.953,
+      "step": 1268
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.421605987418996e-05,
+      "loss": 1.3682,
+      "step": 1269
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.419160779009051e-05,
+      "loss": 1.2347,
+      "step": 1270
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.416714355387925e-05,
+      "loss": 1.1684,
+      "step": 1271
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.41426671865046e-05,
+      "loss": 1.0615,
+      "step": 1272
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.411817870892541e-05,
+      "loss": 1.1865,
+      "step": 1273
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.409367814211087e-05,
+      "loss": 1.1502,
+      "step": 1274
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.406916550704055e-05,
+      "loss": 1.1492,
+      "step": 1275
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.4044640824704343e-05,
+      "loss": 1.1971,
+      "step": 1276
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.4020104116102426e-05,
+      "loss": 1.3191,
+      "step": 1277
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.3995555402245335e-05,
+      "loss": 1.086,
+      "step": 1278
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.397099470415383e-05,
+      "loss": 1.3027,
+      "step": 1279
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.394642204285898e-05,
+      "loss": 1.0774,
+      "step": 1280
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.392183743940206e-05,
+      "loss": 1.0189,
+      "step": 1281
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.389724091483459e-05,
+      "loss": 1.1296,
+      "step": 1282
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.387263249021827e-05,
+      "loss": 1.1292,
+      "step": 1283
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.384801218662506e-05,
+      "loss": 1.1039,
+      "step": 1284
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.3823380025137e-05,
+      "loss": 0.97,
+      "step": 1285
+    },
+    {
+      "epoch": 0.73,
+      "learning_rate": 4.379873602684636e-05,
+      "loss": 1.1007,
+      "step": 1286
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.3774080212855494e-05,
+      "loss": 1.0509,
+      "step": 1287
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.37494126042769e-05,
+      "loss": 1.2696,
+      "step": 1288
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.372473322223319e-05,
+      "loss": 1.2887,
+      "step": 1289
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.3700042087856995e-05,
+      "loss": 1.0498,
+      "step": 1290
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.36753392222911e-05,
+      "loss": 0.9995,
+      "step": 1291
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.3650624646688246e-05,
+      "loss": 1.0911,
+      "step": 1292
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.362589838221127e-05,
+      "loss": 1.1451,
+      "step": 1293
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.360116045003297e-05,
+      "loss": 0.982,
+      "step": 1294
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.357641087133617e-05,
+      "loss": 1.0648,
+      "step": 1295
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.355164966731365e-05,
+      "loss": 1.1329,
+      "step": 1296
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.352687685916813e-05,
+      "loss": 1.1138,
+      "step": 1297
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.350209246811231e-05,
+      "loss": 1.0501,
+      "step": 1298
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.3477296515368754e-05,
+      "loss": 1.1466,
+      "step": 1299
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.345248902216997e-05,
+      "loss": 1.0698,
+      "step": 1300
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.342767000975833e-05,
+      "loss": 1.2433,
+      "step": 1301
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.340283949938607e-05,
+      "loss": 0.9894,
+      "step": 1302
+    },
+    {
+      "epoch": 0.74,
+      "learning_rate": 4.337799751231527e-05,
+      "loss": 1.0328,
+      "step": 1303
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.3353144069817846e-05,
+      "loss": 1.1992,
+      "step": 1304
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.3328279193175505e-05,
+      "loss": 1.2421,
+      "step": 1305
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.3303402903679775e-05,
+      "loss": 1.0685,
+      "step": 1306
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.3278515222631914e-05,
+      "loss": 1.0733,
+      "step": 1307
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.325361617134299e-05,
+      "loss": 1.1811,
+      "step": 1308
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.322870577113375e-05,
+      "loss": 0.8829,
+      "step": 1309
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.3203784043334704e-05,
+      "loss": 1.0744,
+      "step": 1310
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.317885100928603e-05,
+      "loss": 0.9467,
+      "step": 1311
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.315390669033761e-05,
+      "loss": 1.037,
+      "step": 1312
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.312895110784898e-05,
+      "loss": 1.1876,
+      "step": 1313
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.310398428318931e-05,
+      "loss": 1.1313,
+      "step": 1314
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.307900623773741e-05,
+      "loss": 1.073,
+      "step": 1315
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.3054016992881696e-05,
+      "loss": 0.8866,
+      "step": 1316
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.302901657002019e-05,
+      "loss": 1.0044,
+      "step": 1317
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.300400499056044e-05,
+      "loss": 1.1682,
+      "step": 1318
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.29789822759196e-05,
+      "loss": 1.175,
+      "step": 1319
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.295394844752432e-05,
+      "loss": 1.2591,
+      "step": 1320
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 4.2928903526810796e-05,
+      "loss": 0.9364,
+      "step": 1321
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.290384753522469e-05,
+      "loss": 1.1218,
+      "step": 1322
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.287878049422118e-05,
+      "loss": 1.043,
+      "step": 1323
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.285370242526487e-05,
+      "loss": 1.1169,
+      "step": 1324
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.282861334982984e-05,
+      "loss": 1.1353,
+      "step": 1325
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.280351328939956e-05,
+      "loss": 1.0789,
+      "step": 1326
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.277840226546695e-05,
+      "loss": 1.1102,
+      "step": 1327
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.275328029953427e-05,
+      "loss": 1.0535,
+      "step": 1328
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.272814741311319e-05,
+      "loss": 1.1585,
+      "step": 1329
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.2703003627724715e-05,
+      "loss": 1.1055,
+      "step": 1330
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.267784896489916e-05,
+      "loss": 1.2775,
+      "step": 1331
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.265268344617619e-05,
+      "loss": 1.1448,
+      "step": 1332
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.262750709310475e-05,
+      "loss": 1.0274,
+      "step": 1333
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.2602319927243067e-05,
+      "loss": 0.9375,
+      "step": 1334
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.2577121970158626e-05,
+      "loss": 0.943,
+      "step": 1335
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.2551913243428145e-05,
+      "loss": 1.136,
+      "step": 1336
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.2526693768637556e-05,
+      "loss": 1.1142,
+      "step": 1337
+    },
+    {
+      "epoch": 0.76,
+      "learning_rate": 4.250146356738204e-05,
+      "loss": 1.0625,
+      "step": 1338
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.24762226612659e-05,
+      "loss": 0.9428,
+      "step": 1339
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.245097107190266e-05,
+      "loss": 1.102,
+      "step": 1340
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.2425708820914935e-05,
+      "loss": 1.0611,
+      "step": 1341
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.240043592993454e-05,
+      "loss": 1.0967,
+      "step": 1342
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.237515242060234e-05,
+      "loss": 1.2498,
+      "step": 1343
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.234985831456832e-05,
+      "loss": 0.9554,
+      "step": 1344
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.232455363349153e-05,
+      "loss": 1.1384,
+      "step": 1345
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.22992383990401e-05,
+      "loss": 1.1939,
+      "step": 1346
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.2273912632891154e-05,
+      "loss": 1.1117,
+      "step": 1347
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.224857635673086e-05,
+      "loss": 1.1504,
+      "step": 1348
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.2223229592254393e-05,
+      "loss": 1.0111,
+      "step": 1349
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.2197872361165885e-05,
+      "loss": 0.9367,
+      "step": 1350
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.217250468517847e-05,
+      "loss": 0.8513,
+      "step": 1351
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.2147126586014154e-05,
+      "loss": 0.9356,
+      "step": 1352
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.2121738085403944e-05,
+      "loss": 1.1411,
+      "step": 1353
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.209633920508773e-05,
+      "loss": 0.9788,
+      "step": 1354
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.207092996681427e-05,
+      "loss": 1.169,
+      "step": 1355
+    },
+    {
+      "epoch": 0.77,
+      "learning_rate": 4.204551039234121e-05,
+      "loss": 1.3429,
+      "step": 1356
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.2020080503435035e-05,
+      "loss": 1.0272,
+      "step": 1357
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.199464032187107e-05,
+      "loss": 1.088,
+      "step": 1358
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.196918986943346e-05,
+      "loss": 1.032,
+      "step": 1359
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.194372916791513e-05,
+      "loss": 0.9742,
+      "step": 1360
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.191825823911779e-05,
+      "loss": 1.0397,
+      "step": 1361
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.18927771048519e-05,
+      "loss": 1.1333,
+      "step": 1362
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.186728578693668e-05,
+      "loss": 1.1718,
+      "step": 1363
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.1841784307200045e-05,
+      "loss": 1.1091,
+      "step": 1364
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.1816272687478616e-05,
+      "loss": 1.0262,
+      "step": 1365
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.1790750949617714e-05,
+      "loss": 1.1429,
+      "step": 1366
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.176521911547129e-05,
+      "loss": 1.1269,
+      "step": 1367
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.173967720690199e-05,
+      "loss": 0.8973,
+      "step": 1368
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.1714125245781046e-05,
+      "loss": 1.0412,
+      "step": 1369
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.168856325398831e-05,
+      "loss": 1.2691,
+      "step": 1370
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.166299125341221e-05,
+      "loss": 1.0469,
+      "step": 1371
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.163740926594979e-05,
+      "loss": 0.9203,
+      "step": 1372
+    },
+    {
+      "epoch": 0.78,
+      "learning_rate": 4.16118173135066e-05,
+      "loss": 1.1247,
+      "step": 1373
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.1586215417996725e-05,
+      "loss": 1.1512,
+      "step": 1374
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.156060360134279e-05,
+      "loss": 1.0366,
+      "step": 1375
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.153498188547589e-05,
+      "loss": 1.1013,
+      "step": 1376
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.150935029233562e-05,
+      "loss": 1.1135,
+      "step": 1377
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.148370884387002e-05,
+      "loss": 1.095,
+      "step": 1378
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.145805756203556e-05,
+      "loss": 1.0954,
+      "step": 1379
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.1432396468797136e-05,
+      "loss": 1.0587,
+      "step": 1380
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.140672558612806e-05,
+      "loss": 1.1363,
+      "step": 1381
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.138104493601002e-05,
+      "loss": 1.169,
+      "step": 1382
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.135535454043306e-05,
+      "loss": 1.1388,
+      "step": 1383
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.132965442139556e-05,
+      "loss": 0.9062,
+      "step": 1384
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.1303944600904265e-05,
+      "loss": 1.1099,
+      "step": 1385
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.127822510097417e-05,
+      "loss": 1.0918,
+      "step": 1386
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.1252495943628617e-05,
+      "loss": 1.089,
+      "step": 1387
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.122675715089917e-05,
+      "loss": 1.0056,
+      "step": 1388
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.120100874482567e-05,
+      "loss": 1.0015,
+      "step": 1389
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.117525074745619e-05,
+      "loss": 1.1729,
+      "step": 1390
+    },
+    {
+      "epoch": 0.79,
+      "learning_rate": 4.114948318084699e-05,
+      "loss": 1.1346,
+      "step": 1391
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.112370606706257e-05,
+      "loss": 0.9681,
+      "step": 1392
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.1097919428175565e-05,
+      "loss": 1.106,
+      "step": 1393
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.107212328626678e-05,
+      "loss": 1.2157,
+      "step": 1394
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.104631766342514e-05,
+      "loss": 1.0188,
+      "step": 1395
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.102050258174774e-05,
+      "loss": 1.1365,
+      "step": 1396
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.099467806333971e-05,
+      "loss": 1.1124,
+      "step": 1397
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.096884413031431e-05,
+      "loss": 1.1796,
+      "step": 1398
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.0943000804792835e-05,
+      "loss": 1.0771,
+      "step": 1399
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.091714810890463e-05,
+      "loss": 1.1652,
+      "step": 1400
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.089128606478706e-05,
+      "loss": 1.036,
+      "step": 1401
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.0865414694585504e-05,
+      "loss": 0.9786,
+      "step": 1402
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.083953402045331e-05,
+      "loss": 1.1401,
+      "step": 1403
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.081364406455182e-05,
+      "loss": 1.2316,
+      "step": 1404
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.07877448490503e-05,
+      "loss": 0.9955,
+      "step": 1405
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.076183639612594e-05,
+      "loss": 1.151,
+      "step": 1406
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.073591872796388e-05,
+      "loss": 1.0725,
+      "step": 1407
+    },
+    {
+      "epoch": 0.8,
+      "learning_rate": 4.07099918667571e-05,
+      "loss": 1.0564,
+      "step": 1408
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.068405583470649e-05,
+      "loss": 0.9774,
+      "step": 1409
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.065811065402077e-05,
+      "loss": 1.1762,
+      "step": 1410
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0632156346916506e-05,
+      "loss": 1.2036,
+      "step": 1411
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0606192935618074e-05,
+      "loss": 1.1293,
+      "step": 1412
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0580220442357654e-05,
+      "loss": 1.1404,
+      "step": 1413
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.055423888937517e-05,
+      "loss": 1.1274,
+      "step": 1414
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.052824829891837e-05,
+      "loss": 1.072,
+      "step": 1415
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.050224869324267e-05,
+      "loss": 1.0084,
+      "step": 1416
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0476240094611236e-05,
+      "loss": 1.0994,
+      "step": 1417
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0450222525294944e-05,
+      "loss": 1.0224,
+      "step": 1418
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0424196007572347e-05,
+      "loss": 1.0557,
+      "step": 1419
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.039816056372964e-05,
+      "loss": 1.0424,
+      "step": 1420
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0372116216060686e-05,
+      "loss": 1.1038,
+      "step": 1421
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.034606298686696e-05,
+      "loss": 1.0399,
+      "step": 1422
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0320000898457544e-05,
+      "loss": 1.0004,
+      "step": 1423
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0293929973149116e-05,
+      "loss": 1.1441,
+      "step": 1424
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.026785023326589e-05,
+      "loss": 0.964,
+      "step": 1425
+    },
+    {
+      "epoch": 0.81,
+      "learning_rate": 4.0241761701139686e-05,
+      "loss": 0.9785,
+      "step": 1426
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 4.0215664399109785e-05,
+      "loss": 1.056,
+      "step": 1427
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 4.018955834952301e-05,
+      "loss": 1.2284,
+      "step": 1428
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 4.0163443574733695e-05,
+      "loss": 1.218,
+      "step": 1429
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 4.013732009710361e-05,
+      "loss": 1.1238,
+      "step": 1430
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 4.011118793900199e-05,
+      "loss": 1.0776,
+      "step": 1431
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 4.0085047122805495e-05,
+      "loss": 1.0572,
+      "step": 1432
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 4.005889767089823e-05,
+      "loss": 1.2548,
+      "step": 1433
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 4.003273960567165e-05,
+      "loss": 1.0943,
+      "step": 1434
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 4.000657294952462e-05,
+      "loss": 1.0131,
+      "step": 1435
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 3.998039772486335e-05,
+      "loss": 1.0873,
+      "step": 1436
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 3.995421395410139e-05,
+      "loss": 0.9314,
+      "step": 1437
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 3.992802165965959e-05,
+      "loss": 1.0567,
+      "step": 1438
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 3.990182086396612e-05,
+      "loss": 1.1572,
+      "step": 1439
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 3.9875611589456427e-05,
+      "loss": 1.049,
+      "step": 1440
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 3.98493938585732e-05,
+      "loss": 1.0952,
+      "step": 1441
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 3.98231676937664e-05,
+      "loss": 1.1931,
+      "step": 1442
+    },
+    {
+      "epoch": 0.82,
+      "learning_rate": 3.979693311749319e-05,
+      "loss": 1.1523,
+      "step": 1443
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.977069015221793e-05,
+      "loss": 1.0754,
+      "step": 1444
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.9744438820412175e-05,
+      "loss": 1.1959,
+      "step": 1445
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.9718179144554634e-05,
+      "loss": 0.964,
+      "step": 1446
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.9691911147131184e-05,
+      "loss": 1.0595,
+      "step": 1447
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.96656348506348e-05,
+      "loss": 1.0887,
+      "step": 1448
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.963935027756557e-05,
+      "loss": 1.0801,
+      "step": 1449
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.961305745043069e-05,
+      "loss": 1.0098,
+      "step": 1450
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.9586756391744395e-05,
+      "loss": 1.1497,
+      "step": 1451
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.956044712402799e-05,
+      "loss": 1.0162,
+      "step": 1452
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.953412966980979e-05,
+      "loss": 1.1201,
+      "step": 1453
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.9507804051625146e-05,
+      "loss": 1.0949,
+      "step": 1454
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.9481470292016366e-05,
+      "loss": 0.9741,
+      "step": 1455
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.9455128413532765e-05,
+      "loss": 1.0957,
+      "step": 1456
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.942877843873058e-05,
+      "loss": 1.0166,
+      "step": 1457
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.9402420390173e-05,
+      "loss": 0.8786,
+      "step": 1458
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.937605429043012e-05,
+      "loss": 1.0423,
+      "step": 1459
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.934968016207893e-05,
+      "loss": 1.0207,
+      "step": 1460
+    },
+    {
+      "epoch": 0.83,
+      "learning_rate": 3.93232980277033e-05,
+      "loss": 1.0752,
+      "step": 1461
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.9296907909893945e-05,
+      "loss": 0.999,
+      "step": 1462
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.927050983124842e-05,
+      "loss": 1.0192,
+      "step": 1463
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.924410381437111e-05,
+      "loss": 1.0706,
+      "step": 1464
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.921768988187317e-05,
+      "loss": 1.0832,
+      "step": 1465
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.919126805637256e-05,
+      "loss": 1.1519,
+      "step": 1466
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.916483836049399e-05,
+      "loss": 1.1098,
+      "step": 1467
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.9138400816868896e-05,
+      "loss": 0.9309,
+      "step": 1468
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.911195544813545e-05,
+      "loss": 1.1909,
+      "step": 1469
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.908550227693852e-05,
+      "loss": 1.0317,
+      "step": 1470
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.9059041325929664e-05,
+      "loss": 1.0857,
+      "step": 1471
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.903257261776707e-05,
+      "loss": 1.0614,
+      "step": 1472
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.9006096175115613e-05,
+      "loss": 1.1145,
+      "step": 1473
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.897961202064676e-05,
+      "loss": 1.0893,
+      "step": 1474
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.895312017703858e-05,
+      "loss": 1.1384,
+      "step": 1475
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.892662066697576e-05,
+      "loss": 1.1807,
+      "step": 1476
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.8900113513149506e-05,
+      "loss": 1.1011,
+      "step": 1477
+    },
+    {
+      "epoch": 0.84,
+      "learning_rate": 3.88735987382576e-05,
+      "loss": 0.8656,
+      "step": 1478
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.884707636500434e-05,
+      "loss": 1.1281,
+      "step": 1479
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.882054641610054e-05,
+      "loss": 0.996,
+      "step": 1480
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.879400891426348e-05,
+      "loss": 1.0439,
+      "step": 1481
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.876746388221693e-05,
+      "loss": 0.8749,
+      "step": 1482
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.874091134269109e-05,
+      "loss": 1.2257,
+      "step": 1483
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.87143513184226e-05,
+      "loss": 1.0008,
+      "step": 1484
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.868778383215451e-05,
+      "loss": 1.0704,
+      "step": 1485
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.866120890663624e-05,
+      "loss": 1.0469,
+      "step": 1486
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.863462656462362e-05,
+      "loss": 1.084,
+      "step": 1487
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.860803682887879e-05,
+      "loss": 1.0376,
+      "step": 1488
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.858143972217023e-05,
+      "loss": 1.0513,
+      "step": 1489
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.855483526727276e-05,
+      "loss": 1.2046,
+      "step": 1490
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.852822348696746e-05,
+      "loss": 1.0804,
+      "step": 1491
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.8501604404041684e-05,
+      "loss": 1.2802,
+      "step": 1492
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.8474978041289075e-05,
+      "loss": 1.0618,
+      "step": 1493
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.8448344421509456e-05,
+      "loss": 1.1949,
+      "step": 1494
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.84217035675089e-05,
+      "loss": 1.0358,
+      "step": 1495
+    },
+    {
+      "epoch": 0.85,
+      "learning_rate": 3.8395055502099675e-05,
+      "loss": 1.2381,
+      "step": 1496
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.836840024810022e-05,
+      "loss": 1.1422,
+      "step": 1497
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.83417378283351e-05,
+      "loss": 1.0567,
+      "step": 1498
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.831506826563507e-05,
+      "loss": 0.9907,
+      "step": 1499
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.8288391582836953e-05,
+      "loss": 1.0871,
+      "step": 1500
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.826170780278369e-05,
+      "loss": 1.0011,
+      "step": 1501
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.82350169483243e-05,
+      "loss": 1.2093,
+      "step": 1502
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.8208319042313866e-05,
+      "loss": 1.1253,
+      "step": 1503
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.8181614107613475e-05,
+      "loss": 1.0206,
+      "step": 1504
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.815490216709029e-05,
+      "loss": 1.1282,
+      "step": 1505
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.812818324361742e-05,
+      "loss": 0.9878,
+      "step": 1506
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.810145736007398e-05,
+      "loss": 1.1502,
+      "step": 1507
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.8074724539345047e-05,
+      "loss": 0.9939,
+      "step": 1508
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.804798480432161e-05,
+      "loss": 1.1002,
+      "step": 1509
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.802123817790063e-05,
+      "loss": 1.1452,
+      "step": 1510
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.799448468298489e-05,
+      "loss": 1.0446,
+      "step": 1511
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.7967724342483154e-05,
+      "loss": 1.0144,
+      "step": 1512
+    },
+    {
+      "epoch": 0.86,
+      "learning_rate": 3.794095717930997e-05,
+      "loss": 1.0674,
+      "step": 1513
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.7914183216385765e-05,
+      "loss": 1.0119,
+      "step": 1514
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.7887402476636754e-05,
+      "loss": 1.094,
+      "step": 1515
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.7860614982995016e-05,
+      "loss": 1.0546,
+      "step": 1516
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.783382075839835e-05,
+      "loss": 1.0119,
+      "step": 1517
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.780701982579035e-05,
+      "loss": 1.0624,
+      "step": 1518
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.778021220812035e-05,
+      "loss": 1.1662,
+      "step": 1519
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.775339792834341e-05,
+      "loss": 1.0938,
+      "step": 1520
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.7726577009420297e-05,
+      "loss": 1.1406,
+      "step": 1521
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.769974947431743e-05,
+      "loss": 1.0804,
+      "step": 1522
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.767291534600696e-05,
+      "loss": 0.969,
+      "step": 1523
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.764607464746662e-05,
+      "loss": 1.1277,
+      "step": 1524
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.76192274016798e-05,
+      "loss": 1.0155,
+      "step": 1525
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.7592373631635486e-05,
+      "loss": 0.9612,
+      "step": 1526
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.756551336032827e-05,
+      "loss": 1.0267,
+      "step": 1527
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.7538646610758276e-05,
+      "loss": 1.0882,
+      "step": 1528
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.751177340593121e-05,
+      "loss": 1.0945,
+      "step": 1529
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.7484893768858276e-05,
+      "loss": 1.1199,
+      "step": 1530
+    },
+    {
+      "epoch": 0.87,
+      "learning_rate": 3.745800772255622e-05,
+      "loss": 1.0068,
+      "step": 1531
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.743111529004724e-05,
+      "loss": 0.904,
+      "step": 1532
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.7404216494359023e-05,
+      "loss": 1.1507,
+      "step": 1533
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.7377311358524715e-05,
+      "loss": 0.9991,
+      "step": 1534
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.735039990558285e-05,
+      "loss": 1.124,
+      "step": 1535
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.732348215857743e-05,
+      "loss": 1.183,
+      "step": 1536
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.729655814055778e-05,
+      "loss": 1.2798,
+      "step": 1537
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.726962787457866e-05,
+      "loss": 1.0411,
+      "step": 1538
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.7242691383700135e-05,
+      "loss": 0.9955,
+      "step": 1539
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.721574869098761e-05,
+      "loss": 1.1511,
+      "step": 1540
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.718879981951182e-05,
+      "loss": 1.0546,
+      "step": 1541
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.716184479234876e-05,
+      "loss": 1.1773,
+      "step": 1542
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.713488363257972e-05,
+      "loss": 1.1261,
+      "step": 1543
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.710791636329124e-05,
+      "loss": 0.9876,
+      "step": 1544
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.7080943007575074e-05,
+      "loss": 0.9804,
+      "step": 1545
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.705396358852821e-05,
+      "loss": 1.029,
+      "step": 1546
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.70269781292528e-05,
+      "loss": 1.3153,
+      "step": 1547
+    },
+    {
+      "epoch": 0.88,
+      "learning_rate": 3.699998665285621e-05,
+      "loss": 0.932,
+      "step": 1548
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.69729891824509e-05,
+      "loss": 1.124,
+      "step": 1549
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.694598574115453e-05,
+      "loss": 1.0563,
+      "step": 1550
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.6918976352089815e-05,
+      "loss": 1.2111,
+      "step": 1551
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.689196103838459e-05,
+      "loss": 1.1645,
+      "step": 1552
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.686493982317177e-05,
+      "loss": 1.304,
+      "step": 1553
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.683791272958931e-05,
+      "loss": 1.1125,
+      "step": 1554
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.68108797807802e-05,
+      "loss": 1.0045,
+      "step": 1555
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.678384099989243e-05,
+      "loss": 0.9903,
+      "step": 1556
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.675679641007904e-05,
+      "loss": 1.0133,
+      "step": 1557
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.672974603449795e-05,
+      "loss": 1.182,
+      "step": 1558
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.670268989631214e-05,
+      "loss": 0.9592,
+      "step": 1559
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.667562801868943e-05,
+      "loss": 1.0219,
+      "step": 1560
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.664856042480263e-05,
+      "loss": 1.1853,
+      "step": 1561
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.662148713782939e-05,
+      "loss": 1.3429,
+      "step": 1562
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.659440818095227e-05,
+      "loss": 0.9732,
+      "step": 1563
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.6567323577358664e-05,
+      "loss": 1.195,
+      "step": 1564
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.65402333502408e-05,
+      "loss": 1.0789,
+      "step": 1565
+    },
+    {
+      "epoch": 0.89,
+      "learning_rate": 3.651313752279576e-05,
+      "loss": 0.8848,
+      "step": 1566
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.648603611822536e-05,
+      "loss": 1.0485,
+      "step": 1567
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.645892915973625e-05,
+      "loss": 1.1381,
+      "step": 1568
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.6431816670539785e-05,
+      "loss": 1.105,
+      "step": 1569
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.6404698673852096e-05,
+      "loss": 0.9889,
+      "step": 1570
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.637757519289401e-05,
+      "loss": 1.1356,
+      "step": 1571
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.635044625089105e-05,
+      "loss": 1.0646,
+      "step": 1572
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.6323311871073425e-05,
+      "loss": 1.053,
+      "step": 1573
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.6296172076675994e-05,
+      "loss": 0.8142,
+      "step": 1574
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.626902689093826e-05,
+      "loss": 1.1283,
+      "step": 1575
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.624187633710432e-05,
+      "loss": 1.1113,
+      "step": 1576
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.621472043842289e-05,
+      "loss": 1.0564,
+      "step": 1577
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.618755921814726e-05,
+      "loss": 0.9835,
+      "step": 1578
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.616039269953526e-05,
+      "loss": 1.0192,
+      "step": 1579
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.61332209058493e-05,
+      "loss": 0.9671,
+      "step": 1580
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.610604386035625e-05,
+      "loss": 1.1171,
+      "step": 1581
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.607886158632751e-05,
+      "loss": 1.0145,
+      "step": 1582
+    },
+    {
+      "epoch": 0.9,
+      "learning_rate": 3.605167410703895e-05,
+      "loss": 1.0229,
+      "step": 1583
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.6024481445770904e-05,
+      "loss": 0.8651,
+      "step": 1584
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.599728362580814e-05,
+      "loss": 1.1346,
+      "step": 1585
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.597008067043983e-05,
+      "loss": 1.118,
+      "step": 1586
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.594287260295956e-05,
+      "loss": 1.0153,
+      "step": 1587
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.591565944666528e-05,
+      "loss": 0.9777,
+      "step": 1588
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.588844122485933e-05,
+      "loss": 1.139,
+      "step": 1589
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.586121796084833e-05,
+      "loss": 1.0878,
+      "step": 1590
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.5833989677943276e-05,
+      "loss": 1.0057,
+      "step": 1591
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.580675639945943e-05,
+      "loss": 0.948,
+      "step": 1592
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.577951814871632e-05,
+      "loss": 1.1411,
+      "step": 1593
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.575227494903777e-05,
+      "loss": 1.1908,
+      "step": 1594
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.572502682375181e-05,
+      "loss": 1.1426,
+      "step": 1595
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.569777379619071e-05,
+      "loss": 0.9068,
+      "step": 1596
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.567051588969091e-05,
+      "loss": 0.9781,
+      "step": 1597
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.564325312759307e-05,
+      "loss": 1.065,
+      "step": 1598
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.5615985533241946e-05,
+      "loss": 1.0918,
+      "step": 1599
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.55887131299865e-05,
+      "loss": 1.0614,
+      "step": 1600
+    },
+    {
+      "epoch": 0.91,
+      "learning_rate": 3.556143594117976e-05,
+      "loss": 1.1036,
+      "step": 1601
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.553415399017889e-05,
+      "loss": 0.9999,
+      "step": 1602
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.550686730034508e-05,
+      "loss": 1.0067,
+      "step": 1603
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.547957589504366e-05,
+      "loss": 0.8924,
+      "step": 1604
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.545227979764391e-05,
+      "loss": 0.9356,
+      "step": 1605
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.5424979031519176e-05,
+      "loss": 1.0334,
+      "step": 1606
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.5397673620046794e-05,
+      "loss": 0.9766,
+      "step": 1607
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.537036358660809e-05,
+      "loss": 1.1162,
+      "step": 1608
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.5343048954588325e-05,
+      "loss": 1.2132,
+      "step": 1609
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.5315729747376686e-05,
+      "loss": 1.0088,
+      "step": 1610
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.528840598836633e-05,
+      "loss": 0.9503,
+      "step": 1611
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.526107770095426e-05,
+      "loss": 1.031,
+      "step": 1612
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.523374490854138e-05,
+      "loss": 1.0179,
+      "step": 1613
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.5206407634532453e-05,
+      "loss": 1.0868,
+      "step": 1614
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.517906590233608e-05,
+      "loss": 0.9974,
+      "step": 1615
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.515171973536466e-05,
+      "loss": 1.1548,
+      "step": 1616
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.5124369157034413e-05,
+      "loss": 1.0408,
+      "step": 1617
+    },
+    {
+      "epoch": 0.92,
+      "learning_rate": 3.509701419076533e-05,
+      "loss": 1.0266,
+      "step": 1618
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.506965485998114e-05,
+      "loss": 0.9955,
+      "step": 1619
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.504229118810935e-05,
+      "loss": 0.9682,
+      "step": 1620
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.5014923198581134e-05,
+      "loss": 1.0309,
+      "step": 1621
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.4987550914831416e-05,
+      "loss": 1.0222,
+      "step": 1622
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.496017436029875e-05,
+      "loss": 0.9709,
+      "step": 1623
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.493279355842539e-05,
+      "loss": 1.0605,
+      "step": 1624
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.490540853265717e-05,
+      "loss": 1.147,
+      "step": 1625
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.48780193064436e-05,
+      "loss": 1.1728,
+      "step": 1626
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.4850625903237754e-05,
+      "loss": 1.1768,
+      "step": 1627
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.4823228346496295e-05,
+      "loss": 1.0783,
+      "step": 1628
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.479582665967943e-05,
+      "loss": 1.0335,
+      "step": 1629
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.4768420866250924e-05,
+      "loss": 1.1179,
+      "step": 1630
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.4741010989678024e-05,
+      "loss": 0.8841,
+      "step": 1631
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.471359705343152e-05,
+      "loss": 1.156,
+      "step": 1632
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.4686179080985636e-05,
+      "loss": 1.1368,
+      "step": 1633
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.4658757095818085e-05,
+      "loss": 1.04,
+      "step": 1634
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.463133112140998e-05,
+      "loss": 1.1505,
+      "step": 1635
+    },
+    {
+      "epoch": 0.93,
+      "learning_rate": 3.460390118124587e-05,
+      "loss": 1.0031,
+      "step": 1636
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.457646729881373e-05,
+      "loss": 1.0613,
+      "step": 1637
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.4549029497604836e-05,
+      "loss": 1.0468,
+      "step": 1638
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.4521587801113905e-05,
+      "loss": 0.891,
+      "step": 1639
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.4494142232838916e-05,
+      "loss": 0.9296,
+      "step": 1640
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.446669281628122e-05,
+      "loss": 1.131,
+      "step": 1641
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.4439239574945426e-05,
+      "loss": 1.2038,
+      "step": 1642
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.441178253233944e-05,
+      "loss": 0.9712,
+      "step": 1643
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.43843217119744e-05,
+      "loss": 1.1038,
+      "step": 1644
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.4356857137364714e-05,
+      "loss": 1.0785,
+      "step": 1645
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.432938883202796e-05,
+      "loss": 0.9494,
+      "step": 1646
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.430191681948496e-05,
+      "loss": 1.0807,
+      "step": 1647
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.427444112325966e-05,
+      "loss": 1.0785,
+      "step": 1648
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.424696176687921e-05,
+      "loss": 1.1426,
+      "step": 1649
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.4219478773873844e-05,
+      "loss": 0.8732,
+      "step": 1650
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.419199216777696e-05,
+      "loss": 1.1445,
+      "step": 1651
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.4164501972125006e-05,
+      "loss": 1.0236,
+      "step": 1652
+    },
+    {
+      "epoch": 0.94,
+      "learning_rate": 3.413700821045752e-05,
+      "loss": 1.126,
+      "step": 1653
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.4109510906317125e-05,
+      "loss": 1.0785,
+      "step": 1654
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.408201008324942e-05,
+      "loss": 1.0916,
+      "step": 1655
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.405450576480306e-05,
+      "loss": 1.044,
+      "step": 1656
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.4026997974529664e-05,
+      "loss": 1.1964,
+      "step": 1657
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.3999486735983865e-05,
+      "loss": 1.1826,
+      "step": 1658
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.3971972072723196e-05,
+      "loss": 1.0548,
+      "step": 1659
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.394445400830817e-05,
+      "loss": 0.9895,
+      "step": 1660
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.3916932566302174e-05,
+      "loss": 1.1141,
+      "step": 1661
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.388940777027152e-05,
+      "loss": 1.004,
+      "step": 1662
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.386187964378537e-05,
+      "loss": 1.0619,
+      "step": 1663
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.383434821041574e-05,
+      "loss": 1.0376,
+      "step": 1664
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.380681349373749e-05,
+      "loss": 1.1606,
+      "step": 1665
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.3779275517328275e-05,
+      "loss": 1.1529,
+      "step": 1666
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.3751734304768564e-05,
+      "loss": 0.9852,
+      "step": 1667
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.372418987964157e-05,
+      "loss": 0.8109,
+      "step": 1668
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.3696642265533276e-05,
+      "loss": 0.963,
+      "step": 1669
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.366909148603238e-05,
+      "loss": 1.0846,
+      "step": 1670
+    },
+    {
+      "epoch": 0.95,
+      "learning_rate": 3.3641537564730325e-05,
+      "loss": 0.9307,
+      "step": 1671
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.361398052522119e-05,
+      "loss": 0.8419,
+      "step": 1672
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.358642039110177e-05,
+      "loss": 1.1447,
+      "step": 1673
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.355885718597149e-05,
+      "loss": 1.06,
+      "step": 1674
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.353129093343241e-05,
+      "loss": 1.04,
+      "step": 1675
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.350372165708919e-05,
+      "loss": 0.9734,
+      "step": 1676
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.34761493805491e-05,
+      "loss": 1.0425,
+      "step": 1677
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.344857412742195e-05,
+      "loss": 1.1037,
+      "step": 1678
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.342099592132013e-05,
+      "loss": 1.0243,
+      "step": 1679
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.3393414785858537e-05,
+      "loss": 0.9589,
+      "step": 1680
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.336583074465457e-05,
+      "loss": 1.086,
+      "step": 1681
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.333824382132815e-05,
+      "loss": 1.0266,
+      "step": 1682
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.3310654039501626e-05,
+      "loss": 1.079,
+      "step": 1683
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.328306142279983e-05,
+      "loss": 0.9338,
+      "step": 1684
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.3255465994849986e-05,
+      "loss": 1.0495,
+      "step": 1685
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.3227867779281774e-05,
+      "loss": 0.9882,
+      "step": 1686
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.3200266799727196e-05,
+      "loss": 1.0079,
+      "step": 1687
+    },
+    {
+      "epoch": 0.96,
+      "learning_rate": 3.317266307982068e-05,
+      "loss": 1.0587,
+      "step": 1688
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.314505664319896e-05,
+      "loss": 1.0583,
+      "step": 1689
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.311744751350113e-05,
+      "loss": 1.138,
+      "step": 1690
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.308983571436856e-05,
+      "loss": 0.8603,
+      "step": 1691
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.306222126944493e-05,
+      "loss": 1.0784,
+      "step": 1692
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.303460420237616e-05,
+      "loss": 1.0069,
+      "step": 1693
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.300698453681043e-05,
+      "loss": 0.9386,
+      "step": 1694
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.297936229639817e-05,
+      "loss": 1.1075,
+      "step": 1695
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.295173750479195e-05,
+      "loss": 1.0399,
+      "step": 1696
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.292411018564659e-05,
+      "loss": 0.9691,
+      "step": 1697
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.2896480362619044e-05,
+      "loss": 1.0323,
+      "step": 1698
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.286884805936841e-05,
+      "loss": 1.3105,
+      "step": 1699
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.2841213299555914e-05,
+      "loss": 1.066,
+      "step": 1700
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.281357610684489e-05,
+      "loss": 1.0937,
+      "step": 1701
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.278593650490075e-05,
+      "loss": 1.0402,
+      "step": 1702
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.2758294517390965e-05,
+      "loss": 1.186,
+      "step": 1703
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.2730650167985056e-05,
+      "loss": 1.0405,
+      "step": 1704
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.270300348035457e-05,
+      "loss": 1.1166,
+      "step": 1705
+    },
+    {
+      "epoch": 0.97,
+      "learning_rate": 3.267535447817303e-05,
+      "loss": 1.121,
+      "step": 1706
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.2647703185116e-05,
+      "loss": 1.1058,
+      "step": 1707
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.262004962486092e-05,
+      "loss": 0.9752,
+      "step": 1708
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.2592393821087255e-05,
+      "loss": 0.9843,
+      "step": 1709
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.256473579747634e-05,
+      "loss": 1.0179,
+      "step": 1710
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.253707557771142e-05,
+      "loss": 1.062,
+      "step": 1711
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.250941318547763e-05,
+      "loss": 1.2319,
+      "step": 1712
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.248174864446196e-05,
+      "loss": 1.0306,
+      "step": 1713
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.245408197835324e-05,
+      "loss": 1.1292,
+      "step": 1714
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.242641321084213e-05,
+      "loss": 1.1111,
+      "step": 1715
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.2398742365621074e-05,
+      "loss": 1.0391,
+      "step": 1716
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.237106946638429e-05,
+      "loss": 1.1871,
+      "step": 1717
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.234339453682778e-05,
+      "loss": 1.0356,
+      "step": 1718
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.231571760064927e-05,
+      "loss": 1.115,
+      "step": 1719
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.22880386815482e-05,
+      "loss": 1.0645,
+      "step": 1720
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.226035780322571e-05,
+      "loss": 1.0338,
+      "step": 1721
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.223267498938462e-05,
+      "loss": 1.1193,
+      "step": 1722
+    },
+    {
+      "epoch": 0.98,
+      "learning_rate": 3.2204990263729414e-05,
+      "loss": 1.049,
+      "step": 1723
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.21773036499662e-05,
+      "loss": 1.1378,
+      "step": 1724
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.214961517180272e-05,
+      "loss": 1.1094,
+      "step": 1725
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.2121924852948294e-05,
+      "loss": 0.983,
+      "step": 1726
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.209423271711383e-05,
+      "loss": 0.9378,
+      "step": 1727
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.206653878801178e-05,
+      "loss": 1.259,
+      "step": 1728
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.203884308935615e-05,
+      "loss": 0.9538,
+      "step": 1729
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.2011145644862445e-05,
+      "loss": 1.1399,
+      "step": 1730
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.198344647824767e-05,
+      "loss": 0.9938,
+      "step": 1731
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.1955745613230305e-05,
+      "loss": 0.9935,
+      "step": 1732
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.192804307353029e-05,
+      "loss": 0.8954,
+      "step": 1733
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.190033888286898e-05,
+      "loss": 1.0076,
+      "step": 1734
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.1872633064969176e-05,
+      "loss": 1.0954,
+      "step": 1735
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.184492564355505e-05,
+      "loss": 0.9893,
+      "step": 1736
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.181721664235213e-05,
+      "loss": 0.9061,
+      "step": 1737
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.178950608508735e-05,
+      "loss": 0.9137,
+      "step": 1738
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.1761793995488914e-05,
+      "loss": 1.1163,
+      "step": 1739
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.1734080397286394e-05,
+      "loss": 1.1284,
+      "step": 1740
+    },
+    {
+      "epoch": 0.99,
+      "learning_rate": 3.17063653142106e-05,
+      "loss": 1.2179,
+      "step": 1741
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.167864876999367e-05,
+      "loss": 1.0974,
+      "step": 1742
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.1650930788368944e-05,
+      "loss": 1.1022,
+      "step": 1743
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.162321139307103e-05,
+      "loss": 1.0501,
+      "step": 1744
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.159549060783571e-05,
+      "loss": 0.9784,
+      "step": 1745
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.156776845639999e-05,
+      "loss": 1.0902,
+      "step": 1746
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.154004496250203e-05,
+      "loss": 1.2624,
+      "step": 1747
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.1512320149881146e-05,
+      "loss": 1.1374,
+      "step": 1748
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.148459404227776e-05,
+      "loss": 1.1168,
+      "step": 1749
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.1456866663433454e-05,
+      "loss": 0.9728,
+      "step": 1750
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.1429138037090825e-05,
+      "loss": 0.9581,
+      "step": 1751
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.140140818699362e-05,
+      "loss": 0.9418,
+      "step": 1752
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.1373677136886567e-05,
+      "loss": 0.9157,
+      "step": 1753
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.134594491051545e-05,
+      "loss": 1.0414,
+      "step": 1754
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.131821153162707e-05,
+      "loss": 0.888,
+      "step": 1755
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.129047702396919e-05,
+      "loss": 0.9189,
+      "step": 1756
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.126274141129056e-05,
+      "loss": 0.8993,
+      "step": 1757
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 3.123500471734087e-05,
+      "loss": 0.9722,
+      "step": 1758
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.120726696587074e-05,
+      "loss": 0.9242,
+      "step": 1759
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.117952818063167e-05,
+      "loss": 1.0235,
+      "step": 1760
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.1151788385376073e-05,
+      "loss": 0.9269,
+      "step": 1761
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.112404760385723e-05,
+      "loss": 0.9743,
+      "step": 1762
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.109630585982926e-05,
+      "loss": 0.9359,
+      "step": 1763
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.106856317704707e-05,
+      "loss": 0.9358,
+      "step": 1764
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.104081957926644e-05,
+      "loss": 0.9867,
+      "step": 1765
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.1013075090243874e-05,
+      "loss": 0.9211,
+      "step": 1766
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.098532973373667e-05,
+      "loss": 1.0446,
+      "step": 1767
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.0957583533502845e-05,
+      "loss": 0.9938,
+      "step": 1768
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.092983651330119e-05,
+      "loss": 0.9287,
+      "step": 1769
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.0902088696891117e-05,
+      "loss": 0.9382,
+      "step": 1770
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.08743401080328e-05,
+      "loss": 1.0011,
+      "step": 1771
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.0846590770487017e-05,
+      "loss": 1.0141,
+      "step": 1772
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.0818840708015216e-05,
+      "loss": 0.8862,
+      "step": 1773
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.0791089944379456e-05,
+      "loss": 0.9001,
+      "step": 1774
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.0763338503342405e-05,
+      "loss": 1.0013,
+      "step": 1775
+    },
+    {
+      "epoch": 1.01,
+      "learning_rate": 3.073558640866731e-05,
+      "loss": 0.9,
+      "step": 1776
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.070783368411796e-05,
+      "loss": 0.8966,
+      "step": 1777
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.06800803534587e-05,
+      "loss": 1.122,
+      "step": 1778
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.0652326440454404e-05,
+      "loss": 1.0969,
+      "step": 1779
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.062457196887041e-05,
+      "loss": 1.0016,
+      "step": 1780
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.0596816962472576e-05,
+      "loss": 1.0051,
+      "step": 1781
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.056906144502717e-05,
+      "loss": 0.9232,
+      "step": 1782
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.054130544030095e-05,
+      "loss": 0.8481,
+      "step": 1783
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.051354897206106e-05,
+      "loss": 0.8522,
+      "step": 1784
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.0485792064075048e-05,
+      "loss": 0.9224,
+      "step": 1785
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.0458034740110825e-05,
+      "loss": 1.0526,
+      "step": 1786
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.043027702393669e-05,
+      "loss": 1.0716,
+      "step": 1787
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.0402518939321237e-05,
+      "loss": 1.0831,
+      "step": 1788
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.037476051003342e-05,
+      "loss": 0.9124,
+      "step": 1789
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.0347001759842447e-05,
+      "loss": 0.9517,
+      "step": 1790
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.0319242712517835e-05,
+      "loss": 0.9357,
+      "step": 1791
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.029148339182932e-05,
+      "loss": 0.9155,
+      "step": 1792
+    },
+    {
+      "epoch": 1.02,
+      "learning_rate": 3.026372382154691e-05,
+      "loss": 0.9676,
+      "step": 1793
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 3.0235964025440795e-05,
+      "loss": 1.0018,
+      "step": 1794
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 3.0208204027281387e-05,
+      "loss": 0.8741,
+      "step": 1795
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 3.0180443850839243e-05,
+      "loss": 0.8607,
+      "step": 1796
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 3.0152683519885083e-05,
+      "loss": 0.9932,
+      "step": 1797
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 3.012492305818977e-05,
+      "loss": 0.8812,
+      "step": 1798
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 3.0097162489524267e-05,
+      "loss": 1.1022,
+      "step": 1799
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 3.0069401837659633e-05,
+      "loss": 0.941,
+      "step": 1800
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 3.004164112636699e-05,
+      "loss": 1.03,
+      "step": 1801
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 3.001388037941754e-05,
+      "loss": 1.0099,
+      "step": 1802
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 2.998611962058247e-05,
+      "loss": 1.0081,
+      "step": 1803
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 2.9958358873633014e-05,
+      "loss": 1.0256,
+      "step": 1804
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 2.9930598162340372e-05,
+      "loss": 0.9515,
+      "step": 1805
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 2.990283751047574e-05,
+      "loss": 1.023,
+      "step": 1806
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 2.9875076941810234e-05,
+      "loss": 1.0843,
+      "step": 1807
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 2.9847316480114926e-05,
+      "loss": 1.0352,
+      "step": 1808
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 2.9819556149160762e-05,
+      "loss": 1.023,
+      "step": 1809
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 2.9791795972718618e-05,
+      "loss": 1.0146,
+      "step": 1810
+    },
+    {
+      "epoch": 1.03,
+      "learning_rate": 2.976403597455921e-05,
+      "loss": 0.861,
+      "step": 1811
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9736276178453094e-05,
+      "loss": 0.9593,
+      "step": 1812
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9708516608170685e-05,
+      "loss": 0.84,
+      "step": 1813
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9680757287482167e-05,
+      "loss": 0.9181,
+      "step": 1814
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9652998240157558e-05,
+      "loss": 0.838,
+      "step": 1815
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9625239489966583e-05,
+      "loss": 0.957,
+      "step": 1816
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9597481060678764e-05,
+      "loss": 1.0359,
+      "step": 1817
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9569722976063315e-05,
+      "loss": 1.1971,
+      "step": 1818
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.954196525988918e-05,
+      "loss": 0.9897,
+      "step": 1819
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9514207935924957e-05,
+      "loss": 1.0354,
+      "step": 1820
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9486451027938944e-05,
+      "loss": 1.0508,
+      "step": 1821
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.945869455969905e-05,
+      "loss": 0.9383,
+      "step": 1822
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9430938554972833e-05,
+      "loss": 0.8846,
+      "step": 1823
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9403183037527436e-05,
+      "loss": 0.942,
+      "step": 1824
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9375428031129596e-05,
+      "loss": 0.7904,
+      "step": 1825
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.93476735595456e-05,
+      "loss": 1.0236,
+      "step": 1826
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.93199196465413e-05,
+      "loss": 0.9233,
+      "step": 1827
+    },
+    {
+      "epoch": 1.04,
+      "learning_rate": 2.9292166315882053e-05,
+      "loss": 1.0588,
+      "step": 1828
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.92644135913327e-05,
+      "loss": 0.9573,
+      "step": 1829
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.9236661496657607e-05,
+      "loss": 1.1295,
+      "step": 1830
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.9208910055620552e-05,
+      "loss": 0.9029,
+      "step": 1831
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.91811592919848e-05,
+      "loss": 0.93,
+      "step": 1832
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.9153409229513e-05,
+      "loss": 0.8872,
+      "step": 1833
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.9125659891967218e-05,
+      "loss": 0.9824,
+      "step": 1834
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.909791130310889e-05,
+      "loss": 1.1364,
+      "step": 1835
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.907016348669883e-05,
+      "loss": 0.8953,
+      "step": 1836
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.9042416466497153e-05,
+      "loss": 0.9504,
+      "step": 1837
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.9014670266263343e-05,
+      "loss": 0.9675,
+      "step": 1838
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.8986924909756134e-05,
+      "loss": 1.0403,
+      "step": 1839
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.895918042073357e-05,
+      "loss": 1.0428,
+      "step": 1840
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.8931436822952933e-05,
+      "loss": 0.9869,
+      "step": 1841
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.8903694140170755e-05,
+      "loss": 0.8788,
+      "step": 1842
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.8875952396142772e-05,
+      "loss": 1.0638,
+      "step": 1843
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.884821161462393e-05,
+      "loss": 1.066,
+      "step": 1844
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.8820471819368347e-05,
+      "loss": 0.8585,
+      "step": 1845
+    },
+    {
+      "epoch": 1.05,
+      "learning_rate": 2.8792733034129278e-05,
+      "loss": 0.9928,
+      "step": 1846
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.876499528265914e-05,
+      "loss": 0.9018,
+      "step": 1847
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8737258588709445e-05,
+      "loss": 1.012,
+      "step": 1848
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.870952297603082e-05,
+      "loss": 1.1365,
+      "step": 1849
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.868178846837294e-05,
+      "loss": 0.9994,
+      "step": 1850
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8654055089484563e-05,
+      "loss": 0.8442,
+      "step": 1851
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8626322863113445e-05,
+      "loss": 0.9576,
+      "step": 1852
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8598591813006393e-05,
+      "loss": 0.9667,
+      "step": 1853
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8570861962909177e-05,
+      "loss": 0.9358,
+      "step": 1854
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.854313333656656e-05,
+      "loss": 1.0805,
+      "step": 1855
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8515405957722235e-05,
+      "loss": 1.0862,
+      "step": 1856
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8487679850118852e-05,
+      "loss": 0.914,
+      "step": 1857
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8459955037497968e-05,
+      "loss": 0.9998,
+      "step": 1858
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8432231543600003e-05,
+      "loss": 1.1164,
+      "step": 1859
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.840450939216429e-05,
+      "loss": 0.9892,
+      "step": 1860
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8376788606928973e-05,
+      "loss": 1.2025,
+      "step": 1861
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.834906921163105e-05,
+      "loss": 0.8948,
+      "step": 1862
+    },
+    {
+      "epoch": 1.06,
+      "learning_rate": 2.8321351230006334e-05,
+      "loss": 1.0224,
+      "step": 1863
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.8293634685789397e-05,
+      "loss": 1.0021,
+      "step": 1864
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.8265919602713614e-05,
+      "loss": 0.8028,
+      "step": 1865
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.8238206004511084e-05,
+      "loss": 1.0406,
+      "step": 1866
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.8210493914912658e-05,
+      "loss": 0.8938,
+      "step": 1867
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.8182783357647865e-05,
+      "loss": 1.0481,
+      "step": 1868
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.815507435644496e-05,
+      "loss": 1.0429,
+      "step": 1869
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.8127366935030822e-05,
+      "loss": 0.8008,
+      "step": 1870
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.809966111713102e-05,
+      "loss": 0.8669,
+      "step": 1871
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.8071956926469714e-05,
+      "loss": 0.9077,
+      "step": 1872
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.80442543867697e-05,
+      "loss": 1.0665,
+      "step": 1873
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.8016553521752333e-05,
+      "loss": 0.9913,
+      "step": 1874
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.798885435513756e-05,
+      "loss": 1.0388,
+      "step": 1875
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.7961156910643846e-05,
+      "loss": 0.9883,
+      "step": 1876
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.793346121198822e-05,
+      "loss": 0.982,
+      "step": 1877
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.7905767282886168e-05,
+      "loss": 0.9212,
+      "step": 1878
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.78780751470517e-05,
+      "loss": 0.8233,
+      "step": 1879
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.7850384828197282e-05,
+      "loss": 0.989,
+      "step": 1880
+    },
+    {
+      "epoch": 1.07,
+      "learning_rate": 2.7822696350033797e-05,
+      "loss": 1.0618,
+      "step": 1881
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.779500973627059e-05,
+      "loss": 1.048,
+      "step": 1882
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.7767325010615386e-05,
+      "loss": 0.9902,
+      "step": 1883
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.77396421967743e-05,
+      "loss": 0.894,
+      "step": 1884
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.771196131845181e-05,
+      "loss": 0.9563,
+      "step": 1885
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.768428239935074e-05,
+      "loss": 0.7832,
+      "step": 1886
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.765660546317222e-05,
+      "loss": 0.9659,
+      "step": 1887
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.7628930533615718e-05,
+      "loss": 0.7416,
+      "step": 1888
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.7601257634378934e-05,
+      "loss": 0.8003,
+      "step": 1889
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.7573586789157878e-05,
+      "loss": 1.0561,
+      "step": 1890
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.7545918021646763e-05,
+      "loss": 0.9843,
+      "step": 1891
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.7518251355538047e-05,
+      "loss": 0.8494,
+      "step": 1892
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.749058681452238e-05,
+      "loss": 0.8606,
+      "step": 1893
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.746292442228859e-05,
+      "loss": 0.9678,
+      "step": 1894
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.743526420252367e-05,
+      "loss": 0.9708,
+      "step": 1895
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.7407606178912754e-05,
+      "loss": 1.0187,
+      "step": 1896
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.7379950375139083e-05,
+      "loss": 0.9152,
+      "step": 1897
+    },
+    {
+      "epoch": 1.08,
+      "learning_rate": 2.735229681488401e-05,
+      "loss": 1.1439,
+      "step": 1898
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.7324645521826972e-05,
+      "loss": 1.0161,
+      "step": 1899
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.729699651964544e-05,
+      "loss": 0.9885,
+      "step": 1900
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.7269349832014952e-05,
+      "loss": 0.9032,
+      "step": 1901
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.724170548260904e-05,
+      "loss": 0.9161,
+      "step": 1902
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.7214063495099258e-05,
+      "loss": 1.0209,
+      "step": 1903
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.7186423893155115e-05,
+      "loss": 1.1037,
+      "step": 1904
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.7158786700444094e-05,
+      "loss": 1.0711,
+      "step": 1905
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.7131151940631597e-05,
+      "loss": 0.9552,
+      "step": 1906
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.7103519637380964e-05,
+      "loss": 0.9224,
+      "step": 1907
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.7075889814353413e-05,
+      "loss": 0.9781,
+      "step": 1908
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.7048262495208057e-05,
+      "loss": 0.9027,
+      "step": 1909
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.702063770360184e-05,
+      "loss": 1.0046,
+      "step": 1910
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.699301546318957e-05,
+      "loss": 0.8598,
+      "step": 1911
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.6965395797623846e-05,
+      "loss": 0.9315,
+      "step": 1912
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.693777873055508e-05,
+      "loss": 0.8987,
+      "step": 1913
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.6910164285631443e-05,
+      "loss": 0.9728,
+      "step": 1914
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.688255248649887e-05,
+      "loss": 0.9749,
+      "step": 1915
+    },
+    {
+      "epoch": 1.09,
+      "learning_rate": 2.6854943356801042e-05,
+      "loss": 1.1129,
+      "step": 1916
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6827336920179326e-05,
+      "loss": 0.9036,
+      "step": 1917
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.679973320027281e-05,
+      "loss": 0.9881,
+      "step": 1918
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6772132220718234e-05,
+      "loss": 1.0261,
+      "step": 1919
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6744534005150015e-05,
+      "loss": 1.0735,
+      "step": 1920
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6716938577200176e-05,
+      "loss": 0.8722,
+      "step": 1921
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6689345960498383e-05,
+      "loss": 0.9669,
+      "step": 1922
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.666175617867186e-05,
+      "loss": 0.9317,
+      "step": 1923
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6634169255345436e-05,
+      "loss": 0.9348,
+      "step": 1924
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6606585214141475e-05,
+      "loss": 1.0212,
+      "step": 1925
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.657900407867988e-05,
+      "loss": 0.868,
+      "step": 1926
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.655142587257805e-05,
+      "loss": 0.9855,
+      "step": 1927
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6523850619450907e-05,
+      "loss": 0.888,
+      "step": 1928
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6496278342910818e-05,
+      "loss": 0.8115,
+      "step": 1929
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.64687090665676e-05,
+      "loss": 0.9238,
+      "step": 1930
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.644114281402852e-05,
+      "loss": 1.0044,
+      "step": 1931
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.6413579608898236e-05,
+      "loss": 0.882,
+      "step": 1932
+    },
+    {
+      "epoch": 1.1,
+      "learning_rate": 2.638601947477882e-05,
+      "loss": 0.9902,
+      "step": 1933
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.6358462435269687e-05,
+      "loss": 0.89,
+      "step": 1934
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.6330908513967626e-05,
+      "loss": 0.9393,
+      "step": 1935
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.6303357734466733e-05,
+      "loss": 0.9564,
+      "step": 1936
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.6275810120358443e-05,
+      "loss": 0.9719,
+      "step": 1937
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.6248265695231445e-05,
+      "loss": 0.979,
+      "step": 1938
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.622072448267173e-05,
+      "loss": 0.9045,
+      "step": 1939
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.619318650626252e-05,
+      "loss": 0.885,
+      "step": 1940
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.616565178958427e-05,
+      "loss": 0.966,
+      "step": 1941
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.6138120356214642e-05,
+      "loss": 0.9691,
+      "step": 1942
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.611059222972849e-05,
+      "loss": 0.9853,
+      "step": 1943
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.608306743369783e-05,
+      "loss": 0.8811,
+      "step": 1944
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.6055545991691844e-05,
+      "loss": 0.9323,
+      "step": 1945
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.6028027927276816e-05,
+      "loss": 0.8947,
+      "step": 1946
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.6000513264016146e-05,
+      "loss": 0.7702,
+      "step": 1947
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.5973002025470347e-05,
+      "loss": 0.999,
+      "step": 1948
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.5945494235196954e-05,
+      "loss": 0.8963,
+      "step": 1949
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.5917989916750594e-05,
+      "loss": 0.8793,
+      "step": 1950
+    },
+    {
+      "epoch": 1.11,
+      "learning_rate": 2.5890489093682886e-05,
+      "loss": 1.0409,
+      "step": 1951
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5862991789542485e-05,
+      "loss": 0.9737,
+      "step": 1952
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5835498027875005e-05,
+      "loss": 1.0023,
+      "step": 1953
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5808007832223057e-05,
+      "loss": 1.0683,
+      "step": 1954
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5780521226126158e-05,
+      "loss": 0.8854,
+      "step": 1955
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5753038233120804e-05,
+      "loss": 0.942,
+      "step": 1956
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5725558876740346e-05,
+      "loss": 0.982,
+      "step": 1957
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.569808318051505e-05,
+      "loss": 0.9387,
+      "step": 1958
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5670611167972042e-05,
+      "loss": 0.873,
+      "step": 1959
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5643142862635298e-05,
+      "loss": 0.9416,
+      "step": 1960
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5615678288025604e-05,
+      "loss": 0.9923,
+      "step": 1961
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.558821746766056e-05,
+      "loss": 0.9463,
+      "step": 1962
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5560760425054575e-05,
+      "loss": 1.001,
+      "step": 1963
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5533307183718777e-05,
+      "loss": 0.9779,
+      "step": 1964
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5505857767161083e-05,
+      "loss": 1.0035,
+      "step": 1965
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.5478412198886103e-05,
+      "loss": 0.9252,
+      "step": 1966
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.545097050239516e-05,
+      "loss": 0.9358,
+      "step": 1967
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 2.542353270118628e-05,
+      "loss": 0.9884,
+      "step": 1968
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5396098818754122e-05,
+      "loss": 0.9952,
+      "step": 1969
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5368668878590023e-05,
+      "loss": 0.8435,
+      "step": 1970
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5341242904181917e-05,
+      "loss": 0.9389,
+      "step": 1971
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5313820919014355e-05,
+      "loss": 0.7947,
+      "step": 1972
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.528640294656847e-05,
+      "loss": 0.9389,
+      "step": 1973
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.525898901032197e-05,
+      "loss": 0.7985,
+      "step": 1974
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5231579133749077e-05,
+      "loss": 1.0377,
+      "step": 1975
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5204173340320567e-05,
+      "loss": 0.904,
+      "step": 1976
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5176771653503703e-05,
+      "loss": 1.0249,
+      "step": 1977
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5149374096762248e-05,
+      "loss": 1.0072,
+      "step": 1978
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5121980693556398e-05,
+      "loss": 0.9401,
+      "step": 1979
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.509459146734283e-05,
+      "loss": 0.9004,
+      "step": 1980
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.506720644157462e-05,
+      "loss": 0.9687,
+      "step": 1981
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5039825639701246e-05,
+      "loss": 0.8884,
+      "step": 1982
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.5012449085168582e-05,
+      "loss": 0.8861,
+      "step": 1983
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.4985076801418858e-05,
+      "loss": 0.9966,
+      "step": 1984
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.4957708811890653e-05,
+      "loss": 1.0397,
+      "step": 1985
+    },
+    {
+      "epoch": 1.13,
+      "learning_rate": 2.4930345140018856e-05,
+      "loss": 0.9002,
+      "step": 1986
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.490298580923468e-05,
+      "loss": 0.9874,
+      "step": 1987
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.4875630842965588e-05,
+      "loss": 1.0452,
+      "step": 1988
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.4848280264635345e-05,
+      "loss": 1.007,
+      "step": 1989
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.4820934097663923e-05,
+      "loss": 0.9871,
+      "step": 1990
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.479359236546755e-05,
+      "loss": 1.0677,
+      "step": 1991
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.476625509145862e-05,
+      "loss": 1.0024,
+      "step": 1992
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.473892229904575e-05,
+      "loss": 0.9323,
+      "step": 1993
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.471159401163368e-05,
+      "loss": 0.9943,
+      "step": 1994
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.468427025262332e-05,
+      "loss": 0.8644,
+      "step": 1995
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.4656951045411687e-05,
+      "loss": 0.92,
+      "step": 1996
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.4629636413391917e-05,
+      "loss": 1.1001,
+      "step": 1997
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.4602326379953208e-05,
+      "loss": 1.0151,
+      "step": 1998
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.457502096848083e-05,
+      "loss": 1.0378,
+      "step": 1999
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.45477202023561e-05,
+      "loss": 0.8964,
+      "step": 2000
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.452042410495635e-05,
+      "loss": 0.9375,
+      "step": 2001
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.449313269965492e-05,
+      "loss": 0.9846,
+      "step": 2002
+    },
+    {
+      "epoch": 1.14,
+      "learning_rate": 2.446584600982112e-05,
+      "loss": 0.9057,
+      "step": 2003
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4438564058820246e-05,
+      "loss": 0.9691,
+      "step": 2004
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4411286870013506e-05,
+      "loss": 0.969,
+      "step": 2005
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.438401446675806e-05,
+      "loss": 0.962,
+      "step": 2006
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.435674687240694e-05,
+      "loss": 0.9711,
+      "step": 2007
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.432948411030909e-05,
+      "loss": 0.9116,
+      "step": 2008
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4302226203809294e-05,
+      "loss": 1.0946,
+      "step": 2009
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4274973176248193e-05,
+      "loss": 0.9455,
+      "step": 2010
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4247725050962235e-05,
+      "loss": 1.0277,
+      "step": 2011
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4220481851283685e-05,
+      "loss": 0.8642,
+      "step": 2012
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.419324360054058e-05,
+      "loss": 0.9662,
+      "step": 2013
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4166010322056725e-05,
+      "loss": 0.9651,
+      "step": 2014
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4138782039151673e-05,
+      "loss": 0.8588,
+      "step": 2015
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4111558775140677e-05,
+      "loss": 0.9828,
+      "step": 2016
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.408434055333472e-05,
+      "loss": 0.8892,
+      "step": 2017
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4057127397040447e-05,
+      "loss": 0.9161,
+      "step": 2018
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.402991932956018e-05,
+      "loss": 0.9349,
+      "step": 2019
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.4002716374191868e-05,
+      "loss": 0.9816,
+      "step": 2020
+    },
+    {
+      "epoch": 1.15,
+      "learning_rate": 2.39755185542291e-05,
+      "loss": 1.0386,
+      "step": 2021
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.3948325892961053e-05,
+      "loss": 1.0411,
+      "step": 2022
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.39211384136725e-05,
+      "loss": 0.7393,
+      "step": 2023
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.3893956139643757e-05,
+      "loss": 0.9778,
+      "step": 2024
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.386677909415071e-05,
+      "loss": 0.9581,
+      "step": 2025
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.3839607300464735e-05,
+      "loss": 0.8885,
+      "step": 2026
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.381244078185275e-05,
+      "loss": 0.9194,
+      "step": 2027
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.3785279561577118e-05,
+      "loss": 0.9372,
+      "step": 2028
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.375812366289569e-05,
+      "loss": 0.8544,
+      "step": 2029
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.373097310906175e-05,
+      "loss": 0.8251,
+      "step": 2030
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.370382792332401e-05,
+      "loss": 0.8932,
+      "step": 2031
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.367668812892658e-05,
+      "loss": 0.99,
+      "step": 2032
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.3649553749108955e-05,
+      "loss": 0.9177,
+      "step": 2033
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.3622424807105998e-05,
+      "loss": 0.8946,
+      "step": 2034
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.3595301326147906e-05,
+      "loss": 1.1158,
+      "step": 2035
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.3568183329460223e-05,
+      "loss": 0.8565,
+      "step": 2036
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.3541070840263753e-05,
+      "loss": 0.8957,
+      "step": 2037
+    },
+    {
+      "epoch": 1.16,
+      "learning_rate": 2.351396388177464e-05,
+      "loss": 0.8848,
+      "step": 2038
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3486862477204244e-05,
+      "loss": 0.9264,
+      "step": 2039
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3459766649759196e-05,
+      "loss": 0.8407,
+      "step": 2040
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3432676422641344e-05,
+      "loss": 0.9207,
+      "step": 2041
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3405591819047738e-05,
+      "loss": 0.8944,
+      "step": 2042
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.337851286217061e-05,
+      "loss": 1.0119,
+      "step": 2043
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.335143957519738e-05,
+      "loss": 0.8372,
+      "step": 2044
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.332437198131057e-05,
+      "loss": 0.9324,
+      "step": 2045
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3297310103687873e-05,
+      "loss": 0.9952,
+      "step": 2046
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3270253965502056e-05,
+      "loss": 0.9834,
+      "step": 2047
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3243203589920978e-05,
+      "loss": 0.8643,
+      "step": 2048
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3216159000107578e-05,
+      "loss": 0.8379,
+      "step": 2049
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3189120219219817e-05,
+      "loss": 0.9824,
+      "step": 2050
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3162087270410705e-05,
+      "loss": 0.9931,
+      "step": 2051
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3135060176828237e-05,
+      "loss": 0.8867,
+      "step": 2052
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.310803896161542e-05,
+      "loss": 0.9371,
+      "step": 2053
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.30810236479102e-05,
+      "loss": 0.9422,
+      "step": 2054
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3054014258845488e-05,
+      "loss": 0.9725,
+      "step": 2055
+    },
+    {
+      "epoch": 1.17,
+      "learning_rate": 2.3027010817549105e-05,
+      "loss": 0.9722,
+      "step": 2056
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.3000013347143808e-05,
+      "loss": 0.9361,
+      "step": 2057
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.2973021870747206e-05,
+      "loss": 0.9339,
+      "step": 2058
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.2946036411471803e-05,
+      "loss": 1.0728,
+      "step": 2059
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.291905699242493e-05,
+      "loss": 0.8918,
+      "step": 2060
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.289208363670877e-05,
+      "loss": 1.0508,
+      "step": 2061
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.2865116367420283e-05,
+      "loss": 1.1881,
+      "step": 2062
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.283815520765125e-05,
+      "loss": 1.0075,
+      "step": 2063
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.28112001804882e-05,
+      "loss": 0.9752,
+      "step": 2064
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.27842513090124e-05,
+      "loss": 0.8239,
+      "step": 2065
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.275730861629988e-05,
+      "loss": 0.9936,
+      "step": 2066
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.273037212542135e-05,
+      "loss": 0.8871,
+      "step": 2067
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.2703441859442213e-05,
+      "loss": 1.0992,
+      "step": 2068
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.2676517841422576e-05,
+      "loss": 0.9914,
+      "step": 2069
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.264960009441714e-05,
+      "loss": 0.7876,
+      "step": 2070
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.262268864147529e-05,
+      "loss": 0.9901,
+      "step": 2071
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.259578350564097e-05,
+      "loss": 1.0665,
+      "step": 2072
+    },
+    {
+      "epoch": 1.18,
+      "learning_rate": 2.256888470995276e-05,
+      "loss": 0.9947,
+      "step": 2073
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2541992277443782e-05,
+      "loss": 0.9279,
+      "step": 2074
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2515106231141722e-05,
+      "loss": 0.8615,
+      "step": 2075
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.248822659406879e-05,
+      "loss": 1.0552,
+      "step": 2076
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.246135338924173e-05,
+      "loss": 0.8707,
+      "step": 2077
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.243448663967173e-05,
+      "loss": 0.9645,
+      "step": 2078
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.240762636836451e-05,
+      "loss": 0.9485,
+      "step": 2079
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2380772598320202e-05,
+      "loss": 0.9526,
+      "step": 2080
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2353925352533383e-05,
+      "loss": 0.9667,
+      "step": 2081
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.232708465399304e-05,
+      "loss": 0.9152,
+      "step": 2082
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2300250525682563e-05,
+      "loss": 0.8937,
+      "step": 2083
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2273422990579712e-05,
+      "loss": 0.9143,
+      "step": 2084
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2246602071656585e-05,
+      "loss": 0.9887,
+      "step": 2085
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.221978779187965e-05,
+      "loss": 0.9971,
+      "step": 2086
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2192980174209647e-05,
+      "loss": 0.9831,
+      "step": 2087
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.216617924160165e-05,
+      "loss": 0.8576,
+      "step": 2088
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2139385017004982e-05,
+      "loss": 0.8742,
+      "step": 2089
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2112597523363238e-05,
+      "loss": 0.9039,
+      "step": 2090
+    },
+    {
+      "epoch": 1.19,
+      "learning_rate": 2.2085816783614237e-05,
+      "loss": 1.0972,
+      "step": 2091
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.205904282069003e-05,
+      "loss": 0.9621,
+      "step": 2092
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.2032275657516844e-05,
+      "loss": 1.0541,
+      "step": 2093
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.2005515317015107e-05,
+      "loss": 0.9434,
+      "step": 2094
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.197876182209938e-05,
+      "loss": 1.0464,
+      "step": 2095
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.195201519567839e-05,
+      "loss": 1.0499,
+      "step": 2096
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1925275460654955e-05,
+      "loss": 0.8675,
+      "step": 2097
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.189854263992602e-05,
+      "loss": 0.8951,
+      "step": 2098
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1871816756382587e-05,
+      "loss": 0.9301,
+      "step": 2099
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1845097832909713e-05,
+      "loss": 0.9257,
+      "step": 2100
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1818385892386527e-05,
+      "loss": 0.8229,
+      "step": 2101
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1791680957686145e-05,
+      "loss": 0.878,
+      "step": 2102
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1764983051675707e-05,
+      "loss": 0.8166,
+      "step": 2103
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1738292197216314e-05,
+      "loss": 0.9057,
+      "step": 2104
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1711608417163058e-05,
+      "loss": 1.0751,
+      "step": 2105
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1684931734364932e-05,
+      "loss": 0.7848,
+      "step": 2106
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.16582621716649e-05,
+      "loss": 0.9377,
+      "step": 2107
+    },
+    {
+      "epoch": 1.2,
+      "learning_rate": 2.1631599751899782e-05,
+      "loss": 1.0182,
+      "step": 2108
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1604944497900323e-05,
+      "loss": 0.9653,
+      "step": 2109
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1578296432491095e-05,
+      "loss": 0.9402,
+      "step": 2110
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1551655578490553e-05,
+      "loss": 1.045,
+      "step": 2111
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.152502195871093e-05,
+      "loss": 1.0006,
+      "step": 2112
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1498395595958315e-05,
+      "loss": 1.0663,
+      "step": 2113
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1471776513032543e-05,
+      "loss": 0.9712,
+      "step": 2114
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1445164732727244e-05,
+      "loss": 1.0284,
+      "step": 2115
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1418560277829774e-05,
+      "loss": 0.8633,
+      "step": 2116
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1391963171121214e-05,
+      "loss": 0.9605,
+      "step": 2117
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.136537343537639e-05,
+      "loss": 1.036,
+      "step": 2118
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1338791093363758e-05,
+      "loss": 0.9844,
+      "step": 2119
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1312216167845497e-05,
+      "loss": 0.8239,
+      "step": 2120
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.12856486815774e-05,
+      "loss": 0.96,
+      "step": 2121
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1259088657308916e-05,
+      "loss": 0.8208,
+      "step": 2122
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1232536117783074e-05,
+      "loss": 0.9512,
+      "step": 2123
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.120599108573652e-05,
+      "loss": 1.121,
+      "step": 2124
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.117945358389946e-05,
+      "loss": 0.8838,
+      "step": 2125
+    },
+    {
+      "epoch": 1.21,
+      "learning_rate": 2.1152923634995662e-05,
+      "loss": 0.907,
+      "step": 2126
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.1126401261742397e-05,
+      "loss": 1.0239,
+      "step": 2127
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.1099886486850502e-05,
+      "loss": 0.8567,
+      "step": 2128
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.1073379333024244e-05,
+      "loss": 0.9586,
+      "step": 2129
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.104687982296142e-05,
+      "loss": 0.8877,
+      "step": 2130
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.1020387979353243e-05,
+      "loss": 1.2164,
+      "step": 2131
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.099390382488439e-05,
+      "loss": 0.9698,
+      "step": 2132
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.0967427382232934e-05,
+      "loss": 1.0037,
+      "step": 2133
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.0940958674070344e-05,
+      "loss": 1.1267,
+      "step": 2134
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.0914497723061486e-05,
+      "loss": 1.0513,
+      "step": 2135
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.088804455186455e-05,
+      "loss": 0.998,
+      "step": 2136
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.0861599183131113e-05,
+      "loss": 0.8849,
+      "step": 2137
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.0835161639506013e-05,
+      "loss": 0.8688,
+      "step": 2138
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.080873194362744e-05,
+      "loss": 0.8747,
+      "step": 2139
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.078231011812683e-05,
+      "loss": 1.0044,
+      "step": 2140
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.07558961856289e-05,
+      "loss": 1.0709,
+      "step": 2141
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.072949016875158e-05,
+      "loss": 0.9475,
+      "step": 2142
+    },
+    {
+      "epoch": 1.22,
+      "learning_rate": 2.070309209010606e-05,
+      "loss": 0.9382,
+      "step": 2143
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.0676701972296707e-05,
+      "loss": 1.1126,
+      "step": 2144
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.0650319837921075e-05,
+      "loss": 0.8324,
+      "step": 2145
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.0623945709569882e-05,
+      "loss": 0.9773,
+      "step": 2146
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.059757960982701e-05,
+      "loss": 1.1523,
+      "step": 2147
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.0571221561269426e-05,
+      "loss": 0.9145,
+      "step": 2148
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.054487158646725e-05,
+      "loss": 0.9257,
+      "step": 2149
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.0518529707983645e-05,
+      "loss": 0.9079,
+      "step": 2150
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.049219594837487e-05,
+      "loss": 0.882,
+      "step": 2151
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.0465870330190222e-05,
+      "loss": 1.0127,
+      "step": 2152
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.043955287597202e-05,
+      "loss": 0.9719,
+      "step": 2153
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.0413243608255614e-05,
+      "loss": 0.9816,
+      "step": 2154
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.038694254956932e-05,
+      "loss": 0.8586,
+      "step": 2155
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.0360649722434438e-05,
+      "loss": 0.8756,
+      "step": 2156
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.033436514936521e-05,
+      "loss": 1.0386,
+      "step": 2157
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.030808885286883e-05,
+      "loss": 0.9748,
+      "step": 2158
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.0281820855445374e-05,
+      "loss": 0.9654,
+      "step": 2159
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.025556117958784e-05,
+      "loss": 0.9794,
+      "step": 2160
+    },
+    {
+      "epoch": 1.23,
+      "learning_rate": 2.022930984778208e-05,
+      "loss": 1.0883,
+      "step": 2161
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 2.020306688250682e-05,
+      "loss": 0.9905,
+      "step": 2162
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 2.0176832306233602e-05,
+      "loss": 0.8644,
+      "step": 2163
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 2.0150606141426804e-05,
+      "loss": 1.0057,
+      "step": 2164
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 2.0124388410543592e-05,
+      "loss": 0.8791,
+      "step": 2165
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 2.009817913603389e-05,
+      "loss": 0.9355,
+      "step": 2166
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 2.0071978340340427e-05,
+      "loss": 1.0036,
+      "step": 2167
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 2.004578604589862e-05,
+      "loss": 1.012,
+      "step": 2168
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 2.0019602275136663e-05,
+      "loss": 0.8998,
+      "step": 2169
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 1.999342705047539e-05,
+      "loss": 0.9267,
+      "step": 2170
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 1.9967260394328367e-05,
+      "loss": 0.9403,
+      "step": 2171
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 1.9941102329101787e-05,
+      "loss": 0.8239,
+      "step": 2172
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 1.991495287719452e-05,
+      "loss": 1.1546,
+      "step": 2173
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 1.9888812060998022e-05,
+      "loss": 0.8227,
+      "step": 2174
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 1.9862679902896394e-05,
+      "loss": 0.9209,
+      "step": 2175
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 1.9836556425266307e-05,
+      "loss": 0.9116,
+      "step": 2176
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 1.9810441650476985e-05,
+      "loss": 0.9676,
+      "step": 2177
+    },
+    {
+      "epoch": 1.24,
+      "learning_rate": 1.9784335600890216e-05,
+      "loss": 0.9911,
+      "step": 2178
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9758238298860313e-05,
+      "loss": 0.9303,
+      "step": 2179
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.97321497667341e-05,
+      "loss": 1.0291,
+      "step": 2180
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.970607002685088e-05,
+      "loss": 0.9305,
+      "step": 2181
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9679999101542454e-05,
+      "loss": 0.8055,
+      "step": 2182
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9653937013133035e-05,
+      "loss": 0.9545,
+      "step": 2183
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9627883783939315e-05,
+      "loss": 1.0093,
+      "step": 2184
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9601839436270363e-05,
+      "loss": 0.9801,
+      "step": 2185
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9575803992427655e-05,
+      "loss": 0.9149,
+      "step": 2186
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9549777474705054e-05,
+      "loss": 0.9104,
+      "step": 2187
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9523759905388763e-05,
+      "loss": 0.9898,
+      "step": 2188
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.949775130675734e-05,
+      "loss": 0.8456,
+      "step": 2189
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9471751701081627e-05,
+      "loss": 1.0103,
+      "step": 2190
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9445761110624823e-05,
+      "loss": 1.1055,
+      "step": 2191
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9419779557642344e-05,
+      "loss": 0.8003,
+      "step": 2192
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.939380706438192e-05,
+      "loss": 1.0531,
+      "step": 2193
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9367843653083485e-05,
+      "loss": 0.8744,
+      "step": 2194
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.934188934597923e-05,
+      "loss": 0.9172,
+      "step": 2195
+    },
+    {
+      "epoch": 1.25,
+      "learning_rate": 1.9315944165293505e-05,
+      "loss": 1.0053,
+      "step": 2196
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.9290008133242896e-05,
+      "loss": 0.9901,
+      "step": 2197
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.926408127203612e-05,
+      "loss": 0.885,
+      "step": 2198
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.9238163603874054e-05,
+      "loss": 0.9128,
+      "step": 2199
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.9212255150949703e-05,
+      "loss": 0.9532,
+      "step": 2200
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.9186355935448184e-05,
+      "loss": 1.1318,
+      "step": 2201
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.9160465979546696e-05,
+      "loss": 1.0458,
+      "step": 2202
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.9134585305414504e-05,
+      "loss": 0.9364,
+      "step": 2203
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.910871393521295e-05,
+      "loss": 0.9847,
+      "step": 2204
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.9082851891095377e-05,
+      "loss": 1.0416,
+      "step": 2205
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.905699919520717e-05,
+      "loss": 1.0234,
+      "step": 2206
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.9031155869685687e-05,
+      "loss": 0.9729,
+      "step": 2207
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.900532193666029e-05,
+      "loss": 1.0311,
+      "step": 2208
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.8979497418252264e-05,
+      "loss": 0.6598,
+      "step": 2209
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.895368233657486e-05,
+      "loss": 0.8972,
+      "step": 2210
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.892787671373323e-05,
+      "loss": 0.9568,
+      "step": 2211
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.8902080571824443e-05,
+      "loss": 0.9311,
+      "step": 2212
+    },
+    {
+      "epoch": 1.26,
+      "learning_rate": 1.8876293932937428e-05,
+      "loss": 0.9658,
+      "step": 2213
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.885051681915301e-05,
+      "loss": 1.0004,
+      "step": 2214
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.8824749252543812e-05,
+      "loss": 1.1136,
+      "step": 2215
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.8798991255174333e-05,
+      "loss": 0.9565,
+      "step": 2216
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.877324284910084e-05,
+      "loss": 1.021,
+      "step": 2217
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.874750405637139e-05,
+      "loss": 1.0257,
+      "step": 2218
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.872177489902583e-05,
+      "loss": 0.9718,
+      "step": 2219
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.869605539909574e-05,
+      "loss": 1.0097,
+      "step": 2220
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.8670345578604438e-05,
+      "loss": 0.8878,
+      "step": 2221
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.8644645459566942e-05,
+      "loss": 0.9507,
+      "step": 2222
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.861895506398998e-05,
+      "loss": 0.9657,
+      "step": 2223
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.8593274413871935e-05,
+      "loss": 0.9318,
+      "step": 2224
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.856760353120287e-05,
+      "loss": 1.0434,
+      "step": 2225
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.854194243796445e-05,
+      "loss": 0.8537,
+      "step": 2226
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.851629115612999e-05,
+      "loss": 0.8994,
+      "step": 2227
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.8490649707664382e-05,
+      "loss": 0.9733,
+      "step": 2228
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.8465018114524112e-05,
+      "loss": 0.864,
+      "step": 2229
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.8439396398657213e-05,
+      "loss": 0.9469,
+      "step": 2230
+    },
+    {
+      "epoch": 1.27,
+      "learning_rate": 1.8413784582003276e-05,
+      "loss": 0.954,
+      "step": 2231
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.83881826864934e-05,
+      "loss": 1.0112,
+      "step": 2232
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8362590734050206e-05,
+      "loss": 0.8346,
+      "step": 2233
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8337008746587785e-05,
+      "loss": 0.8684,
+      "step": 2234
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.83114367460117e-05,
+      "loss": 0.9385,
+      "step": 2235
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8285874754218962e-05,
+      "loss": 1.0125,
+      "step": 2236
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.826032279309801e-05,
+      "loss": 0.8488,
+      "step": 2237
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.823478088452871e-05,
+      "loss": 0.9496,
+      "step": 2238
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8209249050382295e-05,
+      "loss": 0.956,
+      "step": 2239
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8183727312521392e-05,
+      "loss": 0.9919,
+      "step": 2240
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.815821569279996e-05,
+      "loss": 1.012,
+      "step": 2241
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8132714213063323e-05,
+      "loss": 0.9917,
+      "step": 2242
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8107222895148097e-05,
+      "loss": 0.9548,
+      "step": 2243
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8081741760882218e-05,
+      "loss": 0.9451,
+      "step": 2244
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8056270832084872e-05,
+      "loss": 1.0699,
+      "step": 2245
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.8030810130566545e-05,
+      "loss": 0.9399,
+      "step": 2246
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.800535967812893e-05,
+      "loss": 1.0011,
+      "step": 2247
+    },
+    {
+      "epoch": 1.28,
+      "learning_rate": 1.7979919496564974e-05,
+      "loss": 0.8716,
+      "step": 2248
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7954489607658792e-05,
+      "loss": 0.8905,
+      "step": 2249
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7929070033185737e-05,
+      "loss": 1.1332,
+      "step": 2250
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7903660794912276e-05,
+      "loss": 1.0184,
+      "step": 2251
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7878261914596054e-05,
+      "loss": 0.9185,
+      "step": 2252
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7852873413985855e-05,
+      "loss": 0.9864,
+      "step": 2253
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7827495314821548e-05,
+      "loss": 1.0017,
+      "step": 2254
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.780212763883412e-05,
+      "loss": 0.8861,
+      "step": 2255
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.777677040774561e-05,
+      "loss": 0.8189,
+      "step": 2256
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.775142364326915e-05,
+      "loss": 0.8975,
+      "step": 2257
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7726087367108854e-05,
+      "loss": 1.0172,
+      "step": 2258
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7700761600959913e-05,
+      "loss": 1.0687,
+      "step": 2259
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7675446366508472e-05,
+      "loss": 0.9768,
+      "step": 2260
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.765014168543169e-05,
+      "loss": 0.8793,
+      "step": 2261
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7624847579397668e-05,
+      "loss": 1.0191,
+      "step": 2262
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.759956407006547e-05,
+      "loss": 1.0148,
+      "step": 2263
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7574291179085067e-05,
+      "loss": 1.0466,
+      "step": 2264
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7549028928097355e-05,
+      "loss": 0.8626,
+      "step": 2265
+    },
+    {
+      "epoch": 1.29,
+      "learning_rate": 1.7523777338734104e-05,
+      "loss": 1.045,
+      "step": 2266
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.749853643261798e-05,
+      "loss": 0.9296,
+      "step": 2267
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.747330623136245e-05,
+      "loss": 0.8884,
+      "step": 2268
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7448086756571863e-05,
+      "loss": 0.9578,
+      "step": 2269
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.742287802984138e-05,
+      "loss": 0.9763,
+      "step": 2270
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7397680072756945e-05,
+      "loss": 0.8431,
+      "step": 2271
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7372492906895257e-05,
+      "loss": 0.9266,
+      "step": 2272
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.734731655382382e-05,
+      "loss": 0.9819,
+      "step": 2273
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.732215103510085e-05,
+      "loss": 0.7543,
+      "step": 2274
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7296996372275307e-05,
+      "loss": 1.149,
+      "step": 2275
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7271852586886817e-05,
+      "loss": 1.0113,
+      "step": 2276
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.724671970046573e-05,
+      "loss": 0.9715,
+      "step": 2277
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7221597734533053e-05,
+      "loss": 1.0632,
+      "step": 2278
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7196486710600448e-05,
+      "loss": 0.9907,
+      "step": 2279
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7171386650170162e-05,
+      "loss": 0.9748,
+      "step": 2280
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7146297574735125e-05,
+      "loss": 0.949,
+      "step": 2281
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.7121219505778826e-05,
+      "loss": 1.0361,
+      "step": 2282
+    },
+    {
+      "epoch": 1.3,
+      "learning_rate": 1.709615246477531e-05,
+      "loss": 0.8674,
+      "step": 2283
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.7071096473189202e-05,
+      "loss": 0.9649,
+      "step": 2284
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.7046051552475683e-05,
+      "loss": 0.948,
+      "step": 2285
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.70210177240804e-05,
+      "loss": 1.1275,
+      "step": 2286
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6995995009439556e-05,
+      "loss": 0.9336,
+      "step": 2287
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6970983429979814e-05,
+      "loss": 0.8839,
+      "step": 2288
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6945983007118306e-05,
+      "loss": 0.896,
+      "step": 2289
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6920993762262595e-05,
+      "loss": 1.0525,
+      "step": 2290
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6896015716810698e-05,
+      "loss": 0.9608,
+      "step": 2291
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.687104889215102e-05,
+      "loss": 0.9064,
+      "step": 2292
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6846093309662393e-05,
+      "loss": 0.933,
+      "step": 2293
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.682114899071397e-05,
+      "loss": 0.9902,
+      "step": 2294
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6796215956665294e-05,
+      "loss": 1.0642,
+      "step": 2295
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6771294228866242e-05,
+      "loss": 0.8329,
+      "step": 2296
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6746383828657014e-05,
+      "loss": 1.0782,
+      "step": 2297
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.672148477736808e-05,
+      "loss": 1.0303,
+      "step": 2298
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6696597096320227e-05,
+      "loss": 1.0525,
+      "step": 2299
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.667172080682449e-05,
+      "loss": 0.8653,
+      "step": 2300
+    },
+    {
+      "epoch": 1.31,
+      "learning_rate": 1.6646855930182162e-05,
+      "loss": 0.8618,
+      "step": 2301
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.662200248768473e-05,
+      "loss": 0.9261,
+      "step": 2302
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.659716050061393e-05,
+      "loss": 0.8876,
+      "step": 2303
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6572329990241675e-05,
+      "loss": 1.0007,
+      "step": 2304
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.654751097783003e-05,
+      "loss": 0.8701,
+      "step": 2305
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6522703484631248e-05,
+      "loss": 0.877,
+      "step": 2306
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6497907531887694e-05,
+      "loss": 0.9319,
+      "step": 2307
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6473123140831875e-05,
+      "loss": 0.8756,
+      "step": 2308
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6448350332686362e-05,
+      "loss": 0.9121,
+      "step": 2309
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6423589128663837e-05,
+      "loss": 0.9169,
+      "step": 2310
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.639883954996703e-05,
+      "loss": 0.825,
+      "step": 2311
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6374101617788744e-05,
+      "loss": 1.1349,
+      "step": 2312
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.634937535331176e-05,
+      "loss": 0.9686,
+      "step": 2313
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6324660777708908e-05,
+      "loss": 0.9212,
+      "step": 2314
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6299957912142997e-05,
+      "loss": 0.9442,
+      "step": 2315
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6275266777766825e-05,
+      "loss": 1.04,
+      "step": 2316
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6250587395723098e-05,
+      "loss": 1.015,
+      "step": 2317
+    },
+    {
+      "epoch": 1.32,
+      "learning_rate": 1.6225919787144508e-05,
+      "loss": 0.8911,
+      "step": 2318
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.6201263973153655e-05,
+      "loss": 0.9198,
+      "step": 2319
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.6176619974863005e-05,
+      "loss": 0.9895,
+      "step": 2320
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.615198781337495e-05,
+      "loss": 1.0234,
+      "step": 2321
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.612736750978172e-05,
+      "loss": 0.9568,
+      "step": 2322
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.610275908516543e-05,
+      "loss": 0.9364,
+      "step": 2323
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.6078162560597952e-05,
+      "loss": 0.9733,
+      "step": 2324
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.6053577957141022e-05,
+      "loss": 0.8988,
+      "step": 2325
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.602900529584616e-05,
+      "loss": 1.1556,
+      "step": 2326
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.6004444597754674e-05,
+      "loss": 0.8428,
+      "step": 2327
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.597989588389758e-05,
+      "loss": 1.0207,
+      "step": 2328
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.5955359175295668e-05,
+      "loss": 0.9409,
+      "step": 2329
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.5930834492959446e-05,
+      "loss": 0.9763,
+      "step": 2330
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.5906321857889136e-05,
+      "loss": 0.9759,
+      "step": 2331
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.5881821291074597e-05,
+      "loss": 1.1289,
+      "step": 2332
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.58573328134954e-05,
+      "loss": 0.8601,
+      "step": 2333
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.583285644612075e-05,
+      "loss": 0.9255,
+      "step": 2334
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.5808392209909487e-05,
+      "loss": 0.7505,
+      "step": 2335
+    },
+    {
+      "epoch": 1.33,
+      "learning_rate": 1.578394012581004e-05,
+      "loss": 0.8412,
+      "step": 2336
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5759500214760464e-05,
+      "loss": 0.9596,
+      "step": 2337
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.573507249768838e-05,
+      "loss": 0.9561,
+      "step": 2338
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5710656995510943e-05,
+      "loss": 0.9745,
+      "step": 2339
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.568625372913488e-05,
+      "loss": 0.9475,
+      "step": 2340
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5661862719456435e-05,
+      "loss": 0.9963,
+      "step": 2341
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.563748398736135e-05,
+      "loss": 0.9688,
+      "step": 2342
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5613117553724846e-05,
+      "loss": 0.939,
+      "step": 2343
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.558876343941163e-05,
+      "loss": 0.9159,
+      "step": 2344
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.556442166527585e-05,
+      "loss": 0.9469,
+      "step": 2345
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5540092252161097e-05,
+      "loss": 0.9167,
+      "step": 2346
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.551577522090035e-05,
+      "loss": 0.8205,
+      "step": 2347
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5491470592316022e-05,
+      "loss": 0.9251,
+      "step": 2348
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5467178387219885e-05,
+      "loss": 0.9967,
+      "step": 2349
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5442898626413088e-05,
+      "loss": 1.0866,
+      "step": 2350
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.541863133068609e-05,
+      "loss": 0.9129,
+      "step": 2351
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5394376520818713e-05,
+      "loss": 1.0728,
+      "step": 2352
+    },
+    {
+      "epoch": 1.34,
+      "learning_rate": 1.5370134217580084e-05,
+      "loss": 0.962,
+      "step": 2353
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5345904441728586e-05,
+      "loss": 0.8512,
+      "step": 2354
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5321687214011914e-05,
+      "loss": 0.8866,
+      "step": 2355
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5297482555167e-05,
+      "loss": 0.8572,
+      "step": 2356
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5273290485920035e-05,
+      "loss": 0.7891,
+      "step": 2357
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5249111026986384e-05,
+      "loss": 0.9946,
+      "step": 2358
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5224944199070655e-05,
+      "loss": 1.166,
+      "step": 2359
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5200790022866628e-05,
+      "loss": 0.9569,
+      "step": 2360
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5176648519057256e-05,
+      "loss": 0.8854,
+      "step": 2361
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5152519708314614e-05,
+      "loss": 1.0793,
+      "step": 2362
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5128403611299935e-05,
+      "loss": 0.9459,
+      "step": 2363
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5104300248663568e-05,
+      "loss": 0.9448,
+      "step": 2364
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5080209641044942e-05,
+      "loss": 0.8662,
+      "step": 2365
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.505613180907256e-05,
+      "loss": 0.9907,
+      "step": 2366
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5032066773364002e-05,
+      "loss": 1.0119,
+      "step": 2367
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.5008014554525897e-05,
+      "loss": 1.0738,
+      "step": 2368
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.4983975173153857e-05,
+      "loss": 0.9589,
+      "step": 2369
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.4959948649832547e-05,
+      "loss": 0.9114,
+      "step": 2370
+    },
+    {
+      "epoch": 1.35,
+      "learning_rate": 1.4935935005135601e-05,
+      "loss": 0.8845,
+      "step": 2371
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4911934259625642e-05,
+      "loss": 1.0066,
+      "step": 2372
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4887946433854214e-05,
+      "loss": 0.8978,
+      "step": 2373
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4863971548361826e-05,
+      "loss": 1.0123,
+      "step": 2374
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4840009623677903e-05,
+      "loss": 0.9575,
+      "step": 2375
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4816060680320776e-05,
+      "loss": 0.8289,
+      "step": 2376
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4792124738797631e-05,
+      "loss": 0.8502,
+      "step": 2377
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4768201819604551e-05,
+      "loss": 0.9786,
+      "step": 2378
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4744291943226458e-05,
+      "loss": 0.9875,
+      "step": 2379
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.472039513013712e-05,
+      "loss": 1.0128,
+      "step": 2380
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4696511400799081e-05,
+      "loss": 0.8926,
+      "step": 2381
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4672640775663723e-05,
+      "loss": 0.9079,
+      "step": 2382
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4648783275171182e-05,
+      "loss": 0.8753,
+      "step": 2383
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4624938919750377e-05,
+      "loss": 1.0399,
+      "step": 2384
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.460110772981894e-05,
+      "loss": 0.8736,
+      "step": 2385
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4577289725783252e-05,
+      "loss": 0.9934,
+      "step": 2386
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.4553484928038398e-05,
+      "loss": 0.8538,
+      "step": 2387
+    },
+    {
+      "epoch": 1.36,
+      "learning_rate": 1.452969335696816e-05,
+      "loss": 0.764,
+      "step": 2388
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4505915032944986e-05,
+      "loss": 0.9587,
+      "step": 2389
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4482149976329993e-05,
+      "loss": 1.0294,
+      "step": 2390
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4458398207472909e-05,
+      "loss": 1.0066,
+      "step": 2391
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.443465974671211e-05,
+      "loss": 0.9987,
+      "step": 2392
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4410934614374571e-05,
+      "loss": 0.9102,
+      "step": 2393
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4387222830775866e-05,
+      "loss": 1.1574,
+      "step": 2394
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.43635244162201e-05,
+      "loss": 0.9884,
+      "step": 2395
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4339839390999964e-05,
+      "loss": 0.8853,
+      "step": 2396
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4316167775396674e-05,
+      "loss": 0.8387,
+      "step": 2397
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4292509589679981e-05,
+      "loss": 0.8769,
+      "step": 2398
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4268864854108096e-05,
+      "loss": 0.8583,
+      "step": 2399
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4245233588927745e-05,
+      "loss": 0.9818,
+      "step": 2400
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.422161581437411e-05,
+      "loss": 0.9734,
+      "step": 2401
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4198011550670836e-05,
+      "loss": 0.9864,
+      "step": 2402
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.417442081802996e-05,
+      "loss": 0.9898,
+      "step": 2403
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4150843636651972e-05,
+      "loss": 1.054,
+      "step": 2404
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4127280026725751e-05,
+      "loss": 0.807,
+      "step": 2405
+    },
+    {
+      "epoch": 1.37,
+      "learning_rate": 1.4103730008428522e-05,
+      "loss": 1.0343,
+      "step": 2406
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.4080193601925916e-05,
+      "loss": 1.0904,
+      "step": 2407
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.4056670827371886e-05,
+      "loss": 0.9168,
+      "step": 2408
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.4033161704908723e-05,
+      "loss": 0.8612,
+      "step": 2409
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.4009666254667006e-05,
+      "loss": 1.1703,
+      "step": 2410
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.3986184496765624e-05,
+      "loss": 1.023,
+      "step": 2411
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.396271645131174e-05,
+      "loss": 0.9077,
+      "step": 2412
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.3939262138400787e-05,
+      "loss": 0.9155,
+      "step": 2413
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.3915821578116406e-05,
+      "loss": 0.9946,
+      "step": 2414
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.3892394790530486e-05,
+      "loss": 0.9731,
+      "step": 2415
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.3868981795703118e-05,
+      "loss": 0.8603,
+      "step": 2416
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.3845582613682603e-05,
+      "loss": 0.9374,
+      "step": 2417
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.382219726450536e-05,
+      "loss": 1.0078,
+      "step": 2418
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.3798825768196012e-05,
+      "loss": 0.9906,
+      "step": 2419
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.377546814476732e-05,
+      "loss": 0.8954,
+      "step": 2420
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.375212441422012e-05,
+      "loss": 1.0744,
+      "step": 2421
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.37287945965434e-05,
+      "loss": 0.92,
+      "step": 2422
+    },
+    {
+      "epoch": 1.38,
+      "learning_rate": 1.3705478711714215e-05,
+      "loss": 0.8756,
+      "step": 2423
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3682176779697699e-05,
+      "loss": 0.9425,
+      "step": 2424
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3658888820447013e-05,
+      "loss": 0.9331,
+      "step": 2425
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.363561485390338e-05,
+      "loss": 1.0117,
+      "step": 2426
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3612354899996031e-05,
+      "loss": 0.8586,
+      "step": 2427
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.358910897864221e-05,
+      "loss": 0.9195,
+      "step": 2428
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3565877109747115e-05,
+      "loss": 0.8747,
+      "step": 2429
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.354265931320394e-05,
+      "loss": 0.893,
+      "step": 2430
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3519455608893815e-05,
+      "loss": 0.9453,
+      "step": 2431
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3496266016685826e-05,
+      "loss": 0.9162,
+      "step": 2432
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3473090556436928e-05,
+      "loss": 0.8534,
+      "step": 2433
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3449929247992015e-05,
+      "loss": 0.8576,
+      "step": 2434
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3426782111183854e-05,
+      "loss": 0.9035,
+      "step": 2435
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3403649165833085e-05,
+      "loss": 0.8685,
+      "step": 2436
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.338053043174816e-05,
+      "loss": 1.0749,
+      "step": 2437
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3357425928725398e-05,
+      "loss": 1.0646,
+      "step": 2438
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3334335676548938e-05,
+      "loss": 0.8719,
+      "step": 2439
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3311259694990672e-05,
+      "loss": 0.9861,
+      "step": 2440
+    },
+    {
+      "epoch": 1.39,
+      "learning_rate": 1.3288198003810314e-05,
+      "loss": 0.9079,
+      "step": 2441
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3265150622755322e-05,
+      "loss": 0.9702,
+      "step": 2442
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3242117571560924e-05,
+      "loss": 0.8619,
+      "step": 2443
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.321909886995003e-05,
+      "loss": 1.0499,
+      "step": 2444
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3196094537633307e-05,
+      "loss": 0.8236,
+      "step": 2445
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3173104594309099e-05,
+      "loss": 0.8204,
+      "step": 2446
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3150129059663446e-05,
+      "loss": 1.0256,
+      "step": 2447
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3127167953370016e-05,
+      "loss": 0.9915,
+      "step": 2448
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3104221295090146e-05,
+      "loss": 1.0605,
+      "step": 2449
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3081289104472803e-05,
+      "loss": 0.9178,
+      "step": 2450
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3058371401154573e-05,
+      "loss": 0.9843,
+      "step": 2451
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3035468204759593e-05,
+      "loss": 0.8558,
+      "step": 2452
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.3012579534899633e-05,
+      "loss": 0.9203,
+      "step": 2453
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.2989705411173998e-05,
+      "loss": 0.9173,
+      "step": 2454
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.2966845853169524e-05,
+      "loss": 0.9143,
+      "step": 2455
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.2944000880460601e-05,
+      "loss": 0.7962,
+      "step": 2456
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.2921170512609119e-05,
+      "loss": 0.83,
+      "step": 2457
+    },
+    {
+      "epoch": 1.4,
+      "learning_rate": 1.2898354769164467e-05,
+      "loss": 0.9884,
+      "step": 2458
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2875553669663488e-05,
+      "loss": 1.01,
+      "step": 2459
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2852767233630514e-05,
+      "loss": 0.9528,
+      "step": 2460
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.282999548057731e-05,
+      "loss": 0.8475,
+      "step": 2461
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.280723843000308e-05,
+      "loss": 0.9025,
+      "step": 2462
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2784496101394403e-05,
+      "loss": 1.035,
+      "step": 2463
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2761768514225286e-05,
+      "loss": 1.0557,
+      "step": 2464
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2739055687957105e-05,
+      "loss": 1.0378,
+      "step": 2465
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2716357642038604e-05,
+      "loss": 0.924,
+      "step": 2466
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2693674395905838e-05,
+      "loss": 0.954,
+      "step": 2467
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2671005968982225e-05,
+      "loss": 0.8958,
+      "step": 2468
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2648352380678476e-05,
+      "loss": 0.8958,
+      "step": 2469
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2625713650392616e-05,
+      "loss": 0.9591,
+      "step": 2470
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2603089797509909e-05,
+      "loss": 0.8966,
+      "step": 2471
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2580480841402909e-05,
+      "loss": 1.0993,
+      "step": 2472
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2557886801431421e-05,
+      "loss": 1.0993,
+      "step": 2473
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2535307696942444e-05,
+      "loss": 0.8996,
+      "step": 2474
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2512743547270212e-05,
+      "loss": 0.9885,
+      "step": 2475
+    },
+    {
+      "epoch": 1.41,
+      "learning_rate": 1.2490194371736157e-05,
+      "loss": 0.9407,
+      "step": 2476
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2467660189648884e-05,
+      "loss": 0.93,
+      "step": 2477
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.244514102030414e-05,
+      "loss": 0.984,
+      "step": 2478
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2422636882984838e-05,
+      "loss": 1.053,
+      "step": 2479
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.240014779696102e-05,
+      "loss": 0.9438,
+      "step": 2480
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.237767378148984e-05,
+      "loss": 0.9058,
+      "step": 2481
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2355214855815523e-05,
+      "loss": 0.9097,
+      "step": 2482
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2332771039169403e-05,
+      "loss": 1.1711,
+      "step": 2483
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2310342350769857e-05,
+      "loss": 1.0472,
+      "step": 2484
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.228792880982233e-05,
+      "loss": 0.9099,
+      "step": 2485
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.226553043551926e-05,
+      "loss": 0.8776,
+      "step": 2486
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2243147247040129e-05,
+      "loss": 0.9326,
+      "step": 2487
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2220779263551417e-05,
+      "loss": 0.972,
+      "step": 2488
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2198426504206554e-05,
+      "loss": 0.8338,
+      "step": 2489
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.217608898814596e-05,
+      "loss": 0.949,
+      "step": 2490
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2153766734496998e-05,
+      "loss": 0.8955,
+      "step": 2491
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2131459762373966e-05,
+      "loss": 0.8642,
+      "step": 2492
+    },
+    {
+      "epoch": 1.42,
+      "learning_rate": 1.2109168090878043e-05,
+      "loss": 1.0301,
+      "step": 2493
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.2086891739097358e-05,
+      "loss": 0.924,
+      "step": 2494
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.2064630726106904e-05,
+      "loss": 0.9396,
+      "step": 2495
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.2042385070968507e-05,
+      "loss": 0.9439,
+      "step": 2496
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.2020154792730883e-05,
+      "loss": 0.9478,
+      "step": 2497
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1997939910429556e-05,
+      "loss": 1.0782,
+      "step": 2498
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1975740443086894e-05,
+      "loss": 0.9558,
+      "step": 2499
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1953556409712027e-05,
+      "loss": 0.9039,
+      "step": 2500
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1931387829300899e-05,
+      "loss": 0.8965,
+      "step": 2501
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1909234720836211e-05,
+      "loss": 1.0029,
+      "step": 2502
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1887097103287428e-05,
+      "loss": 0.9407,
+      "step": 2503
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.186497499561072e-05,
+      "loss": 0.8233,
+      "step": 2504
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1842868416749003e-05,
+      "loss": 0.8533,
+      "step": 2505
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1820777385631901e-05,
+      "loss": 0.9698,
+      "step": 2506
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.179870192117569e-05,
+      "loss": 0.9924,
+      "step": 2507
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1776642042283348e-05,
+      "loss": 0.8585,
+      "step": 2508
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1754597767844502e-05,
+      "loss": 1.0129,
+      "step": 2509
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1732569116735415e-05,
+      "loss": 0.8723,
+      "step": 2510
+    },
+    {
+      "epoch": 1.43,
+      "learning_rate": 1.1710556107818957e-05,
+      "loss": 0.8904,
+      "step": 2511
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1688558759944622e-05,
+      "loss": 0.8978,
+      "step": 2512
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1666577091948493e-05,
+      "loss": 0.8367,
+      "step": 2513
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1644611122653222e-05,
+      "loss": 1.1601,
+      "step": 2514
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1622660870868009e-05,
+      "loss": 0.9817,
+      "step": 2515
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1600726355388604e-05,
+      "loss": 0.8778,
+      "step": 2516
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.157880759499729e-05,
+      "loss": 1.0791,
+      "step": 2517
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.155690460846286e-05,
+      "loss": 0.9458,
+      "step": 2518
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.153501741454057e-05,
+      "loss": 0.7613,
+      "step": 2519
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.151314603197218e-05,
+      "loss": 0.994,
+      "step": 2520
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1491290479485923e-05,
+      "loss": 1.0731,
+      "step": 2521
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1469450775796437e-05,
+      "loss": 0.954,
+      "step": 2522
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1447626939604815e-05,
+      "loss": 0.9383,
+      "step": 2523
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.142581898959857e-05,
+      "loss": 0.9502,
+      "step": 2524
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1404026944451603e-05,
+      "loss": 0.842,
+      "step": 2525
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1382250822824176e-05,
+      "loss": 0.8642,
+      "step": 2526
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1360490643362943e-05,
+      "loss": 0.9762,
+      "step": 2527
+    },
+    {
+      "epoch": 1.44,
+      "learning_rate": 1.1338746424700895e-05,
+      "loss": 1.0442,
+      "step": 2528
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1317018185457374e-05,
+      "loss": 1.1096,
+      "step": 2529
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1295305944237996e-05,
+      "loss": 0.8186,
+      "step": 2530
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1273609719634723e-05,
+      "loss": 0.8544,
+      "step": 2531
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1251929530225777e-05,
+      "loss": 0.8564,
+      "step": 2532
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1230265394575674e-05,
+      "loss": 0.8743,
+      "step": 2533
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1208617331235142e-05,
+      "loss": 1.0179,
+      "step": 2534
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1186985358741185e-05,
+      "loss": 0.9478,
+      "step": 2535
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1165369495617006e-05,
+      "loss": 1.0065,
+      "step": 2536
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.114376976037204e-05,
+      "loss": 0.9859,
+      "step": 2537
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.112218617150187e-05,
+      "loss": 0.8079,
+      "step": 2538
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1100618747488286e-05,
+      "loss": 0.8358,
+      "step": 2539
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.107906750679924e-05,
+      "loss": 1.047,
+      "step": 2540
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1057532467888792e-05,
+      "loss": 1.0814,
+      "step": 2541
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.103601364919716e-05,
+      "loss": 0.8781,
+      "step": 2542
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.1014511069150663e-05,
+      "loss": 0.8514,
+      "step": 2543
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.0993024746161725e-05,
+      "loss": 0.8971,
+      "step": 2544
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.097155469862882e-05,
+      "loss": 0.9566,
+      "step": 2545
+    },
+    {
+      "epoch": 1.45,
+      "learning_rate": 1.0950100944936516e-05,
+      "loss": 1.0629,
+      "step": 2546
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0928663503455414e-05,
+      "loss": 0.9086,
+      "step": 2547
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0907242392542159e-05,
+      "loss": 0.9697,
+      "step": 2548
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0885837630539391e-05,
+      "loss": 0.9766,
+      "step": 2549
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.086444923577577e-05,
+      "loss": 0.9195,
+      "step": 2550
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0843077226565931e-05,
+      "loss": 1.016,
+      "step": 2551
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0821721621210495e-05,
+      "loss": 0.9126,
+      "step": 2552
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0800382437996005e-05,
+      "loss": 0.9969,
+      "step": 2553
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0779059695194966e-05,
+      "loss": 1.0936,
+      "step": 2554
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.075775341106581e-05,
+      "loss": 0.8577,
+      "step": 2555
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0736463603852848e-05,
+      "loss": 1.0556,
+      "step": 2556
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0715190291786307e-05,
+      "loss": 0.8514,
+      "step": 2557
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0693933493082281e-05,
+      "loss": 0.7919,
+      "step": 2558
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0672693225942733e-05,
+      "loss": 0.8972,
+      "step": 2559
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0651469508555447e-05,
+      "loss": 1.0788,
+      "step": 2560
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0630262359094055e-05,
+      "loss": 0.951,
+      "step": 2561
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0609071795717998e-05,
+      "loss": 0.8494,
+      "step": 2562
+    },
+    {
+      "epoch": 1.46,
+      "learning_rate": 1.0587897836572522e-05,
+      "loss": 0.9228,
+      "step": 2563
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.056674049978863e-05,
+      "loss": 0.9338,
+      "step": 2564
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.054559980348312e-05,
+      "loss": 1.1034,
+      "step": 2565
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.052447576575852e-05,
+      "loss": 0.9334,
+      "step": 2566
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0503368404703122e-05,
+      "loss": 0.903,
+      "step": 2567
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0482277738390894e-05,
+      "loss": 0.9398,
+      "step": 2568
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0461203784881543e-05,
+      "loss": 0.7737,
+      "step": 2569
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0440146562220456e-05,
+      "loss": 0.826,
+      "step": 2570
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.04191060884387e-05,
+      "loss": 0.9026,
+      "step": 2571
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0398082381552976e-05,
+      "loss": 0.8236,
+      "step": 2572
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0377075459565653e-05,
+      "loss": 0.8661,
+      "step": 2573
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.035608534046473e-05,
+      "loss": 0.9844,
+      "step": 2574
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0335112042223783e-05,
+      "loss": 0.9778,
+      "step": 2575
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0314155582802021e-05,
+      "loss": 0.9841,
+      "step": 2576
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0293215980144218e-05,
+      "loss": 0.9777,
+      "step": 2577
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0272293252180734e-05,
+      "loss": 0.9068,
+      "step": 2578
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0251387416827432e-05,
+      "loss": 0.9332,
+      "step": 2579
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.023049849198576e-05,
+      "loss": 1.0043,
+      "step": 2580
+    },
+    {
+      "epoch": 1.47,
+      "learning_rate": 1.0209626495542656e-05,
+      "loss": 0.9148,
+      "step": 2581
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.0188771445370592e-05,
+      "loss": 0.9401,
+      "step": 2582
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.0167933359327483e-05,
+      "loss": 0.8391,
+      "step": 2583
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.014711225525676e-05,
+      "loss": 1.0266,
+      "step": 2584
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.012630815098729e-05,
+      "loss": 0.938,
+      "step": 2585
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.0105521064333403e-05,
+      "loss": 0.9749,
+      "step": 2586
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.008475101309483e-05,
+      "loss": 0.8581,
+      "step": 2587
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.0063998015056727e-05,
+      "loss": 0.8518,
+      "step": 2588
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.0043262087989671e-05,
+      "loss": 0.9951,
+      "step": 2589
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.0022543249649573e-05,
+      "loss": 1.0204,
+      "step": 2590
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 1.0001841517777753e-05,
+      "loss": 0.904,
+      "step": 2591
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 9.981156910100862e-06,
+      "loss": 0.9768,
+      "step": 2592
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 9.960489444330903e-06,
+      "loss": 0.8809,
+      "step": 2593
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 9.93983913816518e-06,
+      "loss": 1.0356,
+      "step": 2594
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 9.919206009286313e-06,
+      "loss": 1.0214,
+      "step": 2595
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 9.898590075362225e-06,
+      "loss": 0.8792,
+      "step": 2596
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 9.877991354046109e-06,
+      "loss": 0.9099,
+      "step": 2597
+    },
+    {
+      "epoch": 1.48,
+      "learning_rate": 9.857409862976399e-06,
+      "loss": 0.9342,
+      "step": 2598
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.836845619776784e-06,
+      "loss": 0.9427,
+      "step": 2599
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.81629864205623e-06,
+      "loss": 1.1137,
+      "step": 2600
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.795768947408841e-06,
+      "loss": 0.8489,
+      "step": 2601
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.775256553413976e-06,
+      "loss": 1.0125,
+      "step": 2602
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.754761477636162e-06,
+      "loss": 0.9982,
+      "step": 2603
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.73428373762511e-06,
+      "loss": 0.8536,
+      "step": 2604
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.713823350915653e-06,
+      "loss": 1.0247,
+      "step": 2605
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.693380335027797e-06,
+      "loss": 0.8965,
+      "step": 2606
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.672954707466674e-06,
+      "loss": 0.9172,
+      "step": 2607
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.652546485722494e-06,
+      "loss": 1.0506,
+      "step": 2608
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.632155687270598e-06,
+      "loss": 1.0005,
+      "step": 2609
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.611782329571393e-06,
+      "loss": 0.8393,
+      "step": 2610
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.591426430070361e-06,
+      "loss": 0.8651,
+      "step": 2611
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.571088006198007e-06,
+      "loss": 1.1155,
+      "step": 2612
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.550767075369901e-06,
+      "loss": 0.8588,
+      "step": 2613
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.530463654986628e-06,
+      "loss": 0.9496,
+      "step": 2614
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.510177762433778e-06,
+      "loss": 0.9848,
+      "step": 2615
+    },
+    {
+      "epoch": 1.49,
+      "learning_rate": 9.489909415081914e-06,
+      "loss": 0.8465,
+      "step": 2616
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.469658630286603e-06,
+      "loss": 0.9866,
+      "step": 2617
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.449425425388357e-06,
+      "loss": 1.0218,
+      "step": 2618
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.429209817712648e-06,
+      "loss": 0.9783,
+      "step": 2619
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.409011824569853e-06,
+      "loss": 1.0349,
+      "step": 2620
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.388831463255289e-06,
+      "loss": 0.9776,
+      "step": 2621
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.368668751049176e-06,
+      "loss": 0.9073,
+      "step": 2622
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.348523705216616e-06,
+      "loss": 1.0071,
+      "step": 2623
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.328396343007569e-06,
+      "loss": 0.9648,
+      "step": 2624
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.308286681656871e-06,
+      "loss": 0.9056,
+      "step": 2625
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.288194738384208e-06,
+      "loss": 0.999,
+      "step": 2626
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.268120530394061e-06,
+      "loss": 1.0301,
+      "step": 2627
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.248064074875756e-06,
+      "loss": 1.01,
+      "step": 2628
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.228025389003407e-06,
+      "loss": 0.9867,
+      "step": 2629
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.208004489935922e-06,
+      "loss": 0.8065,
+      "step": 2630
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.188001394816946e-06,
+      "loss": 0.8902,
+      "step": 2631
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.16801612077491e-06,
+      "loss": 0.7949,
+      "step": 2632
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 9.148048684922985e-06,
+      "loss": 0.9651,
+      "step": 2633
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 9.12809910435906e-06,
+      "loss": 1.0788,
+      "step": 2634
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 9.108167396165715e-06,
+      "loss": 0.9297,
+      "step": 2635
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 9.088253577410258e-06,
+      "loss": 0.8644,
+      "step": 2636
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 9.068357665144658e-06,
+      "loss": 0.8498,
+      "step": 2637
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 9.048479676405576e-06,
+      "loss": 1.0795,
+      "step": 2638
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 9.02861962821428e-06,
+      "loss": 0.8261,
+      "step": 2639
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 9.008777537576715e-06,
+      "loss": 1.0132,
+      "step": 2640
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.988953421483445e-06,
+      "loss": 1.0919,
+      "step": 2641
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.969147296909621e-06,
+      "loss": 0.893,
+      "step": 2642
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.949359180815004e-06,
+      "loss": 0.927,
+      "step": 2643
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.929589090143935e-06,
+      "loss": 1.0658,
+      "step": 2644
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.909837041825327e-06,
+      "loss": 1.1004,
+      "step": 2645
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.890103052772615e-06,
+      "loss": 0.9596,
+      "step": 2646
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.870387139883797e-06,
+      "loss": 1.1047,
+      "step": 2647
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.850689320041385e-06,
+      "loss": 0.9344,
+      "step": 2648
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.831009610112406e-06,
+      "loss": 1.0106,
+      "step": 2649
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.811348026948353e-06,
+      "loss": 0.9023,
+      "step": 2650
+    },
+    {
+      "epoch": 1.51,
+      "learning_rate": 8.791704587385224e-06,
+      "loss": 1.0207,
+      "step": 2651
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.772079308243473e-06,
+      "loss": 0.8255,
+      "step": 2652
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.752472206328008e-06,
+      "loss": 1.0658,
+      "step": 2653
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.732883298428155e-06,
+      "loss": 0.9005,
+      "step": 2654
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.713312601317678e-06,
+      "loss": 0.8657,
+      "step": 2655
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.693760131754749e-06,
+      "loss": 0.8668,
+      "step": 2656
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.674225906481911e-06,
+      "loss": 0.9767,
+      "step": 2657
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.654709942226103e-06,
+      "loss": 0.8345,
+      "step": 2658
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.635212255698623e-06,
+      "loss": 0.9203,
+      "step": 2659
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.61573286359513e-06,
+      "loss": 0.9868,
+      "step": 2660
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.596271782595582e-06,
+      "loss": 1.0257,
+      "step": 2661
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.576829029364293e-06,
+      "loss": 0.8865,
+      "step": 2662
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.557404620549872e-06,
+      "loss": 0.8684,
+      "step": 2663
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.537998572785222e-06,
+      "loss": 1.0118,
+      "step": 2664
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.518610902687512e-06,
+      "loss": 1.1283,
+      "step": 2665
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.499241626858181e-06,
+      "loss": 1.0179,
+      "step": 2666
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.479890761882923e-06,
+      "loss": 0.8671,
+      "step": 2667
+    },
+    {
+      "epoch": 1.52,
+      "learning_rate": 8.460558324331675e-06,
+      "loss": 0.9369,
+      "step": 2668
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.441244330758561e-06,
+      "loss": 0.9748,
+      "step": 2669
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.421948797701948e-06,
+      "loss": 0.9279,
+      "step": 2670
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.402671741684372e-06,
+      "loss": 1.0535,
+      "step": 2671
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.38341317921257e-06,
+      "loss": 0.8964,
+      "step": 2672
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.36417312677741e-06,
+      "loss": 0.9145,
+      "step": 2673
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.344951600853939e-06,
+      "loss": 0.8678,
+      "step": 2674
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.325748617901342e-06,
+      "loss": 1.207,
+      "step": 2675
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.30656419436289e-06,
+      "loss": 0.9756,
+      "step": 2676
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.287398346666004e-06,
+      "loss": 0.9096,
+      "step": 2677
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.26825109122217e-06,
+      "loss": 1.0389,
+      "step": 2678
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.249122444426982e-06,
+      "loss": 0.7568,
+      "step": 2679
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.230012422660058e-06,
+      "loss": 0.9634,
+      "step": 2680
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.210921042285105e-06,
+      "loss": 0.9859,
+      "step": 2681
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.191848319649851e-06,
+      "loss": 0.98,
+      "step": 2682
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.172794271086065e-06,
+      "loss": 0.9511,
+      "step": 2683
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.153758912909486e-06,
+      "loss": 1.0223,
+      "step": 2684
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.134742261419889e-06,
+      "loss": 0.8699,
+      "step": 2685
+    },
+    {
+      "epoch": 1.53,
+      "learning_rate": 8.11574433290101e-06,
+      "loss": 0.8053,
+      "step": 2686
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 8.096765143620573e-06,
+      "loss": 0.984,
+      "step": 2687
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 8.07780470983022e-06,
+      "loss": 0.8444,
+      "step": 2688
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 8.058863047765566e-06,
+      "loss": 0.9801,
+      "step": 2689
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 8.039940173646147e-06,
+      "loss": 0.9089,
+      "step": 2690
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 8.021036103675386e-06,
+      "loss": 0.7906,
+      "step": 2691
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 8.002150854040631e-06,
+      "loss": 0.9996,
+      "step": 2692
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.983284440913107e-06,
+      "loss": 1.0192,
+      "step": 2693
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.964436880447917e-06,
+      "loss": 0.9664,
+      "step": 2694
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.945608188783995e-06,
+      "loss": 0.9717,
+      "step": 2695
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.926798382044143e-06,
+      "loss": 0.8971,
+      "step": 2696
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.90800747633498e-06,
+      "loss": 1.1301,
+      "step": 2697
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.88923548774696e-06,
+      "loss": 0.7921,
+      "step": 2698
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.870482432354301e-06,
+      "loss": 1.0081,
+      "step": 2699
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.851748326215039e-06,
+      "loss": 0.9787,
+      "step": 2700
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.833033185370978e-06,
+      "loss": 0.9793,
+      "step": 2701
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.814337025847685e-06,
+      "loss": 1.0689,
+      "step": 2702
+    },
+    {
+      "epoch": 1.54,
+      "learning_rate": 7.795659863654451e-06,
+      "loss": 0.8346,
+      "step": 2703
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.777001714784327e-06,
+      "loss": 1.0722,
+      "step": 2704
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.758362595214075e-06,
+      "loss": 0.8823,
+      "step": 2705
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.739742520904156e-06,
+      "loss": 0.8675,
+      "step": 2706
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.721141507798732e-06,
+      "loss": 0.8303,
+      "step": 2707
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.70255957182564e-06,
+      "loss": 0.9362,
+      "step": 2708
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.683996728896371e-06,
+      "loss": 1.0671,
+      "step": 2709
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.665452994906079e-06,
+      "loss": 0.9015,
+      "step": 2710
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.64692838573355e-06,
+      "loss": 0.9097,
+      "step": 2711
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.628422917241207e-06,
+      "loss": 1.0291,
+      "step": 2712
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.609936605275055e-06,
+      "loss": 0.9775,
+      "step": 2713
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.59146946566472e-06,
+      "loss": 0.9411,
+      "step": 2714
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.573021514223405e-06,
+      "loss": 1.0872,
+      "step": 2715
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.554592766747884e-06,
+      "loss": 0.8276,
+      "step": 2716
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.5361832390184685e-06,
+      "loss": 0.9451,
+      "step": 2717
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.5177929467990365e-06,
+      "loss": 0.8453,
+      "step": 2718
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.499421905836984e-06,
+      "loss": 0.9106,
+      "step": 2719
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.481070131863232e-06,
+      "loss": 1.0018,
+      "step": 2720
+    },
+    {
+      "epoch": 1.55,
+      "learning_rate": 7.462737640592182e-06,
+      "loss": 0.9117,
+      "step": 2721
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.444424447721743e-06,
+      "loss": 1.0052,
+      "step": 2722
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.42613056893329e-06,
+      "loss": 0.8667,
+      "step": 2723
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.407856019891675e-06,
+      "loss": 0.8923,
+      "step": 2724
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.389600816245168e-06,
+      "loss": 0.9969,
+      "step": 2725
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.371364973625499e-06,
+      "loss": 0.9847,
+      "step": 2726
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.3531485076478225e-06,
+      "loss": 0.9672,
+      "step": 2727
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.334951433910672e-06,
+      "loss": 1.0243,
+      "step": 2728
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.316773767996e-06,
+      "loss": 0.7732,
+      "step": 2729
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.29861552546914e-06,
+      "loss": 1.0856,
+      "step": 2730
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.280476721878794e-06,
+      "loss": 0.83,
+      "step": 2731
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.262357372756993e-06,
+      "loss": 0.9174,
+      "step": 2732
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.244257493619146e-06,
+      "loss": 0.944,
+      "step": 2733
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.226177099963961e-06,
+      "loss": 0.9289,
+      "step": 2734
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.208116207273486e-06,
+      "loss": 0.9414,
+      "step": 2735
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.190074831013044e-06,
+      "loss": 0.9135,
+      "step": 2736
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.1720529866312655e-06,
+      "loss": 0.924,
+      "step": 2737
+    },
+    {
+      "epoch": 1.56,
+      "learning_rate": 7.154050689560051e-06,
+      "loss": 0.8849,
+      "step": 2738
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 7.136067955214569e-06,
+      "loss": 0.9609,
+      "step": 2739
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 7.1181047989932125e-06,
+      "loss": 0.7165,
+      "step": 2740
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 7.100161236277637e-06,
+      "loss": 0.8656,
+      "step": 2741
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 7.082237282432719e-06,
+      "loss": 0.8943,
+      "step": 2742
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 7.064332952806517e-06,
+      "loss": 0.9949,
+      "step": 2743
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 7.046448262730315e-06,
+      "loss": 1.1221,
+      "step": 2744
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 7.028583227518569e-06,
+      "loss": 0.9985,
+      "step": 2745
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 7.010737862468912e-06,
+      "loss": 0.8641,
+      "step": 2746
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.992912182862111e-06,
+      "loss": 0.8263,
+      "step": 2747
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.975106203962099e-06,
+      "loss": 1.1006,
+      "step": 2748
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.957319941015931e-06,
+      "loss": 0.9541,
+      "step": 2749
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.939553409253795e-06,
+      "loss": 0.9382,
+      "step": 2750
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.921806623888946e-06,
+      "loss": 1.0271,
+      "step": 2751
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.904079600117767e-06,
+      "loss": 0.8995,
+      "step": 2752
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.886372353119702e-06,
+      "loss": 0.9334,
+      "step": 2753
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.868684898057278e-06,
+      "loss": 1.091,
+      "step": 2754
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.85101725007604e-06,
+      "loss": 0.8383,
+      "step": 2755
+    },
+    {
+      "epoch": 1.57,
+      "learning_rate": 6.833369424304604e-06,
+      "loss": 0.8832,
+      "step": 2756
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.815741435854611e-06,
+      "loss": 0.9982,
+      "step": 2757
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.798133299820686e-06,
+      "loss": 1.025,
+      "step": 2758
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.7805450312804874e-06,
+      "loss": 0.9259,
+      "step": 2759
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.762976645294645e-06,
+      "loss": 0.9409,
+      "step": 2760
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.7454281569067825e-06,
+      "loss": 1.0441,
+      "step": 2761
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.7278995811434455e-06,
+      "loss": 0.9386,
+      "step": 2762
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.710390933014164e-06,
+      "loss": 0.8887,
+      "step": 2763
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.692902227511394e-06,
+      "loss": 0.9627,
+      "step": 2764
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.6754334796105274e-06,
+      "loss": 1.0273,
+      "step": 2765
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.657984704269831e-06,
+      "loss": 0.9922,
+      "step": 2766
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.6405559164305004e-06,
+      "loss": 0.8931,
+      "step": 2767
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.623147131016614e-06,
+      "loss": 0.9104,
+      "step": 2768
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.605758362935118e-06,
+      "loss": 0.8898,
+      "step": 2769
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.5883896270758e-06,
+      "loss": 0.8419,
+      "step": 2770
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.571040938311323e-06,
+      "loss": 0.9313,
+      "step": 2771
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.553712311497168e-06,
+      "loss": 1.0478,
+      "step": 2772
+    },
+    {
+      "epoch": 1.58,
+      "learning_rate": 6.53640376147165e-06,
+      "loss": 0.7588,
+      "step": 2773
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.5191153030558645e-06,
+      "loss": 0.9182,
+      "step": 2774
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.501846951053731e-06,
+      "loss": 0.9882,
+      "step": 2775
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.484598720251952e-06,
+      "loss": 0.9899,
+      "step": 2776
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.467370625419971e-06,
+      "loss": 1.011,
+      "step": 2777
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.450162681310019e-06,
+      "loss": 0.9352,
+      "step": 2778
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.43297490265706e-06,
+      "loss": 0.8146,
+      "step": 2779
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.415807304178807e-06,
+      "loss": 1.1213,
+      "step": 2780
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.3986599005756555e-06,
+      "loss": 0.7497,
+      "step": 2781
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.38153270653074e-06,
+      "loss": 1.0358,
+      "step": 2782
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.364425736709888e-06,
+      "loss": 0.795,
+      "step": 2783
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.347339005761603e-06,
+      "loss": 0.9453,
+      "step": 2784
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.330272528317049e-06,
+      "loss": 0.7725,
+      "step": 2785
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.313226318990056e-06,
+      "loss": 0.8234,
+      "step": 2786
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.296200392377105e-06,
+      "loss": 0.9963,
+      "step": 2787
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.27919476305731e-06,
+      "loss": 0.9332,
+      "step": 2788
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.262209445592376e-06,
+      "loss": 1.0405,
+      "step": 2789
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.24524445452665e-06,
+      "loss": 0.85,
+      "step": 2790
+    },
+    {
+      "epoch": 1.59,
+      "learning_rate": 6.228299804387067e-06,
+      "loss": 0.8917,
+      "step": 2791
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.2113755096831206e-06,
+      "loss": 0.8858,
+      "step": 2792
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.194471584906899e-06,
+      "loss": 0.8351,
+      "step": 2793
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.1775880445330406e-06,
+      "loss": 0.9998,
+      "step": 2794
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.160724903018736e-06,
+      "loss": 0.9316,
+      "step": 2795
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.1438821748036865e-06,
+      "loss": 0.9264,
+      "step": 2796
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.1270598743101344e-06,
+      "loss": 1.0574,
+      "step": 2797
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.110258015942824e-06,
+      "loss": 0.7975,
+      "step": 2798
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.093476614089004e-06,
+      "loss": 0.9235,
+      "step": 2799
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.076715683118382e-06,
+      "loss": 0.7538,
+      "step": 2800
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.059975237383155e-06,
+      "loss": 0.7431,
+      "step": 2801
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.043255291217983e-06,
+      "loss": 0.9161,
+      "step": 2802
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.026555858939966e-06,
+      "loss": 0.9961,
+      "step": 2803
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 6.009876954848627e-06,
+      "loss": 0.9138,
+      "step": 2804
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 5.993218593225926e-06,
+      "loss": 0.9813,
+      "step": 2805
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 5.976580788336229e-06,
+      "loss": 1.0565,
+      "step": 2806
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 5.959963554426304e-06,
+      "loss": 0.759,
+      "step": 2807
+    },
+    {
+      "epoch": 1.6,
+      "learning_rate": 5.94336690572529e-06,
+      "loss": 1.0324,
+      "step": 2808
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.926790856444706e-06,
+      "loss": 0.9758,
+      "step": 2809
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.91023542077845e-06,
+      "loss": 0.8242,
+      "step": 2810
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.893700612902727e-06,
+      "loss": 0.9333,
+      "step": 2811
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.877186446976124e-06,
+      "loss": 0.9698,
+      "step": 2812
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.860692937139536e-06,
+      "loss": 0.9452,
+      "step": 2813
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.844220097516152e-06,
+      "loss": 0.878,
+      "step": 2814
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.827767942211482e-06,
+      "loss": 0.8338,
+      "step": 2815
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.811336485313326e-06,
+      "loss": 1.0952,
+      "step": 2816
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.794925740891749e-06,
+      "loss": 0.9373,
+      "step": 2817
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.778535722999078e-06,
+      "loss": 1.0013,
+      "step": 2818
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.762166445669902e-06,
+      "loss": 1.0219,
+      "step": 2819
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.74581792292105e-06,
+      "loss": 0.8048,
+      "step": 2820
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.72949016875158e-06,
+      "loss": 0.8673,
+      "step": 2821
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.713183197142746e-06,
+      "loss": 0.9885,
+      "step": 2822
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.6968970220580286e-06,
+      "loss": 0.9758,
+      "step": 2823
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.6806316574430984e-06,
+      "loss": 0.9903,
+      "step": 2824
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.664387117225805e-06,
+      "loss": 0.98,
+      "step": 2825
+    },
+    {
+      "epoch": 1.61,
+      "learning_rate": 5.6481634153161495e-06,
+      "loss": 0.9153,
+      "step": 2826
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.631960565606309e-06,
+      "loss": 1.0343,
+      "step": 2827
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.615778581970606e-06,
+      "loss": 0.8885,
+      "step": 2828
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.5996174782654786e-06,
+      "loss": 0.8534,
+      "step": 2829
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.583477268329495e-06,
+      "loss": 1.1119,
+      "step": 2830
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.5673579659833385e-06,
+      "loss": 0.9879,
+      "step": 2831
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.551259585029787e-06,
+      "loss": 0.81,
+      "step": 2832
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.535182139253689e-06,
+      "loss": 1.0452,
+      "step": 2833
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.519125642421985e-06,
+      "loss": 0.9059,
+      "step": 2834
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.503090108283668e-06,
+      "loss": 0.918,
+      "step": 2835
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.487075550569796e-06,
+      "loss": 0.8447,
+      "step": 2836
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.4710819829934274e-06,
+      "loss": 1.048,
+      "step": 2837
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.455109419249687e-06,
+      "loss": 0.8033,
+      "step": 2838
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.4391578730156976e-06,
+      "loss": 0.8949,
+      "step": 2839
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.423227357950589e-06,
+      "loss": 0.9632,
+      "step": 2840
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.407317887695471e-06,
+      "loss": 0.7952,
+      "step": 2841
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.391429475873444e-06,
+      "loss": 0.969,
+      "step": 2842
+    },
+    {
+      "epoch": 1.62,
+      "learning_rate": 5.3755621360895844e-06,
+      "loss": 0.8784,
+      "step": 2843
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.359715881930898e-06,
+      "loss": 0.8847,
+      "step": 2844
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.34389072696636e-06,
+      "loss": 0.8817,
+      "step": 2845
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.3280866847468665e-06,
+      "loss": 0.8657,
+      "step": 2846
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.312303768805251e-06,
+      "loss": 1.1143,
+      "step": 2847
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.296541992656225e-06,
+      "loss": 0.9686,
+      "step": 2848
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.280801369796427e-06,
+      "loss": 0.9077,
+      "step": 2849
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.265081913704373e-06,
+      "loss": 0.9254,
+      "step": 2850
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.249383637840463e-06,
+      "loss": 0.9468,
+      "step": 2851
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.233706555646933e-06,
+      "loss": 0.9371,
+      "step": 2852
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.218050680547896e-06,
+      "loss": 0.8276,
+      "step": 2853
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.202416025949307e-06,
+      "loss": 0.9365,
+      "step": 2854
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.186802605238941e-06,
+      "loss": 0.9867,
+      "step": 2855
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.171210431786383e-06,
+      "loss": 0.9909,
+      "step": 2856
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.155639518943037e-06,
+      "loss": 0.9346,
+      "step": 2857
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.1400898800421025e-06,
+      "loss": 0.992,
+      "step": 2858
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.124561528398558e-06,
+      "loss": 0.8724,
+      "step": 2859
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.109054477309147e-06,
+      "loss": 0.954,
+      "step": 2860
+    },
+    {
+      "epoch": 1.63,
+      "learning_rate": 5.0935687400523826e-06,
+      "loss": 0.949,
+      "step": 2861
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 5.078104329888532e-06,
+      "loss": 0.8755,
+      "step": 2862
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 5.062661260059585e-06,
+      "loss": 0.9745,
+      "step": 2863
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 5.047239543789265e-06,
+      "loss": 1.0413,
+      "step": 2864
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 5.0318391942830135e-06,
+      "loss": 0.9465,
+      "step": 2865
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 5.016460224727987e-06,
+      "loss": 0.9603,
+      "step": 2866
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 5.001102648293001e-06,
+      "loss": 0.8056,
+      "step": 2867
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.985766478128584e-06,
+      "loss": 0.9506,
+      "step": 2868
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.970451727366921e-06,
+      "loss": 1.0168,
+      "step": 2869
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.95515840912187e-06,
+      "loss": 0.9524,
+      "step": 2870
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.939886536488906e-06,
+      "loss": 0.9783,
+      "step": 2871
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.924636122545163e-06,
+      "loss": 1.0099,
+      "step": 2872
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.909407180349406e-06,
+      "loss": 0.9163,
+      "step": 2873
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.894199722942006e-06,
+      "loss": 0.8969,
+      "step": 2874
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.87901376334492e-06,
+      "loss": 0.961,
+      "step": 2875
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.86384931456172e-06,
+      "loss": 0.9283,
+      "step": 2876
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.8487063895775605e-06,
+      "loss": 1.0831,
+      "step": 2877
+    },
+    {
+      "epoch": 1.64,
+      "learning_rate": 4.8335850013591385e-06,
+      "loss": 0.9709,
+      "step": 2878
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.8184851628547366e-06,
+      "loss": 0.836,
+      "step": 2879
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.803406886994168e-06,
+      "loss": 0.897,
+      "step": 2880
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.788350186688799e-06,
+      "loss": 0.8899,
+      "step": 2881
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.773315074831496e-06,
+      "loss": 1.0191,
+      "step": 2882
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.75830156429666e-06,
+      "loss": 0.9207,
+      "step": 2883
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.743309667940191e-06,
+      "loss": 0.8428,
+      "step": 2884
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.7283393985994834e-06,
+      "loss": 1.026,
+      "step": 2885
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.713390769093398e-06,
+      "loss": 0.8316,
+      "step": 2886
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.698463792222276e-06,
+      "loss": 0.9713,
+      "step": 2887
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.683558480767922e-06,
+      "loss": 0.8503,
+      "step": 2888
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.66867484749359e-06,
+      "loss": 0.9029,
+      "step": 2889
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.653812905143949e-06,
+      "loss": 0.9377,
+      "step": 2890
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.638972666445122e-06,
+      "loss": 0.9307,
+      "step": 2891
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.624154144104644e-06,
+      "loss": 0.9284,
+      "step": 2892
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.609357350811427e-06,
+      "loss": 0.938,
+      "step": 2893
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.594582299235807e-06,
+      "loss": 0.8232,
+      "step": 2894
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.579829002029488e-06,
+      "loss": 0.8896,
+      "step": 2895
+    },
+    {
+      "epoch": 1.65,
+      "learning_rate": 4.5650974718255644e-06,
+      "loss": 1.003,
+      "step": 2896
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.550387721238457e-06,
+      "loss": 0.8738,
+      "step": 2897
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.535699762863967e-06,
+      "loss": 0.7685,
+      "step": 2898
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.5210336092792285e-06,
+      "loss": 0.9371,
+      "step": 2899
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.506389273042701e-06,
+      "loss": 1.0637,
+      "step": 2900
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.491766766694153e-06,
+      "loss": 0.8862,
+      "step": 2901
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.477166102754678e-06,
+      "loss": 0.8145,
+      "step": 2902
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.462587293726656e-06,
+      "loss": 0.9132,
+      "step": 2903
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.448030352093762e-06,
+      "loss": 0.9328,
+      "step": 2904
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.433495290320924e-06,
+      "loss": 0.9502,
+      "step": 2905
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.418982120854362e-06,
+      "loss": 0.9001,
+      "step": 2906
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.40449085612153e-06,
+      "loss": 1.0785,
+      "step": 2907
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.3900215085311456e-06,
+      "loss": 1.0159,
+      "step": 2908
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.3755740904731246e-06,
+      "loss": 0.9472,
+      "step": 2909
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.361148614318641e-06,
+      "loss": 0.9817,
+      "step": 2910
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.34674509242007e-06,
+      "loss": 0.9931,
+      "step": 2911
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.332363537110967e-06,
+      "loss": 1.0665,
+      "step": 2912
+    },
+    {
+      "epoch": 1.66,
+      "learning_rate": 4.3180039607061036e-06,
+      "loss": 0.9848,
+      "step": 2913
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.303666375501422e-06,
+      "loss": 0.9864,
+      "step": 2914
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.289350793774033e-06,
+      "loss": 0.9064,
+      "step": 2915
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.275057227782198e-06,
+      "loss": 0.9564,
+      "step": 2916
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.260785689765335e-06,
+      "loss": 0.7813,
+      "step": 2917
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.246536191944017e-06,
+      "loss": 0.8438,
+      "step": 2918
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.232308746519907e-06,
+      "loss": 0.9393,
+      "step": 2919
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.218103365675811e-06,
+      "loss": 0.9184,
+      "step": 2920
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.203920061575634e-06,
+      "loss": 0.8216,
+      "step": 2921
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.189758846364384e-06,
+      "loss": 0.9536,
+      "step": 2922
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.175619732168136e-06,
+      "loss": 1.0011,
+      "step": 2923
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.161502731094059e-06,
+      "loss": 0.9094,
+      "step": 2924
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.147407855230378e-06,
+      "loss": 1.0077,
+      "step": 2925
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.133335116646381e-06,
+      "loss": 0.837,
+      "step": 2926
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.119284527392383e-06,
+      "loss": 1.0043,
+      "step": 2927
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.105256099499745e-06,
+      "loss": 0.8774,
+      "step": 2928
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.091249844980863e-06,
+      "loss": 0.912,
+      "step": 2929
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.077265775829116e-06,
+      "loss": 0.7938,
+      "step": 2930
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.063303904018906e-06,
+      "loss": 0.9599,
+      "step": 2931
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 4.049364241505631e-06,
+      "loss": 0.8558,
+      "step": 2932
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 4.035446800225666e-06,
+      "loss": 1.03,
+      "step": 2933
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 4.021551592096349e-06,
+      "loss": 0.8797,
+      "step": 2934
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 4.007678629015994e-06,
+      "loss": 0.9092,
+      "step": 2935
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.993827922863856e-06,
+      "loss": 0.9346,
+      "step": 2936
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.979999485500149e-06,
+      "loss": 0.9006,
+      "step": 2937
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.9661933287659894e-06,
+      "loss": 0.8281,
+      "step": 2938
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.952409464483441e-06,
+      "loss": 0.8401,
+      "step": 2939
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.938647904455466e-06,
+      "loss": 0.9191,
+      "step": 2940
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.924908660465941e-06,
+      "loss": 1.0241,
+      "step": 2941
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.9111917442796094e-06,
+      "loss": 0.8554,
+      "step": 2942
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.897497167642115e-06,
+      "loss": 1.0713,
+      "step": 2943
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.883824942279979e-06,
+      "loss": 0.9212,
+      "step": 2944
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.870175079900554e-06,
+      "loss": 0.9366,
+      "step": 2945
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.856547592192069e-06,
+      "loss": 1.0402,
+      "step": 2946
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.842942490823589e-06,
+      "loss": 0.9215,
+      "step": 2947
+    },
+    {
+      "epoch": 1.68,
+      "learning_rate": 3.829359787445008e-06,
+      "loss": 1.0005,
+      "step": 2948
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.815799493687033e-06,
+      "loss": 0.8799,
+      "step": 2949
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.8022616211611925e-06,
+      "loss": 0.8363,
+      "step": 2950
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.7887461814598135e-06,
+      "loss": 0.9867,
+      "step": 2951
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.7752531861560145e-06,
+      "loss": 0.8762,
+      "step": 2952
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.7617826468036874e-06,
+      "loss": 0.9283,
+      "step": 2953
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.7483345749375054e-06,
+      "loss": 0.8533,
+      "step": 2954
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.7349089820728967e-06,
+      "loss": 0.9382,
+      "step": 2955
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.721505879706052e-06,
+      "loss": 0.8874,
+      "step": 2956
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.7081252793138774e-06,
+      "loss": 0.9699,
+      "step": 2957
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.694767192354045e-06,
+      "loss": 0.8199,
+      "step": 2958
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.6814316302649208e-06,
+      "loss": 0.9741,
+      "step": 2959
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.668118604465608e-06,
+      "loss": 1.0082,
+      "step": 2960
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.6548281263558867e-06,
+      "loss": 0.8997,
+      "step": 2961
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.641560207316241e-06,
+      "loss": 0.824,
+      "step": 2962
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.628314858707853e-06,
+      "loss": 0.9865,
+      "step": 2963
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.6150920918725427e-06,
+      "loss": 0.8359,
+      "step": 2964
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.601891918132827e-06,
+      "loss": 0.8246,
+      "step": 2965
+    },
+    {
+      "epoch": 1.69,
+      "learning_rate": 3.588714348791864e-06,
+      "loss": 0.8615,
+      "step": 2966
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.575559395133461e-06,
+      "loss": 0.9122,
+      "step": 2967
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.5624270684220404e-06,
+      "loss": 0.8557,
+      "step": 2968
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.5493173799026712e-06,
+      "loss": 0.9298,
+      "step": 2969
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.53623034080103e-06,
+      "loss": 0.9354,
+      "step": 2970
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.5231659623234056e-06,
+      "loss": 0.8604,
+      "step": 2971
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.5101242556566636e-06,
+      "loss": 0.9709,
+      "step": 2972
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.497105231968274e-06,
+      "loss": 0.9239,
+      "step": 2973
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.484108902406279e-06,
+      "loss": 0.872,
+      "step": 2974
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.4711352780992968e-06,
+      "loss": 0.9726,
+      "step": 2975
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.458184370156474e-06,
+      "loss": 0.902,
+      "step": 2976
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.4452561896675404e-06,
+      "loss": 0.7422,
+      "step": 2977
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.4323507477027474e-06,
+      "loss": 0.8571,
+      "step": 2978
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.419468055312871e-06,
+      "loss": 0.9361,
+      "step": 2979
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.4066081235292178e-06,
+      "loss": 0.9052,
+      "step": 2980
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.3937709633635993e-06,
+      "loss": 0.8888,
+      "step": 2981
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.380956585808339e-06,
+      "loss": 1.0139,
+      "step": 2982
+    },
+    {
+      "epoch": 1.7,
+      "learning_rate": 3.3681650018362263e-06,
+      "loss": 0.8482,
+      "step": 2983
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.3553962224005565e-06,
+      "loss": 1.0294,
+      "step": 2984
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.3426502584350895e-06,
+      "loss": 0.8541,
+      "step": 2985
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.329927120854055e-06,
+      "loss": 1.0297,
+      "step": 2986
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.317226820552118e-06,
+      "loss": 0.7969,
+      "step": 2987
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.3045493684044072e-06,
+      "loss": 0.8241,
+      "step": 2988
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.2918947752664774e-06,
+      "loss": 0.875,
+      "step": 2989
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.279263051974325e-06,
+      "loss": 0.9975,
+      "step": 2990
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.266654209344334e-06,
+      "loss": 0.9291,
+      "step": 2991
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.2540682581733183e-06,
+      "loss": 0.9219,
+      "step": 2992
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.24150520923849e-06,
+      "loss": 0.8806,
+      "step": 2993
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.228965073297434e-06,
+      "loss": 1.1078,
+      "step": 2994
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.216447861088131e-06,
+      "loss": 1.0187,
+      "step": 2995
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.203953583328927e-06,
+      "loss": 0.9167,
+      "step": 2996
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.1914822507185373e-06,
+      "loss": 1.045,
+      "step": 2997
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.179033873936006e-06,
+      "loss": 1.0289,
+      "step": 2998
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.1666084636407467e-06,
+      "loss": 0.8626,
+      "step": 2999
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.1542060304724918e-06,
+      "loss": 0.9067,
+      "step": 3000
+    },
+    {
+      "epoch": 1.71,
+      "learning_rate": 3.1418265850513127e-06,
+      "loss": 0.8926,
+      "step": 3001
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.1294701379775737e-06,
+      "loss": 0.8894,
+      "step": 3002
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.117136699831964e-06,
+      "loss": 0.9302,
+      "step": 3003
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.104826281175469e-06,
+      "loss": 0.8607,
+      "step": 3004
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.0925388925493636e-06,
+      "loss": 1.0539,
+      "step": 3005
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.0802745444751914e-06,
+      "loss": 0.9368,
+      "step": 3006
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.0680332474547713e-06,
+      "loss": 1.1108,
+      "step": 3007
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.0558150119701923e-06,
+      "loss": 0.7508,
+      "step": 3008
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.0436198484837917e-06,
+      "loss": 0.9826,
+      "step": 3009
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.0314477674381435e-06,
+      "loss": 1.08,
+      "step": 3010
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.0192987792560635e-06,
+      "loss": 0.9005,
+      "step": 3011
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 3.007172894340596e-06,
+      "loss": 1.0909,
+      "step": 3012
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 2.9950701230749866e-06,
+      "loss": 0.8624,
+      "step": 3013
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 2.982990475822711e-06,
+      "loss": 0.8689,
+      "step": 3014
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 2.970933962927429e-06,
+      "loss": 0.9027,
+      "step": 3015
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 2.958900594712999e-06,
+      "loss": 0.859,
+      "step": 3016
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 2.9468903814834515e-06,
+      "loss": 1.0397,
+      "step": 3017
+    },
+    {
+      "epoch": 1.72,
+      "learning_rate": 2.9349033335229935e-06,
+      "loss": 0.8641,
+      "step": 3018
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.9229394610960047e-06,
+      "loss": 0.9897,
+      "step": 3019
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.9109987744470133e-06,
+      "loss": 0.8819,
+      "step": 3020
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.899081283800684e-06,
+      "loss": 0.8713,
+      "step": 3021
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.8871869993618305e-06,
+      "loss": 0.8375,
+      "step": 3022
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.8753159313153988e-06,
+      "loss": 0.9736,
+      "step": 3023
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.863468089826444e-06,
+      "loss": 0.8895,
+      "step": 3024
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.8516434850401384e-06,
+      "loss": 0.9194,
+      "step": 3025
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.8398421270817556e-06,
+      "loss": 0.9141,
+      "step": 3026
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.828064026056675e-06,
+      "loss": 1.0962,
+      "step": 3027
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.8163091920503294e-06,
+      "loss": 1.0102,
+      "step": 3028
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.8045776351282637e-06,
+      "loss": 0.8125,
+      "step": 3029
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.792869365336076e-06,
+      "loss": 0.8985,
+      "step": 3030
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.7811843926994128e-06,
+      "loss": 0.9378,
+      "step": 3031
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.7695227272239943e-06,
+      "loss": 0.984,
+      "step": 3032
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.7578843788955656e-06,
+      "loss": 0.9167,
+      "step": 3033
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.746269357679918e-06,
+      "loss": 0.9945,
+      "step": 3034
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.7346776735228527e-06,
+      "loss": 0.8527,
+      "step": 3035
+    },
+    {
+      "epoch": 1.73,
+      "learning_rate": 2.7231093363502035e-06,
+      "loss": 0.93,
+      "step": 3036
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.7115643560677994e-06,
+      "loss": 1.0711,
+      "step": 3037
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.7000427425614895e-06,
+      "loss": 0.9408,
+      "step": 3038
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.6885445056970816e-06,
+      "loss": 0.8553,
+      "step": 3039
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.67706965532039e-06,
+      "loss": 0.9052,
+      "step": 3040
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.665618201257205e-06,
+      "loss": 0.9038,
+      "step": 3041
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.654190153313276e-06,
+      "loss": 0.9507,
+      "step": 3042
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.642785521274299e-06,
+      "loss": 0.8055,
+      "step": 3043
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.631404314905942e-06,
+      "loss": 0.8366,
+      "step": 3044
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.620046543953799e-06,
+      "loss": 0.8363,
+      "step": 3045
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.6087122181433944e-06,
+      "loss": 0.8862,
+      "step": 3046
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.597401347180184e-06,
+      "loss": 0.9751,
+      "step": 3047
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.5861139407495406e-06,
+      "loss": 0.9342,
+      "step": 3048
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.574850008516746e-06,
+      "loss": 0.8232,
+      "step": 3049
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.563609560126965e-06,
+      "loss": 0.9097,
+      "step": 3050
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.5523926052052713e-06,
+      "loss": 0.9215,
+      "step": 3051
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.541199153356616e-06,
+      "loss": 0.9336,
+      "step": 3052
+    },
+    {
+      "epoch": 1.74,
+      "learning_rate": 2.5300292141658277e-06,
+      "loss": 0.8711,
+      "step": 3053
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.5188827971975894e-06,
+      "loss": 0.9512,
+      "step": 3054
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.507759911996456e-06,
+      "loss": 0.9613,
+      "step": 3055
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.4966605680868284e-06,
+      "loss": 1.08,
+      "step": 3056
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.485584774972948e-06,
+      "loss": 0.895,
+      "step": 3057
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.474532542138884e-06,
+      "loss": 0.8882,
+      "step": 3058
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.4635038790485443e-06,
+      "loss": 0.9331,
+      "step": 3059
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.4524987951456403e-06,
+      "loss": 0.9843,
+      "step": 3060
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.441517299853714e-06,
+      "loss": 0.9486,
+      "step": 3061
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.430559402576077e-06,
+      "loss": 0.8925,
+      "step": 3062
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.4196251126958568e-06,
+      "loss": 0.9037,
+      "step": 3063
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.408714439575971e-06,
+      "loss": 1.0342,
+      "step": 3064
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.397827392559092e-06,
+      "loss": 0.8869,
+      "step": 3065
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.38696398096768e-06,
+      "loss": 1.0098,
+      "step": 3066
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.3761242141039474e-06,
+      "loss": 0.9365,
+      "step": 3067
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.3653081012498723e-06,
+      "loss": 0.9774,
+      "step": 3068
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.354515651667153e-06,
+      "loss": 0.9319,
+      "step": 3069
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.3437468745972536e-06,
+      "loss": 0.8242,
+      "step": 3070
+    },
+    {
+      "epoch": 1.75,
+      "learning_rate": 2.333001779261348e-06,
+      "loss": 0.7664,
+      "step": 3071
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.322280374860346e-06,
+      "loss": 0.824,
+      "step": 3072
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.311582670574854e-06,
+      "loss": 0.9777,
+      "step": 3073
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.300908675565202e-06,
+      "loss": 0.874,
+      "step": 3074
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.2902583989714045e-06,
+      "loss": 0.9044,
+      "step": 3075
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.27963184991318e-06,
+      "loss": 0.8342,
+      "step": 3076
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.2690290374899124e-06,
+      "loss": 0.7997,
+      "step": 3077
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.258449970780674e-06,
+      "loss": 0.8275,
+      "step": 3078
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.2478946588442005e-06,
+      "loss": 0.8452,
+      "step": 3079
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.237363110718876e-06,
+      "loss": 0.9466,
+      "step": 3080
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.226855335422754e-06,
+      "loss": 1.0566,
+      "step": 3081
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.216371341953519e-06,
+      "loss": 1.0905,
+      "step": 3082
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.2059111392885013e-06,
+      "loss": 1.0302,
+      "step": 3083
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.1954747363846383e-06,
+      "loss": 1.0532,
+      "step": 3084
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.1850621421785153e-06,
+      "loss": 1.0095,
+      "step": 3085
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.174673365586317e-06,
+      "loss": 0.9787,
+      "step": 3086
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.164308415503834e-06,
+      "loss": 0.8618,
+      "step": 3087
+    },
+    {
+      "epoch": 1.76,
+      "learning_rate": 2.1539673008064465e-06,
+      "loss": 0.9104,
+      "step": 3088
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.143650030349141e-06,
+      "loss": 0.8637,
+      "step": 3089
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.133356612966475e-06,
+      "loss": 0.9654,
+      "step": 3090
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.1230870574725936e-06,
+      "loss": 0.9215,
+      "step": 3091
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.1128413726611864e-06,
+      "loss": 0.9426,
+      "step": 3092
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.1026195673055213e-06,
+      "loss": 0.8964,
+      "step": 3093
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.0924216501584147e-06,
+      "loss": 0.9087,
+      "step": 3094
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.0822476299522307e-06,
+      "loss": 0.988,
+      "step": 3095
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.0720975153988606e-06,
+      "loss": 1.0792,
+      "step": 3096
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.0619713151897326e-06,
+      "loss": 0.9876,
+      "step": 3097
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.051869037995803e-06,
+      "loss": 1.0145,
+      "step": 3098
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.0417906924675255e-06,
+      "loss": 0.9203,
+      "step": 3099
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.0317362872348776e-06,
+      "loss": 0.9365,
+      "step": 3100
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.021705830907332e-06,
+      "loss": 0.8835,
+      "step": 3101
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.0116993320738586e-06,
+      "loss": 0.9471,
+      "step": 3102
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 2.0017167993028997e-06,
+      "loss": 1.0082,
+      "step": 3103
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 1.9917582411423873e-06,
+      "loss": 0.836,
+      "step": 3104
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 1.981823666119724e-06,
+      "loss": 0.884,
+      "step": 3105
+    },
+    {
+      "epoch": 1.77,
+      "learning_rate": 1.9719130827417755e-06,
+      "loss": 0.8416,
+      "step": 3106
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.962026499494849e-06,
+      "loss": 0.9239,
+      "step": 3107
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.9521639248447232e-06,
+      "loss": 0.8024,
+      "step": 3108
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.9423253672366058e-06,
+      "loss": 0.9106,
+      "step": 3109
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.9325108350951482e-06,
+      "loss": 0.9397,
+      "step": 3110
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.9227203368244073e-06,
+      "loss": 0.9536,
+      "step": 3111
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.912953880807884e-06,
+      "loss": 1.0187,
+      "step": 3112
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.9032114754084885e-06,
+      "loss": 0.9542,
+      "step": 3113
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.893493128968521e-06,
+      "loss": 0.9031,
+      "step": 3114
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.8837988498096947e-06,
+      "loss": 0.8869,
+      "step": 3115
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.8741286462331097e-06,
+      "loss": 0.7493,
+      "step": 3116
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.8644825265192556e-06,
+      "loss": 0.8941,
+      "step": 3117
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.8548604989279882e-06,
+      "loss": 0.9216,
+      "step": 3118
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.8452625716985405e-06,
+      "loss": 0.944,
+      "step": 3119
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.8356887530495114e-06,
+      "loss": 1.0456,
+      "step": 3120
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.8261390511788568e-06,
+      "loss": 0.8164,
+      "step": 3121
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.8166134742638652e-06,
+      "loss": 1.0748,
+      "step": 3122
+    },
+    {
+      "epoch": 1.78,
+      "learning_rate": 1.8071120304611887e-06,
+      "loss": 0.9392,
+      "step": 3123
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7976347279067994e-06,
+      "loss": 0.9105,
+      "step": 3124
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7881815747160158e-06,
+      "loss": 0.9055,
+      "step": 3125
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.778752578983449e-06,
+      "loss": 0.9484,
+      "step": 3126
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7693477487830478e-06,
+      "loss": 0.9721,
+      "step": 3127
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7599670921680633e-06,
+      "loss": 1.034,
+      "step": 3128
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7506106171710368e-06,
+      "loss": 0.9874,
+      "step": 3129
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7412783318038195e-06,
+      "loss": 0.9577,
+      "step": 3130
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7319702440575391e-06,
+      "loss": 0.9246,
+      "step": 3131
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7226863619026034e-06,
+      "loss": 1.0243,
+      "step": 3132
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7134266932886933e-06,
+      "loss": 0.822,
+      "step": 3133
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.7041912461447596e-06,
+      "loss": 0.9456,
+      "step": 3134
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.694980028379013e-06,
+      "loss": 0.8715,
+      "step": 3135
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.6857930478789073e-06,
+      "loss": 0.9629,
+      "step": 3136
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.6766303125111537e-06,
+      "loss": 0.9955,
+      "step": 3137
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.6674918301216957e-06,
+      "loss": 0.9264,
+      "step": 3138
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.6583776085357172e-06,
+      "loss": 0.9086,
+      "step": 3139
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.649287655557612e-06,
+      "loss": 0.8001,
+      "step": 3140
+    },
+    {
+      "epoch": 1.79,
+      "learning_rate": 1.6402219789710105e-06,
+      "loss": 0.9713,
+      "step": 3141
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.6311805865387464e-06,
+      "loss": 0.921,
+      "step": 3142
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.6221634860028634e-06,
+      "loss": 0.8036,
+      "step": 3143
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.6131706850845984e-06,
+      "loss": 0.9986,
+      "step": 3144
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.6042021914843818e-06,
+      "loss": 0.9922,
+      "step": 3145
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5952580128818373e-06,
+      "loss": 0.9256,
+      "step": 3146
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5863381569357648e-06,
+      "loss": 0.8691,
+      "step": 3147
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5774426312841318e-06,
+      "loss": 0.9525,
+      "step": 3148
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5685714435440712e-06,
+      "loss": 0.9944,
+      "step": 3149
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5597246013118871e-06,
+      "loss": 0.7925,
+      "step": 3150
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5509021121630262e-06,
+      "loss": 0.8541,
+      "step": 3151
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5421039836520824e-06,
+      "loss": 0.8788,
+      "step": 3152
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5333302233127956e-06,
+      "loss": 0.9272,
+      "step": 3153
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5245808386580429e-06,
+      "loss": 0.9195,
+      "step": 3154
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5158558371798149e-06,
+      "loss": 0.715,
+      "step": 3155
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.5071552263492282e-06,
+      "loss": 1.0817,
+      "step": 3156
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.4984790136165239e-06,
+      "loss": 1.1471,
+      "step": 3157
+    },
+    {
+      "epoch": 1.8,
+      "learning_rate": 1.489827206411042e-06,
+      "loss": 1.0034,
+      "step": 3158
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.481199812141223e-06,
+      "loss": 0.9456,
+      "step": 3159
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.4725968381946076e-06,
+      "loss": 0.8157,
+      "step": 3160
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.4640182919378265e-06,
+      "loss": 0.8372,
+      "step": 3161
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.4554641807165936e-06,
+      "loss": 1.0127,
+      "step": 3162
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.4469345118556898e-06,
+      "loss": 0.933,
+      "step": 3163
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.4384292926589726e-06,
+      "loss": 0.7591,
+      "step": 3164
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.4299485304093762e-06,
+      "loss": 0.8681,
+      "step": 3165
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.4214922323688651e-06,
+      "loss": 0.877,
+      "step": 3166
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.4130604057784768e-06,
+      "loss": 0.932,
+      "step": 3167
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.4046530578582927e-06,
+      "loss": 0.8805,
+      "step": 3168
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.3962701958074274e-06,
+      "loss": 0.8414,
+      "step": 3169
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.3879118268040225e-06,
+      "loss": 0.9549,
+      "step": 3170
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.3795779580052626e-06,
+      "loss": 0.8443,
+      "step": 3171
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.3712685965473393e-06,
+      "loss": 0.9989,
+      "step": 3172
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.3629837495454712e-06,
+      "loss": 0.9152,
+      "step": 3173
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.3547234240938667e-06,
+      "loss": 0.9874,
+      "step": 3174
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.3464876272657577e-06,
+      "loss": 0.9089,
+      "step": 3175
+    },
+    {
+      "epoch": 1.81,
+      "learning_rate": 1.3382763661133567e-06,
+      "loss": 0.8893,
+      "step": 3176
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.3300896476678825e-06,
+      "loss": 0.9027,
+      "step": 3177
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.3219274789395208e-06,
+      "loss": 0.903,
+      "step": 3178
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.3137898669174408e-06,
+      "loss": 0.9445,
+      "step": 3179
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.3056768185697987e-06,
+      "loss": 1.0551,
+      "step": 3180
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2975883408436907e-06,
+      "loss": 0.9403,
+      "step": 3181
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2895244406651996e-06,
+      "loss": 0.7898,
+      "step": 3182
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2814851249393421e-06,
+      "loss": 1.0126,
+      "step": 3183
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.273470400550102e-06,
+      "loss": 1.0141,
+      "step": 3184
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2654802743603888e-06,
+      "loss": 0.8011,
+      "step": 3185
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2575147532120567e-06,
+      "loss": 0.9051,
+      "step": 3186
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2495738439258963e-06,
+      "loss": 0.849,
+      "step": 3187
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.241657553301615e-06,
+      "loss": 0.7786,
+      "step": 3188
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2337658881178404e-06,
+      "loss": 0.8262,
+      "step": 3189
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2258988551321138e-06,
+      "loss": 0.9101,
+      "step": 3190
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2180564610808863e-06,
+      "loss": 1.0403,
+      "step": 3191
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.21023871267952e-06,
+      "loss": 0.8066,
+      "step": 3192
+    },
+    {
+      "epoch": 1.82,
+      "learning_rate": 1.2024456166222497e-06,
+      "loss": 0.9118,
+      "step": 3193
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1946771795822243e-06,
+      "loss": 1.1533,
+      "step": 3194
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1869334082114625e-06,
+      "loss": 0.9088,
+      "step": 3195
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1792143091408703e-06,
+      "loss": 0.8527,
+      "step": 3196
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1715198889802237e-06,
+      "loss": 1.0431,
+      "step": 3197
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1638501543181623e-06,
+      "loss": 1.0036,
+      "step": 3198
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1562051117222028e-06,
+      "loss": 0.9102,
+      "step": 3199
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1485847677386985e-06,
+      "loss": 0.8609,
+      "step": 3200
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1409891288928664e-06,
+      "loss": 0.7981,
+      "step": 3201
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.133418201688764e-06,
+      "loss": 0.8557,
+      "step": 3202
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.125871992609292e-06,
+      "loss": 1.0696,
+      "step": 3203
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1183505081161816e-06,
+      "loss": 1.0633,
+      "step": 3204
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1108537546499942e-06,
+      "loss": 0.8835,
+      "step": 3205
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.1033817386301147e-06,
+      "loss": 0.9112,
+      "step": 3206
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.0959344664547487e-06,
+      "loss": 0.7953,
+      "step": 3207
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.0885119445009018e-06,
+      "loss": 0.9802,
+      "step": 3208
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.0811141791244029e-06,
+      "loss": 0.8441,
+      "step": 3209
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.0737411766598682e-06,
+      "loss": 0.8495,
+      "step": 3210
+    },
+    {
+      "epoch": 1.83,
+      "learning_rate": 1.0663929434207242e-06,
+      "loss": 0.804,
+      "step": 3211
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 1.0590694856991678e-06,
+      "loss": 0.9455,
+      "step": 3212
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 1.0517708097661992e-06,
+      "loss": 0.8885,
+      "step": 3213
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 1.0444969218715927e-06,
+      "loss": 0.9557,
+      "step": 3214
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 1.0372478282438924e-06,
+      "loss": 0.9005,
+      "step": 3215
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 1.030023535090413e-06,
+      "loss": 1.0722,
+      "step": 3216
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 1.0228240485972361e-06,
+      "loss": 0.7213,
+      "step": 3217
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 1.0156493749292038e-06,
+      "loss": 1.0412,
+      "step": 3218
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 1.0084995202298986e-06,
+      "loss": 0.9915,
+      "step": 3219
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 1.001374490621666e-06,
+      "loss": 0.9014,
+      "step": 3220
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 9.942742922055858e-07,
+      "loss": 0.8518,
+      "step": 3221
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 9.871989310614782e-07,
+      "loss": 0.923,
+      "step": 3222
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 9.801484132478932e-07,
+      "loss": 0.91,
+      "step": 3223
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 9.731227448021052e-07,
+      "loss": 0.9979,
+      "step": 3224
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 9.661219317401181e-07,
+      "loss": 0.8557,
+      "step": 3225
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 9.591459800566538e-07,
+      "loss": 0.8349,
+      "step": 3226
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 9.52194895725127e-07,
+      "loss": 0.8837,
+      "step": 3227
+    },
+    {
+      "epoch": 1.84,
+      "learning_rate": 9.4526868469768e-07,
+      "loss": 0.8953,
+      "step": 3228
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 9.383673529051517e-07,
+      "loss": 0.8236,
+      "step": 3229
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 9.314909062570653e-07,
+      "loss": 0.8399,
+      "step": 3230
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 9.246393506416473e-07,
+      "loss": 0.9065,
+      "step": 3231
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 9.178126919258045e-07,
+      "loss": 0.9823,
+      "step": 3232
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 9.110109359551344e-07,
+      "loss": 0.7853,
+      "step": 3233
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 9.042340885538947e-07,
+      "loss": 1.0676,
+      "step": 3234
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.974821555250201e-07,
+      "loss": 0.8577,
+      "step": 3235
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.907551426501259e-07,
+      "loss": 0.9442,
+      "step": 3236
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.840530556894677e-07,
+      "loss": 0.866,
+      "step": 3237
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.773759003819681e-07,
+      "loss": 0.8111,
+      "step": 3238
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.707236824452003e-07,
+      "loss": 0.9049,
+      "step": 3239
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.64096407575381e-07,
+      "loss": 0.9824,
+      "step": 3240
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.574940814473709e-07,
+      "loss": 0.8761,
+      "step": 3241
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.509167097146642e-07,
+      "loss": 0.8699,
+      "step": 3242
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.443642980093924e-07,
+      "loss": 0.8797,
+      "step": 3243
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.378368519423107e-07,
+      "loss": 0.9932,
+      "step": 3244
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.313343771027948e-07,
+      "loss": 0.9409,
+      "step": 3245
+    },
+    {
+      "epoch": 1.85,
+      "learning_rate": 8.248568790588406e-07,
+      "loss": 0.9475,
+      "step": 3246
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 8.184043633570548e-07,
+      "loss": 0.9925,
+      "step": 3247
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 8.119768355226542e-07,
+      "loss": 1.0364,
+      "step": 3248
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 8.055743010594563e-07,
+      "loss": 0.8948,
+      "step": 3249
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.991967654498822e-07,
+      "loss": 1.1077,
+      "step": 3250
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.928442341549402e-07,
+      "loss": 1.0158,
+      "step": 3251
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.865167126142259e-07,
+      "loss": 0.8755,
+      "step": 3252
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.802142062459283e-07,
+      "loss": 0.9421,
+      "step": 3253
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.739367204468139e-07,
+      "loss": 1.026,
+      "step": 3254
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.676842605922197e-07,
+      "loss": 1.0485,
+      "step": 3255
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.614568320360526e-07,
+      "loss": 0.8083,
+      "step": 3256
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.552544401107941e-07,
+      "loss": 0.8843,
+      "step": 3257
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.490770901274791e-07,
+      "loss": 0.9078,
+      "step": 3258
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.429247873757028e-07,
+      "loss": 0.9259,
+      "step": 3259
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.36797537123608e-07,
+      "loss": 1.0249,
+      "step": 3260
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.306953446178943e-07,
+      "loss": 0.9239,
+      "step": 3261
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.246182150837954e-07,
+      "loss": 0.9014,
+      "step": 3262
+    },
+    {
+      "epoch": 1.86,
+      "learning_rate": 7.185661537250954e-07,
+      "loss": 1.0473,
+      "step": 3263
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 7.125391657240954e-07,
+      "loss": 0.8371,
+      "step": 3264
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 7.065372562416406e-07,
+      "loss": 0.7938,
+      "step": 3265
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 7.005604304171032e-07,
+      "loss": 0.7648,
+      "step": 3266
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.946086933683626e-07,
+      "loss": 1.0657,
+      "step": 3267
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.886820501918256e-07,
+      "loss": 0.8811,
+      "step": 3268
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.827805059624093e-07,
+      "loss": 0.9203,
+      "step": 3269
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.769040657335446e-07,
+      "loss": 0.8499,
+      "step": 3270
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.710527345371497e-07,
+      "loss": 0.9707,
+      "step": 3271
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.652265173836602e-07,
+      "loss": 0.8731,
+      "step": 3272
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.594254192619953e-07,
+      "loss": 0.8852,
+      "step": 3273
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.536494451395747e-07,
+      "loss": 0.9351,
+      "step": 3274
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.478985999622922e-07,
+      "loss": 0.9365,
+      "step": 3275
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.421728886545353e-07,
+      "loss": 0.8787,
+      "step": 3276
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.364723161191655e-07,
+      "loss": 0.848,
+      "step": 3277
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.307968872375181e-07,
+      "loss": 0.9371,
+      "step": 3278
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.251466068693923e-07,
+      "loss": 0.7532,
+      "step": 3279
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.19521479853068e-07,
+      "loss": 0.9947,
+      "step": 3280
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 6.139215110052721e-07,
+      "loss": 0.9468,
+      "step": 3281
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 6.083467051211888e-07,
+      "loss": 1.0498,
+      "step": 3282
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 6.027970669744698e-07,
+      "loss": 0.9872,
+      "step": 3283
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.972726013172036e-07,
+      "loss": 0.946,
+      "step": 3284
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.917733128799297e-07,
+      "loss": 0.9342,
+      "step": 3285
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.862992063716211e-07,
+      "loss": 0.9683,
+      "step": 3286
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.808502864796916e-07,
+      "loss": 0.7921,
+      "step": 3287
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.754265578699958e-07,
+      "loss": 0.9733,
+      "step": 3288
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.700280251868084e-07,
+      "loss": 1.0127,
+      "step": 3289
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.646546930528284e-07,
+      "loss": 0.7634,
+      "step": 3290
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.59306566069182e-07,
+      "loss": 1.0324,
+      "step": 3291
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.53983648815406e-07,
+      "loss": 0.941,
+      "step": 3292
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.486859458494576e-07,
+      "loss": 0.9386,
+      "step": 3293
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.43413461707698e-07,
+      "loss": 0.921,
+      "step": 3294
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.381662009048927e-07,
+      "loss": 0.9015,
+      "step": 3295
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.32944167934214e-07,
+      "loss": 1.0107,
+      "step": 3296
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.277473672672317e-07,
+      "loss": 0.8989,
+      "step": 3297
+    },
+    {
+      "epoch": 1.88,
+      "learning_rate": 5.225758033538997e-07,
+      "loss": 0.8652,
+      "step": 3298
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 5.174294806225721e-07,
+      "loss": 0.7864,
+      "step": 3299
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 5.123084034799907e-07,
+      "loss": 0.9487,
+      "step": 3300
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 5.072125763112711e-07,
+      "loss": 1.0309,
+      "step": 3301
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 5.021420034799095e-07,
+      "loss": 0.9549,
+      "step": 3302
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.970966893277862e-07,
+      "loss": 0.7323,
+      "step": 3303
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.920766381751451e-07,
+      "loss": 0.9647,
+      "step": 3304
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.870818543205946e-07,
+      "loss": 1.0758,
+      "step": 3305
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.8211234204111e-07,
+      "loss": 1.0146,
+      "step": 3306
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.771681055920341e-07,
+      "loss": 0.8785,
+      "step": 3307
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.722491492070569e-07,
+      "loss": 0.9838,
+      "step": 3308
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.673554770982258e-07,
+      "loss": 0.8146,
+      "step": 3309
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.624870934559322e-07,
+      "loss": 1.0018,
+      "step": 3310
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.576440024489248e-07,
+      "loss": 0.8485,
+      "step": 3311
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.528262082242829e-07,
+      "loss": 0.7393,
+      "step": 3312
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.480337149074265e-07,
+      "loss": 0.9465,
+      "step": 3313
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.4326652660211297e-07,
+      "loss": 1.0854,
+      "step": 3314
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.3852464739044027e-07,
+      "loss": 0.9567,
+      "step": 3315
+    },
+    {
+      "epoch": 1.89,
+      "learning_rate": 4.338080813328138e-07,
+      "loss": 1.0135,
+      "step": 3316
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 4.291168324679795e-07,
+      "loss": 1.0523,
+      "step": 3317
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 4.244509048130041e-07,
+      "loss": 0.8702,
+      "step": 3318
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 4.198103023632649e-07,
+      "loss": 0.8118,
+      "step": 3319
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 4.1519502909245664e-07,
+      "loss": 0.9127,
+      "step": 3320
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 4.1060508895258476e-07,
+      "loss": 0.9476,
+      "step": 3321
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 4.0604048587396194e-07,
+      "loss": 0.868,
+      "step": 3322
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 4.015012237652116e-07,
+      "loss": 1.0292,
+      "step": 3323
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.9698730651324456e-07,
+      "loss": 0.828,
+      "step": 3324
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.9249873798327896e-07,
+      "loss": 0.9124,
+      "step": 3325
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.88035522018827e-07,
+      "loss": 0.9042,
+      "step": 3326
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.835976624416915e-07,
+      "loss": 0.8773,
+      "step": 3327
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.7918516305195274e-07,
+      "loss": 1.0758,
+      "step": 3328
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.7479802762799164e-07,
+      "loss": 0.8656,
+      "step": 3329
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.704362599264566e-07,
+      "loss": 0.9065,
+      "step": 3330
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.6609986368228653e-07,
+      "loss": 0.8672,
+      "step": 3331
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.6178884260868126e-07,
+      "loss": 0.948,
+      "step": 3332
+    },
+    {
+      "epoch": 1.9,
+      "learning_rate": 3.5750320039711793e-07,
+      "loss": 0.8942,
+      "step": 3333
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.5324294071735096e-07,
+      "loss": 0.952,
+      "step": 3334
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.4900806721738566e-07,
+      "loss": 0.96,
+      "step": 3335
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.447985835234979e-07,
+      "loss": 0.8149,
+      "step": 3336
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.406144932402211e-07,
+      "loss": 0.9491,
+      "step": 3337
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.364557999503459e-07,
+      "loss": 0.908,
+      "step": 3338
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.323225072149072e-07,
+      "loss": 0.9068,
+      "step": 3339
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.282146185732038e-07,
+      "loss": 0.913,
+      "step": 3340
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.241321375427686e-07,
+      "loss": 0.8357,
+      "step": 3341
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.200750676193853e-07,
+      "loss": 0.9898,
+      "step": 3342
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.16043412277075e-07,
+      "loss": 0.9182,
+      "step": 3343
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.120371749681028e-07,
+      "loss": 0.9248,
+      "step": 3344
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.080563591229646e-07,
+      "loss": 0.9523,
+      "step": 3345
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.0410096815038037e-07,
+      "loss": 0.9839,
+      "step": 3346
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 3.001710054373108e-07,
+      "loss": 0.9203,
+      "step": 3347
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 2.9626647434893407e-07,
+      "loss": 0.9424,
+      "step": 3348
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 2.923873782286657e-07,
+      "loss": 0.8751,
+      "step": 3349
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 2.8853372039811867e-07,
+      "loss": 1.1042,
+      "step": 3350
+    },
+    {
+      "epoch": 1.91,
+      "learning_rate": 2.847055041571467e-07,
+      "loss": 0.8459,
+      "step": 3351
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.80902732783801e-07,
+      "loss": 0.9389,
+      "step": 3352
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.7712540953435673e-07,
+      "loss": 0.9756,
+      "step": 3353
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.733735376432867e-07,
+      "loss": 0.8647,
+      "step": 3354
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.6964712032327755e-07,
+      "loss": 0.8947,
+      "step": 3355
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.659461607652203e-07,
+      "loss": 0.7796,
+      "step": 3356
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.6227066213820316e-07,
+      "loss": 0.9248,
+      "step": 3357
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.586206275895153e-07,
+      "loss": 0.9702,
+      "step": 3358
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.549960602446366e-07,
+      "loss": 1.0024,
+      "step": 3359
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.513969632072477e-07,
+      "loss": 0.8118,
+      "step": 3360
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.4782333955920665e-07,
+      "loss": 0.9251,
+      "step": 3361
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.442751923605724e-07,
+      "loss": 0.914,
+      "step": 3362
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.407525246495812e-07,
+      "loss": 0.8891,
+      "step": 3363
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.3725533944265354e-07,
+      "loss": 0.9602,
+      "step": 3364
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.3378363973439065e-07,
+      "loss": 0.7838,
+      "step": 3365
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.3033742849756457e-07,
+      "loss": 0.8369,
+      "step": 3366
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.2691670868313474e-07,
+      "loss": 0.9094,
+      "step": 3367
+    },
+    {
+      "epoch": 1.92,
+      "learning_rate": 2.2352148322021481e-07,
+      "loss": 0.8561,
+      "step": 3368
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 2.2015175501610253e-07,
+      "loss": 0.8414,
+      "step": 3369
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 2.1680752695625972e-07,
+      "loss": 0.938,
+      "step": 3370
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 2.1348880190430908e-07,
+      "loss": 1.0041,
+      "step": 3371
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 2.101955827020341e-07,
+      "loss": 0.938,
+      "step": 3372
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 2.069278721693857e-07,
+      "loss": 0.9088,
+      "step": 3373
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 2.036856731044623e-07,
+      "loss": 0.9257,
+      "step": 3374
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 2.0046898828352978e-07,
+      "loss": 0.9747,
+      "step": 3375
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.972778204609882e-07,
+      "loss": 0.9951,
+      "step": 3376
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.941121723694017e-07,
+      "loss": 0.92,
+      "step": 3377
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.90972046719482e-07,
+      "loss": 0.8617,
+      "step": 3378
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.8785744620008482e-07,
+      "loss": 0.8847,
+      "step": 3379
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.8476837347820019e-07,
+      "loss": 0.9552,
+      "step": 3380
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.8170483119896552e-07,
+      "loss": 0.7832,
+      "step": 3381
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.7866682198566575e-07,
+      "loss": 0.8723,
+      "step": 3382
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.7565434843970662e-07,
+      "loss": 0.9903,
+      "step": 3383
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.7266741314063472e-07,
+      "loss": 0.9193,
+      "step": 3384
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.6970601864613077e-07,
+      "loss": 0.8509,
+      "step": 3385
+    },
+    {
+      "epoch": 1.93,
+      "learning_rate": 1.6677016749200303e-07,
+      "loss": 0.9102,
+      "step": 3386
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.6385986219218719e-07,
+      "loss": 1.1086,
+      "step": 3387
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.6097510523874315e-07,
+      "loss": 1.005,
+      "step": 3388
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.581158991018583e-07,
+      "loss": 0.8518,
+      "step": 3389
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.5528224622983757e-07,
+      "loss": 1.0141,
+      "step": 3390
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.5247414904910327e-07,
+      "loss": 0.8212,
+      "step": 3391
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.496916099641954e-07,
+      "loss": 1.0088,
+      "step": 3392
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.4693463135777462e-07,
+      "loss": 1.0866,
+      "step": 3393
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.4420321559061257e-07,
+      "loss": 1.0302,
+      "step": 3394
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.414973650015816e-07,
+      "loss": 0.8482,
+      "step": 3395
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.3881708190767505e-07,
+      "loss": 0.9282,
+      "step": 3396
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.3616236860398702e-07,
+      "loss": 0.8827,
+      "step": 3397
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.3353322736372242e-07,
+      "loss": 0.8574,
+      "step": 3398
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.3092966043818378e-07,
+      "loss": 0.9089,
+      "step": 3399
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.2835167005677106e-07,
+      "loss": 0.9013,
+      "step": 3400
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.257992584269918e-07,
+      "loss": 1.0048,
+      "step": 3401
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.2327242773444436e-07,
+      "loss": 0.9269,
+      "step": 3402
+    },
+    {
+      "epoch": 1.94,
+      "learning_rate": 1.2077118014282795e-07,
+      "loss": 0.927,
+      "step": 3403
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 1.1829551779393266e-07,
+      "loss": 1.0613,
+      "step": 3404
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 1.1584544280763942e-07,
+      "loss": 0.817,
+      "step": 3405
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 1.134209572819167e-07,
+      "loss": 0.9041,
+      "step": 3406
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 1.1102206329282383e-07,
+      "loss": 1.1191,
+      "step": 3407
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 1.0864876289451098e-07,
+      "loss": 0.9327,
+      "step": 3408
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 1.0630105811920588e-07,
+      "loss": 0.7782,
+      "step": 3409
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 1.0397895097722043e-07,
+      "loss": 0.9096,
+      "step": 3410
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 1.0168244345694744e-07,
+      "loss": 0.9333,
+      "step": 3411
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 9.941153752486054e-08,
+      "loss": 0.9453,
+      "step": 3412
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 9.716623512551426e-08,
+      "loss": 0.8324,
+      "step": 3413
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 9.494653818153399e-08,
+      "loss": 0.8424,
+      "step": 3414
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 9.275244859361598e-08,
+      "loss": 0.9937,
+      "step": 3415
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 9.058396824054071e-08,
+      "loss": 0.9345,
+      "step": 3416
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 8.844109897914954e-08,
+      "loss": 0.8623,
+      "step": 3417
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 8.6323842644358e-08,
+      "loss": 1.0624,
+      "step": 3418
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 8.423220104914587e-08,
+      "loss": 0.9061,
+      "step": 3419
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 8.21661759845671e-08,
+      "loss": 0.7705,
+      "step": 3420
+    },
+    {
+      "epoch": 1.95,
+      "learning_rate": 8.012576921972991e-08,
+      "loss": 0.7315,
+      "step": 3421
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 7.81109825018167e-08,
+      "loss": 1.0331,
+      "step": 3422
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 7.612181755606074e-08,
+      "loss": 0.9136,
+      "step": 3423
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 7.415827608576953e-08,
+      "loss": 0.8705,
+      "step": 3424
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 7.222035977229146e-08,
+      "loss": 0.8156,
+      "step": 3425
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 7.030807027504582e-08,
+      "loss": 0.919,
+      "step": 3426
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 6.842140923150942e-08,
+      "loss": 0.8695,
+      "step": 3427
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 6.656037825720329e-08,
+      "loss": 0.9397,
+      "step": 3428
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 6.472497894570606e-08,
+      "loss": 0.9903,
+      "step": 3429
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 6.291521286865054e-08,
+      "loss": 0.996,
+      "step": 3430
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 6.113108157572046e-08,
+      "loss": 0.8714,
+      "step": 3431
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 5.937258659464706e-08,
+      "loss": 0.9561,
+      "step": 3432
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 5.763972943120588e-08,
+      "loss": 1.0388,
+      "step": 3433
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 5.593251156922663e-08,
+      "loss": 1.1427,
+      "step": 3434
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 5.425093447057994e-08,
+      "loss": 0.9929,
+      "step": 3435
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 5.259499957518066e-08,
+      "loss": 0.8189,
+      "step": 3436
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 5.096470830098787e-08,
+      "loss": 0.8967,
+      "step": 3437
+    },
+    {
+      "epoch": 1.96,
+      "learning_rate": 4.936006204399823e-08,
+      "loss": 0.9126,
+      "step": 3438
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 4.778106217825262e-08,
+      "loss": 0.9308,
+      "step": 3439
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 4.6227710055832814e-08,
+      "loss": 0.897,
+      "step": 3440
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 4.470000700685817e-08,
+      "loss": 0.9064,
+      "step": 3441
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 4.3197954339478926e-08,
+      "loss": 0.8514,
+      "step": 3442
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 4.172155333988625e-08,
+      "loss": 1.0112,
+      "step": 3443
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 4.027080527230886e-08,
+      "loss": 0.8068,
+      "step": 3444
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 3.884571137900306e-08,
+      "loss": 0.9874,
+      "step": 3445
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 3.744627288025937e-08,
+      "loss": 0.81,
+      "step": 3446
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 3.607249097440257e-08,
+      "loss": 1.0637,
+      "step": 3447
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 3.472436683778835e-08,
+      "loss": 0.9682,
+      "step": 3448
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 3.3401901624799945e-08,
+      "loss": 0.8413,
+      "step": 3449
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 3.210509646784488e-08,
+      "loss": 0.9765,
+      "step": 3450
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 3.0833952477368196e-08,
+      "loss": 1.1056,
+      "step": 3451
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 2.9588470741829243e-08,
+      "loss": 0.9546,
+      "step": 3452
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 2.836865232772823e-08,
+      "loss": 0.8494,
+      "step": 3453
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 2.7174498279572967e-08,
+      "loss": 0.9684,
+      "step": 3454
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 2.6006009619912174e-08,
+      "loss": 0.7603,
+      "step": 3455
+    },
+    {
+      "epoch": 1.97,
+      "learning_rate": 2.4863187349302152e-08,
+      "loss": 0.9831,
+      "step": 3456
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 2.3746032446333443e-08,
+      "loss": 1.0461,
+      "step": 3457
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 2.2654545867610842e-08,
+      "loss": 0.8792,
+      "step": 3458
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 2.1588728547760062e-08,
+      "loss": 0.9236,
+      "step": 3459
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 2.0548581399434384e-08,
+      "loss": 0.9205,
+      "step": 3460
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.9534105313294692e-08,
+      "loss": 0.8841,
+      "step": 3461
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.8545301158026108e-08,
+      "loss": 1.0633,
+      "step": 3462
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.7582169780331335e-08,
+      "loss": 0.9391,
+      "step": 3463
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.664471200492734e-08,
+      "loss": 1.1878,
+      "step": 3464
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.5732928634552002e-08,
+      "loss": 0.9561,
+      "step": 3465
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.4846820449954113e-08,
+      "loss": 0.8791,
+      "step": 3466
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.3986388209893398e-08,
+      "loss": 0.9205,
+      "step": 3467
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.3151632651150491e-08,
+      "loss": 1.0207,
+      "step": 3468
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.2342554488520285e-08,
+      "loss": 0.891,
+      "step": 3469
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.1559154414805261e-08,
+      "loss": 0.7866,
+      "step": 3470
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.0801433100818825e-08,
+      "loss": 0.9718,
+      "step": 3471
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 1.0069391195395294e-08,
+      "loss": 0.7396,
+      "step": 3472
+    },
+    {
+      "epoch": 1.98,
+      "learning_rate": 9.36302932536659e-09,
+      "loss": 0.8985,
+      "step": 3473
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 8.682348095588877e-09,
+      "loss": 0.9929,
+      "step": 3474
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 8.02734808891592e-09,
+      "loss": 0.9314,
+      "step": 3475
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 7.3980298662224e-09,
+      "loss": 0.9362,
+      "step": 3476
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 6.794393966383927e-09,
+      "loss": 0.9153,
+      "step": 3477
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 6.216440906283705e-09,
+      "loss": 0.8521,
+      "step": 3478
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 5.664171180822519e-09,
+      "loss": 0.7657,
+      "step": 3479
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 5.137585262898759e-09,
+      "loss": 0.8058,
+      "step": 3480
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 4.6366836034217315e-09,
+      "loss": 0.9368,
+      "step": 3481
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 4.161466631308342e-09,
+      "loss": 1.071,
+      "step": 3482
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 3.7119347534830817e-09,
+      "loss": 1.1287,
+      "step": 3483
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 3.288088354871377e-09,
+      "loss": 0.9184,
+      "step": 3484
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 2.889927798412906e-09,
+      "loss": 0.9175,
+      "step": 3485
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 2.5174534250449466e-09,
+      "loss": 0.9944,
+      "step": 3486
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 2.1706655537123698e-09,
+      "loss": 0.8754,
+      "step": 3487
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 1.8495644813676382e-09,
+      "loss": 0.8816,
+      "step": 3488
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 1.5541504829674758e-09,
+      "loss": 0.8295,
+      "step": 3489
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 1.2844238114662066e-09,
+      "loss": 0.9145,
+      "step": 3490
+    },
+    {
+      "epoch": 1.99,
+      "learning_rate": 1.0403846978324083e-09,
+      "loss": 1.0116,
+      "step": 3491
+    },
+    {
+      "epoch": 2.0,
+      "learning_rate": 8.220333510322587e-10,
+      "loss": 0.8851,
+      "step": 3492
+    },
+    {
+      "epoch": 2.0,
+      "learning_rate": 6.293699580361967e-10,
+      "loss": 0.9676,
+      "step": 3493
+    },
+    {
+      "epoch": 2.0,
+      "learning_rate": 4.623946838222537e-10,
+      "loss": 0.9926,
+      "step": 3494
+    },
+    {
+      "epoch": 2.0,
+      "learning_rate": 3.2110767136939166e-10,
+      "loss": 0.8198,
+      "step": 3495
+    },
+    {
+      "epoch": 2.0,
+      "learning_rate": 2.0550904165750339e-10,
+      "loss": 0.7474,
+      "step": 3496
+    },
+    {
+      "epoch": 2.0,
+      "learning_rate": 1.1559889367407373e-10,
+      "loss": 0.9538,
+      "step": 3497
+    },
+    {
+      "epoch": 2.0,
+      "learning_rate": 5.137730440751831e-11,
+      "loss": 0.7955,
+      "step": 3498
+    },
+    {
+      "epoch": 2.0,
+      "learning_rate": 1.284432885051423e-11,
+      "loss": 0.8574,
+      "step": 3499
+    },
+    {
+      "epoch": 2.0,
+      "learning_rate": 0.0,
+      "loss": 0.8248,
+      "step": 3500
+    },
+    {
+      "epoch": 2.0,
+      "step": 3500,
+      "total_flos": 4.080173634562294e+17,
+      "train_loss": 1.066873051609312,
+      "train_runtime": 21305.0838,
+      "train_samples_per_second": 2.628,
+      "train_steps_per_second": 0.164
+    }
+  ],
+  "logging_steps": 1.0,
+  "max_steps": 3500,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 2,
+  "save_steps": 50000,
+  "total_flos": 4.080173634562294e+17,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}